com.bigdata.concurrent

Class TestLockManager

java.lang.Object

junit.framework.Assert

junit.framework.TestCase

com.bigdata.concurrent.TestLockManager

All Implemented Interfaces:

com.bigdata.testutil.ExperimentDriver.IComparisonTest, junit.framework.Test

public class TestLockManager
extends junit.framework.TestCase
implements com.bigdata.testutil.ExperimentDriver.IComparisonTest

Suite of stress tests of the concurrency control mechanisms (without the database implementation) - See LockManager.

Goals:

1. higher concurrency of unisolated operations on the ds/journal with group commit. this only requires a "lock" per writable named index, e.g., an operation will lock exactly one resource. show consistency of the data in a suite of stress tests with varying #s of threads, tasks, and resources. Each task will lock exactly one resource - the unisolated named index on which it would write. DO THIS W/O the TxDAG first and get group commit debugged before trying to work through the tx commit stuff, which requires the WAITS_FOR graph support.

2. transaction processing integrated with unisolated operations. since a transaction MAY write on more than one index this requires a TxDAG and a queue of resources waiting to get into the granted group (which will always be a singleton since writes on unisolated named indices require exclusive locks). show that concurrency control never deadlocks in a suite of stress tests with varying #s of threads, tasks, resources, and resource locked per task. Again, a resource is a unisolated named index.

Author:

Bryan Thompson

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TestLockManager.Generate Generates an XML file that can be used to (re-)run the concurrency control tests.
static class	TestLockManager.TestOptions Options for doComparisonTest(Properties).
static class	TestLockManager.Wait10ResourceTask Waits 10ms once it acquires its locks.

Constructor Summary

Constructors

Constructor and Description
TestLockManager()
TestLockManager(String name)

Method Summary

Methods

Modifier and Type	Method and Description
com.bigdata.testutil.ExperimentDriver.Result	doComparisonTest(Properties properties) Test driver.
void	setUpComparisonTest(Properties properties)
void	tearDownComparisonTest()
void	test_multipleResourceLocking_resources10_locktries10_predeclareLocks() Test where each operation locks one or more resources.
void	test_multipleResourceLocking_resources10_locktries10() Test where each operation locks one or more resources.
void	test_multipleResourceLocking_resources3_locktries_3() Test where each operation locks one or more resources.
void	test_noResourcesDoesNotWait()
void	test_singleResourceLocking_defaultConcurrency20() Test where each operation locks only a single resource (default concurrency).
void	test_singleResourceLocking_highConcurrency100() Test where each operation locks only a single resource (high concurrency).
void	test_singleResourceLocking_lowConcurrency5() Test where each operation locks only a single resource (low concurrency condition w/ 5 threads).
void	test_singleResourceLocking_serialized_highConcurrency_lockTimeout() Test where each operation locks only a single resource and there is only one resource to be locked so that all operations MUST be serialized with a non-zero lock timeout.
void	test_singleResourceLocking_serialized_highConcurrency() Test where each operation locks only a single resource and there is only one resource to be locked so that all operations MUST be serialized.
void	test_singleResourceLocking_serialized_lowConcurrency2() Test where each operation locks only a single resource and there is only one resource to be locked so that all operations MUST be serialized.
void	test_singleResourceLocking_serialized_lowConcurrency5_withTaskDeath() Test where each operation locks only a single resource and there is only one resource to be locked so that all operations MUST be serialized and where 10% of all tasks die a horrid death.
void	test_singleResourceLocking_serialized_lowConcurrency5() Test where each operation locks only a single resource and there is only one resource to be locked so that all operations MUST be serialized.

Methods inherited from class junit.framework.TestCase

assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertFalse, assertFalse, assertNotNull, assertNotNull, assertNotSame, assertNotSame, assertNull, assertNull, assertSame, assertSame, assertTrue, assertTrue, countTestCases, createResult, fail, fail, failNotEquals, failNotSame, failSame, format, getName, run, run, runBare, runTest, setName, setUp, tearDown, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

TestLockManager

public TestLockManager()

TestLockManager

public TestLockManager(String name)

Method Detail

doComparisonTest

public com.bigdata.testutil.ExperimentDriver.Result doComparisonTest(Properties properties)
                                                              throws Exception

Test driver.

Note: A "resource" is a named index (partition), so set nresources based on your expectations for the #of index partitions on a journal or federation.

Note: The likelihood of deadlock increases as (a) more locks are requested per task; and (b) fewer resources are available to be locked. When minLocks==maxLocks==nresources then tasks will be serialized since each task requires all resources in order to proceed.

Note: At minLocks==maxLocks==1 this test can be used to explore the behavior of tasks that lock only a single resource, eg., unisolated operations on the DataService.

Specified by:

doComparisonTest in interface com.bigdata.testutil.ExperimentDriver.IComparisonTest

Throws:

Exception

setUpComparisonTest

public void setUpComparisonTest(Properties properties)
                         throws Exception

Specified by:

setUpComparisonTest in interface com.bigdata.testutil.ExperimentDriver.IComparisonTest

Throws:

Exception

tearDownComparisonTest

public void tearDownComparisonTest()
                            throws Exception

Specified by:

tearDownComparisonTest in interface com.bigdata.testutil.ExperimentDriver.IComparisonTest

Throws:

Exception

test_noResourcesDoesNotWait

public void test_noResourcesDoesNotWait()
                                 throws Exception

Throws:

Exception

test_singleResourceLocking_lowConcurrency5

public void test_singleResourceLocking_lowConcurrency5()
                                                throws Exception

Test where each operation locks only a single resource (low concurrency condition w/ 5 threads).

Throws:

Exception

test_singleResourceLocking_defaultConcurrency20

public void test_singleResourceLocking_defaultConcurrency20()
                                                     throws Exception

Test where each operation locks only a single resource (default concurrency).

Throws:

Exception

test_singleResourceLocking_highConcurrency100

public void test_singleResourceLocking_highConcurrency100()
                                                   throws Exception

Test where each operation locks only a single resource (high concurrency).

Throws:

Exception

test_singleResourceLocking_serialized_lowConcurrency2

public void test_singleResourceLocking_serialized_lowConcurrency2()
                                                           throws Exception

Test where each operation locks only a single resource and there is only one resource to be locked so that all operations MUST be serialized.

Throws:

Exception

test_singleResourceLocking_serialized_lowConcurrency5

public void test_singleResourceLocking_serialized_lowConcurrency5()
                                                           throws Exception

Test where each operation locks only a single resource and there is only one resource to be locked so that all operations MUST be serialized.

Throws:

Exception

test_singleResourceLocking_serialized_lowConcurrency5_withTaskDeath

public void test_singleResourceLocking_serialized_lowConcurrency5_withTaskDeath()
                                                                         throws Exception

Test where each operation locks only a single resource and there is only one resource to be locked so that all operations MUST be serialized and where 10% of all tasks die a horrid death.

Throws:

Exception

test_singleResourceLocking_serialized_highConcurrency

public void test_singleResourceLocking_serialized_highConcurrency()
                                                           throws Exception

Test where each operation locks only a single resource and there is only one resource to be locked so that all operations MUST be serialized.

Throws:

Exception

test_singleResourceLocking_serialized_highConcurrency_lockTimeout

public void test_singleResourceLocking_serialized_highConcurrency_lockTimeout()
                                                                       throws Exception

Test where each operation locks only a single resource and there is only one resource to be locked so that all operations MUST be serialized with a non-zero lock timeout. This test stresses the logic in lock() that is responsible for backing out a lock request on timeout.

Throws:

Exception

test_multipleResourceLocking_resources3_locktries_3

public void test_multipleResourceLocking_resources3_locktries_3()
                                                         throws Exception

Test where each operation locks one or more resources.

Note: This condition provides the basis for deadlocks.

Throws:

Exception

test_multipleResourceLocking_resources10_locktries10_predeclareLocks

public void test_multipleResourceLocking_resources10_locktries10_predeclareLocks()
                                                                          throws Exception

Test where each operation locks one or more resources.

Note: This condition provides the basis for deadlocks. In fact, since we have 10 resource locks for each operation and only 100 operations the chances of a deadlock on any given operation are extremely high. However, since we are predeclaring our locks and the lock requests are being sorted NO deadlocks should result.

Throws:

Exception

See Also:

CI deadlock in com.bigdata.concurrent.TestLockManager.test_multipleResourceLocking_resources10_locktries10

test_multipleResourceLocking_resources10_locktries10

public void test_multipleResourceLocking_resources10_locktries10()
                                                          throws Exception

Test where each operation locks one or more resources.

Note: This condition provides the basis for deadlocks. In fact, since we have 10 resource locks for each operation and only 100 operations the chances of a deadlock on any given operation are extremely high. However, since we are predeclaring our locks and the lock requests are being sorted NO deadlocks should result.

Throws:

Exception

See Also:

CI deadlock in com.bigdata.concurrent.TestLockManager.test_multipleResourceLocking_resources10_locktries10