com.bigdata.journal

Class StressTestConcurrentTx

java.lang.Object

junit.framework.Assert

junit.framework.TestCase

junit.framework.TestCase2

com.bigdata.io.TestCase3

com.bigdata.journal.AbstractIndexManagerTestCase<S>

com.bigdata.journal.ProxyTestCase<Journal>

com.bigdata.journal.StressTestConcurrentTx

All Implemented Interfaces:

com.bigdata.testutil.ExperimentDriver.IComparisonTest, IProxyTest, junit.framework.Test

public class StressTestConcurrentTx
extends ProxyTestCase<Journal>
implements com.bigdata.testutil.ExperimentDriver.IComparisonTest

Stress tests for concurrent transaction processing.

Note: For short transactions, TPS is basically constant for a given combination of the buffer mode and whether or not commits are forced to disk. This means that the #of clients is not a strong influence on performance. The big wins are Transient and Force := No since neither conditions syncs to disk. This suggests that the big win for TPS throughput is going to be group commit followed by either the use of SDD for the journal or pipelining writes to secondary journals on failover hosts. FIXME Finish support for transactions in AbstractTask.

Author:

Bryan Thompson

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	StressTestConcurrentTx.GenerateExperiment Experiment generation utility class.
static class	StressTestConcurrentTx.Task Run a transaction.
static interface	StressTestConcurrentTx.TestOptions Additional properties understood by this test.

Nested classes/interfaces inherited from class junit.framework.TestCase2

TestCase2.MyProperties, TestCase2.RandomType

Field Summary

Fields inherited from class com.bigdata.io.TestCase3

r

Fields inherited from class junit.framework.TestCase2

_randomType, log

Constructor Summary

Constructors

Constructor and Description
StressTestConcurrentTx()
StressTestConcurrentTx(String name)

Method Summary

Methods

Modifier and Type	Method and Description
com.bigdata.testutil.ExperimentDriver.Result	doComparisonTest(Properties properties) Setup and run a test.
static com.bigdata.testutil.ExperimentDriver.Result	doConcurrentClientTest(Journal journal, long timeout, int nclients, int ntrials, int keyLen, int nops, double abortRate) A stress test with a pool of concurrent clients.
static void	main(String[] args) Runs a single instance of the test as configured in the code.
void	setUpComparisonTest(Properties properties)
void	tearDownComparisonTest()
void	test_concurrentClients() A stress test with a small pool of concurrent clients.

Methods inherited from class com.bigdata.journal.ProxyTestCase

getDelegate, getOurDelegate, getProperties, getStore, getStore, reopenStore, setDelegate, setUp, tearDown

Methods inherited from class com.bigdata.journal.AbstractIndexManagerTestCase

checkIfProxy, fail, getRandomData, setUp, tearDown

Methods inherited from class com.bigdata.io.TestCase3

assertCondition, assertCondition, assertEquals, assertEquals, getBytes, getPort, getRandomData, getRandomData

Methods inherited from class junit.framework.TestCase2

assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEqualsWithinUlps, assertSameArray, assertSameArray, assertSameBigDecimal, assertSameBigDecimal, assertSameBigInteger, assertSameBigInteger, assertSameIterator, assertSameIterator, assertSameIteratorAnyOrder, assertSameIteratorAnyOrder, assertSameValue, assertSameValue, assertZeroUlps, assertZeroUlps, fail, getInnerCause, getNormalInt, getProjectBuildPath, getRandomObject, getRandomObject, getRandomOrder, getRandomString, getTestInputStream, getTestResource, getTestResource, getUlps, getUlps, isDEBUG, isDEBUG, isINFO, isINFO, isInnerCause, logProperties

Methods inherited from class junit.framework.TestCase

assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertFalse, assertFalse, assertNotNull, assertNotNull, assertNotSame, assertNotSame, assertNull, assertNull, assertSame, assertSame, assertTrue, assertTrue, countTestCases, createResult, fail, fail, failNotEquals, failNotSame, failSame, format, getName, run, run, runBare, runTest, setName, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface junit.framework.Test

countTestCases, run

Constructor Detail

StressTestConcurrentTx

public StressTestConcurrentTx()

StressTestConcurrentTx

public StressTestConcurrentTx(String name)

Method Detail

setUpComparisonTest

public void setUpComparisonTest(Properties properties)
                         throws Exception

Specified by:

setUpComparisonTest in interface com.bigdata.testutil.ExperimentDriver.IComparisonTest

Throws:

Exception

tearDownComparisonTest

public void tearDownComparisonTest()
                            throws Exception

Specified by:

tearDownComparisonTest in interface com.bigdata.testutil.ExperimentDriver.IComparisonTest

Throws:

Exception

test_concurrentClients

public void test_concurrentClients()
                            throws InterruptedException

A stress test with a small pool of concurrent clients.

Throws:

InterruptedException

doConcurrentClientTest

public static com.bigdata.testutil.ExperimentDriver.Result doConcurrentClientTest(Journal journal,
                                                                  long timeout,
                                                                  int nclients,
                                                                  int ntrials,
                                                                  int keyLen,
                                                                  int nops,
                                                                  double abortRate)
                                                                           throws InterruptedException

A stress test with a pool of concurrent clients.

Note: nclients corresponds to a number of external processes that start transactions, submit AbstractTasks that operate against those transactions, and finally choose to either commit or abort the transactions. The concurrency with which the AbstractTasks submitted by the "clients" may run is governed by the ConcurrencyManager.Options. However, the concurrency is capped by the #of clients since each client manages a single transaction at a time.

Parameters:

journal - The database.

resource - The name of the index on which the transactions will operation.

timeout - The #of seconds before the test will terminate.

nclients - The #of concurrent clients.

ntrials - The #of transactions to execute.

keyLen - The length of the random unsigned byte[] keys used in the operations. The longer the keys the less likely it is that there will be a write-write conflict (that concurrent txs will write on the same key).

nops - The #of operations to be performed in each transaction.

abortRate - The #of clients that choose to abort a transaction rather the committing it [0.0:1.0]. Note that the abort point is always choosen after the client has submitting at least one write task for the transaction.

Throws:

InterruptedException

main

public static void main(String[] args)
                 throws Exception

Runs a single instance of the test as configured in the code.

Throws:

Exception

See Also:

ExperimentDriver, which parameterizes the use of this stress test. That information should be used to limit the #of transactions allowed to start at one time on the server and should guide a search for thinning down resource consumption, e.g., memory usage by btrees, the node serializer, etc., GenerateExperiment, which may be used to generate a set of conditions to be run by the {@link ExperimentDriver}.

doComparisonTest

public com.bigdata.testutil.ExperimentDriver.Result doComparisonTest(Properties properties)
                                                              throws Exception

Setup and run a test.

Specified by:

doComparisonTest in interface com.bigdata.testutil.ExperimentDriver.IComparisonTest

Parameters:

properties - There are no "optional" properties - you must make sure that each property has a defined value.

Throws:

Exception