com.bigdata.resources

Class TestSegSplitter

java.lang.Object

junit.framework.Assert

junit.framework.TestCase

junit.framework.TestCase2

com.bigdata.resources.AbstractTestSegSplitter

com.bigdata.resources.TestSegSplitter

All Implemented Interfaces:

junit.framework.Test

public class TestSegSplitter
extends AbstractTestSegSplitter

Unit tests for splitting an index segment based on its size on the disk, the nominal size of an index partition, and an optional application level constraint on the choice of the separator keys. This approach presumes a compacting merge has been performed such that all history other than the buffered writes is on a single index segment. The buffered writes are not considered when choosing the #of splits to make and the separator keys for those splits. They are simply copied afterwards onto the new index partition which covers their key-range.

Version:

$Id$

Author:

Bryan Thompson

See Also:

src/architecture/SplitMath.xls

Nested Class Summary

Nested classes/interfaces inherited from class com.bigdata.resources.AbstractTestSegSplitter

AbstractTestSegSplitter.MockPartitionIdFactory, AbstractTestSegSplitter.RejectSplitsAfterKey

Nested classes/interfaces inherited from class junit.framework.TestCase2

TestCase2.MyProperties, TestCase2.RandomType

Field Summary

Fields inherited from class com.bigdata.resources.AbstractTestSegSplitter

acceptAllSplits, pidFactory, rejectAllSplits

Fields inherited from class junit.framework.TestCase2

_randomType, log

Constructor Summary

Constructors

Constructor and Description
TestSegSplitter()
TestSegSplitter(String name)

Method Summary

Methods

Modifier and Type	Method and Description
protected BTree	generateData(IJournal store, String name, int ntuples, LocalPartitionMetadata pmd) Register a BTree against the journal, generate some data in the specified key range, and commit the data.
void	test_split_applicationConstraint_acceptAllSplits() Unit test using an ISimpleSplitHandler which accepts all splits (the behavior should be the same as if there were no override).
void	test_split_applicationConstraint_rejectAllSplits() Unit test using an ISimpleSplitHandler which rejects all splits.
void	test_split_applicationConstraint_remainerGoesIntoSplit() Unit test when the application specifies a split handler which accepts the first N splits of a multiway split but then rejects all other split points.
void	test_split_fromToKeyConstraints() A unit test which examines correctness when the fromKey and/or toKey are non-null.
void	test_split_lower_bounds() A unit test when the split would create two or three index segments (both cases are tested here to cover the lower bound and the near lower bound).
void	test_split_segment_underflow() Unit test the edge cases surrounding when an index partition is split.
void	test_split_stress() A stress test which increases the target number of splits until each split would have only one tuple.
void	test_split_upper_bound() A unit test for fence posts when nominal shard size is so small that we will get only one tuple into each generated split.

Methods inherited from class com.bigdata.resources.AbstractTestSegSplitter

doBuild, getStore

Methods inherited from class junit.framework.TestCase2

assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEqualsWithinUlps, assertSameArray, assertSameArray, assertSameBigDecimal, assertSameBigDecimal, assertSameBigInteger, assertSameBigInteger, assertSameIterator, assertSameIterator, assertSameIteratorAnyOrder, assertSameIteratorAnyOrder, assertSameValue, assertSameValue, assertZeroUlps, assertZeroUlps, fail, getInnerCause, getNormalInt, getProjectBuildPath, getProperties, getRandomObject, getRandomObject, getRandomOrder, getRandomString, getTestInputStream, getTestResource, getTestResource, getUlps, getUlps, isDEBUG, isDEBUG, isINFO, isINFO, isInnerCause, logProperties

Methods inherited from class junit.framework.TestCase

assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertEquals, assertFalse, assertFalse, assertNotNull, assertNotNull, assertNotSame, assertNotSame, assertNull, assertNull, assertSame, assertSame, assertTrue, assertTrue, countTestCases, createResult, fail, fail, failNotEquals, failNotSame, failSame, format, getName, run, run, runBare, runTest, setName, setUp, tearDown, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

TestSegSplitter

public TestSegSplitter()

TestSegSplitter

public TestSegSplitter(String name)

Parameters:

name -

Method Detail

generateData

protected BTree generateData(IJournal store,
                 String name,
                 int ntuples,
                 LocalPartitionMetadata pmd)

Register a BTree against the journal, generate some data in the specified key range, and commit the data.

Note: this uses int values to generate the keys. If you specify the fromKey as anything other than an empty byte[] or the toKey as anything other than null then the key must be at least 4 bytes long and the 1st 4 bytes will be decoded as an integer.

Parameters:

store -

ntuples -

pmd -

test_split_segment_underflow

public void test_split_segment_underflow()
                                  throws Exception

Unit test the edge cases surrounding when an index partition is split.

Throws:

Exception

See Also:

src/architecture/SplitMath.xls, for the math concerning the #of splits to be generated from an index segment file of a given size.

test_split_lower_bounds

public void test_split_lower_bounds()
                             throws Exception

A unit test when the split would create two or three index segments (both cases are tested here to cover the lower bound and the near lower bound).

Throws:

Exception

test_split_upper_bound

public void test_split_upper_bound()
                            throws Exception

A unit test for fence posts when nominal shard size is so small that we will get only one tuple into each generated split.

Throws:

Exception

test_split_stress

public void test_split_stress()
                       throws Exception

A stress test which increases the target number of splits until each split would have only one tuple.

Throws:

Exception

test_split_fromToKeyConstraints

public void test_split_fromToKeyConstraints()
                                     throws Exception

A unit test which examines correctness when the fromKey and/or toKey are non-null. This models the normal case when the index segment is part of any shard except the first shard of the scale-out index.

Throws:

Exception

test_split_applicationConstraint_acceptAllSplits

public void test_split_applicationConstraint_acceptAllSplits()
                                                      throws Exception

Unit test using an ISimpleSplitHandler which accepts all splits (the behavior should be the same as if there were no override).

Throws:

Exception

test_split_applicationConstraint_rejectAllSplits

public void test_split_applicationConstraint_rejectAllSplits()
                                                      throws Exception

Unit test using an ISimpleSplitHandler which rejects all splits. No Splits will be chosen and the IndexSegment WILL NOT be split.

Throws:

Exception

test_split_applicationConstraint_remainerGoesIntoSplit

public void test_split_applicationConstraint_remainerGoesIntoSplit()
                                                            throws Exception

Unit test when the application specifies a split handler which accepts the first N splits of a multiway split but then rejects all other split points. The test verifies that all tuples after the last accepted split point flows into the last split.

Throws:

Exception