com.bigdata.journal

Class Journal

java.lang.Object

com.bigdata.journal.AbstractJournal

com.bigdata.journal.Journal

All Implemented Interfaces:

ICounterSetAccess, IAtomicStore, IBTreeManager, IConcurrencyManager, IGISTLocalManager, IGISTManager, IIndexManager, IIndexStore, IJournal, IResourceManager, IAddressManager, IAllocationManagerStore, IMRMW, IMROW, IRawStore, IStreamStore, IAllocationManager, IServiceShutdown

public class Journal
extends AbstractJournal
implements IConcurrencyManager, IResourceManager

Concrete implementation suitable for a local and unpartitioned database.

Note: This implementation does NOT not support partitioned indices. Because all data must reside on a single journal resource there is no point to a view. Views are designed to have data on a mixture of the live journal, one or more historical journals, and one or more IndexSegments.

See Also:

ResourceManager, which supports views.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static interface	Journal.IJournalCounters Interface defines and documents the counters and counter namespaces reported by the Journal and the various services which it uses.
static interface	Journal.Options Options understood by the Journal.

Nested classes/interfaces inherited from class com.bigdata.journal.AbstractJournal

AbstractJournal.BasicHA, AbstractJournal.ISnapshotData, AbstractJournal.ISnapshotEntry, AbstractJournal.SnapshotData

Field Summary

Fields inherited from class com.bigdata.journal.AbstractJournal

DELETEBLOCK, deleteOnClose, doubleSync, forceOnCommit, haLog, PREV_ROOTBLOCK, properties, ROOT_ICUVERSION, ROOT_NAME2ADDR, tmpDir

Fields inherited from interface com.bigdata.rawstore.IAddressManager

NULL

Constructor Summary

Constructors

Constructor and Description
Journal(Properties properties) Create or re-open a journal.
Journal(Properties properties, Quorum<HAGlue,QuorumService<HAGlue>> quorum)

Method Summary

Methods

Modifier and Type	Method and Description
protected void	_close() Core implementation of immediate shutdown handles event reporting.
void	abort(long tx) Abort a transaction.
AccessSemaphore.Access	acquireReadWriteConnectionAccess() Acquire an Access for a read/write isolated transaction.
AccessSemaphore.Access	acquireUnisolatedConnectionAccess() Acquire an Access object for the UNISOLATED connection.
ScheduledFuture<?>	addScheduledTask(Runnable task, long initialDelay, long delay, TimeUnit unit) Adds a task which will run until canceled, until it throws an exception, or until the service is shutdown.
long	commit(long tx) Commit a transaction.
Future<Journal>	compact(File outFile) Compacts the named indices found on this journal as of the most recent commit point, writing their view onto a new Journal.
protected void	discardCommitters() This method is invoked by AbstractJournal.abort() when the store must discard any hard references that it may be holding to objects registered as ICommitters.
void	dropIndex(String name) Drops the named index.
boolean	getCollectPlatformStatistics() true iff performance counters will be collected for the platform on which the client is running.
boolean	getCollectQueueStatistics() true iff statistics will be collected for work queues.
ConcurrencyManager	getConcurrencyManager()
CounterSet	getCounters() Return counters reporting on various aspects of the journal.
File	getDataDir() The directory in which the journal's file is located -or- null if the journal is not backed by a file.
DataService	getDataService() The local DataService whose resources are being managed.
UUID	getDataServiceUUID() Return the UUID of the IDataService whose resources are being managed.
ExecutorService	getExecutorService() Service for running arbitrary tasks in support of IResourceLocator.
IBigdataFederation<?>	getFederation() The federation whose resources are being managed.
Object	getGangliaService()
BigdataFileSystem	getGlobalFileSystem() Return the global file system used to store block-structured files and their metadata and as a source and sink for map/reduce processing.
SparseRowStore	getGlobalRowStore() Return an unisolated view of the global SparseRowStore used to store named property sets.
SparseRowStore	getGlobalRowStore(long timestamp) Return a view of the global SparseRowStore used to store named property sets as of the specified timestamp.
int	getHttpdPort() The port on which the optional httpd service will be run.
ILocalBTreeView	getIndex(String name, long timestamp) Return a view of the named index as of the specified timestamp.
BTreeCounters	getIndexCounters(String name) Return the BTreeCounters for the named index.
StaleLocatorReason	getIndexPartitionGone(String name) Always returns null since index partition moves are not supported.
File	getIndexSegmentFile(IndexMetadata indexMetadata) Return the file on which a new IndexSegment should be written.
AbstractBTree[]	getIndexSources(String name, long timestamp) Always returns an array containing a single BTree which is the BTree loaded from the commit record whose commit timestamp is less than or equal to timestamp -or- null if there are no ICommitRecords that satisfy the probe or if the named index was not registered as of that timestamp.
AbstractBTree[]	getIndexSources(String name, long timestamp, BTree btree) Always returns the BTree as the sole element of the array since partitioned indices are not supported.
AbstractJournal	getJournal(long timestamp) Always returns this.
AbstractJournal	getLiveJournal() Always returns this.
AbstractLocalTransactionManager	getLocalTransactionManager() Return the object providing the local transaction manager for this journal.
AbstractStatisticsCollector	getPlatformStatisticsCollector() Host wide performance counters (collected from the OS) (optional).
LatchedExecutor	getReadExecutor() An executor service used to read on the local disk.
IResourceLocator<?>	getResourceLocator() Return the default locator for resources that are logical index containers (relations and relation containers).
IResourceLockService	getResourceLockService() The service that may be used to acquire synchronous distributed locks without deadlock detection.
IResourceManager	getResourceManager() The object used to manage local resources.
TemporaryStore	getTempStore() A factory for TemporaryStores.
File	getTmpDir() The directory for temporary files.
ILocalTransactionManager	getTransactionManager() The client side of the transaction manager.
ITransactionService	getTransactionService()
WriteExecutorService	getWriteService() The service on which read-write tasks are executed.
<T> List<Future<T>>	invokeAll(Collection<? extends AbstractTask<T>> tasks) Executes the given tasks, returning a list of Futures holding their status and results when all complete.
<T> List<Future<T>>	invokeAll(Collection<? extends AbstractTask<T>> tasks, long timeout, TimeUnit unit) Executes the given tasks, returning a list of Futures holding their status and results when all complete or the timeout expires, whichever happens first.
boolean	isGroupCommit() Return true if the index manager supports group commit semantics.
boolean	isHAJournal() Convenience method created in BLZG-1370 to factor out bigdata-jini artifact dependencies.
boolean	isOverflowEnabled() Note: This implementation always returns false.
protected AbstractLocalTransactionManager	newLocalTransactionManager()
protected IResourceLocator<?>	newResourceLocator() Factory for the IResourceLocator for the Journal.
protected JournalTransactionService	newTransactionService()
long	newTx(long timestamp) Create a new transaction on the Journal.
long	nextTimestamp() Deprecated. This is here for historical reasons and is only used by the test suite. Use getLocalTransactionManager() and ITimestampService.nextTimestamp().
IRawStore	openStore(UUID uuid) Note: This will only succeed if the uuid identifies this journal.
Future<Object>	overflow() Overflow processing creates a new journal, migrates the named indices on the current journal the new journal, and continues operations on the new journal.
boolean	prepare(long txId) Validate the write set for a transaction.
boolean	shouldOverflow() Note: This implementation always returns false.
void	shutdown() Note: The transaction service is shutdown first, then the executorService, then the IConcurrencyManager, the ITransactionService and finally the IResourceLockService.
void	shutdownNow() Note: The IConcurrencyManager is shutdown first, then the ITransactionService and finally the IResourceManager.
Future<ISnapshotResult>	snapshot(ISnapshotFactory snapshotFactory) Submit a task that will take a snapshot of the journal and return the Future for that task.
<T> FutureTask<T>	submit(AbstractTask<T> task) Submit a task (asynchronous).
Future<Map<String,BaseIndexStats>>	warmUp(List<String> namespaces) Warmup the indicated namespaces.

Methods inherited from class com.bigdata.journal.AbstractJournal

_getName2Addr, abort, abortContext, assertBefore, assertCanRead, assertCanWrite, assertCommitTimeAdvances, assertHAReady, assertOpen, assertPriorCommitTimeAdvances, awaitHAReady, clearQuorumToken, close, closeForWrites, commit, commitNow, delete, delete, deleteResources, destroy, detachContext, doLocalAbort, doLocalCommit, doLocalCommit, ensureMinFree, finalize, force, getBufferStrategy, getByteCount, getCommitRecord, getCommitRecord, getCommitRecordIndex, getCommitRecordStrictlyGreaterThan, getEarliestVisibleCommitRecordForHA, getFile, getHAPrepareTimeout, getHAReady, getHAReleaseTimeConsensusTimeout, getHAStatus, getHistoricalIndexCacheSize, getIndex, getIndexCacheSize, getIndexCounters, getIndexLocal, getIndexWithCheckpointAddr, getIndexWithCommitRecord, getInputStream, getLastCommitTime, getMaximumClockSkewMillis, getMaximumExtent, getMaxRecordSize, getName2Addr, getName2Addr, getOffset, getOffsetBits, getOutputStream, getOutputStream, getPhysicalAddress, getProperties, getProperty, getProperty, getProperty, getQuorum, getQuorumToken, getReadOnlyCommitRecordIndex, getResourceMetadata, getRootAddr, getRootBlocks, getRootBlockView, getRootBlockViewWithLock, getUnisolatedIndex, getUUID, indexNameScan, installRootBlocks, invalidateCommitters, isChecked, isDirty, isDoubleSync, isFullyBuffered, isOpen, isReadOnly, isStable, newAllocationContext, newHAGlue, read, register, registerIndex, registerIndex, registerIndex, registerIndex, removeCommitRecordEntries, rollback, setCommitter, setQuorumToken, setupCommitters, size, snapshotAllocationData, toAddr, toString, truncate, validateIndexMetadata, write, write

Methods inherited from class java.lang.Object

clone, equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface com.bigdata.journal.IResourceManager

deleteResources

Methods inherited from interface com.bigdata.service.IServiceShutdown

isOpen

Constructor Detail

Journal

public Journal(Properties properties)

Create or re-open a journal.

Parameters:

properties - See Options.

Journal

public Journal(Properties properties,
       Quorum<HAGlue,QuorumService<HAGlue>> quorum)

Method Detail

newResourceLocator

protected IResourceLocator<?> newResourceLocator()

Factory for the IResourceLocator for the Journal.

newTransactionService

protected JournalTransactionService newTransactionService()

newLocalTransactionManager

protected AbstractLocalTransactionManager newLocalTransactionManager()

getLocalTransactionManager

public AbstractLocalTransactionManager getLocalTransactionManager()

Description copied from interface: IJournal

Return the object providing the local transaction manager for this journal.

Specified by:

getLocalTransactionManager in interface IJournal

isGroupCommit

public boolean isGroupCommit()

Description copied from interface: IIndexManager

Return true if the index manager supports group commit semantics.

Specified by:

isGroupCommit in interface IIndexManager

See Also:

(NSS GROUP COMMIT)

getCounters

public CounterSet getCounters()

Return counters reporting on various aspects of the journal.

Overridden to attach additional performance counters.

Specified by:

getCounters in interface ICounterSetAccess

Specified by:

getCounters in interface IResourceManager

Overrides:

getCounters in class AbstractJournal

getTmpDir

public File getTmpDir()

Description copied from interface: IResourceManager

The directory for temporary files.

Specified by:

getTmpDir in interface IResourceManager

getDataDir

public File getDataDir()

The directory in which the journal's file is located -or- null if the journal is not backed by a file.

Specified by:

getDataDir in interface IResourceManager

openStore

public IRawStore openStore(UUID uuid)

Note: This will only succeed if the uuid identifies this journal.

Specified by:

openStore in interface IResourceManager

Parameters:

uuid - The UUID identifying that store file.

Returns:

The open IRawStore.

getIndexSources

public AbstractBTree[] getIndexSources(String name,
                              long timestamp)

Always returns an array containing a single BTree which is the BTree loaded from the commit record whose commit timestamp is less than or equal to timestamp -or- null if there are no ICommitRecords that satisfy the probe or if the named index was not registered as of that timestamp.

Specified by:

getIndexSources in interface IResourceManager

Parameters:

name -

timestamp -

Returns:

The sources for the index view or null if the index was not defined as of the timestamp.

Throws:

UnsupportedOperationException - If the timestamp is ITx.READ_COMMITTED. You MUST use getIndex(String, long) in order to obtain a view that has ITx.READ_COMMITTED semantics.

See Also:

FusedView

getLiveJournal

public final AbstractJournal getLiveJournal()

Always returns this.

Specified by:

getLiveJournal in interface IResourceManager

getJournal

public final AbstractJournal getJournal(long timestamp)

Always returns this.

Specified by:

getJournal in interface IResourceManager

Parameters:

timestamp - A transaction identifier, ITx.UNISOLATED for the unisolated index view, ITx.READ_COMMITTED, or timestamp for a historical view no later than the specified timestamp.

Returns:

The corresponding journal for that timestamp -or- null if no journal has data for that timestamp, including when a historical journal with data for that timestamp has been deleted.

compact

public Future<Journal> compact(File outFile)

Compacts the named indices found on this journal as of the most recent commit point, writing their view onto a new Journal. This method MAY be used concurrently with the Journal but writes after the selected commit point WILL NOT be reflected in the output file. Typical uses are to reduce the space required by the backing store, to improve locality in the backing store, and to make a backup of the most recent commit point.

Parameters:

outFile - The file on which the new journal will be created.

Returns:

The Future on which you must wait for the CompactTask to complete. The already open journal is accessible using Future.get(). If you are backing up data, then be sure to shutdown the returned Journal so that it can release its resources.

snapshot

public Future<ISnapshotResult> snapshot(ISnapshotFactory snapshotFactory)

Submit a task that will take a snapshot of the journal and return the Future for that task. The snapshot is taken on a temporary file. Iff the snapshot is successful, the temporary file is renamed to the application determined file. Thus all snapshots are either valid or are were not written. A snapshot of an empty journal is not permitted. Also, the backing store MUST implement the IHABufferStrategy.

Note: This method supports application controlled snapshots and is primarily intended for non-HA deployments. HA has an integrated snapshot and transaction log mechanism which is preferred in HA deployments and also provides the ability for an application to take snapshots on demand.

Parameters:

snapshotFactory - The factory that will provide the name of the file on which the snapshot will be written.

Returns:

The Future for the snapshot.

Throws:

UnsupportedOperationException - if the backing store does not implement the IHABufferStrategy interface.

Since:

1.5.2

See Also:

Online backup for Journal

dropIndex

public void dropIndex(String name)

Description copied from class: AbstractJournal

Drops the named index.

Note: Whether or not and when index resources are reclaimed is dependent on the store. For example, an immortal store will retain all historical states for all indices. Likewise, a store that uses index partitions may be able to delete index segments immediately.

Drops the named index. The index will no longer participate in atomic commits and will not be visible to new transactions. Storage will be reclaimed IFF the backing store support that functionality.

Specified by:

dropIndex in interface IGISTManager

Overrides:

dropIndex in class AbstractJournal

Parameters:

name - The name of the index to be dropped.

getIndex

public ILocalBTreeView getIndex(String name,
                       long timestamp)

Return a view of the named index as of the specified timestamp.

Note: Transactions should pass in the timestamp against which they are reading rather than the transaction identifier (aka startTime). By providing the timestamp of the commit point, the transaction will hit the AbstractJournal.indexCache. If the transaction passes the startTime instead, then all startTimes will be different and the cache will be defeated.

Note: ITx.READ_COMMITTED views are given read-committed semantics using a ReadCommittedView. This means that they can be cached since the view will update automatically as commits are made against the Journal.

Specified by:

getIndex in interface IIndexManager

Specified by:

getIndex in interface IResourceManager

Overrides:

getIndex in class AbstractJournal

Parameters:

name - The index name.

timestamp - A timestamp which represents either a possible commit time on the store or a read-only transaction identifier.

Returns:

The index or null iff there is no index registered with that name for that timestamp.

See Also:

IndexManager.getIndex(String, long)

getIndexSources

public AbstractBTree[] getIndexSources(String name,
                              long timestamp,
                              BTree btree)

Always returns the BTree as the sole element of the array since partitioned indices are not supported.

Specified by:

getIndexSources in interface IResourceManager

btree - A BTree.

Returns:

The source(s) for the view associated with that BTree.

newTx

public final long newTx(long timestamp)

Create a new transaction on the Journal.

Note: This is a convenience method. The implementation of this method is delegated to the object returned by getTransactionService().

Parameters:

timestamp - A positive timestamp for a historical read-only transaction as of the first commit point LTE the given timestamp, ITx.READ_COMMITTED for a historical read-only transaction as of the most current commit point on the Journal as of the moment that the transaction is created, or ITx.UNISOLATED for a read-write transaction.

Returns:

The transaction identifier.

See Also:

ITransactionService.newTx(long)

abort

public final void abort(long tx)

Abort a transaction.

Note: This is a convenience method. The implementation of this method is delegated to the object returned by getTransactionService().

Parameters:

tx - The transaction identifier.

See Also:

ITransactionService.abort(long)

commit

public final long commit(long tx)
                  throws ValidationError

Commit a transaction.

Note: This is a convenience method. The implementation of this method is delegated to the object returned by getTransactionService().

Parameters:

tx - The transaction identifier.

Returns:

The commit time assigned to that transaction.

Throws:

ValidationError

See Also:

ITransactionService.commit(long)

prepare

public final boolean prepare(long txId)

Validate the write set for a transaction. This operation is not required. Validation will be performed during commit processing for a transaction regardless.

Parameters:

txId - The transaction identifier.

Returns:

true iff the write set of the transaction could be validated.

Throws:

TransactionNotFoundException - if no such transaction exists.

nextTimestamp

public final long nextTimestamp()

Deprecated. This is here for historical reasons and is only used by the test suite. Use getLocalTransactionManager() and ITimestampService.nextTimestamp().

Returns the next timestamp from the ILocalTransactionManager.

Note: This is a convenience method. The implementation of this method is delegated to the object returned by getTransactionService().

See Also:

ITimestampService.nextTimestamp()

getConcurrencyManager

public ConcurrencyManager getConcurrencyManager()

shutdown

public void shutdown()

Note: The transaction service is shutdown first, then the executorService, then the IConcurrencyManager, the ITransactionService and finally the IResourceLockService.

Specified by:

shutdown in interface IConcurrencyManager

Specified by:

shutdown in interface IJournal

Specified by:

shutdown in interface IServiceShutdown

Overrides:

shutdown in class AbstractJournal

See Also:

AbstractJournal.shutdownNow()

shutdownNow

public void shutdownNow()

Note: The IConcurrencyManager is shutdown first, then the ITransactionService and finally the IResourceManager.

Specified by:

shutdownNow in interface IConcurrencyManager

Specified by:

shutdownNow in interface IJournal

Specified by:

shutdownNow in interface IServiceShutdown

Overrides:

shutdownNow in class AbstractJournal

See Also:

AbstractJournal.shutdown()

_close

protected void _close()

Core implementation of immediate shutdown handles event reporting.

Overridden to close the TemporaryStoreFactory.

Overrides:

_close in class AbstractJournal

submit

public <T> FutureTask<T> submit(AbstractTask<T> task)

Description copied from interface: IConcurrencyManager

Submit a task (asynchronous). Tasks will execute asynchronously in the appropriate thread pool with as much concurrency as possible.

Note: Unisolated write tasks will NOT return before the next group commit (exceptions may be thrown if the task fails or the commit fails). The purpose of group commits is to provide higher throughput for writes on the store by only syncing the data to disk periodically rather than after every write. Group commits are scheduled by the #commitService. The trigger conditions for group commits may be configured using ConcurrencyManager.Options. If you are using the store in a single threaded context then you may set Options#WRITE_SERVICE_CORE_POOL_SIZE to ONE (1) which has the effect of triggering commit immediately after each unisolated write. However, note that you can not sync a disk more than ~ 30-40 times per second so your throughput in write operations per second will never exceed that for a single-threaded application writing on a hard disk. (Your mileage can vary if you are writing on a transient store or using a durable medium other than disk).

Note: The isolated indices used by a read-write transaction are NOT thread-safe. Therefore a partial order is imposed over concurrent tasks for the same transaction that seek to read or write on the same index(s). Full concurrency is allowed when different transactions access the same index(s), but write-write conflicts MAY be detected during commit processing.

Note: The following exceptions MAY be wrapped by Future.get() for tasks submitted via this method:

ValidationError

An unisolated write task was attempting to commit the write set for a transaction but validation failed. You may retry the entire transaction.

InterruptedException

A task was interrupted during execution and before the task had completed normally. You MAY retry the task, but note that this exception is also generated when tasks are cancelled when the journal is being IConcurrencyManager.shutdown() after the timeout has expired or IConcurrencyManager.shutdownNow(). In either of these cases the task will not be accepted by the journal.

Specified by:

submit in interface IConcurrencyManager

Parameters:

task - The task.

Returns:

The Future that may be used to resolve the outcome of the task.

invokeAll

public <T> List<Future<T>> invokeAll(Collection<? extends AbstractTask<T>> tasks,
                            long timeout,
                            TimeUnit unit)
                          throws InterruptedException

Description copied from interface: IConcurrencyManager

Executes the given tasks, returning a list of Futures holding their status and results when all complete or the timeout expires, whichever happens first. Note that a completed task could have terminated either normally or by throwing an exception. The results of this method are undefined if the given collection is modified while this operation is in progress.

Note: Contract is based on ExecutorService.invokeAll(Collection, long, TimeUnit) but only the Futures of the submitted tasks are returned.

Specified by:

invokeAll in interface IConcurrencyManager

Parameters:

tasks - The tasks.

Returns:

The Futures of all tasks that were submitted prior to the expiration of the timeout.

Throws:

InterruptedException - if interrupted while waiting, in which case unfinished tasks are cancelled.

invokeAll

public <T> List<Future<T>> invokeAll(Collection<? extends AbstractTask<T>> tasks)
                          throws InterruptedException

Description copied from interface: IConcurrencyManager

Executes the given tasks, returning a list of Futures holding their status and results when all complete. Note that a completed task could have terminated either normally or by throwing an exception. The results of this method are undefined if the given collection is modified while this operation is in progress.

Note: Contract is per ExecutorService.invokeAll(Collection)

Specified by:

invokeAll in interface IConcurrencyManager

Parameters:

tasks - The tasks.

Returns:

Their Futures.

Throws:

InterruptedException - if interrupted while waiting, in which case unfinished tasks are cancelled.

getResourceManager

public IResourceManager getResourceManager()

Description copied from interface: IConcurrencyManager

The object used to manage local resources.

Specified by:

getResourceManager in interface IConcurrencyManager

getTransactionManager

public ILocalTransactionManager getTransactionManager()

Description copied from interface: IConcurrencyManager

The client side of the transaction manager.

Specified by:

getTransactionManager in interface IConcurrencyManager

getTransactionService

public ITransactionService getTransactionService()

getWriteService

public WriteExecutorService getWriteService()

Description copied from interface: IConcurrencyManager

The service on which read-write tasks are executed.

Specified by:

getWriteService in interface IConcurrencyManager

shouldOverflow

public boolean shouldOverflow()

Note: This implementation always returns false. As a consequence the journal capacity will simply be extended by AbstractJournal.write(ByteBuffer) until the available disk space is exhausted.

Specified by:

shouldOverflow in interface IResourceManager

Returns:

This implementation returns false since overflow is NOT supported.

isOverflowEnabled

public boolean isOverflowEnabled()

Note: This implementation always returns false.

Specified by:

isOverflowEnabled in interface IResourceManager

overflow

public Future<Object> overflow()

Description copied from interface: IResourceManager

Overflow processing creates a new journal, migrates the named indices on the current journal the new journal, and continues operations on the new journal. Typically this involves updating the view of the named indices such that they read from a fused view of an empty index on the new journal and the last committed state of the index on the old journal.

Note: When this method returns true journal references MUST NOT be presumed to survive this method. In particular, the old journal MAY be closed out by this method and marked as read-only henceforth.

Note: The caller MUST ensure that they have an exclusive lock on the WriteExecutorService such that no task is running with write access to the live journal.

Note: The implementation MUST NOT write on the old journal - those writes will not be made restart safe by the WriteExecutorService - but it MAY write on the new journal.

Specified by:

overflow in interface IResourceManager

Returns:

The Future for the task handling post-processing of the old journal.

getIndexSegmentFile

public File getIndexSegmentFile(IndexMetadata indexMetadata)

Description copied from interface: IResourceManager

Return the file on which a new IndexSegment should be written. The file will exist but will have zero length.

Specified by:

getIndexSegmentFile in interface IResourceManager

Parameters:

indexMetadata - The index metadata.

Returns:

The file.

Throws:

UnsupportedOperationException - since overflow() is not supported.

getFederation

public IBigdataFederation<?> getFederation()

Description copied from interface: IResourceManager

The federation whose resources are being managed.

Specified by:

getFederation in interface IResourceManager

Throws:

UnsupportedOperationException - always.

getDataService

public DataService getDataService()

Description copied from interface: IResourceManager

The local DataService whose resources are being managed.

Specified by:

getDataService in interface IResourceManager

Throws:

UnsupportedOperationException - always.

getDataServiceUUID

public UUID getDataServiceUUID()

Description copied from interface: IResourceManager

Return the UUID of the IDataService whose resources are being managed.

Specified by:

getDataServiceUUID in interface IResourceManager

Throws:

UnsupportedOperationException - always.

getIndexPartitionGone

public StaleLocatorReason getIndexPartitionGone(String name)

Always returns null since index partition moves are not supported.

Specified by:

getIndexPartitionGone in interface IResourceManager

Parameters:

name - The name of an index partition.

Returns:

The reason (split, join, or move) -or- null iff the index partition is not known to be gone.

getGlobalRowStore

public SparseRowStore getGlobalRowStore()

Description copied from interface: IIndexStore

Return an unisolated view of the global SparseRowStore used to store named property sets.

Specified by:

getGlobalRowStore in interface IIndexStore

See Also:

GlobalRowStoreSchema

getGlobalRowStore

public SparseRowStore getGlobalRowStore(long timestamp)

Description copied from interface: IIndexStore

Return a view of the global SparseRowStore used to store named property sets as of the specified timestamp.

The SparseRowStore only permits ITx.UNISOLATED writes, so you MUST specify ITx.UNISOLATED as the timestamp if you intend to write on the global row store!

You can request the most recent committed state of the global row store by specifying ITx.READ_COMMITTED.

Specified by:

getGlobalRowStore in interface IIndexStore

Parameters:

timestamp - The timestamp of the view.

Returns:

The global row store view -or- null if no view exists as of that timestamp.

getGlobalFileSystem

public BigdataFileSystem getGlobalFileSystem()

Description copied from interface: IIndexStore

Return the global file system used to store block-structured files and their metadata and as a source and sink for map/reduce processing.

Specified by:

getGlobalFileSystem in interface IIndexStore

See Also:

BigdataFileSystem

discardCommitters

protected void discardCommitters()

Description copied from class: AbstractJournal

This method is invoked by AbstractJournal.abort() when the store must discard any hard references that it may be holding to objects registered as ICommitters.

The default implementation discards the btree mapping names to named btrees.

Subclasses MAY extend this method to discard their own committers but MUST NOT override it completely.

Overrides:

discardCommitters in class AbstractJournal

getTempStore

public TemporaryStore getTempStore()

Description copied from interface: IIndexStore

A factory for TemporaryStores. TemporaryStores are thread-safe and may be used by multiple processes at once. Old TemporaryStores are eventually retired by the factory and their storage is reclaimed once they are finalized (after they are no longer in use by any process). The decision to retire a TemporaryStore is either made implicitly, when it is no longer weakly reachable, or explicitly, when it has grown large enough that no new processes should begin using that TemporaryStore. In the latter case, the TemporaryStore will remain available to the process(es) using it and a new TemporaryStore will be allocated and made available to the caller.

It is important that processes do not hold a hard reference to a TemporaryStore beyond the end of the process as that will prevent the TemporaryStore from being finalized. Holding reference to an AbstractBTree created on a TemporaryStore is equivalent to holding a hard reference to the TemporaryStore itself since the AbstractBTree holds onto the backing IRawStore using a hard reference.

Specified by:

getTempStore in interface IIndexStore

Returns:

A TemporaryStore.

getResourceLocator

public IResourceLocator<?> getResourceLocator()

Description copied from interface: IIndexStore

Return the default locator for resources that are logical index containers (relations and relation containers).

Specified by:

getResourceLocator in interface IIndexStore

getResourceLockService

public IResourceLockService getResourceLockService()

Description copied from interface: IIndexStore

The service that may be used to acquire synchronous distributed locks without deadlock detection.

Specified by:

getResourceLockService in interface IIndexStore

getExecutorService

public ExecutorService getExecutorService()

Description copied from class: AbstractJournal

Service for running arbitrary tasks in support of IResourceLocator. There is no concurrency control associated with this service, but tasks run here may submit tasks to the ConcurrencyManager.

Specified by:

getExecutorService in interface IIndexStore

Specified by:

getExecutorService in class AbstractJournal

getPlatformStatisticsCollector

public AbstractStatisticsCollector getPlatformStatisticsCollector()

Host wide performance counters (collected from the OS) (optional).

See Also:

PlatformStatsPlugIn

getGangliaService

public Object getGangliaService()

getReadExecutor

public LatchedExecutor getReadExecutor()

An executor service used to read on the local disk. TODO This is currently used by prefetch. We should generalize this mechanism, probably moving it to the IResourceManager, and use it to do all IO, ideally using the JSR 166 fork/join mechanisms. Without moving this method to another interface, pre-fetch will not work for AbstractTask.

This should be reconciled with the ConcurrencyManager, which has distinct ExecutorServices for readers and writers which control the per-task concurrency while this controls the disk read concurrency.

We could use the same pool for readers and writers on the disk.

warmUp

public Future<Map<String,BaseIndexStats>> warmUp(List<String> namespaces)

Warmup the indicated namespaces.

Parameters:

namespaces - A list of zero or more namespaces to be warmed up (optional). When null or empty, all namespaces will be warmed up.

Returns:

A future for the task that is warming up the indices associated with those namespace(s). The future evaluates to a map from the name of the index to the statistics collected for that index during the warmup procedure.

See Also:

pre-heat the journal on startup , WarmUpTask

addScheduledTask

public ScheduledFuture<?> addScheduledTask(Runnable task,
                                  long initialDelay,
                                  long delay,
                                  TimeUnit unit)

Description copied from interface: IIndexStore

Adds a task which will run until canceled, until it throws an exception, or until the service is shutdown.

Specified by:

addScheduledTask in interface IIndexStore

Parameters:

task - The task.

initialDelay - The initial delay.

delay - The delay between invocations.

unit - The units for the delay parameters.

Returns:

The ScheduledFuture for that task.

getCollectPlatformStatistics

public final boolean getCollectPlatformStatistics()

true iff performance counters will be collected for the platform on which the client is running.

Specified by:

getCollectPlatformStatistics in interface IIndexStore

See Also:

PlatformStatsPlugIn.Options.COLLECT_PLATFORM_STATISTICS

getCollectQueueStatistics

public final boolean getCollectQueueStatistics()

true iff statistics will be collected for work queues.

Specified by:

getCollectQueueStatistics in interface IIndexStore

See Also:

QueueStatsPlugIn.Options.COLLECT_QUEUE_STATISTICS

getHttpdPort

public final int getHttpdPort()

The port on which the optional httpd service will be run. The httpd service exposes statistics about the client, its work queues, the platform on which it is running, etc. If this is ZERO (0), then the port will be chosen randomly.

Specified by:

getHttpdPort in interface IIndexStore

See Also:

HttpPlugin.Options.HTTPD_PORT

getIndexCounters

public BTreeCounters getIndexCounters(String name)

Description copied from interface: IResourceManager

Return the BTreeCounters for the named index. If none exist, then a new instance is atomically created and returned to the caller. This facilitates the reuse of the same BTreeCounters instance for all views of the named index.

Specified by:

getIndexCounters in interface IResourceManager

Parameters:

name - The name of the index.

Returns:

The counters for that index and never null.

acquireUnisolatedConnectionAccess

public AccessSemaphore.Access acquireUnisolatedConnectionAccess()
                                                         throws InterruptedException

Acquire an Access object for the UNISOLATED connection.

Throws:

InterruptedException

acquireReadWriteConnectionAccess

public AccessSemaphore.Access acquireReadWriteConnectionAccess()
                                                        throws InterruptedException

Acquire an Access for a read/write isolated transaction.

Throws:

InterruptedException

See Also:

BLZG-2041

isHAJournal

public boolean isHAJournal()

Description copied from interface: IJournal

Convenience method created in BLZG-1370 to factor out bigdata-jini artifact dependencies. This should return true IFF the underlying journal is com.bigdata.jini.ha.HAJournal.

Specified by:

isHAJournal in interface IJournal

Returns: