com.bigdata.rdf.lexicon

Class BigdataSubjectCentricFullTextIndex

java.lang.Object

com.bigdata.relation.AbstractResource<IRelation<E>>

com.bigdata.relation.AbstractRelation

com.bigdata.search.FullTextIndex

com.bigdata.rdf.lexicon.BigdataSubjectCentricFullTextIndex

All Implemented Interfaces:

ISubjectCentricTextIndexer<Hit>, ITextIndexer<Hit>, IMutableRelation, IMutableResource, IRelation, ILocatableResource

public class BigdataSubjectCentricFullTextIndex
extends FullTextIndex
implements ISubjectCentricTextIndexer<Hit>

Implementation based on the built-in keyword search capabilities for bigdata.

Version:

$Id: BigdataRDFFullTextIndex.java 4709 2011-06-15 16:23:22Z thompsonbry $

Author:

Bryan Thompson

Nested Class Summary

Nested classes/interfaces inherited from class com.bigdata.search.FullTextIndex

FullTextIndex.Options

Nested classes/interfaces inherited from interface com.bigdata.rdf.lexicon.ITextIndexer

ITextIndexer.FullTextQuery

Field Summary

Fields

Modifier and Type	Field and Description
static String	NAME_SUBJ_SEARCH The basename of the search index.

Fields inherited from class com.bigdata.search.FullTextIndex

NAME_SEARCH

Fields inherited from class com.bigdata.relation.AbstractResource

indexManager

Constructor Summary

Constructors

Constructor and Description
BigdataSubjectCentricFullTextIndex(IIndexManager indexManager, String namespace, Long timestamp, Properties properties)

Method Summary

Methods

Modifier and Type	Method and Description
void	create() Conditionally registers the necessary index(s).
void	destroy() The full text index is currently located in the same namespace as the lexicon relation.
IIndex	getIndex() The index used to associate term identifiers with tokens parsed from documents.
boolean	getIndexDatatypeLiterals() Return true iff datatype literals are being indexed.
static BigdataSubjectCentricFullTextIndex	getInstance(IIndexManager indexManager, String namespace, Long timestamp, Properties properties)
void	index(IV<?,?> subject, Iterator<BigdataValue> valuesIterator) Add the terms to the full text index so that we can do fast lookup of the corresponding term identifiers.

Methods inherited from class com.bigdata.search.FullTextIndex

_search, applyRegex, count, delete, executeQuery, getAnalyzer, getElementClass, getIndexNames, getKeyBuilder, getKeyOrder, getKeyOrders, getPrimaryKeyOrder, getTokenStream, index, index, insert, isOverwrite, isReadOnly, matchExact, newElement, search, slice, tokenize

Methods inherited from class com.bigdata.relation.AbstractRelation

getAccessPath, getAccessPath, getAccessPath, getFQN, getFQN, getFQN, getIndex, getIndex, getIndex, newAccessPath, newIndexMetadata

Methods inherited from class com.bigdata.relation.AbstractResource

acquireExclusiveLock, assertWritable, getBareProperties, getChunkCapacity, getChunkOfChunksCapacity, getChunkTimeout, getCommitTime, getContainer, getContainerNamespace, getExecutorService, getFullyBufferedReadThreshold, getIndexManager, getMaxParallelSubqueries, getNamespace, getProperties, getProperty, getProperty, getTimestamp, init, isForceSerialExecution, toString, unlock

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Methods inherited from interface com.bigdata.rdf.lexicon.ITextIndexer

count, search

Methods inherited from interface com.bigdata.relation.IRelation

getExecutorService, getIndexManager

Methods inherited from interface com.bigdata.relation.locator.ILocatableResource

getContainerNamespace, getNamespace, getTimestamp, init

Field Detail

NAME_SUBJ_SEARCH

public static final transient String NAME_SUBJ_SEARCH

The basename of the search index.

See Also:

Constant Field Values

Constructor Detail

BigdataSubjectCentricFullTextIndex

public BigdataSubjectCentricFullTextIndex(IIndexManager indexManager,
                                  String namespace,
                                  Long timestamp,
                                  Properties properties)

Parameters:

indexManager -

namespace -

timestamp -

properties -

Method Detail

getInstance

public static BigdataSubjectCentricFullTextIndex getInstance(IIndexManager indexManager,
                                             String namespace,
                                             Long timestamp,
                                             Properties properties)

getIndexDatatypeLiterals

public boolean getIndexDatatypeLiterals()

Description copied from interface: ITextIndexer

Return true iff datatype literals are being indexed.

Specified by:

getIndexDatatypeLiterals in interface ITextIndexer<Hit>

create

public void create()

Conditionally registers the necessary index(s).

Specified by:

create in interface ITextIndexer<Hit>

Specified by:

create in interface IMutableResource

Overrides:

create in class FullTextIndex

Throws:

IllegalStateException - if the client does not have write access.

destroy

public void destroy()

The full text index is currently located in the same namespace as the lexicon relation. However, the distributed zookeeper locks (ZLocks) are not reentrant. Therefore this method is overridden to NOT acquire the ZLock for the namespace of the relation when destroying the full text index -- that lock is already held for the same namespace by the LexiconRelation.

Specified by:

destroy in interface ITextIndexer<Hit>

Specified by:

destroy in interface IMutableResource

Overrides:

destroy in class FullTextIndex

getIndex

public IIndex getIndex()

The index used to associate term identifiers with tokens parsed from documents.

Overrides:

getIndex in class FullTextIndex

index

public void index(IV<?,?> subject,
         Iterator<BigdataValue> valuesIterator)

Description copied from interface: ISubjectCentricTextIndexer

Add the terms to the full text index so that we can do fast lookup of the corresponding term identifiers. Only literals are tokenized. Literals that have a language code property are parsed using a tokenizer appropriate for the specified language family. Other literals and URIs are tokenized using the default Locale.

In the subject-centric text index, these tokenized literals are rolled up by subject rather than using the IV for the literals as the docId in the text index.

Specified by:

index in interface ISubjectCentricTextIndexer<Hit>

Parameters:

subject - The subject to which these values belong.