com.bigdata.service.ndx.pipeline

Interface IDuplicateRemover<O>

All Known Implementing Classes:

DefaultDuplicateRemover, NOPDuplicateRemover

public interface IDuplicateRemover<O>

Interface allowing application specific elimination of duplicates.

Version:

$Id$

Author:

Bryan Thompson

Method Summary

Methods

Modifier and Type	Method and Description
KVO<O>[]	filter(KVO<O>[] a) Accepts a dense array of key-value tuples and returns a dense array of key-value tuples in which duplicates have been eliminated.

Method Detail

filter

KVO<O>[] filter(KVO<O>[] a)

Accepts a dense array of key-value tuples and returns a dense array of key-value tuples in which duplicates have been eliminated. The elements of the given array MUST NOT be modified as a side-effect.

Implementations MUST be thread-safe.

Implementations MUST test for KVOList and obey its contract (this ensures that we can map KVO.done() over the eliminated duplicates once the original has been written successfully onto the database).

Parameters:

a - A sorted array of key-value tuples.

Returns:

The a dense array of key-value tuples in which any duplicates have been eliminated.