Uses of Class
com.sun.labs.minion.indexer.partition.DiskPartition

Packages that use DiskPartition

com.sun.labs.minion.classification	Provides the automatic document classification functionality in Minion.
com.sun.labs.minion.indexer.dictionary	Provides the classes that implement the dictionaries used by the indexer and the retrieval engine.
com.sun.labs.minion.indexer.partition	Provides the classes that implement the partitions of the indexer.
com.sun.labs.minion.lextax
com.sun.labs.minion.retrieval	Provides the query evaluation capabilities for Minion.
com.sun.labs.minion.retrieval.cache
com.sun.labs.minion.test	Provides test classes and utilities for indexing and querying.
com.sun.labs.minion.test.regression	Provides the classes that generates the entries and queries for the regression test.

Uses of DiskPartition in com.sun.labs.minion.classification

Subclasses of DiskPartition in com.sun.labs.minion.classification

class	ClassifierDiskPartition A disk partition that will hold classifier data.
class	ClusterDiskPartition A disk partition that will hold classifier data.

Fields in com.sun.labs.minion.classification declared as DiskPartition

protected DiskPartition

BigQuery.part The partition upon which we're operating.

Fields in com.sun.labs.minion.classification with type parameters of type DiskPartition

protected java.util.Map<DiskPartition,TermCache>	QueryZone.termCaches A term cache to use when building classifiers.
protected java.util.Map<DiskPartition,TermCache>	Rocchio.termCaches A term cache to use when building classifiers.

Methods in com.sun.labs.minion.classification that return DiskPartition

DiskPartition	ClassifierPartitionFactory.getDiskPartition(int number, PartitionManager m)
DiskPartition	ClusterPartitionFactory.getDiskPartition(int number, PartitionManager m)

Methods in com.sun.labs.minion.classification with parameters of type DiskPartition

float[]	BalancedWinnow.classify(DiskPartition sdp)
java.util.Map<java.lang.String,ClassificationResult>	ClassifierManager.classify(DiskPartition sdp) Begin classification of a set of documents in memory.
float[]	ClassifierModel.classify(DiskPartition sdp) Classifies a disk partition of documents.
float[]	Rocchio.classify(DiskPartition sdp) Classifies a set of documents.
void	ClassifierDiskPartition.classify(DiskPartition sdp, ExtraClassification ec, java.util.Map<java.lang.String,ClassificationResult> results) Classifies all the documents in a disk partition.
float[][]	BulkClassifier.classify(java.lang.String fromField, ClassifierDiskPartition cdp, DiskPartition sdp) Evaluates all of the classifiers in the given classifier disk partition against all of the new documents in the given disk partition.
float[][]	Rocchio.classify(java.lang.String fromField, ClassifierDiskPartition cdp, DiskPartition sdp)
protected void	ClassifierDiskPartition.mergeCustom(int newPartNumber, DiskPartition[] sortedParts, int[][] idMaps, int newMaxDocID, int[] docIDStart, int[] nUndel, int[][] docIDMaps) Merges the model specific data for these classifiers.

Method parameters in com.sun.labs.minion.classification with type arguments of type DiskPartition

protected java.util.List	BalancedWinnow.getStrengthArrays(java.util.Map<DiskPartition,java.util.List> partToDocList, FeatureClusterSet clusterSet, java.util.Map<DiskPartition,TermCache> termCaches)
protected java.util.List	BalancedWinnow.getStrengthArrays(java.util.Map<DiskPartition,java.util.List> partToDocList, FeatureClusterSet clusterSet, java.util.Map<DiskPartition,TermCache> termCaches)
void	BalancedWinnow.train(java.lang.String name, java.lang.String fieldName, PartitionManager manager, ResultSetImpl training, FeatureClusterSet selectedFeatures, java.util.Map<java.lang.String,TermStatsImpl> termStats, java.util.Map<DiskPartition,TermCache> termCaches, Progress progress) Train a balanced winnow classifier.
void	ClassifierModel.train(java.lang.String name, java.lang.String fieldName, PartitionManager manager, ResultSetImpl docs, FeatureClusterSet fcs, java.util.Map<java.lang.String,TermStatsImpl> termStats, java.util.Map<DiskPartition,TermCache> termCaches, Progress progress) Trains the classifier on a set of documents.
void	Rocchio.train(java.lang.String name, java.lang.String fieldName, PartitionManager manager, ResultSetImpl training, FeatureClusterSet selectedFeatures, java.util.Map<java.lang.String,TermStatsImpl> termStats, java.util.Map<DiskPartition,TermCache> termCaches, Progress progress) Trains the classifier on a set of documents.

Constructor parameters in com.sun.labs.minion.classification with type arguments of type DiskPartition

QueryZone(ResultSetImpl training, java.lang.String fromField, FeatureClusterSet featureClusters, java.util.Map<java.lang.String,TermStatsImpl> termStats, java.util.Map<DiskPartition,TermCache> termCaches, PartitionManager manager)

Uses of DiskPartition in com.sun.labs.minion.indexer.dictionary

Fields in com.sun.labs.minion.indexer.dictionary declared as DiskPartition

protected DiskPartition

DiskFieldStore.part The partition this field store is associated with.

Methods in com.sun.labs.minion.indexer.dictionary with parameters of type DiskPartition

DiskBiGramDictionary	DictionaryFactory.getBiGramDictionary(DiskDictionary mainDict, java.io.RandomAccessFile dictFile, java.io.RandomAccessFile postFile, DiskPartition part) Gets a bigram dictionary.
DiskDictionary	DictionaryFactory.getCachedDiskDictionary(NameDecoder decoder, java.io.RandomAccessFile dictFile, java.io.RandomAccessFile[] postFiles, DiskPartition part) Gets a cached dictionary that's configured according to the configuration.
DiskDictionary	DictionaryFactory.getDiskDictionary(java.lang.Class entryClass, NameDecoder decoder, java.io.RandomAccessFile dictFile, java.io.RandomAccessFile[] postFiles, DiskPartition part) Gets a disk dictionary that's configured according to the configuration, except it uses a different entry type.
DiskDictionary	DictionaryFactory.getDiskDictionary(NameDecoder decoder, java.io.RandomAccessFile dictFile, java.io.RandomAccessFile[] postFiles, DiskPartition part) Gets a disk dictionary that's configured according to the configuration.
protected SavedField	DiskFieldStore.makeSavedField(FieldInfo fi, java.io.RandomAccessFile dictFile, java.io.RandomAccessFile[] postFiles, DictionaryFactory fieldStoreDictFactory, DictionaryFactory bigramDictFactory, DiskPartition part) Makes a saved field instance of the appropriate type.

Method parameters in com.sun.labs.minion.indexer.dictionary with type arguments of type DiskPartition

void	UncachedTermStatsDictionary.recalculateTermStats(java.io.File df, java.util.List<DiskPartition> parts) Creates a term stats dictionary from a number of partitions.

Constructors in com.sun.labs.minion.indexer.dictionary with parameters of type DiskPartition

BasicField(FieldInfo field, java.io.RandomAccessFile dictFile, java.io.RandomAccessFile[] postFiles, DictionaryFactory fieldStoreDictFactory, DictionaryFactory bigramDictFactory, DiskPartition part)
Constructs a saved field that will be used to retrieve data during querying.

DiskFieldStore(DiskPartition part, java.io.RandomAccessFile dictFile, java.io.RandomAccessFile[] postFiles, DictionaryFactory fieldStoreDictFactory, DictionaryFactory bigramDictFactory, MetaFile metaFile)
Reads the field store from the provided file.

FeatureVector(FieldInfo field, java.io.RandomAccessFile dictFile, java.io.RandomAccessFile[] postFiles, DiskPartition part)
Constructs a feature vector field that will be used to retrieve data during querying.

Uses of DiskPartition in com.sun.labs.minion.indexer.partition

Subclasses of DiskPartition in com.sun.labs.minion.indexer.partition

class

InvFileDiskPartition A disk partition that holds data that is specific to the implementation of an inverted file.

Fields in com.sun.labs.minion.indexer.partition declared as DiskPartition

protected DiskPartition	DocumentIterator.currPart
protected DiskPartition	PartitionManager.Merger.newDP The new disk partition resulting from the merge.
protected DiskPartition	DocumentVectorLengths.part The partition whose values we're storing.

Fields in com.sun.labs.minion.indexer.partition with type parameters of type DiskPartition

protected java.util.List<DiskPartition>	PartitionManager.activeParts The list of partitions that we're managing.
protected java.util.List<DiskPartition>	PartitionManager.mergedParts A list of partitions that have been merged.
protected java.util.List<DiskPartition>	PartitionManager.Merger.toMerge The list of partitions that we wish to merge.

Methods in com.sun.labs.minion.indexer.partition that return DiskPartition

DiskPartition	DiskPartitionFactory.getDiskPartition(int number, PartitionManager m) Gets a disk partition with the given number, managed by the given manager.
DiskPartition	InvFilePartitionFactory.getDiskPartition(int number, PartitionManager m)
DiskPartition	PartitionManager.Merger.merge() Merges.
protected DiskPartition	PartitionManager.merge(java.util.List<DiskPartition> parts) Merges together the partitions in the provided list.
DiskPartition	DiskPartition.merge(java.util.List<DiskPartition> partitions, java.util.List<DelMap> delMaps, boolean calculateDVL) Merges a number of DiskPartitions into a single partition.
DiskPartition	DiskPartition.merge(java.util.List<DiskPartition> partitions, java.util.List<DelMap> delMaps, boolean calculateDVL, int depth) Merges a number of DiskPartitions into a single partition.
DiskPartition	PartitionManager.mergeAll() Merges all partitions from the active list into a new partition.
protected DiskPartition	PartitionManager.mergeInPieces(java.util.List<DiskPartition> parts) Breakss a list of partitions into blocks of mergeBlockSize, and merges those.
protected DiskPartition	PartitionManager.newDiskPartition(java.lang.Integer partNum, PartitionManager m) Instantiates a disk partition of the correct type for this manager
protected DiskPartition	PartitionManager.realMerge(java.util.List<DiskPartition> diskParts, boolean calculateDVL) Merges a list of partitions.

Methods in com.sun.labs.minion.indexer.partition that return types with arguments of type DiskPartition

java.util.List<DiskPartition>	PartitionManager.getActivePartitions() Returns a list of the currently active partitions.
protected java.util.List<DiskPartition>	PartitionManager.getPartitions(java.util.List<java.lang.Integer> partNums) Gets a list of partitions from the corresponding partition numbers.
java.util.List<DiskPartition>	PartitionManager.mergeGeometric() This is a geometric merge heuristic controlled by the mergeRate.
java.util.List<DiskPartition>	PartitionManager.updateActiveParts(boolean addNew) Reads the active file and adds any new partitions to our active list.

Methods in com.sun.labs.minion.indexer.partition with parameters of type DiskPartition

protected void	PartitionManager.addNewPartition(DiskPartition dp, java.util.Set<java.lang.Object> keys)
void	DocumentVectorLengths.calculateLengths(DiskPartition p, TermStatsDictionary gts, boolean adjustStats) Calculates a set of document vector lengths from a partition using a global set of term statistics.
protected void	DiskPartition.mergeCustom(int newPartNumber, DiskPartition[] sortedParts, int[][] idMaps, int newMaxDocID, int[] docIDStart, int[] nUndel, int[][] docIDMaps) Provides a place to merge data that is specific to a subclass of disk partition.
protected void	InvFileDiskPartition.mergeCustom(int newPartNumber, DiskPartition[] sortedParts, int[][] idMaps, int newMaxDocID, int[] docIDStart, int[] nUndel, int[][] docIDMaps)

Method parameters in com.sun.labs.minion.indexer.partition with type arguments of type DiskPartition

PartitionManager.Merger	PartitionManager.getMerger(java.util.List<DiskPartition> l) Gets an instance of the merger class in order to merge a list of partitions.
PartitionManager.Merger	PartitionManager.getMerger(java.util.List<DiskPartition> l, FileLock localMergeLock) Gets an instance of the merger class in order to merge a list of partitions.
protected java.util.List<java.lang.Integer>	PartitionManager.getPartNumbers(java.util.List<DiskPartition> parts) Gets a list of the partition numbers for the given partitions.
protected DiskPartition	PartitionManager.merge(java.util.List<DiskPartition> parts) Merges together the partitions in the provided list.
DiskPartition	DiskPartition.merge(java.util.List<DiskPartition> partitions, java.util.List<DelMap> delMaps, boolean calculateDVL) Merges a number of DiskPartitions into a single partition.
DiskPartition	DiskPartition.merge(java.util.List<DiskPartition> partitions, java.util.List<DelMap> delMaps, boolean calculateDVL, int depth) Merges a number of DiskPartitions into a single partition.
protected DiskPartition	PartitionManager.mergeInPieces(java.util.List<DiskPartition> parts) Breakss a list of partitions into blocks of mergeBlockSize, and merges those.
protected DiskPartition	PartitionManager.realMerge(java.util.List<DiskPartition> diskParts, boolean calculateDVL) Merges a list of partitions.
protected void	PartitionManager.writeActiveFile(java.util.List<DiskPartition> parts) Writes a list of partition numbers to the active file.

Constructors in com.sun.labs.minion.indexer.partition with parameters of type DiskPartition

CachedDocumentVectorLengths(DiskPartition part, boolean adjustStats)

DocumentVectorLengths(DiskPartition part, boolean adjustStats)
Creates a set of vector lengths for a given partition.

DocumentVectorLengths(DiskPartition part, int buffSize, boolean adjustStats)
Creates a set of vector lengths for a given partition.

Constructor parameters in com.sun.labs.minion.indexer.partition with type arguments of type DiskPartition

PartitionManager.Merger(java.util.List<DiskPartition> l, FileLock localMergeLock)
Instantiates a merger for the given list of partitions.

Uses of DiskPartition in com.sun.labs.minion.lextax

Constructors in com.sun.labs.minion.lextax with parameters of type DiskPartition

DiskTaxonomy(java.io.File f, DiskPartition p)
Instantiates a taxonomy from a file.

Uses of DiskPartition in com.sun.labs.minion.retrieval

Fields in com.sun.labs.minion.retrieval declared as DiskPartition

protected DiskPartition	ArrayGroup.part The partition that generated this set.
protected DiskPartition	QueryElement.part A partition upon which retrieval will be performed.
protected DiskPartition	QuickOr.part The partition for which we're holding documents.

Methods in com.sun.labs.minion.retrieval that return DiskPartition

DiskPartition	ArrayGroup.DocIterator.getPart() Gets the partition associated with this array group.
DiskPartition	ResultImpl.getPart()
DiskPartition	ArrayGroup.getPartition() Gets the partition that generated this group.

Methods in com.sun.labs.minion.retrieval with parameters of type DiskPartition

void	ArrayGroup.setPartition(DiskPartition part) Sets the partitoin for this group.
void	DictTerm.setPartition(DiskPartition part) Sets the partition that this term will be operating on.
void	FieldTerm.setPartition(DiskPartition part)
void	MultiDictTerm.setPartition(DiskPartition part) Overrides the standard DictTerm setPartition.
void	Operator.setPartition(DiskPartition part) Sets the partition that we will be operating on.
protected void	QueryElement.setPartition(DiskPartition part) Sets the current partition, and makes sure that we have valid search field and multiplier arrays for this partition.
protected boolean	QuickOr.shouldStoreAll(DiskPartition part, int estSize) Decide whether we should store weights for all documents in a partition.

Constructors in com.sun.labs.minion.retrieval with parameters of type DiskPartition

ArrayGroup(DiskPartition part, int[] docs, int l)
Creates an array group with the specified array of document IDs.

QuickOr(DiskPartition part, int estSize)

ScoredGroup(DiskPartition part, double[] dist)
Creates a scored group from a set of euclidean distances between documents.

ScoredGroup(DiskPartition part, float[] scores)

ScoredGroup(DiskPartition part, int[] docs, float[] scores, int l)
Creates a scored group from the given arrays.

ScoredGroup(DiskPartition part, int[] docs, float[] scores, int l, float sqw)
Creates a scored group from the given arrays.

ScoredQuickOr(DiskPartition part, int estSize)
Creates a quick or for a given partition.

Uses of DiskPartition in com.sun.labs.minion.retrieval.cache

Fields in com.sun.labs.minion.retrieval.cache declared as DiskPartition

protected DiskPartition	TermCache.part
protected DiskPartition	TermCacheElement.part

Fields in com.sun.labs.minion.retrieval.cache with type parameters of type DiskPartition

protected java.util.Map<DiskPartition,DictionaryIterator>

DocCache.m

Methods in com.sun.labs.minion.retrieval.cache with parameters of type DiskPartition

DocCacheElement	DocCache.get(DocKeyEntry dke, java.lang.String field, DiskPartition p)
DocCacheElement	DocCache.get(java.lang.String key, java.lang.String field, DiskPartition p)

Constructors in com.sun.labs.minion.retrieval.cache with parameters of type DiskPartition

DocCacheElement(DocKeyEntry key, DiskPartition part, java.lang.String field, WeightingFunction wf, WeightingComponents wc)
Creates an element in a document term cache.

FieldedTermCacheElement(java.util.List<java.lang.String> terms, PostingsIteratorFeatures feat, DiskPartition part)
Creates a cache element with a given name.

TermCache(DiskPartition part)

TermCache(int size, DiskPartition part)

TermCacheElement(java.util.List<java.lang.String> terms, PostingsIteratorFeatures feat, DiskPartition part)
Creates a cache element.

Uses of DiskPartition in com.sun.labs.minion.test

Methods in com.sun.labs.minion.test that return types with arguments of type DiskPartition

java.util.List<DiskPartition>

Deleter.getMerging()

Methods in com.sun.labs.minion.test with parameters of type DiskPartition

static void

DelDuringMerge.deleter(DiskPartition dp, java.util.List<java.lang.Integer> docs)

Uses of DiskPartition in com.sun.labs.minion.test.regression

Methods in com.sun.labs.minion.test.regression with parameters of type DiskPartition

void	DVPostingsTester.DocumentPartition.compareFrequenciesFromDocumentIterator(java.util.Iterator documentIterator, DiskPartition partition) Compare the Frequencies of the document vector postings with those accumulated from the main dictionary
void	DVPostingsTester.DocumentPartition.createDocuments(DiskPartition partition) Create the empty collection of documents to be maintained by this DocumentPartition
void	IndexInverter.DocumentPartition.createDocuments(DiskPartition partition) Create the empty collection of documents to be maintained by this DocumentPartition
void	DVPostingsTester.DocumentPartition.createFrequenciesFromMainDictionaryIterator(DictionaryIterator mainDictionaryIterator, DiskPartition partition) Accumulate the frequencies from the main dictionary