edu.ucla.sspace.text.corpora

Class UsenetCorpusReader

java.lang.Object

edu.ucla.sspace.text.DirectoryCorpusReader<Document>

edu.ucla.sspace.text.corpora.UsenetCorpusReader

All Implemented Interfaces:

CorpusReader<Document>

public class UsenetCorpusReader
extends DirectoryCorpusReader<Document>

A DirectoryCorpusReader for the Usenet corpus provided by the Westbury Lab. The corpus filenames are expected to remain unchanged from how they were specified, i.e. have the numeric timestamp naming convention.

Author:

Keith Stevens

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	UsenetCorpusReader.UseNetIterator

Nested classes/interfaces inherited from class edu.ucla.sspace.text.DirectoryCorpusReader

DirectoryCorpusReader.BaseFileIterator

Constructor Summary

Constructors

Constructor and Description
UsenetCorpusReader()
UsenetCorpusReader(DocumentPreprocessor preprocessor)

Method Summary

Methods

Modifier and Type	Method and Description
protected Iterator<Document>	corpusIterator(Iterator<File> files) Returns an Iterator over documents contained in the Files traversed by fileIter.

Methods inherited from class edu.ucla.sspace.text.DirectoryCorpusReader

initialize, read, read

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

UsenetCorpusReader

public UsenetCorpusReader()

UsenetCorpusReader

public UsenetCorpusReader(DocumentPreprocessor preprocessor)

Method Detail

corpusIterator

protected Iterator<Document> corpusIterator(Iterator<File> files)

Description copied from class: DirectoryCorpusReader

Returns an Iterator over documents contained in the Files traversed by fileIter. Sub-classes are encouraged to sub-class BaseFileIterator for the return value of this method.

Specified by:

corpusIterator in class DirectoryCorpusReader<Document>