edu.ucla.sspace.text

Class UsenetCorpusReader

java.lang.Object

edu.ucla.sspace.text.DirectoryCorpusReader<Document>

edu.ucla.sspace.text.UsenetCorpusReader

All Implemented Interfaces:

CorpusReader<Document>

Direct Known Subclasses:

TemporalUsenetCorpusReader

public class UsenetCorpusReader
extends DirectoryCorpusReader<Document>

A DirectoryCorpusReader for the Usenet corpus provided by the Westbury Lab. The corpus filenames are expected to remain unchanged from how they were specified, i.e. have the numeric timestamp naming convention.

Author:

Keith Stevens

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	UsenetCorpusReader.InnerIterator

Nested classes/interfaces inherited from class edu.ucla.sspace.text.DirectoryCorpusReader

DirectoryCorpusReader.BaseFileIterator

Constructor Summary

Constructors

Constructor and Description
UsenetCorpusReader() Creates a reader for USENET document, starting with the specified file.
UsenetCorpusReader(boolean includeTimestamps) Creates a reader for USENET document, starting with the specified file and, if includeTimestamps is true, prepending the creation date of each document as the first token in the document.

Method Summary

Methods

Modifier and Type	Method and Description
protected Iterator<Document>	corpusIterator(Iterator<File> fileIter) Returns an Iterator over documents contained in the Files traversed by fileIter.

Methods inherited from class edu.ucla.sspace.text.DirectoryCorpusReader

initialize, read, read

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

UsenetCorpusReader

public UsenetCorpusReader()

Creates a reader for USENET document, starting with the specified file.

UsenetCorpusReader

public UsenetCorpusReader(boolean includeTimestamps)

Creates a reader for USENET document, starting with the specified file and, if includeTimestamps is true, prepending the creation date of each document as the first token in the document.

Method Detail

corpusIterator

protected Iterator<Document> corpusIterator(Iterator<File> fileIter)

Description copied from class: DirectoryCorpusReader

Returns an Iterator over documents contained in the Files traversed by fileIter. Sub-classes are encouraged to sub-class BaseFileIterator for the return value of this method.

Specified by:

corpusIterator in class DirectoryCorpusReader<Document>