edu.ucla.sspace.text.corpora

Class PukWacCorpusReader

java.lang.Object

edu.ucla.sspace.text.corpora.PukWacCorpusReader

All Implemented Interfaces:

CorpusReader<Document>

public class PukWacCorpusReader
extends Object
implements CorpusReader<Document>

Reads full documents from a parsed UkWac or Wackypedia corpus. The corpus is expected to be in full XML, with text tags delmiting documents and s tags delmiting sentences. All sentences for a document will be returned in the same document. Any other additional information in the corpus is discarded.

Author:

Keith Stevens

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	PukWacCorpusReader.UkWacIterator

Constructor Summary

Constructors

Constructor and Description
PukWacCorpusReader()

Method Summary

Methods

Modifier and Type	Method and Description
Iterator<Document>	read(File file) Returns a Iterator that traverses the documents containted in the given file.
Iterator<Document>	read(Reader baseReader) Retrusn a Iterator that traverses the documents contained in baseReader.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PukWacCorpusReader

public PukWacCorpusReader()

Method Detail

read

public Iterator<Document> read(File file)

Returns a Iterator that traverses the documents containted in the given file.

Specified by:

read in interface CorpusReader<Document>

Parameters:

file - A text file holding documents in a format that is readable by a particular CorpusReader. This text file may have it's own unique text structure or an xml format. Each CorpusReader should specify the expected text format.

read

public Iterator<Document> read(Reader baseReader)

Retrusn a Iterator that traverses the documents contained in baseReader.

Specified by:

read in interface CorpusReader<Document>

Parameters:

baseReader - A Reader that will extract text from a data source, such as a URL, a File, a data stream, or any other source accesible via the Reader interface. Each CorpusReader should specify the expected text format, be it an XML schema or some other unique format.