gov.llnl.ontology.mapreduce.stats
Class DependencyOccurrenceCountMR.DependencyOccurrenceCountMapper

java.lang.Object
  org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.hbase.io.ImmutableBytesWritable,org.apache.hadoop.hbase.client.Result,KEYOUT,VALUEOUT>
      org.apache.hadoop.hbase.mapreduce.TableMapper<K,V>
          gov.llnl.ontology.mapreduce.CorpusTableMR.CorpusTableMapper<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>
              gov.llnl.ontology.mapreduce.stats.DependencyOccurrenceCountMR.DependencyOccurrenceCountMapper

Enclosing class:

DependencyOccurrenceCountMR

public static class DependencyOccurrenceCountMR.DependencyOccurrenceCountMapper
extends CorpusTableMR.CorpusTableMapper<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Iterates through each DependencyTreeNode and finds all valid paths from that node to other nodes in the sentence. Each co-occurrence is emitted with it's total count in the whole document.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.Mapper

org.apache.hadoop.mapreduce.Mapper.Context

Field Summary

Fields inherited from class gov.llnl.ontology.mapreduce.CorpusTableMR.CorpusTableMapper

table

Constructor Summary

DependencyOccurrenceCountMR.DependencyOccurrenceCountMapper()

Method Summary

void	map(org.apache.hadoop.hbase.io.ImmutableBytesWritable key, org.apache.hadoop.hbase.client.Result row, org.apache.hadoop.mapreduce.Mapper.Context context)
void	setup(org.apache.hadoop.mapreduce.Mapper.Context context, org.apache.hadoop.conf.Configuration conf) Sets up any addition data classes or information needed by the CorpusTableMR.CorpusTableMapper.

Methods inherited from class gov.llnl.ontology.mapreduce.CorpusTableMR.CorpusTableMapper

setup

Methods inherited from class org.apache.hadoop.mapreduce.Mapper

cleanup, run

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

DependencyOccurrenceCountMR.DependencyOccurrenceCountMapper

public DependencyOccurrenceCountMR.DependencyOccurrenceCountMapper()

Method Detail

setup

public void setup(org.apache.hadoop.mapreduce.Mapper.Context context,
                  org.apache.hadoop.conf.Configuration conf)
           throws IOException,
                  InterruptedException

Sets up any addition data classes or information needed by the CorpusTableMR.CorpusTableMapper. By default, this does nothing.

Overrides:

setup in class CorpusTableMR.CorpusTableMapper<org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Throws:

IOException

InterruptedException

map

public void map(org.apache.hadoop.hbase.io.ImmutableBytesWritable key,
                org.apache.hadoop.hbase.client.Result row,
                org.apache.hadoop.mapreduce.Mapper.Context context)
         throws IOException,
                InterruptedException

Overrides:

map in class org.apache.hadoop.mapreduce.Mapper<org.apache.hadoop.hbase.io.ImmutableBytesWritable,org.apache.hadoop.hbase.client.Result,org.apache.hadoop.io.Text,org.apache.hadoop.io.Text>

Throws:

IOException

InterruptedException