edu.ucla.sspace.evaluation

Class AbstractWordPrimingTest

java.lang.Object

edu.ucla.sspace.evaluation.AbstractWordPrimingTest

All Implemented Interfaces:

WordPrimingTest

Direct Known Subclasses:

OnePairPerLinePrimingTest

public abstract class AbstractWordPrimingTest
extends Object
implements WordPrimingTest

A test-runner for evaluating the performance of a SemanticSpace on a WordSimilarityEvaluation test.

Author:

Keith Stevens

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	AbstractWordPrimingTest.SimpleWordPrimingReport A simple struct serving as a WordPrimingReport.

Field Summary

Fields

Modifier and Type	Field and Description
protected Set<Pair<String>>	primeTargetPairs A mapping from a word pair to the human association judgement for it

Constructor Summary

Constructors

Constructor and Description
AbstractWordPrimingTest(Set<Pair<String>> primeTargetPairs)

Method Summary

Methods

Modifier and Type	Method and Description
protected abstract Double	computePriming(SemanticSpace sspace, String word1, String word2) Returns the association of the two words on a scale of 0 to 1.
WordPrimingReport	evaluate(SemanticSpace sspace) Evaluates the performance of a given SemanticSpace on a given WordSimilarityEvaluation using the provided similarity metric.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

primeTargetPairs

protected final Set<Pair<String>> primeTargetPairs

A mapping from a word pair to the human association judgement for it

Constructor Detail

AbstractWordPrimingTest

public AbstractWordPrimingTest(Set<Pair<String>> primeTargetPairs)

Parameters:

wordPairToHumanJudgement - A mapping from a word pair to the human association judgement for it

Method Detail

evaluate

public WordPrimingReport evaluate(SemanticSpace sspace)

Evaluates the performance of a given SemanticSpace on a given WordSimilarityEvaluation using the provided similarity metric. Returns a WordSimilarityReport detailing the performance, with similarity scores scaled by the lowest and highest human based similarity ratings.

Specified by:

evaluate in interface WordPrimingTest

Parameters:

sspace - The SemanticSpace to test against

Returns:

A WordSimilarityReport detailing the performance

computePriming

protected abstract Double computePriming(SemanticSpace sspace,
                    String word1,
                    String word2)

Returns the association of the two words on a scale of 0 to 1. Subclasses should override this method to provide specific ways of determining the association of two words in the semantic space, but should ensure that the return value falls with the predefined scale.

Returns:

the assocation between word1 and word2