edu.ucla.sspace.evaluation

Class AbstractNormedWordPrimingTest

java.lang.Object

edu.ucla.sspace.evaluation.AbstractNormedWordPrimingTest

All Implemented Interfaces:

NormedWordPrimingTest

Direct Known Subclasses:

OneNormedQuestionPerLineTest

public abstract class AbstractNormedWordPrimingTest
extends Object
implements NormedWordPrimingTest

Author:

Keith Stevens

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	AbstractNormedWordPrimingTest.SimpleNormedWordPrimingReport A simple NormedWordPrimingReport that serves as a struct.

Field Summary

Fields

Modifier and Type	Field and Description
protected Set<NormedPrimingQuestion>	normedWordQuestions A mapping from a word pair to the human association judgement for it

Constructor Summary

Constructors

Constructor and Description
AbstractNormedWordPrimingTest(Set<NormedPrimingQuestion> primes)

Method Summary

Methods

Modifier and Type	Method and Description
protected abstract double	computeStrength(SemanticSpace sspace, String word1, String word2) Returns the association of the two words on a scale of 0 to 1.
NormedWordPrimingReport	evaluate(SemanticSpace sspace) Evaluates the performance of a given SemanticSpace on a given WordSimilarityEvaluation using the provided similarity metric.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

normedWordQuestions

protected final Set<NormedPrimingQuestion> normedWordQuestions

A mapping from a word pair to the human association judgement for it

Constructor Detail

AbstractNormedWordPrimingTest

public AbstractNormedWordPrimingTest(Set<NormedPrimingQuestion> primes)

Parameters:

wordPairToHumanJudgement - A mapping from a word pair to the human association judgement for it

Method Detail

evaluate

public NormedWordPrimingReport evaluate(SemanticSpace sspace)

Evaluates the performance of a given SemanticSpace on a given WordSimilarityEvaluation using the provided similarity metric. Returns a WordSimilarityReport detailing the performance, with similarity scores scaled by the lowest and highest human based similarity ratings.

Specified by:

evaluate in interface NormedWordPrimingTest

Parameters:

sspace - The SemanticSpace to test against

Returns:

A WordSimilarityReport detailing the performance

computeStrength

protected abstract double computeStrength(SemanticSpace sspace,
                     String word1,
                     String word2)

Returns the association of the two words on a scale of 0 to 1. Subclasses should override this method to provide specific ways of determining the association of two words in the semantic space, but should ensure that the return value falls with the predefined scale.

Returns:

the assocation between word1 and word2