edu.ucla.sspace.tools

Class PsudoWordSelector

java.lang.Object

edu.ucla.sspace.tools.PsudoWordSelector

public class PsudoWordSelector
extends Object

A utility for selecting a set of pseudo words. It takes in a list of words and their scores, and optionally a list of words that should serve as the basis for any psuedoword. The output will be a list of mappings from the original term to it's pseudo word. This also supports separation by parts of speech. When using parts of speech, confounders will always have the same part of speech.

Author:

Keith Stevens

Constructor Summary

Constructors

Constructor and Description
PsudoWordSelector()

Method Summary

Methods

Modifier and Type	Method and Description
static void	addWord(String word, int index, List<String> words, Map<String,Integer> wordIndices, Map<String,String> pseudoWordMap)
static List<Set<String>>	extractWordList(String wordListFile)
static List<Map<String,Double>>	loadScores(String scoreFile)
static void	main(String[] args)
static Map<String,String>	selectHigh(Map<String,Double> wordScores, Set<String> baseWords)
static Map<String,String>	selectLow(Map<String,Double> wordScores, Set<String> baseWords)
static Map<String,String>	selectMed(Map<String,Double> wordScores, Set<String> baseWords)
static List<Set<String>>	selectWord(List<Map<String,Double>> wordScores, int numWords)
static void	usage(ArgOptions options)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PsudoWordSelector

public PsudoWordSelector()

Method Detail

usage

public static void usage(ArgOptions options)

main

public static void main(String[] args)
                 throws Exception

Throws:

Exception

selectHigh

public static Map<String,String> selectHigh(Map<String,Double> wordScores,
                            Set<String> baseWords)

addWord

public static void addWord(String word,
           int index,
           List<String> words,
           Map<String,Integer> wordIndices,
           Map<String,String> pseudoWordMap)

selectMed

public static Map<String,String> selectMed(Map<String,Double> wordScores,
                           Set<String> baseWords)

selectLow

public static Map<String,String> selectLow(Map<String,Double> wordScores,
                           Set<String> baseWords)

loadScores

public static List<Map<String,Double>> loadScores(String scoreFile)
                                           throws Exception

Throws:

Exception

extractWordList

public static List<Set<String>> extractWordList(String wordListFile)
                                         throws Exception

Throws:

Exception

selectWord

public static List<Set<String>> selectWord(List<Map<String,Double>> wordScores,
                           int numWords)