Package edu.stanford.nlp.international.spanish.pipeline

Class MultiWordPreprocessor

java.lang.Object

edu.stanford.nlp.international.spanish.pipeline.MultiWordPreprocessor

public final class MultiWordPreprocessor
extends Object

Clean up an AnCora treebank which has been processed to expand multi-word tokens into separate leaves. (This prior splitting task is performed by SpanishTreeNormalizer through the SpanishXMLTreeReader class).

Author:

Jon Gauthier, Spence Green (original French version)

Constructor Summary

Constructors

Constructor	Description
MultiWordPreprocessor()

Method Summary

Modifier and Type	Method	Description
static void	main(String[] args)
static void	traverseAndFix(Tree t, Tree parent, TwoDimensionalCounter<String,String> unigramTagger, boolean retainNER)
static void	updateTagger(TwoDimensionalCounter<String,String> tagger, Tree t)	Source training data for a unigram tagger from the given tree.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MultiWordPreprocessor

public MultiWordPreprocessor()

Method Detail

updateTagger

public static void updateTagger(TwoDimensionalCounter<String,String> tagger,
                                Tree t)

Source training data for a unigram tagger from the given tree.

traverseAndFix

public static void traverseAndFix(Tree t,
                                  Tree parent,
                                  TwoDimensionalCounter<String,String> unigramTagger,
                                  boolean retainNER)

main

public static void main(String[] args)

Parameters:

args -