edu.stanford.nlp.stats

Class MultiClassChunkEvalStats

java.lang.Object

edu.stanford.nlp.stats.MultiClassPrecisionRecallStats<L>

edu.stanford.nlp.stats.MultiClassPrecisionRecallExtendedStats<java.lang.String>

edu.stanford.nlp.stats.MultiClassPrecisionRecallExtendedStats.MultiClassStringLabelStats

edu.stanford.nlp.stats.MultiClassChunkEvalStats

All Implemented Interfaces:

Scorer<java.lang.String>

public class MultiClassChunkEvalStats
extends MultiClassPrecisionRecallExtendedStats.MultiClassStringLabelStats

Calculates phrase based precision and recall (similar to conlleval) Handles various encodings such as IO, IOB, IOE, BILOU, SBEIO, [] Usage: java edu.stanford.nlp.stats.MultiClassChunkEvalStats [options] < filename
-r - Do raw token based evaluation
-d delimiter - Specifies delimiter to use (instead of tab)
-b boundary - Boundary token (default is -X- )
-t defaultTag - Default tag to use if tag is not prefixed (i.e. is not X-xxx )
-ignoreProvidedTag - Discards the provided tag (i.e. if label is X-xxx, just use xxx for evaluation)

Author:

Angel Chang

Nested Class Summary

Nested classes/interfaces inherited from class edu.stanford.nlp.stats.MultiClassPrecisionRecallExtendedStats

MultiClassPrecisionRecallExtendedStats.MultiClassStringLabelStats, MultiClassPrecisionRecallExtendedStats.StringStringConverter

Field Summary

Fields inherited from class edu.stanford.nlp.stats.MultiClassPrecisionRecallExtendedStats

correctGuesses, foundCorrect, foundGuessed, noLabel, stringConverter, tokensCorrect, tokensCount

Fields inherited from class edu.stanford.nlp.stats.MultiClassPrecisionRecallStats

fnCount, fpCount, labelIndex, negIndex, negLabel, tpCount

Constructor Summary

Constructors

Constructor and Description
MultiClassChunkEvalStats(Classifier<java.lang.String,F> classifier, GeneralDataset<java.lang.String,F> data, java.lang.String negLabel)
MultiClassChunkEvalStats(Index<java.lang.String> dataLabelIndex, java.lang.String negLabel)
MultiClassChunkEvalStats(java.lang.String negLabel)

Method Summary

Modifier and Type	Method and Description
protected void	addGuess(LabeledChunkIdentifier.LabelTagType guess, LabeledChunkIdentifier.LabelTagType correct, boolean addUnknownLabels)
protected void	addGuess(java.lang.String guess, java.lang.String trueLabel, boolean addUnknownLabels)
void	clearCounts()
protected void	finalizeCounts()
LabeledChunkIdentifier	getChunker()
java.lang.String	getConllEvalString()
static void	main(java.lang.String[] args)
protected void	markBoundary()

Methods inherited from class edu.stanford.nlp.stats.MultiClassPrecisionRecallExtendedStats

addGuess, addGuesses, getAccuracy, getAccuracyDescription, getAccuracyInfo, getConllEvalString, getCorrect, getCorrect, getLabels, getRelevant, getRelevant, getRetrieved, getRetrieved, score, score, score, score, score, score, score, score, setLabelIndex

Methods inherited from class edu.stanford.nlp.stats.MultiClassPrecisionRecallStats

getDescription, getF1Description, getF1Description, getFMeasure, getFMeasure, getNegLabel, getPrecision, getPrecision, getPrecisionDescription, getPrecisionDescription, getPrecisionInfo, getPrecisionInfo, getRecall, getRecall, getRecallDescription, getRecallDescription, getRecallInfo, getRecallInfo, score

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

MultiClassChunkEvalStats

public MultiClassChunkEvalStats(Classifier<java.lang.String,F> classifier,
                                GeneralDataset<java.lang.String,F> data,
                                java.lang.String negLabel)

MultiClassChunkEvalStats

public MultiClassChunkEvalStats(java.lang.String negLabel)

MultiClassChunkEvalStats

public MultiClassChunkEvalStats(Index<java.lang.String> dataLabelIndex,
                                java.lang.String negLabel)

Method Detail

getChunker

public LabeledChunkIdentifier getChunker()

clearCounts

public void clearCounts()

Overrides:

clearCounts in class MultiClassPrecisionRecallExtendedStats<java.lang.String>

finalizeCounts

protected void finalizeCounts()

Overrides:

finalizeCounts in class MultiClassPrecisionRecallExtendedStats<java.lang.String>

markBoundary

protected void markBoundary()

Overrides:

markBoundary in class MultiClassPrecisionRecallExtendedStats<java.lang.String>

addGuess

protected void addGuess(java.lang.String guess,
                        java.lang.String trueLabel,
                        boolean addUnknownLabels)

Overrides:

addGuess in class MultiClassPrecisionRecallExtendedStats<java.lang.String>

addGuess

protected void addGuess(LabeledChunkIdentifier.LabelTagType guess,
                        LabeledChunkIdentifier.LabelTagType correct,
                        boolean addUnknownLabels)

getConllEvalString

public java.lang.String getConllEvalString()

Overrides:

getConllEvalString in class MultiClassPrecisionRecallExtendedStats<java.lang.String>

main

public static void main(java.lang.String[] args)