edu.stanford.nlp.pipeline

Class CoNLLUReader

java.lang.Object

edu.stanford.nlp.pipeline.CoNLLUReader

public class CoNLLUReader
extends java.lang.Object

A class for reading in CoNLL-U data and creating Annotations.

Author:

Jason Bolton

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	CoNLLUReader.CoNLLUDocument class to store info for a CoNLL-U document
class	CoNLLUReader.CoNLLUSentence class to store info for a CoNLL-U sentence

Field Summary

Fields

Modifier and Type	Field and Description
static java.util.HashMap<java.lang.String,java.lang.String>	classShorthandToFull shorthands for CoreAnnotations
int	columnCount
static java.util.regex.Pattern	COMMENT_LINE patterns to match in CoNLL-U file
static int	CoNLLU_GovField
static int	CoNLLU_IndexField field constants
static int	CoNLLU_LemmaField
static int	CoNLLU_MiscField
static int	CoNLLU_RelnField
static int	CoNLLU_UPOSField
static int	CoNLLU_WordField
static int	CoNLLU_XPOSField
static java.util.regex.Pattern	DOCUMENT_LINE
static java.util.regex.Pattern	MWT_LINE
static java.util.regex.Pattern	TOKEN_LINE

Constructor Summary

Constructors

Constructor and Description
CoNLLUReader()
CoNLLUReader(java.util.Properties props)

Method Summary

Modifier and Type	Method and Description
Annotation	convertCoNLLUDocumentToAnnotation(CoNLLUReader.CoNLLUDocument doc) Convert a CoNLLUDocument into an Annotation The convention is that a CoNLLU document represents a list of sentences, one sentence per line, separated by newline.
CoreMap	convertCoNLLUSentenceToCoreMap(CoNLLUReader.CoNLLUDocument doc, CoNLLUReader.CoNLLUSentence sentence) Convert a list of CoNLL-U token lines into a sentence CoreMap
java.util.List<Annotation>	readCoNLLUFile(java.lang.String filePath) Read a CoNLL-U file and generate a list of Annotations
java.util.List<CoNLLUReader.CoNLLUDocument>	readCoNLLUFileCreateCoNLLUDocuments(java.lang.String filePath) Read a CoNLL-U file and generate a list of CoNLLUDocument objects
java.util.List<java.lang.String>	readCoNLLUFileCreateCoNLLXLines(java.lang.String filePath) Read a CoNLL-U file and generate a list of CoNLL-X lines

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

CoNLLU_IndexField

public static final int CoNLLU_IndexField

field constants

See Also:

Constant Field Values

CoNLLU_WordField

public static final int CoNLLU_WordField

See Also:

Constant Field Values

CoNLLU_LemmaField

public static final int CoNLLU_LemmaField

See Also:

Constant Field Values

CoNLLU_UPOSField

public static final int CoNLLU_UPOSField

See Also:

Constant Field Values

CoNLLU_XPOSField

public static final int CoNLLU_XPOSField

See Also:

Constant Field Values

CoNLLU_GovField

public static final int CoNLLU_GovField

See Also:

Constant Field Values

CoNLLU_RelnField

public static final int CoNLLU_RelnField

See Also:

Constant Field Values

CoNLLU_MiscField

public static final int CoNLLU_MiscField

See Also:

Constant Field Values

columnCount

public int columnCount

COMMENT_LINE

public static java.util.regex.Pattern COMMENT_LINE

patterns to match in CoNLL-U file

DOCUMENT_LINE

public static java.util.regex.Pattern DOCUMENT_LINE

MWT_LINE

public static java.util.regex.Pattern MWT_LINE

TOKEN_LINE

public static java.util.regex.Pattern TOKEN_LINE

classShorthandToFull

public static java.util.HashMap<java.lang.String,java.lang.String> classShorthandToFull

shorthands for CoreAnnotations

Constructor Detail

CoNLLUReader

public CoNLLUReader()
             throws java.lang.ClassNotFoundException

Throws:

java.lang.ClassNotFoundException

CoNLLUReader

public CoNLLUReader(java.util.Properties props)
             throws java.lang.ClassNotFoundException

Throws:

java.lang.ClassNotFoundException

Method Detail

readCoNLLUFile

public java.util.List<Annotation> readCoNLLUFile(java.lang.String filePath)
                                          throws java.io.IOException

Read a CoNLL-U file and generate a list of Annotations

Throws:

java.io.IOException

readCoNLLUFileCreateCoNLLXLines

public java.util.List<java.lang.String> readCoNLLUFileCreateCoNLLXLines(java.lang.String filePath)
                                                                 throws java.io.IOException

Read a CoNLL-U file and generate a list of CoNLL-X lines

Throws:

java.io.IOException

readCoNLLUFileCreateCoNLLUDocuments

public java.util.List<CoNLLUReader.CoNLLUDocument> readCoNLLUFileCreateCoNLLUDocuments(java.lang.String filePath)
                                                                                throws java.io.IOException

Read a CoNLL-U file and generate a list of CoNLLUDocument objects

Throws:

java.io.IOException

convertCoNLLUDocumentToAnnotation

public Annotation convertCoNLLUDocumentToAnnotation(CoNLLUReader.CoNLLUDocument doc)

Convert a CoNLLUDocument into an Annotation The convention is that a CoNLLU document represents a list of sentences, one sentence per line, separated by newline.

convertCoNLLUSentenceToCoreMap

public CoreMap convertCoNLLUSentenceToCoreMap(CoNLLUReader.CoNLLUDocument doc,
                                              CoNLLUReader.CoNLLUSentence sentence)

Convert a list of CoNLL-U token lines into a sentence CoreMap