Java opennlp.tools.tokenize TokenizerME fields, constructors, methods, implement or subclass

Example usage for Java opennlp.tools.tokenize TokenizerME fields, constructors, methods, implement or subclass

  1. HOME
  2. Java
  3. opennlp
  4. opennlp.tools.tokenize.*
  5. TokenizerME

Introduction

In this page you can find the methods, fields and constructors for opennlp.tools.tokenize TokenizerME.

The text is from its open source code.

Constructor

TokenizerME(TokenizerModel model)

Method

Span[]tokenizePos(String d)
Tokenizes the string.
TokenizerModeltrain(ObjectStream samples, TokenizerFactory factory, TrainingParameters mlParams)
Trains a model for the TokenizerME .