Java opennlp.tools.tokenize Tokenizer fields, constructors, methods, implement or subclass

Example usage for Java opennlp.tools.tokenize Tokenizer fields, constructors, methods, implement or subclass

  1. HOME
  2. Java
  3. opennlp
  4. opennlp.tools.tokenize.*
  5. Tokenizer

Introduction

In this page you can find the methods, fields and constructors for opennlp.tools.tokenize Tokenizer.

The text is from its open source code.

Method

String[]tokenize(String s)
Splits a string into its atomic parts
Span[]tokenizePos(String s)
Finds the boundaries of atomic parts in a string.