Java String Tokenize maxTokenLength(String s)

Here you can find the source of maxTokenLength(String s)

Description

max Token Length

License

Apache License

Declaration

public static int maxTokenLength(String s) 

Method Source Code

//package com.java2s;
/*//  ww w  .  j a  v  a  2  s.c  om
 * Copyright (C) 2012 The Stanford MobiSocial Laboratory
 * 
 * Licensed under the Apache License, Version 2.0 (the "License");
 * you may not use this file except in compliance with the License.
 * You may obtain a copy of the License at
 * 
 * http://www.apache.org/licenses/LICENSE-2.0
 * 
 * Unless required by applicable law or agreed to in writing, software
 * distributed under the License is distributed on an "AS IS" BASIS,
 * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
 * See the License for the specific language governing permissions and
 * limitations under the License.
 */

import java.util.*;

public class Main {
    public static int maxTokenLength(String s) {
        if (s == null)
            return 0;

        int max = 0;
        StringTokenizer st = new StringTokenizer(s);
        while (st.hasMoreTokens()) {
            int tokenLength = st.nextToken().length();
            if (tokenLength > max)
                max = tokenLength;
        }
        return max;
    }
}

Related

  1. getUnitType(String typeToken)
  2. hasSuffix(String _token)
  3. isPOSTag(String token)
  4. isStringFunction(String token)
  5. isToken(String sentence, String searchWord)
  6. parseNMTokens(String nmTokens)
  7. parseString(String in, String token)
  8. readTokens(String line)
  9. removeEmptyStrings(String[] tokens)