public class CrossProductTokenization extends WordTokenization
SymbolTokenization.TokenTypeAnnotatable.AnnotationForwarderCHARACTER, FIXEDWIDTH, SEPARATED, UNKNOWNANNOTATION| Constructor and Description |
|---|
CrossProductTokenization(Alphabet alpha) |
CrossProductTokenization(Alphabet alpha,
List tokenizers) |
| Modifier and Type | Method and Description |
|---|---|
Symbol |
parseToken(String token)
Returns the symbol for a single token.
|
String |
tokenizeSymbol(Symbol s)
Return a token representing a single symbol.
|
getAlphabet, getAnnotation, getTokenType, parseStream, parseString, splitString, tokenizeSymbolListaddChangeListener, addChangeListener, addForwarder, getForwarders, getListeners, isUnchanging, removeChangeListener, removeChangeListener, removeForwarderclone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, waitaddChangeListener, addChangeListener, isUnchanging, removeChangeListener, removeChangeListenerpublic CrossProductTokenization(Alphabet alpha) throws BioException
BioExceptionpublic CrossProductTokenization(Alphabet alpha, List tokenizers)
public Symbol parseToken(String token) throws IllegalSymbolException
SymbolTokenizationThe Symbol will be a member of the alphabet. If the token is not recognized as mapping to a symbol, an exception will be thrown.
token - the token to retrieve a Symbol forIllegalSymbolException - if there is no Symbol for the tokenpublic String tokenizeSymbol(Symbol s) throws IllegalSymbolException
SymbolTokenizations - The symbolIllegalSymbolException - if the symbol isn't recognized.Copyright © 2020 BioJava. All rights reserved.