org.deeplearning4j.text.tokenization.tokenizer.preprocessor

Class EndingPreProcessor

java.lang.Object

org.deeplearning4j.text.tokenization.tokenizer.preprocessor.EndingPreProcessor

All Implemented Interfaces:

TokenPreProcess

public class EndingPreProcessor
extends Object
implements TokenPreProcess

Gets rid of endings: ed,ing, ly, s, .

Author:

Adam Gibson

Constructor Summary

Constructors

Constructor and Description
EndingPreProcessor()

Method Summary

Modifier and Type	Method and Description
String	preProcess(String token) Pre process a token

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

EndingPreProcessor

public EndingPreProcessor()

Method Detail

preProcess

public String preProcess(String token)

Description copied from interface: TokenPreProcess

Pre process a token

Specified by:

preProcess in interface TokenPreProcess

Parameters:

token - the token to pre process

Returns:

the preprocessed token