Token is a generic concept. The token could include "word", a separator, and
the part of speech as long as the training and the processing are consistent.
The "tokens" could be:
Pierre Vinken , 61 years old , will join the board as a nonexecutive
director Nov. 29 .
Or
Pierre_NNP Vinken_NNP ,_, 61_CD years_NNS old_JJ ,_, will_MD join_VB the_DT
board_NN as_IN
a_DT nonexecutive_JJ director_NN Nov._NNP 29_CD ._.
-----Original Message-----
From: Zoljargal Munkhjargal [mailto:[email protected]]
Sent: Wednesday, January 29, 2014 6:48 PM
To: [email protected]
Subject: How to add POS tag feature in Namefinder
Dear members,
I am trying to setup the OpenNLP NameFinder in a project with part-of-speech
tag feature. I extended my feature class from
FeatureGeneratorAdapter<http://opennlp.apache.org/documentation/1.5.2-incubating/apidocs/opennlp-tools/opennlp/tools/util/featuregen/FeatureGeneratorAdapter.html>
class,
and overrode following method. Unfortunately this method taking just raw tokens
in parameter. The problem is that how to pass POS tag information in to this
method?
public void createFeatures(List features, String[] tokens, int index, String[]
previousOutcomes)
--
_______________________________
With regards
Zoljargal Munkhjargal
Research Assistant and PhD Student
Information and Communication Technology (ICT)-Doctoral School Department of
Computer Science and Information Engineering.
University of Trento, Italy
