Re: Spark & NLP

[Oleksandr Olgashko]

Factorie (https://github.com/factorie/factorie) might be what you need (i'd
suggest conditional random field/maximum entropy Markov mode for NER).
Also you can use Java's libraries (for example, i'm using opennlp's
implementation of MEMM for close-to-NER-problem in Scala)
Chalk (https://github.com/scalanlp/chalk) is opennlp-based NLP library, it
also may be a good fit.