Re: Model to detect the gender

2016-06-28 Thread William Colen
Not exactly. You would create a new NER model to replace yours. In this approach you would need a corpus like this: Pierre Vinken , 61 years old , will join the board as a nonexecutive director Nov. 29 . Mr . Vinken is chairman of Elsevier N.V. , the Dutch publishing group . Jessie Robson i

Re: Model to detect the gender

2016-06-28 Thread Damiano Porta
Hi William, Ok, so you are talking about a kind of pipe where we execute: 1. NER (personM for example) 2. Regex (filter to reduce false positives) 3. Plain dictionary (filter as above) ? Yes we can split out model in two for M and F, it is not a big problem, we have a database grouped by gender.

Re: Model to detect the gender

2016-06-28 Thread William Colen
Do you plan to use the surrounding context? If yes, maybe you could try to split NER in two categories: PersonM and PersonF. Just an idea, never read or tried anything like it. You would need a training corpus with these classes. You could add both the plain dictionary and the regex as NER feature

Model to detect the gender

2016-06-28 Thread Damiano Porta
Hello everybody, we built a NER model to find persons (name) inside our documents. We are looking for the best approach to understand if the name is male/female. Possible solutions: - Plain dictionary? - Regex to check the initial and/letters of the name? - Classifier? (naive bayes? Maxent?) Tha

Re: DeepLearning4J as a ML for OpenNLP

2016-06-28 Thread Mattmann, Chris A (3980)
Thanks check out http://github.com/SciSpark/scispark ++ Chris Mattmann, Ph.D. Chief Architect Instrument Software and Science Data Systems Section (398) NASA Jet Propulsion Laboratory Pasadena, CA 91109 USA Office: 168-519, Mailstop:

Re: DeepLearning4J as a ML for OpenNLP

2016-06-28 Thread Tommaso Teofili
I had briefly looked into it a while ago, would be nice to collaborate there. Tommaso Il giorno mar 28 giu 2016 alle 23:26 Mattmann, Chris A (3980) < chris.a.mattm...@jpl.nasa.gov> ha scritto: > Yep I think so - you may also look at SciSpark > http://scispark.jpl.nasa.gov > where we are using D

Re: DeepLearning4J as a ML for OpenNLP

2016-06-28 Thread William Colen
Thank you for pointing, Prof. Chris. Can you please point me the exact project at http://scispark.jpl.nasa.gov/ I should look at? It is huge. Thank you again. William William Colen 2016-06-28 18:26 GMT-03:00 Mattmann, Chris A (3980) < chris.a.mattm...@jpl.nasa.gov>: > Yep I think so - you may a

Re: DeepLearning4J as a ML for OpenNLP

2016-06-28 Thread William Colen
Suneel, I mean an implementation so we can use DL4J to train the OpenNLP models, just like we already do in opennlp.tools.ml package with Maxent, Perceptron, NayveBayes. I think it was Jörn who also did a few others that are in the SandBox: Mallet and Mahout. Thank you! William 2016-06-28 18:27

Re: DeepLearning4J as a ML for OpenNLP

2016-06-28 Thread Suneel Marthi
Are u looking at using ND4J (from Deeplearning4j project) as the Math backend for ML work? If so, yes. From: William Colen To: "dev@opennlp.apache.org" Sent: Tuesday, June 28, 2016 5:23 PM Subject: DeepLearning4J as a ML for OpenNLP Hi, Do you think it would be possible to imple

Re: Sentiment Analysis Parser updates

2016-06-28 Thread Mattmann, Chris A (3980)
Thanks William, this is a great idea. I will discuss it with Anastasija tomorrow. Cheers, Chris ++ Chris Mattmann, Ph.D. Chief Architect Instrument Software and Science Data Systems Section (398) NASA Jet Propulsion Laboratory Pas

Re: DeepLearning4J as a ML for OpenNLP

2016-06-28 Thread Mattmann, Chris A (3980)
Yep I think so - you may also look at SciSpark http://scispark.jpl.nasa.gov where we are using DL4J/ND4J and Breeze interchangeably here. Cheers, Chris ++ Chris Mattmann, Ph.D. Chief Architect Instrument Software and Science Data Sys

DeepLearning4J as a ML for OpenNLP

2016-06-28 Thread William Colen
Hi, Do you think it would be possible to implement a ML based on DL4J? http://deeplearning4j.org/ Thank you William

Re: Sentiment Analysis Parser updates

2016-06-28 Thread William Colen
Hi, I tried your code. Very good work so far! Congratulations. Is the examples/result file corrupted? It has only one line. Do you plan to implement a simple CLI to use it interactively from command line, similar to bin/opennlp Doccat bin/opennlp TokenNameFinder ? Also, do you plan to add eva

Re: Usages of Adaptive features.

2016-06-28 Thread William Colen
You can also activate the monitor from command line, using misclassified and detailedF: bin/opennlp TokenNameFinderCrossValidator Usage: opennlp TokenNameFinderCrossValidator[.ontonotes|.bionlp2004|.conll03|.conll02|.ad|.evalita|.muc6|.brat] [-factory factoryName] [-resources resourcesDir] [-type

Re: Usages of Adaptive features.

2016-06-28 Thread William Colen
https://opennlp.apache.org/documentation/1.6.0/manual/opennlp.html#tools.namefind.training.featuregen Do you have a specific question? You can try the default feature generator and check how your model will perform in terms of precision and recall. You can take a look at the kind of errors (use a