How to use a model generated early in a stage in ML pipelines

2016-06-12 Thread Hayri Volkan Agun
. Consider example pipeline where I want to use StringIndexerModel after TFIDF stage. StringIndexer -> TFIDF -> Classification to StringIndexer -> TFIDF -> WorkHere with StringIndexerModel -> Classification Thanks in advance... Hayri Volkan Agun PhD. Student - Anadolu University

OneVsRest SVM - Very Low F-Measure compared to OneVsRest Logistic Regression

2016-06-08 Thread Hayri Volkan Agun
in OneVsRest. What might be the problem? I am using the same features (200125), labels (9), ~1500 training instances, ~500 test instances and OneVsRest for all the compared settings. Thanks in advance... Hayri Volkan Agun PhD. Student - Anadolu University

Re: Spark LBFGS Error with ANN

2016-02-16 Thread Hayri Volkan Agun
face accepts vector-label > pairs. > > > > Best regards, Alexander > > > > *From:* Hayri Volkan Agun [mailto:volkana...@gmail.com] > *Sent:* Monday, February 08, 2016 11:02 AM > *To:* user @spark > *Subject:* Spark LBFGS Error with ANN > > > > I am using Mul

Learning Fails with 4 Number of Layes at ANN Training with SGDOptimizer

2016-02-09 Thread Hayri Volkan Agun
be the problem of this. What should be the parameters? -- Hayri Volkan Agun PhD. Student - Anadolu University

Spark LBFGS Error with ANN

2016-02-08 Thread Hayri Volkan Agun
. Maybe the objective is just poorly behaved? * What is the problem? My objective output is a vector for instance : [1.0 0.0 0.0 1.0] is my label with 4 double values. My network topology is 100,20,4. Thanks in advance Hayri Volkan Agun PhD. Student - Anadolu University

Re: does HashingTF maintain a inverse index?

2015-12-31 Thread Hayri Volkan Agun
words or do I > need to maintain the reverse index my self? I realize there is a chance > some words map to same buck > > Kind regards > > Andy > > -- Hayri Volkan Agun PhD. Student - Anadolu University

Structured Vector Format

2015-12-10 Thread Hayri Volkan Agun
pipeline models... Thanks Hayri Volkan Agun PhD. Student - Anadolu University

Fwd: MLLIB MulticlassMetrics Unable to find class key

2015-08-05 Thread Hayri Volkan Agun
Hi everyone, After a successfull prediction, MulticlassMetrics returns an error for unable to find the key for the class for precision. Is there a way to check whether the metrics contains the class key? -- Hayri Volkan Agun PhD. Student - Anadolu University

Label based MLLib MulticlassMetrics is buggy

2015-08-05 Thread Hayri Volkan Agun
The results in MulticlassMetrics is totally wrong. They are improperly calculated. Confusion matrix may be true I don't know but for each label scores are wrong. -- Hayri Volkan Agun PhD. Student - Anadolu University