[
https://issues.apache.org/jira/browse/LENS-436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sharad Agarwal updated LENS-436:
--------------------------------
Attachment: Lens-436-2.patch
Attaching here, having difficulty in attaching to reviewboard.
Fixed the dependencies.
updated docker to install spark home
Added spark-assembly and lens-ml-lib jars in HIVE_AUX_JARS_PATH
Testing
-----------
- ml tests passed
- docker : predict registration, train and test passes. console output:
$LENS_CLIENT/bin/lens-run-class.sh org.apache.lens.ml.impl.MLRunner
$LENS_ML/data/naive_bayes --conf $LENS_CLIENT_CONF
opt_classname is org.apache.lens.ml.impl.MLRunner
args are
/opt/lens/lens-ml-dist/target/apache-lens-2.1.0-beta-incubating-SNAPSHOT-ml//data/naive_bayes
Executing class org.apache.lens.ml.impl.MLRunner
Adding hadoop libs in classpath from /usr/local/hadoop
HIVE_HOME is set, adding
/usr/local/hive-dist/apache-hive-0.13.4-inm-SNAPSHOT-bin/lib/* into lens
classpath
Example: 8d091ff4-e6d9-4de7-aae0-d1871ed6a6f9
Model: MLModel(id=dbaa9471-95f1-4fea-b56b-f89c121f8b8d, createdAt=Thu
Apr 16 04:21:13 UTC 2015, algoName=spark_naive_bayes, table=naive_bayes_train,
params=[feature, feature1, feature, feature2, feature, feature3, label, label],
labelColumn=label, featureColumns=[feature1, feature2, feature3])
Example: 8d091ff4-e6d9-4de7-aae0-d1871ed6a6f9
EvaluationReport: MLTestReport(testTable=naive_bayes_test,
outputTable=null, outputColumn=prediction_result, labelColumn=label,
featureColumns=[feature1, feature2, feature3], algorithm=spark_naive_bayes,
modelID=dbaa9471-95f1-4fea-b56b-f89c121f8b8d,
reportID=32dcc8d4_b1b7_414a_85d0_7e73ac921d8e, queryID=null,
testOutputPath=null, predictionResultColumn=prediction_result, lensQueryID=null)
Created the Model successfully. Output Table: naive_bayes_output
> Fix dependencies in ML distribution
> -----------------------------------
>
> Key: LENS-436
> URL: https://issues.apache.org/jira/browse/LENS-436
> Project: Apache Lens
> Issue Type: Bug
> Components: ml
> Reporter: Sharad Agarwal
> Assignee: Sharad Agarwal
> Attachments: Lens-436-1.patch, Lens-436-2.patch
>
>
> currently all the transitive dependencies are being pulled into the ml dist
> package leading to conflict in versions while deploying the MLService in Lens
> server.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
