Re: Status of MLI?

2014-04-02 Thread Krakna H
ib is the first component of MLbase - MLI and the higher levels of the > stack are still being developed. Look for updates in terms of our progress > on the hyperparameter tuning/model selection problem in the next month or > so! > > - Evan > > > On Tue, Apr 1, 2014 at 8:05 PM,

Re: Status of MLI?

2014-04-01 Thread Krakna H
he Spark umbrella, > https://issues.apache.org/jira/browse/SPARK/?selectedTab=com.atlassian.jira.jira-projects-plugin:summary-panel > > -- > Nan Zhu > > On Tuesday, April 1, 2014 at 10:38 PM, Krakna H wrote: > > What is the current development status of MLI/MLBase? I see that the

Status of MLI?

2014-04-01 Thread Krakna H
What is the current development status of MLI/MLBase? I see that the github repo is lying dormant (https://github.com/amplab/MLI) and JIRA has had no activity in the last 30 days ( https://spark-project.atlassian.net/browse/MLI/?selectedTab=com.atlassian.jira.jira-projects-plugin:summary-panel). Is

Re: example of non-line oriented input data?

2014-03-17 Thread Krakna H
hat way? > > Thanks, > Diana > > > On Mon, Mar 17, 2014 at 12:09 PM, Krakna H <[hidden > email]<http://user/SendEmail.jtp?type=node&node=2758&i=0> > > wrote: > >> Katrina, >> >> Not sure if this is what you had in mind, but here's so

Re: example of non-line oriented input data?

2014-03-17 Thread Krakna H
Katrina, Not sure if this is what you had in mind, but here's some simple pyspark code that I recently wrote to deal with JSON files. from pyspark import SparkContext, SparkConf from operator import add import json import random import numpy as np def concatenate_paragraphs(sentence_array):

Contributing pyspark ports

2014-03-16 Thread Krakna H
Is there any documentation on contributing pyspark ports of additions to Spark? I only see guidelines on Scala contributions ( https://cwiki.apache.org/confluence/display/SPARK/Contributing+to+Spark). Specifically, I'm interested in porting mllib and graphx contributions. -- View this message i