Hi,
Is there anyone who works on hyper parameter optimization algorithms? If
not, is there any interest on the subject. We are thinking about
implementing some of these algorithms and contributing to spark? thoughts?
Lochana
Found this thread from April..
http://mail-archives.apache.org/mod_mbox/spark-user/201404.mbox/%3ccabjxkq6b7sfaxie4+aqtcmd8jsqbznsxsfw6v5o0wwwouob...@mail.gmail.com%3E
Wondering what the status of this.. We are thinking about implementing
these algorithms.. Would be a waste if they are already
SparkConf conf = new
SparkConf().setAppName(LogisticRegression).setMaster(local[4]);
JavaSparkContext sc = new JavaSparkContext(conf);
JavaRDDString lines = sc.textFile(some.csv);
JavaRDDLabeledPoint lPoints = lines.map(new CSVLineParser());
Is there anyway to parse an index
Figured constructor can be used for this purpose..
On 10/24/14 7:57 AM, Lochana Menikarachchi wrote:
SparkConf conf = new
SparkConf().setAppName(LogisticRegression).setMaster(local[4]);
JavaSparkContext sc = new JavaSparkContext(conf);
JavaRDDString lines = sc.textFile(some.csv
-maven-td5615.html
On Mon, Dec 1, 2014 at 4:28 PM, Lochana Menikarachchi
locha...@gmail.com mailto:locha...@gmail.com wrote:
I have spark core and mllib as dependencies for a spark based osgi
service. When I call the model building method through a unit test
(without osgi) it works
-spark-user-list.1001560.n3.nabble.com/Packaging-a-spark-job-using-maven-td5615.html
On Mon, Dec 1, 2014 at 4:28 PM, Lochana Menikarachchi
locha...@gmail.com mailto:locha...@gmail.com wrote:
I have spark core and mllib as dependencies for a spark based osgi
service. When I call the model
We are trying to call spark through an osgi service (with osgifyed
version of assembly.jar). Spark does not work (due to the way spark
reads akka reference.conf) unless we switch the class loader as follows.
Thread.currentThread().setContextClassLoader(JavaSparkContext.class.getClassLoader());
Do we have one-hot encoding in spark MLLib 1.1.1 or 1.2.0 ? It wasn't
available in 1.1.0.
Thanks.
-
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail: dev-h...@spark.apache.org
