Re: Feedback: Feature request

2015-08-28 Thread Manish Amde
lhs:0,op:=,rhs:-35.0 On Aug 28, 2015 12:03 AM, Manish Amde manish...@gmail.com javascript:_e(%7B%7D,'cvml','manish...@gmail.com'); wrote: Hi James, It's a good idea. A JSON format is more convenient for visualization though a little inconvenient to read. How about toJson() method? It might

Re: Welcoming three new committers

2015-02-03 Thread Manish Amde
Congratulations Cheng, Joseph and Sean. On Tuesday, February 3, 2015, Zhan Zhang zzh...@hortonworks.com wrote: Congratulations! On Feb 3, 2015, at 2:34 PM, Matei Zaharia matei.zaha...@gmail.com javascript:; wrote: Hi all, The PMC recently voted to add three new committers: Cheng Lian,

Re: Quantile regression in tree models

2014-11-18 Thread Manish Amde
how the gradient boosting algorithm is laid out in MLLib? I tried reading the code, but without a Rosetta stone it's impossible to make sense of it. Alex On Mon, Nov 17, 2014 at 8:25 PM, Manish Amde manish...@gmail.com wrote: Hi Alessandro, I think absolute error as splitting criterion

Re: Quantile regression in tree models

2014-11-17 Thread Manish Amde
Hi Alessandro, MLlib v1.1 supports variance for regression and gini impurity and entropy for classification. http://spark.apache.org/docs/latest/mllib-decision-tree.html If the information gain calculation can be performed by distributed aggregation then it might be possible to plug it into the

Re: Quantile regression in tree models

2014-11-17 Thread Manish Amde
guarantees. ... */ By the looks of it, the GradientBoosting API would support an absolute error type loss function to perform quantile regression, except for weak hypothesis weights. Does this refer to the weights of the leaves of the trees? Alex On Mon, Nov 17, 2014 at 2:24 PM, Manish Amde

reduce, transform, combine

2014-05-04 Thread Manish Amde
I am currently using the RDD aggregate operation to reduce (fold) per partition and then combine using the RDD aggregate operation. def aggregate[U: ClassTag](zeroValue: U)(seqOp: (U, T) = U, combOp: (U, U) = U): U I need to perform a transform operation after the seqOp and before the combOp. The

Re: reduce, transform, combine

2014-05-04 Thread Manish Amde
://www.linkedin.com/in/dbtsai On Sun, May 4, 2014 at 1:12 AM, Manish Amde manish...@gmail.com wrote: I am currently using the RDD aggregate operation to reduce (fold) per partition and then combine using the RDD aggregate operation. def aggregate[U: ClassTag](zeroValue: U)(seqOp: (U, T) = U, combOp: (U, U