RDD MLLib Deprecation Question

[John Compitello]

Hey all, 

I see on the MLLib website that there are plans to deprecate the RDD based API 
for MLLib once the new ML API reaches feature parity with RDD based one. Are 
there currently plans to reimplement all the distributed linear algebra / 
matrices operations as part of this new API, or are these things just going 
away? Like, will there still be a BlockMatrix class for distributed multiplies? 

Best, 

John 



-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Spark Conf Problem with CacheLoader

[John Compitello]

Hey all, 

I’ve been working on contributing to Spark a little bit in past few weeks, but 
I’ve suddenly encountered a problem I’m having some trouble with. Specifically, 
however I’ve built Spark on my laptop, I am unable to create a SparkConf. I’ve 
done it in the past, but somehow it’s now broken. When I try to create a 
SparkContext, I get a “NoClassDefFoundError” on “CacheLoader” from 
com/google/common/cache/CacheLoader. Has  anyone ever run into this before? 

Thanks,

John
-
To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: :40: error: value join is not a member of Unit

[John Compitello]

This is not a mailing list to ask for help with your code not working. This 
mailing list is for Spark Developers. This question would be a better fit for 
StackOverflow, or for the user mailing list u...@spark.apache.org 
 . 

Best, 
John

> On Apr 19, 2017, at 1:43 PM, Bhupendra Mishra  
> wrote:
> 
> Hi All,
> Need your help with subjected error
>  
> following code is executing and  getting error
> 
> cala> val join = 
> bat_first_won.join(total_matches_per_venue).map(x=>(x._1,(x._2._1*100/x._2._2))).map(item
>  => item.swap).sortByKey(false).collect.foreach(println)
> :40: error: value join is not a member of Unit
>  val join = 
> bat_first_won.join(total_matches_per_venue).map(x=>(x._1,(x._2._1*100/x._2._2))).map(item
>  => item.swap).sortByKey(false).collect.foreach(println)
> 

Pull Request Made, Ignored So Far

[John Compitello]

Hi all,

I’m a new Spark contributor who put in a pull request a few days ago: 
https://github.com/apache/spark/pull/17459 


It’s a relatively small, isolated change that should be pretty simple to 
review. It has been a big help in the main project I’m working on 
(https://github.com/hail-is/hail ) so I wanted to contribute 
it back to main Spark. It’s been a few days though, and I haven’t had my branch 
cleared to run tests or any acknowledgement of it all. Is there any process to 
ask someone to review your PR or get it assigned to someone? I’m afraid it’s 
just going to slowly sink down onto later and later pages in the PR list until 
it’s too deep for anyone to be expected to find otherwise. 

Best, 

John