Re: No SparkR on Mesos?

Hi, Rodrick, Interesting. SparkR is expected not to work with Mesos due to lack of support for mesos in some places, and it has not been tested yet. Have you modified Spark source code by yourself? Have you deployed Spark binary distribution on all salve nodes, and set

Re: No SparkR on Mesos?

We've been using SparkR on Mesos for quite sometime with no issues. [fedora@prod-rstudio-1 ~]$ /opt/spark-1.6.1/bin/sparkR R version 3.3.0 (2016-05-03) -- "Supposedly Educational" Copyright (C) 2016 The R Foundation for Statistical Computing Platform: x86_64-redhat-linux-gnu (64-bit)

Re: No SparkR on Mesos?

Python should be supported as I tested it, patches should already be merged 1.6.2. Tim > On Sep 8, 2016, at 1:20 AM, Michael Gummelt wrote: > > Quite possibly. I've never used it. I know Python was "unsupported" for a > while, which turned out to mean there was a

Re: No SparkR on Mesos?

This is correct - SparkR is not quite working completely on Mesos. JIRAs and contributions welcome! On Wed, Sep 7, 2016 at 10:21 AM -0700, "Michael Gummelt" > wrote: Quite possibly. I've never used it. I know Python was "unsupported"

Re: No SparkR on Mesos?

Quite possibly. I've never used it. I know Python was "unsupported" for a while, which turned out to mean there was a silly conditional that would fail the submission, even though all the support was there. Could be the same for R. Can you submit a JIRA? On Wed, Sep 7, 2016 at 5:02 AM, Peter

No SparkR on Mesos?

Hello, does SparkR really not work (yet?) on Mesos (Spark 2.0 on Mesos 1.0)? $ /opt/spark/bin/sparkR R version 3.3.1 (2016-06-21) -- "Bug in Your Hair" Copyright (C) 2016 The R Foundation for Statistical Computing Platform: x86_64-pc-linux-gnu (64-bit) Launching java with spark-submit command