Thanks for feedback.
%spark.r
print("Hello World!")
throws exception [2].
Understood - I'll try to remove -Pr and rebuild Zeppelin. Yep, I used a
fresh master snapshot.
( I have't seen anything in maven build logs that could indicate a problem
around R interpreter)
Will update this email thread
Hi moon soo Lee,
Cloudera's Spark doesn't have $SPARK_HOME/bin/sparkR
Would Zeppelin still enable its sparkR interpreter then?
Built Zeppelin using
$ mvn clean package -DskipTests -Pspark-2.1 -Ppyspark
> -Dhadoop.version=2.6.0-cdh5.10.1 -Phadoop-2.6 -Pyarn *-Pr* -Pvendor-repo
> -Pscala-2.10 -pl
Easiest way to figure out what your environment needs is,
1. run SPARK_HOME/bin/sparkR in your shell and make sure it works in the
same host where Zeppelin going to run.
2. try use %spark.r in Zeppelin with SPARK_HOME configured. Normally it
should work when 1) works without problem, otherwise
I'm not 100% sure as I haven't set it up but it looks like I'm using
Zeppelin preconfigured with Spark and I've also taken a snapshot of the
Spark Interpreter configuration that I have access to/using in Zeppelin.
This interpreter comes with SQL and Python integration and I'm figuring out
how do I
AFAIK, Amazon EMR service has an option that launches Zeppelin
(preconfigured) with Spark. Do you use Zeppelin provided by EMR or are you
setting up Zeppelin separately?
Thanks,
moon
On Sat, Mar 18, 2017 at 4:13 PM Shanmukha Sreenivas Potti <
shanmu...@utexas.edu> wrote:
>
> Hi Moon,
>
>
Hi Moon,
Thanks for responding. Exporting Spark_home is exactly where I have a
problem. I'm using Zeppelin notebook with Spark on EMR clusters from an AWS
account on cloud. I'm not the master account holder for that AWS account
but I'm guessing I'm a client account with limited access
If you don't have spark cluster, then you don't need to do 2).
After 1) %spark.r interpreter should work.
If you do have spark cluster, export SPARK_HOME env variable in
conf/zeppelin-env.sh, that should be enough make it work.
Hope this helps.
Thanks,
moon
On Fri, Mar 17, 2017 at 2:41 PM
