Re: Running Spark on EMR

2017-01-16 Thread Everett Anderson
> From: Andrew Holway >> Date: 1/15/17 11:37 AM (GMT-05:00) >> To: Marco Mistroni >> Cc: Neil Jonkers , User >> Subject: Re: Running Spark on EMR >> >> Darn. I didn't respond to the list. Sorry. >> >> >> >> On Sun, Jan 15, 2017 at 5:2

Re: Running Spark on EMR

2017-01-15 Thread Andrew Holway
5/17 11:37 AM (GMT-05:00) > To: Marco Mistroni > Cc: Neil Jonkers , User > Subject: Re: Running Spark on EMR > > Darn. I didn't respond to the list. Sorry. > > > > On Sun, Jan 15, 2017 at 5:29 PM, Marco Mistroni > wrote: > >> thanks Neil. I followed origin

Re: Running Spark on EMR

2017-01-15 Thread Darren Govoni
So what was the answer? Sent from my Verizon, Samsung Galaxy smartphone Original message From: Andrew Holway Date: 1/15/17 11:37 AM (GMT-05:00) To: Marco Mistroni Cc: Neil Jonkers , User Subject: Re: Running Spark on EMR Darn. I didn't respond to the list. Sorry.

Re: Running Spark on EMR

2017-01-15 Thread Andrew Holway
o, >> >> Can you drop the url: >> >> spark://master:7077 >> >> The url is used when running Spark in standalone mode. >> >> Regards >> >> >> Original message ---- >> From: Marco Mistroni >> Date:15/01/20

Re: Running Spark on EMR

2017-01-15 Thread Marco Mistroni
one mode. > > Regards > > > Original message > From: Marco Mistroni > Date:15/01/2017 16:34 (GMT+02:00) > To: User > Subject: Running Spark on EMR > > hi all > could anyone assist here? > i am trying to run spark 2.0.0 on an EMR cluster,but i am having issues

Re: Running Spark on EMR

2017-01-15 Thread Neil Jonkers
Hello, Can you drop the url:  spark://master:7077 The url is used when running Spark in standalone mode. Regards Original message From: Marco Mistroni Date:15/01/2017 16:34 (GMT+02:00) To: User Subject: Running Spark on EMR hi all could anyone assist here? i am

Running Spark on EMR

2017-01-15 Thread Marco Mistroni
hi all could anyone assist here? i am trying to run spark 2.0.0 on an EMR cluster,but i am having issues connecting to the master node So, below is a snippet of what i am doing sc = SparkSession.builder.master(sparkHost).appName("DataProcess").getOrCreate() sparkHost is passed as input paramete