Nobody has any idea ?
> On Mar 31, 2016, at 23:22, Cyril Scetbon <cyril.scet...@free.fr> wrote:
>
> Hi,
>
> I'm having issues to create a StreamingContext with Scala using spark-shell.
> It tries to access the localhost interface and the Application Master is not
> running on this interface :
>
> ERROR ApplicationMaster: Failed to connect to driver at localhost:47257,
> retrying ...
>
> I don't have the issue with Python and pyspark which works fine (you can see
> it uses the ip address) :
>
> ApplicationMaster: Driver now available: 192.168.10.100:43290
>
> I use similar codes though :
>
> test.scala :
> --------------
>
> import org.apache.spark._
> import org.apache.spark.streaming._
> val app = "test-scala"
> val conf = new SparkConf().setAppName(app).setMaster("yarn-client")
> val ssc = new StreamingContext(conf, Seconds(3))
>
> command used : spark-shell -i test.scala
>
> test.py :
> -----------
>
> from pyspark import SparkConf, SparkContext
> from pyspark.streaming import StreamingContext
> app = "test-python"
> conf = SparkConf().setAppName(app).setMaster("yarn-client")
> sc = SparkContext(conf=conf)
> ssc = StreamingContext(sc, 3)
>
> command used : pyspark test.py
>
> Any idea why scala can't instantiate it ? I thought python was barely using
> scala under the hood, but it seems there are differences. Are there any
> parameters set using Scala but not Python ?
>
> Thanks
> --
> Cyril SCETBON
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
> For additional commands, e-mail: user-h...@spark.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org
