Networking problems in Spark 1.6.0

2016-01-05 Thread Yiannis Gkoufas
Hi there, I have been using Spark 1.5.2 on my cluster without a problem and wanted to try Spark 1.6.0. I have the exact same configuration on both clusters. I am able to start the Standalone Cluster but I fail to submit a job getting errors like the following: 16/01/05 14:24:14 INFO

Re: Networking problems in Spark 1.6.0

2016-01-05 Thread Dean Wampler
​Still, it would be good to know what happened exactly. Why did the netty dependency expect Java 8? Did you build your app on a machine with Java 8 and deploy on a Java 7 machine?​ Anyway, I played with the 1.6.0 spark-shell using Java 7 and it worked fine. I also looked at the distribution's

Re: Networking problems in Spark 1.6.0

2016-01-05 Thread Yiannis Gkoufas
Yes, that was the case, the app was built with java 8. But that was the case with Spark 1.5.2 as well and it didn't complain. On 5 January 2016 at 16:40, Dean Wampler wrote: > ​Still, it would be good to know what happened exactly. Why did the netty > dependency expect

Re: Networking problems in Spark 1.6.0

2016-01-05 Thread Yiannis Gkoufas
Hi Dean, thanks so much for the response! It works without a problem now! On 5 January 2016 at 14:33, Dean Wampler wrote: > ConcurrentHashMap.keySet() returning a KeySetView is a Java 8 method. The > Java 7 method returns a Set. Are you running Java 7? What happens if

Re: Networking problems in Spark 1.6.0

2016-01-05 Thread Dean Wampler
ConcurrentHashMap.keySet() returning a KeySetView is a Java 8 method. The Java 7 method returns a Set. Are you running Java 7? What happens if you run Java 8? Dean Wampler, Ph.D. Author: Programming Scala, 2nd Edition (O'Reilly) Typesafe