Re: If you use Spark 1.5 and disabled Tungsten mode ...

2015-11-05 Thread Sjoerd Mulder
n from somewhere else. > > This should fix your problem: https://github.com/apache/spark/pull/9372 > > Can you give it a try? > > > > On Tue, Oct 27, 2015 at 9:12 PM, Sjoerd Mulder > wrote: > >> No the job actually doesn't fail, but since our tests is gene

Re: If you use Spark 1.5 and disabled Tungsten mode ...

2015-10-27 Thread Sjoerd Mulder
ng, fallback to interpreted" in the error message). > > On Tue, Oct 27, 2015 at 12:56 PM Sjoerd Mulder > wrote: > >> I have disabled it because of it started generating ERROR's when >> upgrading from Spark 1.4 to 1.5.1 >> >> 2015-10-27T20:50:11.

Re: If you use Spark 1.5 and disabled Tungsten mode ...

2015-10-27 Thread Sjoerd Mulder
I have disabled it because of it started generating ERROR's when upgrading from Spark 1.4 to 1.5.1 2015-10-27T20:50:11.574+0100 ERROR TungstenSort.newOrdering() - Failed to generate ordering, fallback to interpreted java.util.concurrent.ExecutionException: java.lang.Exception: failed to compile: o

Re: Spark driver hangs on start of job

2015-07-02 Thread Sjoerd Mulder
ation on another EC2 application instance > and shut down this current EC2 instance because it can no longer get > cluster resources. Your use case may be different, but at least action can > be taken at an application level. > > Here is some source code, you should be able to locate mo

Spark driver hangs on start of job

2015-06-26 Thread Sjoerd Mulder
Hi, I have a really annoying issue that i cannot replicate consistently, still it happens every +- 100 submissions. (it's a job that's running every 3 minutes). Already reported an issue for this: https://issues.apache.org/jira/browse/SPARK-8592 Here are the Thread dump of the Driver and the Exec