: user@spark.apache.org<mailto:user@spark.apache.org>
Subject: RE: SQL queries fail in 1.2.0-SNAPSHOT
Hi Reynold,
Seems I am getting a much larger offset than file size.
reading
org.apache.spark.network.FileSegmentManagedBuffer(/mnt/DP_disk2/animal/spark/spark-local-20140930102549-6
Subject: RE: SQL queries fail in 1.2.0-SNAPSHOT
Hi Reynold,
Seems I am getting a much larger offset than file size.
reading
org.apache.spark.network.FileSegmentManagedBuffer(/mnt/DP_disk2/animal/spark/spark-local-20140930102549-622d/11/shuffle_6_191_0.data,
3154043, 588396) (actual file length
)
These are random errors, in most but not every run. And also depend on queries.
Thanks,
Daoyuan
From: Reynold Xin [mailto:r...@databricks.com]
Sent: Tuesday, September 30, 2014 3:48 AM
To: Wang, Daoyuan
Cc: user@spark.apache.org
Subject: Re: SQL queries fail in 1.2.0-SNAPSHOT
Hi Daoyuan,
Do
Hi Daoyuan,
Do you mind applying this patch and look at the exception again?
https://github.com/apache/spark/pull/2580
It has also been merged in master so if you pull from master, you should
have that.
On Mon, Sep 29, 2014 at 1:17 AM, Wang, Daoyuan
wrote:
> Hi all,
>
>
>
> I had some of m
