[SHUFFLE]FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2019-03-11 Thread wangfei
Hi all, Non-deterministic FAILED_TO_UNCOMPRESS(5) or ’Stream is corrupted’ errors may occur during shuffle read, described as this JIRA(https://issues.apache.org/jira/browse/SPARK-4105). There is not new comment for a long time in this JIRA. So, Is there anyone seen these errors in

issue of tableau connect to spark sql 1.5

2015-10-16 Thread Wangfei (X)
Hi all! I test tableau(9.1.0 32bit) to read tables form spark sql(build from branch-1.5) using odbc. And found the following issue: # # "[Simba][SQLEngine] (31740) Table or view not found: SPARK.default.src # table "[default].[src]" not exist" and i found a very stange issue that if i r

spark sql insert into table performance issue

2015-06-11 Thread Wangfei (X)
发件人: Wangfei (X) 发送时间: 2015年6月11日 17:33 收件人: user@spark.apache.org 主题: Hi, all We use spark sql to insert data from a text table into a partitioning table and found that if we give more cores to executors the insert performance whold be worse

[no subject]

2015-06-11 Thread Wangfei (X)
Hi, all We use spark sql to insert data from a text table into a partitioning table and found that if we give more cores to executors the insert performance whold be worse. executors numtotal-executor-cores average time for insert task 3

Re: Spark SQL on large number of columns

2015-05-19 Thread Wangfei (X)
And which version are you using 发自我的 iPhone 在 2015年5月19日,18:29,"ayan guha" mailto:guha.a...@gmail.com>> 写道: can you kindly share your code? On Tue, May 19, 2015 at 8:04 PM, madhu phatak mailto:phatak@gmail.com>> wrote: Hi, I am trying run spark sql aggregation on a file with 26k columns.

Re: [Unit Test Failure] Test org.apache.spark.streaming.JavaAPISuite.testCount failed

2015-05-14 Thread Wangfei (X)
Yes it is repeatedly on my locally Jenkins. 发自我的 iPhone 在 2015年5月14日,18:30,"Tathagata Das" mailto:t...@databricks.com>> 写道: Do you get this failure repeatedly? On Thu, May 14, 2015 at 12:55 AM, kf mailto:wangf...@huawei.com>> wrote: Hi, all, i got following error when i run unit test of spa

Re: Is SQLContext thread-safe?

2015-04-30 Thread Wangfei (X)
actually this is a sql parse exception, are you sure your sql is right? 发自我的 iPhone > 在 2015年4月30日,18:50,"Haopu Wang" 写道: > > Hi, in a test on SparkSQL 1.3.0, multiple threads are doing select on a > same SQLContext instance, but below exception is thrown, so it looks > like SQLContext is NOT t