[jira] [Commented] (SPARK-10667) Add 86 Runnable TPCDS Queries into spark-sql-perf

2015-09-17 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14804318#comment-14804318 ] JESSE CHEN commented on SPARK-10667: Done. > Add 86 Runnable TPCDS Queries into spark-sql-perf >

[jira] [Updated] (SPARK-10667) Add 86 Runnable TPCDS Queries into spark-sql-perf

2015-09-17 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-10667: --- Summary: Add 86 Runnable TPCDS Queries into spark-sql-perf (was: Add 90 Runnable TPCDS Queries into

[jira] [Created] (SPARK-10667) Add 90 Runnable TPCDS Queries into spark-sql-perf

2015-09-17 Thread JESSE CHEN (JIRA)
JESSE CHEN created SPARK-10667: -- Summary: Add 90 Runnable TPCDS Queries into spark-sql-perf Key: SPARK-10667 URL: https://issues.apache.org/jira/browse/SPARK-10667 Project: Spark Issue Type:

[jira] [Commented] (SPARK-13288) [1.6.0] Memory leak in Spark streaming

2016-06-23 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15347338#comment-15347338 ] JESSE CHEN commented on SPARK-13288: [~AlexSparkJiang]The code is: val multiTweetStreams=(1 to

[jira] [Commented] (SPARK-13288) [1.6.0] Memory leak in Spark streaming

2016-02-12 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145148#comment-15145148 ] JESSE CHEN commented on SPARK-13288: Maybe "heap exhaustion" a better term to call this. jstat

[jira] [Commented] (SPARK-13288) [1.6.0] Memory leak in Spark streaming

2016-02-12 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15145174#comment-15145174 ] JESSE CHEN commented on SPARK-13288: I have the heapdumps from 1.5 and 1.6. They are large so let me

[jira] [Created] (SPARK-13288) [1.6.0] Memory leak in Spark streaming

2016-02-11 Thread JESSE CHEN (JIRA)
JESSE CHEN created SPARK-13288: -- Summary: [1.6.0] Memory leak in Spark streaming Key: SPARK-13288 URL: https://issues.apache.org/jira/browse/SPARK-13288 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-13307) TPCDS query 66 degraded by 30% in 1.6.0 compared to 1.4.1

2016-02-13 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15146138#comment-15146138 ] JESSE CHEN commented on SPARK-13307: Have you looked at the plans? I provided at above links. >

[jira] [Commented] (SPARK-13288) [1.6.0] Memory leak in Spark streaming

2016-02-22 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15157725#comment-15157725 ] JESSE CHEN commented on SPARK-13288: The code is simple but I can't share the data per legal

[jira] [Commented] (SPARK-13288) [1.6.0] Memory leak in Spark streaming

2016-02-23 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15159450#comment-15159450 ] JESSE CHEN commented on SPARK-13288: I enabled "spark.memory.useLegacyMode", and out of memory still

[jira] [Commented] (SPARK-13307) TPCDS query 66 degraded by 30% in 1.6.0 compared to 1.4.1

2016-02-23 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15159636#comment-15159636 ] JESSE CHEN commented on SPARK-13307: I tuned up the autoBroadcastJoinThreshold to 100MB, made no

[jira] [Commented] (SPARK-13307) TPCDS query 66 degraded by 30% in 1.6.0 compared to 1.4.1

2016-02-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15146740#comment-15146740 ] JESSE CHEN commented on SPARK-13307: Uploaded newly collected plans (logical, analyzed, optimized and

[jira] [Updated] (SPARK-13307) TPCDS query 66 degraded by 30% in 1.6.0 compared to 1.4.1

2016-02-12 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13307: --- Summary: TPCDS query 66 degraded by 30% in 1.6.0 compared to 1.4.1 (was: TPCDS query 66 degraded by

[jira] [Created] (SPARK-13307) TPCDS query 66 degraded by 35% in 1.6.0 compared to 1.4.1

2016-02-12 Thread JESSE CHEN (JIRA)
JESSE CHEN created SPARK-13307: -- Summary: TPCDS query 66 degraded by 35% in 1.6.0 compared to 1.4.1 Key: SPARK-13307 URL: https://issues.apache.org/jira/browse/SPARK-13307 Project: Spark Issue

[jira] [Commented] (SPARK-13859) TPCDS query 38 returns wrong results compared to TPC official result set

2016-03-18 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15199885#comment-15199885 ] JESSE CHEN commented on SPARK-13859: Testing both Q87 and Q38. Back shortly with results. > TPCDS

[jira] [Updated] (SPARK-13860) TPCDS query 39 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13860: --- Description: Testing Spark SQL using TPC queries. Query 39 returns wrong results compared to

[jira] [Created] (SPARK-13861) TPCDS query 40 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
JESSE CHEN created SPARK-13861: -- Summary: TPCDS query 40 returns wrong results compared to TPC official result set Key: SPARK-13861 URL: https://issues.apache.org/jira/browse/SPARK-13861 Project: Spark

[jira] [Updated] (SPARK-13864) TPCDS query 74 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13864: --- Description: Testing Spark SQL using TPC queries. Query 74 returns wrong results compared to

[jira] [Created] (SPARK-13864) TPCDS query 74 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
JESSE CHEN created SPARK-13864: -- Summary: TPCDS query 74 returns wrong results compared to TPC official result set Key: SPARK-13864 URL: https://issues.apache.org/jira/browse/SPARK-13864 Project: Spark

[jira] [Created] (SPARK-13859) TPCDS query 24b returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
JESSE CHEN created SPARK-13859: -- Summary: TPCDS query 24b returns wrong results compared to TPC official result set Key: SPARK-13859 URL: https://issues.apache.org/jira/browse/SPARK-13859 Project:

[jira] [Created] (SPARK-13865) TPCDS query 87 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
JESSE CHEN created SPARK-13865: -- Summary: TPCDS query 87 returns wrong results compared to TPC official result set Key: SPARK-13865 URL: https://issues.apache.org/jira/browse/SPARK-13865 Project: Spark

[jira] [Created] (SPARK-13860) TPCDS query 39 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
JESSE CHEN created SPARK-13860: -- Summary: TPCDS query 39 returns wrong results compared to TPC official result set Key: SPARK-13860 URL: https://issues.apache.org/jira/browse/SPARK-13860 Project: Spark

[jira] [Updated] (SPARK-13859) TPCDS query 38 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13859: --- Description: Testing Spark SQL using TPC queries. Query 38 returns wrong results compared to

[jira] [Updated] (SPARK-13861) TPCDS query 40 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13861: --- Description: Testing Spark SQL using TPC queries. Query 40 returns wrong results compared to

[jira] [Updated] (SPARK-13860) TPCDS query 39 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13860: --- Labels: tpcds-result-mismatch (was: ) > TPCDS query 39 returns wrong results compared to TPC

[jira] [Updated] (SPARK-13859) TPCDS query 38 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13859: --- Labels: tpcds-result-mismatch (was: ) > TPCDS query 38 returns wrong results compared to TPC

[jira] [Updated] (SPARK-13858) TPCDS query 21 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13858: --- Labels: tpcds-result-mismatch (was: ) > TPCDS query 21 returns wrong results compared to TPC

[jira] [Commented] (SPARK-13862) TPCDS query 49 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193800#comment-15193800 ] JESSE CHEN commented on SPARK-13862: tpcds-result-mismatch > TPCDS query 49 returns wrong results

[jira] [Updated] (SPARK-13863) TPCDS query 66 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13863: --- Description: Testing Spark SQL using TPC queries. Query 66 returns wrong results compared to

[jira] [Updated] (SPARK-13864) TPCDS query 74 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13864: --- Labels: tpcds-result-mismatch (was: ) > TPCDS query 74 returns wrong results compared to TPC

[jira] [Updated] (SPARK-13865) TPCDS query 87 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13865: --- Labels: tpcds-result-mismatch (was: ) > TPCDS query 87 returns wrong results compared to TPC

[jira] [Updated] (SPARK-13862) TPCDS query 49 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13862: --- Description: Testing Spark SQL using TPC queries. Query 49 returns wrong results compared to

[jira] [Created] (SPARK-13863) TPCDS query 66 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
JESSE CHEN created SPARK-13863: -- Summary: TPCDS query 66 returns wrong results compared to TPC official result set Key: SPARK-13863 URL: https://issues.apache.org/jira/browse/SPARK-13863 Project: Spark

[jira] [Updated] (SPARK-13865) TPCDS query 87 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13865: --- Description: Testing Spark SQL using TPC queries. Query 87 returns wrong results compared to

[jira] [Updated] (SPARK-13861) TPCDS query 40 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13861: --- Labels: tpcds-result-mismatch (was: ) > TPCDS query 40 returns wrong results compared to TPC

[jira] [Updated] (SPARK-13863) TPCDS query 66 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13863: --- Labels: tpcds-result-mismatch (was: ) > TPCDS query 66 returns wrong results compared to TPC

[jira] [Updated] (SPARK-13862) TPCDS query 49 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13862: --- Labels: tpcds-result-mismatch (was: ) > TPCDS query 49 returns wrong results compared to TPC

[jira] [Updated] (SPARK-13858) TPCDS query 21 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13858: --- Description: Testing Spark SQL using TPC queries. Query 21 returns wrong results compared to

[jira] [Created] (SPARK-13858) TPCDS query 21 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
JESSE CHEN created SPARK-13858: -- Summary: TPCDS query 21 returns wrong results compared to TPC official result set Key: SPARK-13858 URL: https://issues.apache.org/jira/browse/SPARK-13858 Project: Spark

[jira] [Updated] (SPARK-13858) TPCDS query 21 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13858: --- Description: Testing Spark SQL using TPC queries. Query 21 returns wrong results compared to

[jira] [Created] (SPARK-13862) TPCDS query 49 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
JESSE CHEN created SPARK-13862: -- Summary: TPCDS query 49 returns wrong results compared to TPC official result set Key: SPARK-13862 URL: https://issues.apache.org/jira/browse/SPARK-13862 Project: Spark

[jira] [Updated] (SPARK-13859) TPCDS query 38 returns wrong results compared to TPC official result set

2016-03-14 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-13859: --- Description: Testing Spark SQL using TPC queries. Query 38 returns wrong results compared to

[jira] [Commented] (SPARK-13863) TPCDS query 66 returns wrong results compared to TPC official result set

2016-03-19 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200149#comment-15200149 ] JESSE CHEN commented on SPARK-13863: Going to validate this also on my cluster. Nice find. > TPCDS

[jira] [Commented] (SPARK-13865) TPCDS query 87 returns wrong results compared to TPC official result set

2016-03-19 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200877#comment-15200877 ] JESSE CHEN commented on SPARK-13865: I will open a bug against TPCDS toolkit for this. Will add bug

[jira] [Closed] (SPARK-13863) TPCDS query 66 returns wrong results compared to TPC official result set

2016-03-18 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN closed SPARK-13863. -- Resolution: Workaround fixed schema. > TPCDS query 66 returns wrong results compared to TPC official

[jira] [Closed] (SPARK-13865) TPCDS query 87 returns wrong results compared to TPC official result set

2016-03-18 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN closed SPARK-13865. -- Resolution: Not A Bug Fix Version/s: 2.0.0 > TPCDS query 87 returns wrong results compared to

[jira] [Commented] (SPARK-13865) TPCDS query 87 returns wrong results compared to TPC official result set

2016-03-18 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202280#comment-15202280 ] JESSE CHEN commented on SPARK-13865: Solution is to revert back to original TPC query with INTERSECT

[jira] [Commented] (SPARK-13832) TPC-DS Query 36 fails with Parser error

2016-03-18 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15202272#comment-15202272 ] JESSE CHEN commented on SPARK-13832: This is the vanilla TPC query: {noformat} select

[jira] [Commented] (SPARK-13820) TPC-DS Query 10 fails to compile

2016-03-28 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214795#comment-15214795 ] JESSE CHEN commented on SPARK-13820: Happens in Spark 2.0 as well, in Spark 2.0 error is {noformat}

[jira] [Commented] (SPARK-13831) TPC-DS Query 35 fails with the following compile error

2016-03-28 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15214834#comment-15214834 ] JESSE CHEN commented on SPARK-13831: Same in spark 2.0. Query 41 also returns the same error. >

[jira] [Commented] (SPARK-13820) TPC-DS Query 10 fails to compile

2016-03-30 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15218937#comment-15218937 ] JESSE CHEN commented on SPARK-13820: We are able to run 93 now. We should shoot for all 99. And this

[jira] [Commented] (SPARK-13860) TPCDS query 39 returns wrong results compared to TPC official result set

2016-04-11 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15235649#comment-15235649 ] JESSE CHEN commented on SPARK-13860: [~tsuresh] Could you inform the correct course of action here

[jira] [Commented] (SPARK-13307) TPCDS query 66 degraded by 30% in 1.6.0 compared to 1.4.1

2016-04-11 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15235635#comment-15235635 ] JESSE CHEN commented on SPARK-13307: Performance back on track on Spark 2.0. Closing this. > TPCDS

[jira] [Closed] (SPARK-13307) TPCDS query 66 degraded by 30% in 1.6.0 compared to 1.4.1

2016-04-11 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN closed SPARK-13307. -- Resolution: Fixed Fix Version/s: 2.0.0 Thanks. > TPCDS query 66 degraded by 30% in 1.6.0

[jira] [Closed] (SPARK-13859) TPCDS query 38 returns wrong results compared to TPC official result set

2016-03-19 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN closed SPARK-13859. -- Resolution: Not A Bug Fix Version/s: 2.0.0 Solution is to revert back to original TPC query

[jira] [Commented] (SPARK-13865) TPCDS query 87 returns wrong results compared to TPC official result set

2016-03-19 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198559#comment-15198559 ] JESSE CHEN commented on SPARK-13865: yes sir. > TPCDS query 87 returns wrong results compared to TPC

[jira] [Commented] (SPARK-13858) TPCDS query 21 returns wrong results compared to TPC official result set

2016-03-19 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198558#comment-15198558 ] JESSE CHEN commented on SPARK-13858: Good job, Bo! I would like to test this on my cluster if you

[jira] [Commented] (SPARK-13865) TPCDS query 87 returns wrong results compared to TPC official result set

2016-03-19 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200869#comment-15200869 ] JESSE CHEN commented on SPARK-13865: I am onto that. Thanks. Also, good to know the parsing error is

[jira] [Commented] (SPARK-13865) TPCDS query 87 returns wrong results compared to TPC official result set

2016-03-19 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200886#comment-15200886 ] JESSE CHEN commented on SPARK-13865: You rock! > TPCDS query 87 returns wrong results compared to

[jira] [Commented] (SPARK-13865) TPCDS query 87 returns wrong results compared to TPC official result set

2016-03-19 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200637#comment-15200637 ] JESSE CHEN commented on SPARK-13865: This maybe a TPC toolkit issue. Will be looking into this with

[jira] [Closed] (SPARK-13861) TPCDS query 40 returns wrong results compared to TPC official result set

2016-03-22 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN closed SPARK-13861. -- Resolution: Duplicate Fixed all schema discrepancies. > TPCDS query 40 returns wrong results

[jira] [Commented] (SPARK-13864) TPCDS query 74 returns wrong results compared to TPC official result set

2016-03-22 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15207239#comment-15207239 ] JESSE CHEN commented on SPARK-13864: Tried on two recent builds having issues running to completion.

[jira] [Closed] (SPARK-13858) TPCDS query 21 returns wrong results compared to TPC official result set

2016-03-22 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN closed SPARK-13858. -- Resolution: Not A Bug Schema updates generated correct results in both spark 1.6 and 2.0. Good to

[jira] [Updated] (SPARK-14096) SPARK-SQL CLI returns NPE

2016-03-23 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14096: --- Labels: (was: tpcds-result-mismatch) > SPARK-SQL CLI returns NPE > - > >

[jira] [Updated] (SPARK-14096) SPARK-SQL CLI returns NPE

2016-03-23 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14096: --- Affects Version/s: (was: 1.6.0) 2.0.0 Description: Trying to

[jira] [Created] (SPARK-14096) SPARK-SQL CLI returns NPE

2016-03-23 Thread JESSE CHEN (JIRA)
JESSE CHEN created SPARK-14096: -- Summary: SPARK-SQL CLI returns NPE Key: SPARK-14096 URL: https://issues.apache.org/jira/browse/SPARK-14096 Project: Spark Issue Type: Bug Components:

[jira] [Comment Edited] (SPARK-13865) TPCDS query 87 returns wrong results compared to TPC official result set

2016-03-19 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200850#comment-15200850 ] JESSE CHEN edited comment on SPARK-13865 at 3/18/16 2:24 AM: - Hive, big sql,

[jira] [Commented] (SPARK-13865) TPCDS query 87 returns wrong results compared to TPC official result set

2016-03-19 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200850#comment-15200850 ] JESSE CHEN commented on SPARK-13865: Hive, big sql, db2 queries are all generated off corresponding

[jira] [Commented] (SPARK-13859) TPCDS query 38 returns wrong results compared to TPC official result set

2016-03-19 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15200177#comment-15200177 ] JESSE CHEN commented on SPARK-13859: Tested both q87 and q38 on the lab's cluster. With this

[jira] [Closed] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-04-01 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN closed SPARK-14318. -- Resolution: Not A Problem > TPCDS query 14 causes Spark SQL to hang >

[jira] [Commented] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-04-01 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15221943#comment-15221943 ] JESSE CHEN commented on SPARK-14318: intersect should be used. Investigating further. > TPCDS query

[jira] [Commented] (SPARK-13862) TPCDS query 49 returns wrong results compared to TPC official result set

2016-03-29 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216500#comment-15216500 ] JESSE CHEN commented on SPARK-13862: PR fixed the issue. New result is ordered correctly.

[jira] [Commented] (SPARK-13864) TPCDS query 74 returns wrong results compared to TPC official result set

2016-03-29 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15216483#comment-15216483 ] JESSE CHEN commented on SPARK-13864: Validated successfully. Returned the correct result set in

[jira] [Closed] (SPARK-13862) TPCDS query 49 returns wrong results compared to TPC official result set

2016-03-29 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN closed SPARK-13862. -- PR fixed this issue. Thanks, [~smilegator] > TPCDS query 49 returns wrong results compared to TPC

[jira] [Closed] (SPARK-13864) TPCDS query 74 returns wrong results compared to TPC official result set

2016-03-29 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN closed SPARK-13864. -- PR fixed the issue. Nice work, [~smilegator] > TPCDS query 74 returns wrong results compared to TPC

[jira] [Updated] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-03-31 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14318: --- Description: TPCDS Q14 parses successfully, and plans created successfully. Spark tries to run (I

[jira] [Commented] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-03-31 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15220864#comment-15220864 ] JESSE CHEN commented on SPARK-14318: Q14 is as follows: {noformat} with cross_items as (select

[jira] [Updated] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-03-31 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14318: --- Description: TPCDS Q14 parses successfully, and plans created successfully. Spark tries to run (I

[jira] [Updated] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-03-31 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14318: --- Description: TPCDS Q14 parses successfully, and plans created successfully. Spark tries to run (I

[jira] [Updated] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-03-31 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14318: --- Labels: hangs (was: tpcds-result-mismatch) > TPCDS query 14 causes Spark SQL to hang >

[jira] [Created] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-03-31 Thread JESSE CHEN (JIRA)
JESSE CHEN created SPARK-14318: -- Summary: TPCDS query 14 causes Spark SQL to hang Key: SPARK-14318 URL: https://issues.apache.org/jira/browse/SPARK-14318 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-03-31 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14318: --- Affects Version/s: 2.0.0 > TPCDS query 14 causes Spark SQL to hang >

[jira] [Updated] (SPARK-14318) TPCDS query 14 causes Spark SQL to hang

2016-03-31 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14318: --- Attachment: threaddump-1459461915668.tdump here is the thread dump taken during the high CPU usage

[jira] [Commented] (SPARK-14521) StackOverflowError in Kryo when executing TPC-DS

2016-04-25 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15256836#comment-15256836 ] JESSE CHEN commented on SPARK-14521: This fix will allow us to use Kyro again (in spark-sql shell and

[jira] [Commented] (SPARK-14096) SPARK-SQL CLI returns NPE

2016-04-21 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252592#comment-15252592 ] JESSE CHEN commented on SPARK-14096: duplicate of SPARK-14521 > SPARK-SQL CLI returns NPE >

[jira] [Closed] (SPARK-14096) SPARK-SQL CLI returns NPE

2016-04-21 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN closed SPARK-14096. -- Resolution: Duplicate SPARK-14521 > SPARK-SQL CLI returns NPE > - > >

[jira] [Commented] (SPARK-14096) SPARK-SQL CLI returns NPE

2016-04-21 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15252597#comment-15252597 ] JESSE CHEN commented on SPARK-14096: But the simplest workaround is to use the spark.serializer

[jira] [Updated] (SPARK-14968) TPC-DS query 1 resolved attribute(s) missing

2016-04-27 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14968: --- Summary: TPC-DS query 1 resolved attribute(s) missing (was: TPC-DS query 1 fails to generate plan)

[jira] [Updated] (SPARK-14968) TPC-DS query 1 fails to generate plan

2016-04-27 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14968: --- Description: This is a regression from a week ago. Failed to generate plan for query 1 in TPCDS

[jira] [Created] (SPARK-14968) TPC-DS query 1 fails to generate plan

2016-04-27 Thread JESSE CHEN (JIRA)
JESSE CHEN created SPARK-14968: -- Summary: TPC-DS query 1 fails to generate plan Key: SPARK-14968 URL: https://issues.apache.org/jira/browse/SPARK-14968 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-14968) TPC-DS query 1 fails to generate plan

2016-04-27 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14968: --- Affects Version/s: (was: 1.6.1) 2.0.0 > TPC-DS query 1 fails to generate

[jira] [Updated] (SPARK-14968) TPC-DS query 1 fails to generate plan

2016-04-27 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14968: --- Priority: Critical (was: Major) > TPC-DS query 1 fails to generate plan >

[jira] [Updated] (SPARK-14968) TPC-DS query 1 fails to generate plan

2016-04-27 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14968: --- Description: This is a regression from a week ago. Failed to generate plan for query 1 in TPCDS

[jira] [Updated] (SPARK-15372) TPC-DS Qury 84 returns wrong results against TPC official

2016-05-17 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-15372: --- Labels: SPARK-15071 (was: ) > TPC-DS Qury 84 returns wrong results against TPC official >

[jira] [Created] (SPARK-15372) TPC-DS Qury 84 returns wrong results against TPC official

2016-05-17 Thread JESSE CHEN (JIRA)
JESSE CHEN created SPARK-15372: -- Summary: TPC-DS Qury 84 returns wrong results against TPC official Key: SPARK-15372 URL: https://issues.apache.org/jira/browse/SPARK-15372 Project: Spark Issue

[jira] [Updated] (SPARK-15372) TPC-DS Qury 84 returns wrong results against TPC official

2016-05-17 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-15372: --- Description: The official TPC-DS query 84 returns wrong results when compared to its official

[jira] [Updated] (SPARK-15372) TPC-DS Qury 84 returns wrong results against TPC official

2016-05-17 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-15372: --- Description: The official TPC-DS query 84 returns wrong results when compared to its official

[jira] [Commented] (SPARK-15372) TPC-DS Qury 84 returns wrong results against TPC official

2016-05-18 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15289358#comment-15289358 ] JESSE CHEN commented on SPARK-15372: I will close this next, not a problem with Spark SQL. > TPC-DS

[jira] [Commented] (SPARK-15372) TPC-DS Qury 84 returns wrong results against TPC official

2016-05-18 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15289356#comment-15289356 ] JESSE CHEN commented on SPARK-15372: [~freiss] I agree with you. In addition, in order to match TPC

[jira] [Updated] (SPARK-14968) TPC-DS query 1 resolved attribute(s) missing

2016-04-29 Thread JESSE CHEN (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] JESSE CHEN updated SPARK-14968: --- Description: This is a regression from a week ago. Failed to generate plan for query 1 in TPCDS

  1   2   >