[GitHub] spark pull request #13269: [SPARK-15494][SQL] encoder code cleanup

2016-06-01 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13269#discussion_r65492290 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1884,10 +1884,62 @@ class Analyzer( } e

[GitHub] spark issue #13451: [SPARK-15711][SQL] Ban CREATE TEMPORARY TABLE USING AS S...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13451 Build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #13451: [SPARK-15711][SQL] Ban CREATE TEMPORARY TABLE USING AS S...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13451 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59818/ Test PASSed. ---

[GitHub] spark issue #13451: [SPARK-15711][SQL] Ban CREATE TEMPORARY TABLE USING AS S...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13451 **[Test build #59818 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59818/consoleFull)** for PR 13451 at commit [`d4f5ab6`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13414: [SPARK-15674][SQL] Deprecates "CREATE TEMPORARY TABLE US...

2016-06-01 Thread clockfly
Github user clockfly commented on the issue: https://github.com/apache/spark/pull/13414 @hvanhovell Probably we can talk more face to face next week. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does no

[GitHub] spark issue #13413: [SPARK-15663][SQL][WIP] SparkSession.catalog.listFunctio...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13413 **[Test build #59835 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59835/consoleFull)** for PR 13413 at commit [`0015672`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #13451: [SPARK-15711][SQL] Ban CREATE TEMPORARY TABLE USING AS S...

2016-06-01 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/13451 LGTM. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #13413: [SPARK-15663][SQL][WIP] SparkSession.catalog.listFunctio...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13413 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59819/ Test FAILed. ---

[GitHub] spark issue #13413: [SPARK-15663][SQL][WIP] SparkSession.catalog.listFunctio...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13413 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13413: [SPARK-15663][SQL][WIP] SparkSession.catalog.listFunctio...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13413 **[Test build #59819 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59819/consoleFull)** for PR 13413 at commit [`c3d0067`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13451: [SPARK-15711][SQL] Ban CREATE TEMPORARY TABLE USING AS S...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13451 **[Test build #59834 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59834/consoleFull)** for PR 13451 at commit [`aaca7f0`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #13451: [SPARK-15711][SQL] Ban CREATE TEMPORARY TABLE USING AS S...

2016-06-01 Thread clockfly
Github user clockfly commented on the issue: https://github.com/apache/spark/pull/13451 Thanks @gatorsmile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #13451: [SPARK-15711][SQL] Ban CREATE TEMPORARY TABLE USING AS S...

2016-06-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/13451 LGTM except some minor issues which are already pointed out by others. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proje

[GitHub] spark issue #13464: [Minor] Fix Java Lint errors introduced by #13286 and 13...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13464 **[Test build #59833 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59833/consoleFull)** for PR 13464 at commit [`09486b1`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #13286: [SPARK-15517][SQL][STREAMING] Add support for complete o...

2016-06-01 Thread techaddict
Github user techaddict commented on the issue: https://github.com/apache/spark/pull/13286 @tdas @marmbrus this is failing `dev/lint-java` So we should change `Append` and `Complete` to `append` and `complete` ``` [ERROR] src/main/java/org/apache/spark/sql/streaming/OutputMo

[GitHub] spark pull request #13464: [Minor] Fix Java Lint errors introduced by #13286...

2016-06-01 Thread techaddict
GitHub user techaddict opened a pull request: https://github.com/apache/spark/pull/13464 [Minor] Fix Java Lint errors introduced by #13286 and 13280 ## What changes were proposed in this pull request? Fix Java Lint errors introduced by #13286 and #13280 1. remove unused impo

[GitHub] spark issue #13390: [SPARK-15617][ML][DOC] Clarify that fMeasure in Multicla...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13390 **[Test build #59832 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59832/consoleFull)** for PR 13390 at commit [`42ed0b9`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #13424: [SPARK-15489][SQL][WIP] Dataset kryo encoder won't load ...

2016-06-01 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/13424 As for my second comment about switching serializer, yes, please leave it as it is. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request #13451: [SPARK-15711][SQL] Ban CREATE TEMPORARY TABLE USI...

2016-06-01 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/13451#discussion_r65489880 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/sources/CreateTableAsSelectSuite.scala --- @@ -40,172 +43,175 @@ class CreateTableAsSelectSuite ex

[GitHub] spark pull request #13451: [SPARK-15711][SQL] Ban CREATE TEMPORARY TABLE USI...

2016-06-01 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/13451#discussion_r65489841 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/sources/CreateTableAsSelectSuite.scala --- @@ -40,172 +43,175 @@ class CreateTableAsSelectSuite ex

[GitHub] spark pull request #13451: [SPARK-15711][SQL] Ban CREATE TEMPORARY TABLE USI...

2016-06-01 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/13451#discussion_r65489815 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/sources/CreateTableAsSelectSuite.scala --- @@ -40,172 +43,175 @@ class CreateTableAsSelectSuite ex

[GitHub] spark issue #13390: [SPARK-15617][ML][DOC] Clarify that fMeasure in Multicla...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13390 **[Test build #59831 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59831/consoleFull)** for PR 13390 at commit [`0427cf8`](https://github.com/apache/spark/commit/0

[GitHub] spark pull request #13451: [SPARK-15711][SQL] Ban CREATE TEMPORARY TABLE USI...

2016-06-01 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/13451#discussion_r65489737 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/sources/CreateTableAsSelectSuite.scala --- @@ -40,172 +43,175 @@ class CreateTableAsSelectSuite ex

[GitHub] spark pull request #13451: [SPARK-15711][SQL] Ban CREATE TEMPORARY TABLE USI...

2016-06-01 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/13451#discussion_r65489722 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/sources/CreateTableAsSelectSuite.scala --- @@ -40,172 +43,175 @@ class CreateTableAsSelectSuite ex

[GitHub] spark pull request #13451: [SPARK-15711][SQL] Ban CREATE TEMPORARY TABLE USI...

2016-06-01 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/13451#discussion_r65489614 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/sources/CreateTableAsSelectSuite.scala --- @@ -40,172 +43,175 @@ class CreateTableAsSelectSuite ex

[GitHub] spark pull request #13451: [SPARK-15711][SQL] Ban CREATE TEMPORARY TABLE USI...

2016-06-01 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/13451#discussion_r65489508 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/sources/CreateTableAsSelectSuite.scala --- @@ -40,172 +43,175 @@ class CreateTableAsSelectSuite ex

[GitHub] spark issue #13451: [SPARK-15711][SQL] Ban CREATE TEMPORARY TABLE USING AS S...

2016-06-01 Thread clockfly
Github user clockfly commented on the issue: https://github.com/apache/spark/pull/13451 cc @cloud-fan @liancheng @andrewor14 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enab

[GitHub] spark pull request #13451: [SPARK-15711][SQL] Ban CREATE TEMPORARY TABLE USI...

2016-06-01 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/13451#discussion_r65489271 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/MetastoreDataSourcesSuite.scala --- @@ -1104,4 +1104,22 @@ class MetastoreDataSourcesSuite ex

[GitHub] spark issue #13390: [SPARK-15617][ML][DOC] Clarify that fMeasure in Multicla...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13390 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13390: [SPARK-15617][ML][DOC] Clarify that fMeasure in Multicla...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13390 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59826/ Test FAILed. ---

[GitHub] spark issue #13390: [SPARK-15617][ML][DOC] Clarify that fMeasure in Multicla...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13390 **[Test build #59826 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59826/consoleFull)** for PR 13390 at commit [`b41226f`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13424: [SPARK-15489][SQL][WIP] Dataset kryo encoder won't load ...

2016-06-01 Thread amitsela
Github user amitsela commented on the issue: https://github.com/apache/spark/pull/13424 I will check if the mentioned line above can be removed. If you're switching serializer to boolean as mentioned, I don't see any other way, correct ? Regarding tests, is there any existing test

[GitHub] spark issue #13451: [SPARK-15711][SQL] Ban CREATE TEMPORARY TABLE USING AS S...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13451 **[Test build #59830 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59830/consoleFull)** for PR 13451 at commit [`2f0355f`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #13419: [SPARK-15678][SQL] Not use cache on appends and overwrit...

2016-06-01 Thread tejasapatil
Github user tejasapatil commented on the issue: https://github.com/apache/spark/pull/13419 I guess that the caching is done over multiple nodes. If the data for a dataset is updated physically and some of the nodes where the data was cached go down, would the existing `cached` dataset

[GitHub] spark issue #12173: [SPARK-13792][SQL] Limit logging of bad records in CSVRe...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12173 **[Test build #59829 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59829/consoleFull)** for PR 12173 at commit [`b242a62`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #13439: [SPARK-15701][SQL] Constant ColumnVector only needs to p...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13439 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13439: [SPARK-15701][SQL] Constant ColumnVector only needs to p...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13439 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59815/ Test PASSed. ---

[GitHub] spark issue #13439: [SPARK-15701][SQL] Constant ColumnVector only needs to p...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13439 **[Test build #59815 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59815/consoleFull)** for PR 13439 at commit [`3c445ac`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13390: [SPARK-15617][ML][DOC] Clarify that fMeasure in Multicla...

2016-06-01 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/13390 cc @srowen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #13451: [SPARK-15711][SQL][WIP]Ban CREATE TEMPORARY TABLE USING ...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13451 **[Test build #59828 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59828/consoleFull)** for PR 13451 at commit [`90fb80a`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #12972: [SPARK-15198][SQL] Support for pushing down filters for ...

2016-06-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/12972 Hi @liancheng, I guess you missed this. I will cc in case. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does no

[GitHub] spark issue #13455: [SPARK-15719][SQL] Disables writing Parquet summary file...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13455 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59816/ Test FAILed. ---

[GitHub] spark issue #13455: [SPARK-15719][SQL] Disables writing Parquet summary file...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13455 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13455: [SPARK-15719][SQL] Disables writing Parquet summary file...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13455 **[Test build #59816 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59816/consoleFull)** for PR 13455 at commit [`4a17892`](https://github.com/apache/spark/commit/

[GitHub] spark issue #12173: [SPARK-13792][SQL] Limit logging of bad records in CSVRe...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12173 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #12173: [SPARK-13792][SQL] Limit logging of bad records in CSVRe...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12173 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59827/ Test FAILed. ---

[GitHub] spark issue #12173: [SPARK-13792][SQL] Limit logging of bad records in CSVRe...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12173 **[Test build #59827 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59827/consoleFull)** for PR 12173 at commit [`d517447`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13439: [SPARK-15701][SQL] Constant ColumnVector only needs to p...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13439 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59814/ Test PASSed. ---

[GitHub] spark issue #13439: [SPARK-15701][SQL] Constant ColumnVector only needs to p...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13439 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13439: [SPARK-15701][SQL] Constant ColumnVector only needs to p...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13439 **[Test build #59814 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59814/consoleFull)** for PR 13439 at commit [`42e4dcd`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13413: [SPARK-15663][SQL][WIP] SparkSession.catalog.listFunctio...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13413 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59817/ Test FAILed. ---

[GitHub] spark issue #13390: [SPARK-15617][ML][DOC] Clarify that fMeasure in Multicla...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13390 **[Test build #59826 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59826/consoleFull)** for PR 13390 at commit [`b41226f`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #13413: [SPARK-15663][SQL][WIP] SparkSession.catalog.listFunctio...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13413 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13413: [SPARK-15663][SQL][WIP] SparkSession.catalog.listFunctio...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13413 **[Test build #59817 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59817/consoleFull)** for PR 13413 at commit [`e17f59c`](https://github.com/apache/spark/commit/

[GitHub] spark issue #12173: [SPARK-13792][SQL] Limit logging of bad records in CSVRe...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12173 **[Test build #59827 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59827/consoleFull)** for PR 12173 at commit [`d517447`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #13439: [SPARK-15701][SQL] Constant ColumnVector only needs to p...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13439 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59811/ Test PASSed. ---

[GitHub] spark issue #13439: [SPARK-15701][SQL] Constant ColumnVector only needs to p...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13439 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13439: [SPARK-15701][SQL] Constant ColumnVector only needs to p...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13439 **[Test build #59811 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59811/consoleFull)** for PR 13439 at commit [`b2c14ee`](https://github.com/apache/spark/commit/

[GitHub] spark issue #12173: [SPARK-13792][SQL] Limit logging of bad records in CSVRe...

2016-06-01 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/12173 @falaki ping --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if th

[GitHub] spark issue #13442: [SPARK-15654][SQL] Check if all the input files are spli...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13442 **[Test build #59825 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59825/consoleFull)** for PR 13442 at commit [`1d03636`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #12850: [SPARK-15076][SQL] Add ReorderAssociativeOperator optimi...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12850 **[Test build #59824 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59824/consoleFull)** for PR 12850 at commit [`3959d57`](https://github.com/apache/spark/commit/3

[GitHub] spark pull request #13269: [SPARK-15494][SQL] encoder code cleanup

2016-06-01 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/13269#discussion_r65485798 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/Encoders.scala --- @@ -208,7 +209,7 @@ object Encoders { BoundReference(0, Object

[GitHub] spark pull request #13290: [SPARK-13484] [SQL] Prevent illegal NULL propagat...

2016-06-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13290 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #13137: [SPARK-15247][SQL] Set the default number of partitions ...

2016-06-01 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/13137 @liancheng ping --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #13444: [SPARK-15530][SQL] Set #parallelism for file listing in ...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13444 **[Test build #59823 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59823/consoleFull)** for PR 13444 at commit [`283b55a`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #13439: [SPARK-15701][SQL] Constant ColumnVector only needs to p...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13439 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13439: [SPARK-15701][SQL] Constant ColumnVector only needs to p...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13439 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59810/ Test PASSed. ---

[GitHub] spark issue #13439: [SPARK-15701][SQL] Constant ColumnVector only needs to p...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13439 **[Test build #59810 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59810/consoleFull)** for PR 13439 at commit [`93d1d08`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13290: [SPARK-13484] [SQL] Prevent illegal NULL propagation whe...

2016-06-01 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/13290 Merging to master and branch-2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #13456: [SPARK-15724] Add benchmarks for performance over wide s...

2016-06-01 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/13456 For the ones that we actually are testing throughput (i.e. have more than 1 rows), can we generate temp files using parquet? Or at least add variant of that. --- If your project is set up for it, yo

[GitHub] spark pull request #13456: [SPARK-15724] Add benchmarks for performance over...

2016-06-01 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/13456#discussion_r65485244 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/WideSchemaBenchmark.scala --- @@ -0,0 +1,285 @@ +/* + * Licensed to the Apac

[GitHub] spark pull request #12850: [SPARK-15076][SQL] Add ReorderAssociativeOperator...

2016-06-01 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/12850#discussion_r65485176 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -738,6 +739,42 @@ object InferFiltersFromConstrai

[GitHub] spark issue #12850: [SPARK-15076][SQL] Add ReorderAssociativeOperator optimi...

2016-06-01 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/12850 BTW it goes without saying ... if you do decide to merge this, don't merge it in branch-2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #13463: [SPARK-14959][SQL] handle partitioned table directories ...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13463 **[Test build #59821 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59821/consoleFull)** for PR 13463 at commit [`2f74187`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #13451: [SPARK-15711][SQL][WIP]Ban CREATE TEMPORARY TABLE USING ...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13451 **[Test build #59822 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59822/consoleFull)** for PR 13451 at commit [`b7bb43d`](https://github.com/apache/spark/commit/b

[GitHub] spark pull request #13418: [SPARK-15677][SQL] Query with scalar sub-query in...

2016-06-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/13418#discussion_r65484867 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -1468,10 +1468,15 @@ object DecimalAggregates extends

[GitHub] spark pull request #13463: [SPARK-14959][SQL] handle partitioned table direc...

2016-06-01 Thread xwu0226
GitHub user xwu0226 opened a pull request: https://github.com/apache/spark/pull/13463 [SPARK-14959][SQL] handle partitioned table directories in distributed filesystem ## What changes were proposed in this pull request? # The root cause: When `DataSource.resolveRelation`

[GitHub] spark issue #13452: [SPARK-15718][SQL] better error message for writing buck...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13452 **[Test build #59820 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59820/consoleFull)** for PR 13452 at commit [`4d79552`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #12850: [SPARK-15076][SQL] Add ReorderAssociativeOperator optimi...

2016-06-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/12850 cc @davies , can you take a look? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #13413: [SPARK-15663][SQL][WIP] SparkSession.catalog.listFunctio...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13413 **[Test build #59819 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59819/consoleFull)** for PR 13413 at commit [`c3d0067`](https://github.com/apache/spark/commit/c

[GitHub] spark pull request #12850: [SPARK-15076][SQL] Add ReorderAssociativeOperator...

2016-06-01 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/12850#discussion_r65484414 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -738,6 +739,42 @@ object InferFiltersFromConstraints

[GitHub] spark pull request #13399: [SPARK-15620][SQL] Fix transformed dataset attrib...

2016-06-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13399 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #13399: [SPARK-15620][SQL] Fix transformed dataset attributes re...

2016-06-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/13399 thanks, merging to master and 2.0! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enable

[GitHub] spark issue #13456: [SPARK-15724] Add benchmarks for performance over wide s...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13456 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13456: [SPARK-15724] Add benchmarks for performance over wide s...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13456 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59807/ Test PASSed. ---

[GitHub] spark issue #13456: [SPARK-15724] Add benchmarks for performance over wide s...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13456 **[Test build #59807 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59807/consoleFull)** for PR 13456 at commit [`579e0f9`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #13394: [SPARK-15490][R][DOC] SparkR 2.0 QA: New R APIs a...

2016-06-01 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/13394#discussion_r65483594 --- Diff: R/pkg/R/stats.R --- @@ -135,13 +136,13 @@ setMethod("freqItems", signature(x = "SparkDataFrame", cols = "character"), #' Calculates the ap

[GitHub] spark pull request #13451: [SPARK-15711][SQL][WIP]Ban CREATE TEMPORARY TABLE...

2016-06-01 Thread clockfly
Github user clockfly commented on a diff in the pull request: https://github.com/apache/spark/pull/13451#discussion_r65483550 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLQuerySuite.scala --- @@ -1399,52 +1399,6 @@ class SQLQuerySuite extends QueryTest

[GitHub] spark issue #13461: [SPARK-15721][ML] Make DefaultParamsReadable, DefaultPar...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13461 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59812/ Test PASSed. ---

[GitHub] spark issue #13461: [SPARK-15721][ML] Make DefaultParamsReadable, DefaultPar...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13461 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13461: [SPARK-15721][ML] Make DefaultParamsReadable, DefaultPar...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13461 **[Test build #59812 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59812/consoleFull)** for PR 13461 at commit [`b42d503`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13462: Fixed local-timezone-brittle test where short-timezone f...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13462 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark issue #13451: [SPARK-15711][SQL][WIP]Ban CREATE TEMPORARY TABLE USING ...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13451 **[Test build #59818 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59818/consoleFull)** for PR 13451 at commit [`d4f5ab6`](https://github.com/apache/spark/commit/d

[GitHub] spark pull request #13451: [SPARK-15711][SQL][WIP]Ban CREATE TEMPORARY TABLE...

2016-06-01 Thread clockfly
Github user clockfly commented on a diff in the pull request: https://github.com/apache/spark/pull/13451#discussion_r65483261 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/MetastoreDataSourcesSuite.scala --- @@ -1104,4 +1104,22 @@ class MetastoreDataSourcesSuite exte

[GitHub] spark pull request #13462: Fixed local-timezone-brittle test where short-tim...

2016-06-01 Thread javabrett
GitHub user javabrett opened a pull request: https://github.com/apache/spark/pull/13462 Fixed local-timezone-brittle test where short-timezone form "EST" is … ## What changes were proposed in this pull request? Stop using the abbreviated and ambiguous timezone "EST" in a t

[GitHub] spark issue #12000: [SPARK-14204] [SQL] register driverClass rather than use...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12000 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #12000: [SPARK-14204] [SQL] register driverClass rather than use...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/12000 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59806/ Test PASSed. ---

[GitHub] spark issue #12000: [SPARK-14204] [SQL] register driverClass rather than use...

2016-06-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/12000 **[Test build #59806 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/59806/consoleFull)** for PR 12000 at commit [`a927c76`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13413: [SPARK-15663][SQL][WIP] SparkSession.catalog.listFunctio...

2016-06-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13413 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/59808/ Test FAILed. ---

[GitHub] spark issue #13460: [SPARK-15615] [SQL] Support Json input from Dataset[Stri...

2016-06-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/13460 I just fetched this PR and run tests. It seems `"SPARK-7565 MapType in JsonRDD"` test is being failed. Maybe this should be solved. Also, if `json(jsonRDD: JavaRDD[String])` is being deprecated,

  1   2   3   4   5   6   7   8   >