[GitHub] spark issue #21339: [SPARK-24287][Core] Spark -packages option should suppor...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21339 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21339: [SPARK-24287][Core] Spark -packages option should suppor...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21339 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #21339: [SPARK-24287][Core] Spark -packages option should...

2018-05-15 Thread fangshil
GitHub user fangshil opened a pull request: https://github.com/apache/spark/pull/21339 [SPARK-24287][Core] Spark -packages option should support classifier, no-transitive, and custom conf ## What changes were proposed in this pull request? We should extend Spark's -package

[GitHub] spark pull request #21335: [SPARK-24231][PYSPARK][ML] Provide Python API for...

2018-05-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/21335 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #21335: [SPARK-24231][PYSPARK][ML] Provide Python API for evalua...

2018-05-15 Thread mengxr
Github user mengxr commented on the issue: https://github.com/apache/spark/pull/21335 LGTM. Merged into master. Thanks! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-ma

[GitHub] spark issue #21338: [SPARK-23601][build][follow-up] Keep md5 checksums for n...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21338 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3241/ Tes

[GitHub] spark issue #21338: [SPARK-23601][build][follow-up] Keep md5 checksums for n...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21338 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21338: [SPARK-23601][build][follow-up] Keep md5 checksums for n...

2018-05-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21338 **[Test build #90659 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90659/testReport)** for PR 21338 at commit [`60d058e`](https://github.com/apache/spark/commit/60

[GitHub] spark pull request #21338: [SPARK-23601][build][follow-up] Keep md5 checksum...

2018-05-15 Thread vanzin
GitHub user vanzin opened a pull request: https://github.com/apache/spark/pull/21338 [SPARK-23601][build][follow-up] Keep md5 checksums for nexus artifacts. The repository.apache.org server still requires md5 checksums or it won't publish the staging repo. You can merge this pul

[GitHub] spark issue #21335: [SPARK-24231][PYSPARK][ML] Provide Python API for evalua...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21335 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90658/ Test PASSed. ---

[GitHub] spark issue #21335: [SPARK-24231][PYSPARK][ML] Provide Python API for evalua...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21335 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21335: [SPARK-24231][PYSPARK][ML] Provide Python API for evalua...

2018-05-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21335 **[Test build #90658 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90658/testReport)** for PR 21335 at commit [`17be21c`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #21258: [SPARK-23933][SQL] Add map_from_arrays function

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21258 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90654/ Test FAILed. ---

[GitHub] spark issue #21258: [SPARK-23933][SQL] Add map_from_arrays function

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21258 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21258: [SPARK-23933][SQL] Add map_from_arrays function

2018-05-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21258 **[Test build #90654 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90654/testReport)** for PR 21258 at commit [`01d265b`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #21334: [minor][SQL]Improve ParseError stop location when offend...

2018-05-15 Thread ash211
Github user ash211 commented on the issue: https://github.com/apache/spark/pull/21334 Hi @rubenfiszel thanks for the contribution! Can you please take a glance through http://spark.apache.org/contributing.html to see the best way to get your change merged into Apache Spark?

[GitHub] spark issue #21337: [SPARK-24234][SS] Reader for continuous processing shuff...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21337 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21337: [SPARK-24234][SS] Reader for continuous processing shuff...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21337 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90656/ Test FAILed. ---

[GitHub] spark issue #21337: [SPARK-24234][SS] Reader for continuous processing shuff...

2018-05-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21337 **[Test build #90656 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90656/testReport)** for PR 21337 at commit [`1d6b718`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #21335: [SPARK-24231][PYSPARK][ML] Provide Python API for evalua...

2018-05-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21335 **[Test build #90658 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90658/testReport)** for PR 21335 at commit [`17be21c`](https://github.com/apache/spark/commit/17

[GitHub] spark issue #21335: [SPARK-24231][PYSPARK][ML] Provide Python API for evalua...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21335 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21335: [SPARK-24231][PYSPARK][ML] Provide Python API for evalua...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21335 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90657/ Test FAILed. ---

[GitHub] spark issue #21335: [SPARK-24231][PYSPARK][ML] Provide Python API for evalua...

2018-05-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21335 **[Test build #90657 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90657/testReport)** for PR 21335 at commit [`d02797c`](https://github.com/apache/spark/commit/d

[GitHub] spark pull request #21045: [WIP][SPARK-23931][SQL] Adds zip function to spar...

2018-05-15 Thread DylanGuedes
Github user DylanGuedes commented on a diff in the pull request: https://github.com/apache/spark/pull/21045#discussion_r188420006 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -90,6 +90,88 @@ case class MapKeys(ch

[GitHub] spark pull request #21045: [WIP][SPARK-23931][SQL] Adds zip function to spar...

2018-05-15 Thread DylanGuedes
Github user DylanGuedes commented on a diff in the pull request: https://github.com/apache/spark/pull/21045#discussion_r188419498 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/collectionOperations.scala --- @@ -90,6 +90,88 @@ case class MapKeys(ch

[GitHub] spark issue #21045: [WIP][SPARK-23931][SQL] Adds zip function to sparksql

2018-05-15 Thread DylanGuedes
Github user DylanGuedes commented on the issue: https://github.com/apache/spark/pull/21045 @mn-mikke thank you! Any idea on how to access elements of individual arrays? In the old version I written a 'getValue' that uses `CodeGenerator.getValue`, but since now it is a 2d data structur

[GitHub] spark issue #21335: [SPARK-24231][PYSPARK][ML] Provide Python API for evalua...

2018-05-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21335 **[Test build #90657 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90657/testReport)** for PR 21335 at commit [`d02797c`](https://github.com/apache/spark/commit/d0

[GitHub] spark issue #21326: [SPARK-24275][SQL] Revise doc comments in InputPartition

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21326 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21326: [SPARK-24275][SQL] Revise doc comments in InputPartition

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21326 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90649/ Test PASSed. ---

[GitHub] spark issue #21326: [SPARK-24275][SQL] Revise doc comments in InputPartition

2018-05-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21326 **[Test build #90649 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90649/testReport)** for PR 21326 at commit [`a5bfc1b`](https://github.com/apache/spark/commit/a

[GitHub] spark issue #21332: [SPARK-24236][SS] Continuous replacement for ShuffleExch...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21332 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21332: [SPARK-24236][SS] Continuous replacement for ShuffleExch...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21332 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90648/ Test PASSed. ---

[GitHub] spark issue #21332: [SPARK-24236][SS] Continuous replacement for ShuffleExch...

2018-05-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21332 **[Test build #90648 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90648/testReport)** for PR 21332 at commit [`06c6cfb`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #21333: [SPARK-23778][CORE] Avoid unneeded shuffle when union ge...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21333 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21333: [SPARK-23778][CORE] Avoid unneeded shuffle when union ge...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21333 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90647/ Test PASSed. ---

[GitHub] spark issue #21333: [SPARK-23778][CORE] Avoid unneeded shuffle when union ge...

2018-05-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21333 **[Test build #90647 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90647/testReport)** for PR 21333 at commit [`f67a88d`](https://github.com/apache/spark/commit/f

[GitHub] spark pull request #21258: [SPARK-23933][SQL] Add map_fromarray function

2018-05-15 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/21258#discussion_r188401185 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/expressions/ComplexTypeSuite.scala --- @@ -186,6 +186,37 @@ class ComplexTypeSuite extend

[GitHub] spark pull request #21337: [SPARK-24234][SS] Reader for continuous processin...

2018-05-15 Thread arunmahadevan
Github user arunmahadevan commented on a diff in the pull request: https://github.com/apache/spark/pull/21337#discussion_r188392937 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/continuous/shuffle/ContinuousShuffleReadRDD.scala --- @@ -0,0 +1,64 @@

[GitHub] spark pull request #21337: [SPARK-24234][SS] Reader for continuous processin...

2018-05-15 Thread arunmahadevan
Github user arunmahadevan commented on a diff in the pull request: https://github.com/apache/spark/pull/21337#discussion_r188397958 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/continuous/shuffle/UnsafeRowReceiver.scala --- @@ -0,0 +1,56 @@ +/*

[GitHub] spark pull request #21337: [SPARK-24234][SS] Reader for continuous processin...

2018-05-15 Thread arunmahadevan
Github user arunmahadevan commented on a diff in the pull request: https://github.com/apache/spark/pull/21337#discussion_r188397203 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/continuous/shuffle/UnsafeRowReceiver.scala --- @@ -0,0 +1,56 @@ +/*

[GitHub] spark pull request #21337: [SPARK-24234][SS] Reader for continuous processin...

2018-05-15 Thread arunmahadevan
Github user arunmahadevan commented on a diff in the pull request: https://github.com/apache/spark/pull/21337#discussion_r188396282 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/continuous/shuffle/ContinuousShuffleReadRDD.scala --- @@ -0,0 +1,64 @@

[GitHub] spark pull request #21308: SPARK-24253: Add DeleteSupport mix-in for DataSou...

2018-05-15 Thread bersprockets
Github user bersprockets commented on a diff in the pull request: https://github.com/apache/spark/pull/21308#discussion_r188392219 --- Diff: sql/core/src/main/java/org/apache/spark/sql/sources/v2/DeleteSupport.java --- @@ -0,0 +1,51 @@ +/* + * Licensed to the Apache Softwar

[GitHub] spark issue #21337: [SPARK-24234][SS] Reader for continuous processing shuff...

2018-05-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21337 **[Test build #90656 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90656/testReport)** for PR 21337 at commit [`1d6b718`](https://github.com/apache/spark/commit/1d

[GitHub] spark issue #21337: [SPARK-24234][SS] Reader for continuous processing shuff...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21337 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21337: [SPARK-24234][SS] Reader for continuous processing shuff...

2018-05-15 Thread jose-torres
Github user jose-torres commented on the issue: https://github.com/apache/spark/pull/21337 @HeartSaVioR @arunmahadevan @xuanyuanking --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #21337: [SPARK-24234][SS] Reader for continuous processin...

2018-05-15 Thread jose-torres
GitHub user jose-torres opened a pull request: https://github.com/apache/spark/pull/21337 [SPARK-24234][SS] Reader for continuous processing shuffle ## What changes were proposed in this pull request? Read RDD for continuous processing shuffle, as well as the initial RPC-ba

[GitHub] spark issue #21336: [SPARK-24286][Documentation] DataFrameReader.csv - Add m...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21336 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21336: [SPARK-24286][Documentation] DataFrameReader.csv - Add m...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21336 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #21336: [SPARK-24286][Documentation] DataFrameReader.csv ...

2018-05-15 Thread rohtakdev
GitHub user rohtakdev opened a pull request: https://github.com/apache/spark/pull/21336 [SPARK-24286][Documentation] DataFrameReader.csv - Add missing alias… ## What changes were proposed in this pull request? Documentation misses out on an alias option available for Dat

[GitHub] spark issue #21335: [SPARK-24231][PYSPARK][ML] Provide Python API for evalua...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21335 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21335: [SPARK-24231][PYSPARK][ML] Provide Python API for evalua...

2018-05-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21335 **[Test build #90655 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90655/testReport)** for PR 21335 at commit [`5765049`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #21335: [SPARK-24231][PYSPARK][ML] Provide Python API for evalua...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21335 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90655/ Test FAILed. ---

[GitHub] spark issue #21335: [SPARK-24231][PYSPARK][ML] Provide Python API for evalua...

2018-05-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21335 **[Test build #90655 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90655/testReport)** for PR 21335 at commit [`5765049`](https://github.com/apache/spark/commit/57

[GitHub] spark issue #21258: [SPARK-23933][SQL] Add map_fromarray function

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21258 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3240/ Tes

[GitHub] spark issue #21258: [SPARK-23933][SQL] Add map_fromarray function

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21258 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21258: [SPARK-23933][SQL] Add map_fromarray function

2018-05-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21258 **[Test build #90654 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90654/testReport)** for PR 21258 at commit [`01d265b`](https://github.com/apache/spark/commit/01

[GitHub] spark issue #21332: [SPARK-24236][SS] Continuous replacement for ShuffleExch...

2018-05-15 Thread jose-torres
Github user jose-torres commented on the issue: https://github.com/apache/spark/pull/21332 We're definitely agreed on the broad idea of having a ContinuousShuffleExchangeExec which reuses most of the existing ShuffleExchangeExec. As discussed in the other PR, I'm not sure abo

[GitHub] spark issue #21335: [SPARK-24231][PYSPARK][ML] Provide Python API for evalua...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21335 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21335: [SPARK-24231][PYSPARK][ML] Provide Python API for evalua...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21335 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90653/ Test FAILed. ---

[GitHub] spark issue #21335: [SPARK-24231][PYSPARK][ML] Provide Python API for evalua...

2018-05-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21335 **[Test build #90653 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90653/testReport)** for PR 21335 at commit [`c25c5a6`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #21335: [SPARK-24231][PYSPARK][ML] Provide Python API for evalua...

2018-05-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21335 **[Test build #90653 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90653/testReport)** for PR 21335 at commit [`c25c5a6`](https://github.com/apache/spark/commit/c2

[GitHub] spark issue #21322: [SPARK-24225][CORE] Support closing AutoClosable objects...

2018-05-15 Thread JeetKunDoug
Github user JeetKunDoug commented on the issue: https://github.com/apache/spark/pull/21322 @cloud-fan I added the above-mentioned check for `isBroadcast` and only release resources if it's a broadcast ID. This will affect the MapOutputTracker as well, but I think it's a pretty limited

[GitHub] spark issue #21335: [SPARK-24231][PYSPARK][ML] Provide Python API for evalua...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21335 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #21335: [SPARK-24231][PYSPARK][ML] Provide Python API for...

2018-05-15 Thread ludatabricks
GitHub user ludatabricks opened a pull request: https://github.com/apache/spark/pull/21335 [SPARK-24231][PYSPARK][ML] Provide Python API for evaluateEachIteration for spark.ml GBTs ## What changes were proposed in this pull request? Add evaluateEachIteration for GBTClassif

[GitHub] spark issue #21322: [SPARK-24225][CORE] Support closing AutoClosable objects...

2018-05-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21322 **[Test build #90652 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90652/testReport)** for PR 21322 at commit [`6a08c43`](https://github.com/apache/spark/commit/6a

[GitHub] spark issue #21322: [SPARK-24225][CORE] Support closing AutoClosable objects...

2018-05-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21322 **[Test build #90651 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90651/testReport)** for PR 21322 at commit [`62d46d3`](https://github.com/apache/spark/commit/62

[GitHub] spark issue #21326: [SPARK-24275][SQL] Revise doc comments in InputPartition

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21326 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3239/ Tes

[GitHub] spark issue #21326: [SPARK-24275][SQL] Revise doc comments in InputPartition

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21326 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21326: [SPARK-24275][SQL] Revise doc comments in InputPartition

2018-05-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21326 **[Test build #90650 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90650/testReport)** for PR 21326 at commit [`f571750`](https://github.com/apache/spark/commit/f5

[GitHub] spark issue #21319: [SPARK-24267][SQL] explicitly keep DataSourceReader in D...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21319 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21319: [SPARK-24267][SQL] explicitly keep DataSourceReader in D...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21319 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90644/ Test PASSed. ---

[GitHub] spark issue #21319: [SPARK-24267][SQL] explicitly keep DataSourceReader in D...

2018-05-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21319 **[Test build #90644 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90644/testReport)** for PR 21319 at commit [`65d5664`](https://github.com/apache/spark/commit/6

[GitHub] spark pull request #21239: [SPARK-24040][SS] Support single partition aggreg...

2018-05-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/21239 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #21165: [Spark-20087][CORE] Attach accumulators / metrics to 'Ta...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21165 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21165: [Spark-20087][CORE] Attach accumulators / metrics to 'Ta...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21165 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90643/ Test PASSed. ---

[GitHub] spark issue #21165: [Spark-20087][CORE] Attach accumulators / metrics to 'Ta...

2018-05-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21165 **[Test build #90643 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90643/testReport)** for PR 21165 at commit [`59c2807`](https://github.com/apache/spark/commit/5

[GitHub] spark issue #21239: [SPARK-24040][SS] Support single partition aggregates in...

2018-05-15 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/21239 Merging to master --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h..

[GitHub] spark issue #21158: [SPARK-23850][sql] Add separate config for SQL options r...

2018-05-15 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/21158 That's fine, but I'm not going to wait indefinitely for their feedback. They've already been pinged multiple times here and on jira to comment on this issue. --- --

[GitHub] spark issue #21158: [SPARK-23850][sql] Add separate config for SQL options r...

2018-05-15 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/21158 I would like to hear more inputs from the reviewers of the original PR. cc @onursatici @ash211 @hvanhovell @jiangxb1987 --- -

[GitHub] spark issue #20929: [SPARK-23772][SQL][WIP] Provide an option to ignore colu...

2018-05-15 Thread mengxr
Github user mengxr commented on the issue: https://github.com/apache/spark/pull/20929 @maropu Thanks for the update! I saw some test failures, no sure if they are relevant. Looking at the changes, I feel we don't need to handle the streaming scenarios in the same PR. We just add a fla

[GitHub] spark issue #21326: [SPARK-24275][SQL] Revise doc comments in InputPartition

2018-05-15 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/21326 lgtm except one comment --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: rev

[GitHub] spark pull request #21326: [SPARK-24275][SQL] Revise doc comments in InputPa...

2018-05-15 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/21326#discussion_r188354590 --- Diff: sql/core/src/main/java/org/apache/spark/sql/sources/v2/reader/InputPartition.java --- @@ -42,9 +43,9 @@ * * Note that if a host

[GitHub] spark pull request #21326: [SPARK-24275][SQL] Revise doc comments in InputPa...

2018-05-15 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/21326#discussion_r188354387 --- Diff: sql/core/src/main/java/org/apache/spark/sql/sources/v2/reader/InputPartition.java --- @@ -42,9 +43,9 @@ * * Note that if a host

[GitHub] spark issue #21291: [SPARK-24242][SQL] RangeExec should have correct outputO...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21291 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21326: [SPARK-24275][SQL] Revise doc comments in InputPartition

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21326 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/3238/ Tes

[GitHub] spark issue #21326: [SPARK-24275][SQL] Revise doc comments in InputPartition

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21326 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21291: [SPARK-24242][SQL] RangeExec should have correct outputO...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21291 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90646/ Test FAILed. ---

[GitHub] spark issue #21291: [SPARK-24242][SQL] RangeExec should have correct outputO...

2018-05-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21291 **[Test build #90646 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90646/testReport)** for PR 21291 at commit [`f93738b`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #21326: [SPARK-24275][SQL] Revise doc comments in InputPartition

2018-05-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21326 **[Test build #90649 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90649/testReport)** for PR 21326 at commit [`a5bfc1b`](https://github.com/apache/spark/commit/a5

[GitHub] spark issue #21109: [SPARK-24020][SQL] Sort-merge join inner range optimizat...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21109 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90642/ Test PASSed. ---

[GitHub] spark issue #21109: [SPARK-24020][SQL] Sort-merge join inner range optimizat...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21109 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21109: [SPARK-24020][SQL] Sort-merge join inner range optimizat...

2018-05-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21109 **[Test build #90642 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90642/testReport)** for PR 21109 at commit [`48b1c0e`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #21331: [SPARK-24276][SQL] Order of literals in IN should not af...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21331 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21331: [SPARK-24276][SQL] Order of literals in IN should not af...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21331 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90641/ Test PASSed. ---

[GitHub] spark issue #21331: [SPARK-24276][SQL] Order of literals in IN should not af...

2018-05-15 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21331 **[Test build #90641 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90641/testReport)** for PR 21331 at commit [`9595237`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #21334: [minor][SQL]Improve ParseError stop location when offend...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21334 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21334: [minor][SQL]Improve ParseError stop location when offend...

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21334 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #21334: Improve ParseError stop location when offending s...

2018-05-15 Thread rubenfiszel
GitHub user rubenfiszel opened a pull request: https://github.com/apache/spark/pull/21334 Improve ParseError stop location when offending symbol is a token In the case where the offending symbol is a CommonToken, this PR increases the accuracy of the start and stop origin by le

[GitHub] spark issue #21330: [SPARK-22234] Support distinct window functions

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21330 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90640/ Test PASSed. ---

[GitHub] spark issue #21330: [SPARK-22234] Support distinct window functions

2018-05-15 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21330 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

<    1   2   3   4   5   >