[GitHub] spark issue #20705: [SPARK-23553][TESTS] Tests should not assume the default...

2018-03-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20705 **[Test build #88167 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88167/testReport)** for PR 20705 at commit

[GitHub] spark issue #20757: [SPARK-23595][SQL] ValidateExternalType should support i...

2018-03-12 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/20757 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20757: [SPARK-23595][SQL] ValidateExternalType should support i...

2018-03-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20757 **[Test build #88170 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88170/testReport)** for PR 20757 at commit

[GitHub] spark issue #20794: [SPARK-23644][CORE][UI] Use absolute path for REST call ...

2018-03-12 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/20794 Ping @ajbozarth . --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20801: [SPARK-23651]Add a check for host name

2018-03-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20801 **[Test build #88173 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88173/testReport)** for PR 20801 at commit

[GitHub] spark issue #20757: [SPARK-23595][SQL] ValidateExternalType should support i...

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20757 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20757: [SPARK-23595][SQL] ValidateExternalType should support i...

2018-03-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20757 **[Test build #88169 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88169/testReport)** for PR 20757 at commit

[GitHub] spark issue #20757: [SPARK-23595][SQL] ValidateExternalType should support i...

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20757 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1460/

[GitHub] spark issue #20757: [SPARK-23595][SQL] ValidateExternalType should support i...

2018-03-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20757 **[Test build #88169 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88169/testReport)** for PR 20757 at commit

[GitHub] spark issue #20757: [SPARK-23595][SQL] ValidateExternalType should support i...

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20757 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20757: [SPARK-23595][SQL] ValidateExternalType should support i...

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20757 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88169/ Test FAILed. ---

[GitHub] spark pull request #20687: [SPARK-23500][SQL] Fix complex type simplificatio...

2018-03-12 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/20687#discussion_r173707199 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/ComplexTypes.scala --- @@ -22,54 +22,34 @@ import

[GitHub] spark pull request #20774: [SPARK-23549][SQL] Cast to timestamp when compari...

2018-03-12 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/20774#discussion_r173710678 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala --- @@ -135,11 +135,14 @@ object TypeCoercion {

[GitHub] spark issue #19431: [SPARK-18580] [DStreams] [external/kafka-0-10][external/...

2018-03-12 Thread omuravskiy
Github user omuravskiy commented on the issue: https://github.com/apache/spark/pull/19431 No objections --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #20774: [SPARK-23549][SQL] Cast to timestamp when compari...

2018-03-12 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/20774#discussion_r173730165 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala --- @@ -135,11 +135,14 @@ object TypeCoercion {

[GitHub] spark pull request #20781: [SPARK-23637][YARN]Yarn might allocate more resou...

2018-03-12 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/20781#discussion_r173709533 --- Diff: resource-managers/yarn/src/main/scala/org/apache/spark/deploy/yarn/YarnAllocator.scala --- @@ -81,7 +81,7 @@ private[yarn] class

[GitHub] spark issue #20781: [SPARK-23637][YARN]Yarn might allocate more resource if ...

2018-03-12 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/20781 Still I'm not so sure about the root cause, but adding defensive code seems no harm. --- - To unsubscribe, e-mail:

[GitHub] spark issue #20801: [SPARK-23651]Add a check for host name

2018-03-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20801 **[Test build #88172 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88172/testReport)** for PR 20801 at commit

[GitHub] spark issue #20801: [SPARK-23651]Add a check for host name

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20801 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20801: [SPARK-23651]Add a check for host name

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20801 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1463/

[GitHub] spark issue #20796: [SPARK-23649][SQL] Prevent crashes on schema inferring o...

2018-03-12 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20796 ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #20757: [SPARK-23595][SQL] ValidateExternalType should su...

2018-03-12 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/20757#discussion_r173700914 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/objects/objects.scala --- @@ -1421,13 +1421,36 @@ case class

[GitHub] spark issue #20757: [SPARK-23595][SQL] ValidateExternalType should support i...

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20757 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20757: [SPARK-23595][SQL] ValidateExternalType should support i...

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20757 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1461/

[GitHub] spark issue #20757: [SPARK-23595][SQL] ValidateExternalType should support i...

2018-03-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20757 **[Test build #88171 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88171/testReport)** for PR 20757 at commit

[GitHub] spark pull request #20774: [SPARK-23549][SQL] Cast to timestamp when compari...

2018-03-12 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/20774#discussion_r173709979 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala --- @@ -135,11 +135,14 @@ object TypeCoercion {

[GitHub] spark issue #20801: [SPARK-23651]Add a check for host name

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20801 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88172/ Test FAILed. ---

[GitHub] spark issue #20801: [SPARK-23651]Add a check for host name

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20801 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20801: [SPARK-23651]Add a check for host name

2018-03-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20801 **[Test build #88172 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88172/testReport)** for PR 20801 at commit

[GitHub] spark issue #20705: [SPARK-23553][TESTS] Tests should not assume the default...

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20705 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88167/ Test PASSed. ---

[GitHub] spark issue #20705: [SPARK-23553][TESTS] Tests should not assume the default...

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20705 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20799: [SPARK-23635][YARN] AM env variable should not overwrite...

2018-03-12 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/20799 @mridulm , would you please take a review. Thanks! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark pull request #20774: [SPARK-23549][SQL] Cast to timestamp when compari...

2018-03-12 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/20774#discussion_r173710174 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala --- @@ -135,11 +135,14 @@ object TypeCoercion {

[GitHub] spark issue #20801: [SPARK-23651]Add a check for host name

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20801 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1462/

[GitHub] spark issue #20801: [SPARK-23651]Add a check for host name

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20801 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #20774: [SPARK-23549][SQL] Cast to timestamp when compari...

2018-03-12 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/20774#discussion_r173718706 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala --- @@ -135,11 +135,14 @@ object TypeCoercion {

[GitHub] spark pull request #20774: [SPARK-23549][SQL] Cast to timestamp when compari...

2018-03-12 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/20774#discussion_r173701347 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala --- @@ -135,11 +135,14 @@ object TypeCoercion {

[GitHub] spark pull request #20801: [SPARK-23651]Add a check for host name

2018-03-12 Thread 10110346
GitHub user 10110346 opened a pull request: https://github.com/apache/spark/pull/20801 [SPARK-23651]Add a check for host name ## What changes were proposed in this pull request? I encountered a error like this: `org.apache.spark.SparkException: Invalid Spark URL:

[GitHub] spark issue #20659: [DO-NOT-MERGE] Try to update Hive to 2.3.2

2018-03-12 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/20659 @wangyum can you please create a relative JIRA, so that we discuss on the JIRA. I think it is better to discuss and get a conclusion first. ---

[GitHub] spark pull request #19431: [SPARK-18580] [DStreams] [external/kafka-0-10][ex...

2018-03-12 Thread akonopko
Github user akonopko commented on a diff in the pull request: https://github.com/apache/spark/pull/19431#discussion_r173719300 --- Diff: external/kafka-0-8/src/test/scala/org/apache/spark/streaming/kafka/DirectKafkaStreamSuite.scala --- @@ -456,6 +455,60 @@ class

[GitHub] spark pull request #20774: [SPARK-23549][SQL] Cast to timestamp when compari...

2018-03-12 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/20774#discussion_r173708865 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala --- @@ -135,11 +135,14 @@ object TypeCoercion {

[GitHub] spark issue #20785: [SPARK-23640][CORE] Fix hadoop config may override spark...

2018-03-12 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/20785 I think if you're running on yarn, semantically `spark.shuffle.service.port` is a yarn configuration specified in yarn-site.xml. So it seems correct from semantic point. ---

[GitHub] spark pull request #20774: [SPARK-23549][SQL] Cast to timestamp when compari...

2018-03-12 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/20774#discussion_r173715303 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/TypeCoercion.scala --- @@ -135,11 +135,14 @@ object TypeCoercion {

[GitHub] spark issue #20659: [DO-NOT-MERGE] Try to update Hive to 2.3.2

2018-03-12 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/20659 @gatorsmile @cloud-fan what is our plan for such thing? Currently we're using our own forked version, which blocks the support of Hadoop 3

[GitHub] spark issue #20739: [SPARK-23603][SQL]When the length of the json is in a ra...

2018-03-12 Thread cxzl25
Github user cxzl25 commented on the issue: https://github.com/apache/spark/pull/20739 Another solution: #20738 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20738: [SPARK-23603][SQL]When the length of the json is in a ra...

2018-03-12 Thread cxzl25
Github user cxzl25 commented on the issue: https://github.com/apache/spark/pull/20738 Another solution: https://github.com/apache/spark/pull/20739 --- - To unsubscribe, e-mail:

[GitHub] spark issue #20796: [SPARK-23649][SQL] Prevent crashes on schema inferring o...

2018-03-12 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20796 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #20757: [SPARK-23595][SQL] ValidateExternalType should support i...

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20757 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20757: [SPARK-23595][SQL] ValidateExternalType should support i...

2018-03-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20757 **[Test build #88171 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88171/testReport)** for PR 20757 at commit

[GitHub] spark issue #20802: [SPARK-23651][core]Add a check for host name

2018-03-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20802 **[Test build #88176 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88176/testReport)** for PR 20802 at commit

[GitHub] spark issue #20802: [SPARK-23651][core]Add a check for host name

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20802 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1465/

[GitHub] spark issue #20802: [SPARK-23651][core]Add a check for host name

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20802 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20695: [SPARK-21741][ML][PySpark] Python API for DataFrame-base...

2018-03-12 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/20695 gentle ping @MrBago @yogeshg Thanks! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20757: [SPARK-23595][SQL] ValidateExternalType should support i...

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20757 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20757: [SPARK-23595][SQL] ValidateExternalType should support i...

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20757 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88170/ Test PASSed. ---

[GitHub] spark issue #20781: [SPARK-23637][YARN]Yarn might allocate more resource if ...

2018-03-12 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/20781 @jerryshao Thanks again for review. It does exist in my cluster that same container can be processed multiple times, which will make `numExecutorsRunning` negative. I think I've ever

[GitHub] spark issue #20649: [SPARK-23462][SQL] improve missing field error message i...

2018-03-12 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20649 Merged to master and branch-2.3. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #20801: [SPARK-23651]Add a check for host name

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20801 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20801: [SPARK-23651]Add a check for host name

2018-03-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20801 **[Test build #88173 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88173/testReport)** for PR 20801 at commit

[GitHub] spark issue #20801: [SPARK-23651]Add a check for host name

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20801 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88173/ Test FAILed. ---

[GitHub] spark pull request #20801: [SPARK-23651]Add a check for host name

2018-03-12 Thread 10110346
Github user 10110346 closed the pull request at: https://github.com/apache/spark/pull/20801 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #20796: [SPARK-23649][SQL] Prevent crashes on schema inferring o...

2018-03-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20796 **[Test build #88174 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88174/testReport)** for PR 20796 at commit

[GitHub] spark issue #19381: [SPARK-10884][ML] Support prediction on single instance ...

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19381 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1464/

[GitHub] spark issue #20785: [SPARK-23640][CORE] Fix hadoop config may override spark...

2018-03-12 Thread wangyum
Github user wangyum commented on the issue: https://github.com/apache/spark/pull/20785 You are right. In fact, our cluster has two shuffle services, one for production and one for development. We configure `spark.shuffle.service.port` to decide which shuffle service to use. ---

[GitHub] spark issue #20757: [SPARK-23595][SQL] ValidateExternalType should support i...

2018-03-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20757 **[Test build #88170 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88170/testReport)** for PR 20757 at commit

[GitHub] spark issue #19381: [SPARK-10884][ML] Support prediction on single instance ...

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19381 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88175/ Test FAILed. ---

[GitHub] spark issue #19381: [SPARK-10884][ML] Support prediction on single instance ...

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19381 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19381: [SPARK-10884][ML] Support prediction on single instance ...

2018-03-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19381 **[Test build #88175 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88175/testReport)** for PR 19381 at commit

[GitHub] spark issue #19381: [SPARK-10884][ML] Support prediction on single instance ...

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19381 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #20649: [SPARK-23462][SQL] improve missing field error me...

2018-03-12 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20649 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #20802: [SPARK-23651][core]Add a check for host name

2018-03-12 Thread 10110346
GitHub user 10110346 opened a pull request: https://github.com/apache/spark/pull/20802 [SPARK-23651][core]Add a check for host name I encountered an error like this: `org.apache.spark.SparkException: Invalid Spark URL: spark://HeartbeatReceiver@ci_164:42849 at

[GitHub] spark issue #19951: [SPARK-22760][CORE][YARN] When sc.stop() is called, set ...

2018-03-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19951 **[Test build #88177 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88177/testReport)** for PR 19951 at commit

[GitHub] spark issue #20803: [SPARK-23653][SQL] Show sql statement in spark SQL UI

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20803 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20803: [SPARK-23653][SQL] Show sql statement in spark SQL UI

2018-03-12 Thread LantaoJin
Github user LantaoJin commented on the issue: https://github.com/apache/spark/pull/20803 @gatorsmile @cloud-fan Could you add some comments? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #20781: [SPARK-23637][YARN]Yarn might allocate more resource if ...

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20781 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88178/ Test PASSed. ---

[GitHub] spark issue #20781: [SPARK-23637][YARN]Yarn might allocate more resource if ...

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20781 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20781: [SPARK-23637][YARN]Yarn might allocate more resource if ...

2018-03-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20781 **[Test build #88178 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88178/testReport)** for PR 20781 at commit

[GitHub] spark issue #20802: [SPARK-23651][core]Add a check for host name

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20802 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88176/ Test FAILed. ---

[GitHub] spark issue #19381: [SPARK-10884][ML] Support prediction on single instance ...

2018-03-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19381 **[Test build #88179 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88179/testReport)** for PR 19381 at commit

[GitHub] spark issue #20802: [SPARK-23651][core]Add a check for host name

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20802 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19381: [SPARK-10884][ML] Support prediction on single instance ...

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19381 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19381: [SPARK-10884][ML] Support prediction on single instance ...

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19381 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1467/

[GitHub] spark issue #20781: [SPARK-23637][YARN]Yarn might allocate more resource if ...

2018-03-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20781 **[Test build #88178 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88178/testReport)** for PR 20781 at commit

[GitHub] spark issue #20802: [SPARK-23651][core]Add a check for host name

2018-03-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20802 **[Test build #88176 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88176/testReport)** for PR 20802 at commit

[GitHub] spark issue #19881: [SPARK-22683][CORE] Add tasksPerExecutorSlot parameter

2018-03-12 Thread jcuquemelle
Github user jcuquemelle commented on the issue: https://github.com/apache/spark/pull/19881 The new semantics (throttling w.r.t max possible parallelism) is actually simpler to understand. I'm proposing another name which doesn't have any ambiguity with the existing maxExecutors

[GitHub] spark issue #19951: [SPARK-22760][CORE][YARN] When sc.stop() is called, set ...

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19951 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88177/ Test PASSed. ---

[GitHub] spark issue #19951: [SPARK-22760][CORE][YARN] When sc.stop() is called, set ...

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19951 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20796: [SPARK-23649][SQL] Prevent crashes on schema inferring o...

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20796 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/88174/ Test PASSed. ---

[GitHub] spark issue #20796: [SPARK-23649][SQL] Prevent crashes on schema inferring o...

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20796 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20781: [SPARK-23637][YARN]Yarn might allocate more resource if ...

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20781 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #20781: [SPARK-23637][YARN]Yarn might allocate more resource if ...

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20781 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/1466/

[GitHub] spark issue #19951: [SPARK-22760][CORE][YARN] When sc.stop() is called, set ...

2018-03-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19951 **[Test build #88177 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88177/testReport)** for PR 19951 at commit

[GitHub] spark pull request #20803: [SPARK-23653][SQL] Show sql statement in spark SQ...

2018-03-12 Thread LantaoJin
GitHub user LantaoJin opened a pull request: https://github.com/apache/spark/pull/20803 [SPARK-23653][SQL] Show sql statement in spark SQL UI ## What changes were proposed in this pull request? [SPARK-4871](https://issues.apache.org/jira/browse/SPARK-4871) had already

[GitHub] spark issue #20803: [SPARK-23653][SQL] Show sql statement in spark SQL UI

2018-03-12 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20803 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #20800: [SPARK-23627][SQL] Provide isEmpty in DataSet

2018-03-12 Thread mgaido91
Github user mgaido91 commented on a diff in the pull request: https://github.com/apache/spark/pull/20800#discussion_r173812290 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/Dataset.scala --- @@ -511,6 +511,12 @@ class Dataset[T] private[sql]( */ def isLocal:

[GitHub] spark issue #20796: [SPARK-23649][SQL] Prevent crashes on schema inferring o...

2018-03-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20796 **[Test build #88174 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/88174/testReport)** for PR 20796 at commit

[GitHub] spark issue #20600: [SPARK-23412][ML] Add cosine distance to BisectingKMeans

2018-03-12 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20600 **[Test build #4139 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/4139/testReport)** for PR 20600 at commit

[GitHub] spark pull request #20669: [SPARK-22839][K8S] Remove the use of init-contain...

2018-03-12 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/20669#discussion_r173912287 --- Diff: resource-managers/kubernetes/core/src/main/scala/org/apache/spark/deploy/k8s/submit/steps/DriverConfigPropertiesStep.scala --- @@ -0,0 +1,85 @@

[GitHub] spark issue #20803: [SPARK-23653][SQL] Show sql statement in spark SQL UI

2018-03-12 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/20803 what if an SQL execution triggers multiple jobs? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #20763: [SPARK-23523] [SQL] [BACKPORT-2.3] Fix the incorrect res...

2018-03-12 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/20763 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

  1   2   3   >