[GitHub] spark issue #18605: [SparkR][SPARK-21381]:SparkR: pass on setHandleInvalid f...

2017-07-11 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/18605 @felixcheung This is a follow-up PR of JIRA-20307. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #18554: [SPARK-21306][ML] OneVsRest should cache weightCo...

2017-07-11 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/18554#discussion_r126868713 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/OneVsRest.scala --- @@ -317,7 +318,12 @@ final class OneVsRest @Since("1.4.0") (

[GitHub] spark pull request #18600: [SPARK-17701][SQL] Refactor RowDataSourceScanExec...

2017-07-11 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18600#discussion_r126868678 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/DataSourceScanExec.scala --- @@ -73,34 +72,24 @@ trait DataSourceScanExec extends

[GitHub] spark issue #18228: [SPARK-21007][SQL]Add SQL function - RIGHT && LEFT

2017-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18228 **[Test build #79550 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79550/testReport)** for PR 18228 at commit

[GitHub] spark issue #18228: [SPARK-21007][SQL]Add SQL function - RIGHT && LEFT

2017-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18228 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18228: [SPARK-21007][SQL]Add SQL function - RIGHT && LEFT

2017-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18228 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79548/ Test PASSed. ---

[GitHub] spark issue #18228: [SPARK-21007][SQL]Add SQL function - RIGHT && LEFT

2017-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18228 **[Test build #79548 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79548/testReport)** for PR 18228 at commit

[GitHub] spark pull request #18600: [SPARK-17701][SQL] Refactor RowDataSourceScanExec...

2017-07-11 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/18600#discussion_r126866057 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/DataSourceScanExec.scala --- @@ -73,34 +72,24 @@ trait DataSourceScanExec extends

[GitHub] spark issue #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-07-11 Thread janewangfb
Github user janewangfb commented on the issue: https://github.com/apache/spark/pull/18023 @gatorsmile Sure, I could have a follow-up PR to resolve DataFrameNaFunctions.fill. thanks for reviewing this PR. --- If your project is set up for it, you can reply to this

[GitHub] spark pull request #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-07-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18023 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-07-11 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18023 Thanks! Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-07-11 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18023 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #18023: [SPARK-12139] [SQL] REGEX Column Specification

2017-07-11 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18023 The last comment is about `DataFrameNaFunctions.fill`. It does not work when `spark.sql.parser.quotedRegexColumnNames` is on. Could you resolve that in the follow-up PR? --- If your project is

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

2017-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18444 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

2017-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18444 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79547/ Test FAILed. ---

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

2017-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18444 **[Test build #79547 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79547/testReport)** for PR 18444 at commit

[GitHub] spark pull request #18554: [SPARK-21306][ML] OneVsRest should cache weightCo...

2017-07-11 Thread facaiy
Github user facaiy commented on a diff in the pull request: https://github.com/apache/spark/pull/18554#discussion_r126863072 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/OneVsRest.scala --- @@ -317,7 +318,12 @@ final class OneVsRest @Since("1.4.0") (

[GitHub] spark issue #18594: [SPARK-20904][core] Don't report task failures to driver...

2017-07-11 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/18594 I'm hesitant to support the change. If we don't notify the failure to driver, the status of the failed task would not be updated, thus not rescheduled, perhaps it's not the behavior we expect

[GitHub] spark issue #18604: [SPARK-21219][CORE] Task retry occurs on same executor d...

2017-07-11 Thread jsoltren
Github user jsoltren commented on the issue: https://github.com/apache/spark/pull/18604 My preference is to backport this and other blacklisting related fixes as far back as possible on Spark2 - meaning 2.1 and 2.0 as well, unless convinced otherwise. So, yes, @cloud-fan, I hope we

[GitHub] spark pull request #18228: [SPARK-21007][SQL]Add SQL function - RIGHT && LEF...

2017-07-11 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18228#discussion_r126857958 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -1199,6 +1199,49 @@ case class

[GitHub] spark issue #18604: [SPARK-21219][CORE] Task retry occurs on same executor d...

2017-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18604 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18604: [SPARK-21219][CORE] Task retry occurs on same executor d...

2017-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18604 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79545/ Test PASSed. ---

[GitHub] spark issue #18604: [SPARK-21219][CORE] Task retry occurs on same executor d...

2017-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18604 **[Test build #79545 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79545/testReport)** for PR 18604 at commit

[GitHub] spark issue #18555: [SPARK-21353][CORE]add checkValue in spark.internal.conf...

2017-07-11 Thread heary-cao
Github user heary-cao commented on the issue: https://github.com/apache/spark/pull/18555 @gatorsmile @cloud-fan please review it again. thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #18555: [SPARK-21353][CORE]add checkValue in spark.internal.conf...

2017-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18555 **[Test build #79549 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79549/testReport)** for PR 18555 at commit

[GitHub] spark issue #18601: [SPARK-21373][core] Update Jetty to 9.3.20.v20170531

2017-07-11 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/18601 @srowen thank you for your suggestion. I executed `mvn dependency:tree` in the current master and the version with this PR. I confirmed that only the difference is related to

[GitHub] spark issue #18228: [SPARK-21007][SQL]Add SQL function - RIGHT && LEFT

2017-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18228 **[Test build #79548 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79548/testReport)** for PR 18228 at commit

[GitHub] spark issue #18606: [SPARK-21382] The note about Scala 2.10 in building-spar...

2017-07-11 Thread liu-zhaokun
Github user liu-zhaokun commented on the issue: https://github.com/apache/spark/pull/18606 @srowen But now,spark 2.2.0 released.we know exactly that Scala 2.10 isn't removed in Spark 2.2.0,so we shouldn't give the user an inaccurate message. --- If your project is set up for

[GitHub] spark issue #18596: [SPARK-21371] dev/make-distribution.sh scripts use of $@...

2017-07-11 Thread liu-zhaokun
Github user liu-zhaokun commented on the issue: https://github.com/apache/spark/pull/18596 @srowen @jiangxb1987 Hello,I have modified the PR according to your opinion.Could you help me review it again. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #18606: [SPARK-21382] The note about Scala 2.10 in building-spar...

2017-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18606 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #18606: [SPARK-21382] The note about Scala 2.10 in building-spar...

2017-07-11 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/18606 No, the statement was correct. It said may be removed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #18606: [SPARK-21382] The note about Scala 2.10 in buildi...

2017-07-11 Thread liu-zhaokun
GitHub user liu-zhaokun opened a pull request: https://github.com/apache/spark/pull/18606 [SPARK-21382] The note about Scala 2.10 in building-spark.md is wrong. [https://issues.apache.org/jira/browse/SPARK-21382](https://issues.apache.org/jira/browse/SPARK-21382) There should

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

2017-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18444 **[Test build #79547 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79547/testReport)** for PR 18444 at commit

[GitHub] spark issue #18468: [SPARK-20873][SQL] Enhance ColumnVector to support compr...

2017-07-11 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/18468 @cloud-fan could you please review this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18281: [SPARK-21027][ML][PYTHON] Added tunable parallelism to o...

2017-07-11 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/18281 @ajaysaini725 @jkbradley Can we avoid python-side to re-implement the logic of OneVsRest? It can simply python-side code I think. Just let the wrapper inherit `JavaEstimator`, and when we

[GitHub] spark issue #18605: [SparkR][SPARK-21381]:SparkR: pass on setHandleInvalid f...

2017-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18605 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79546/ Test PASSed. ---

[GitHub] spark issue #18605: [SparkR][SPARK-21381]:SparkR: pass on setHandleInvalid f...

2017-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18605 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18605: [SparkR][SPARK-21381]:SparkR: pass on setHandleInvalid f...

2017-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18605 **[Test build #79546 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79546/testReport)** for PR 18605 at commit

[GitHub] spark issue #18428: [Spark-21221][ML] CrossValidator and TrainValidationSpli...

2017-07-11 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/18428 Also, can you please add "OneVsRest" to the PR and JIRA titles since this touches that class? --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request #18428: [Spark-21221][ML] CrossValidator and TrainValidat...

2017-07-11 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/18428#discussion_r126849117 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tuning/ValidatorParams.scala --- @@ -183,8 +198,14 @@ private[ml] object ValidatorParams {

[GitHub] spark issue #18428: [Spark-21221][ML] CrossValidator and TrainValidationSpli...

2017-07-11 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/18428 LGTM I couldn't think of a great way to reduce code duplication between JavaWrapper and OneVsRest. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #18599: [SPARK-21372] spark writes one log file even I set the n...

2017-07-11 Thread liu-zhaokun
Github user liu-zhaokun commented on the issue: https://github.com/apache/spark/pull/18599 @srowen I think spark provides the param,so I can pass it in the script. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request #18599: [SPARK-21372] spark writes one log file even I se...

2017-07-11 Thread liu-zhaokun
Github user liu-zhaokun commented on a diff in the pull request: https://github.com/apache/spark/pull/18599#discussion_r126847486 --- Diff: sbin/spark-daemon.sh --- @@ -78,6 +78,12 @@ spark_rotate_log () if [ -n "$2" ]; then num=$2 --- End diff --

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

2017-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18444 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

2017-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18444 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79544/ Test FAILed. ---

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

2017-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18444 **[Test build #79544 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79544/testReport)** for PR 18444 at commit

[GitHub] spark issue #18143: [SPARK-20919][SS] Simplificaiton of CachedKafkaConsumer ...

2017-07-11 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/18143 @ScrapCodes I think it should be bounded by `spark.sql.kafkaConsumerCache.capacity`. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark issue #18603: [SPARK-21370][SS] Add test for state reliability when on...

2017-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18603 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18603: [SPARK-21370][SS] Add test for state reliability when on...

2017-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18603 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79543/ Test PASSed. ---

[GitHub] spark pull request #18228: [SPARK-21007][SQL]Add SQL function - RIGHT && LEF...

2017-07-11 Thread 10110346
Github user 10110346 commented on a diff in the pull request: https://github.com/apache/spark/pull/18228#discussion_r126842908 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -1199,6 +1199,49 @@ case class

[GitHub] spark pull request #18228: [SPARK-21007][SQL]Add SQL function - RIGHT && LEF...

2017-07-11 Thread 10110346
Github user 10110346 commented on a diff in the pull request: https://github.com/apache/spark/pull/18228#discussion_r126842852 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -1199,6 +1199,49 @@ case class

[GitHub] spark issue #18603: [SPARK-21370][SS] Add test for state reliability when on...

2017-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18603 **[Test build #79543 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79543/testReport)** for PR 18603 at commit

[GitHub] spark issue #18605: [SparkR][SPARK-21381]:SparkR: pass on setHandleInvalid f...

2017-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18605 **[Test build #79546 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79546/testReport)** for PR 18605 at commit

[GitHub] spark pull request #18605: [SparkR][SPARK-21381]:SparkR: pass on setHandleIn...

2017-07-11 Thread wangmiao1981
GitHub user wangmiao1981 opened a pull request: https://github.com/apache/spark/pull/18605 [SparkR][SPARK-21381]:SparkR: pass on setHandleInvalid for classification algorithms ## What changes were proposed in this pull request? SPARK-20307 Added handleInvalid option to

[GitHub] spark issue #18604: [SPARK-21219][CORE] Task retry occurs on same executor d...

2017-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18604 **[Test build #79545 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79545/testReport)** for PR 18604 at commit

[GitHub] spark issue #18604: [SPARK-21219][CORE] Task retry occurs on same executor d...

2017-07-11 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/18604 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #18604: [SPARK-21219][CORE] Task retry occurs on same executor d...

2017-07-11 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/18604 I don't see why we shouldn't backport a fix to 2.2. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #18357: [SPARK-21146] [CORE] Master/Worker should handle and shu...

2017-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18357 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18357: [SPARK-21146] [CORE] Master/Worker should handle and shu...

2017-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18357 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79542/ Test PASSed. ---

[GitHub] spark issue #18357: [SPARK-21146] [CORE] Master/Worker should handle and shu...

2017-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18357 **[Test build #79542 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79542/testReport)** for PR 18357 at commit

[GitHub] spark issue #18604: [SPARK-21219][CORE] Task retry occurs on same executor d...

2017-07-11 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/18604 Do we want to backport this to 2.2? @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #18253: [SPARK-18838][CORE] Introduce multiple queues in LiveLis...

2017-07-11 Thread bOOm-X
Github user bOOm-X commented on the issue: https://github.com/apache/spark/pull/18253 @vanzin I put an ArrayBlockingQueue as you wanted --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #18603: [SPARK-21370][SS] Add test for state reliability when on...

2017-07-11 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/18603 LGTM! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

2017-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18444 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79540/ Test FAILed. ---

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

2017-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18444 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

2017-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18444 **[Test build #79540 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79540/testReport)** for PR 18444 at commit

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

2017-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18444 **[Test build #79544 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79544/testReport)** for PR 18444 at commit

[GitHub] spark issue #18604: [SPARK-21219][CORE] Task retry occurs on same executor d...

2017-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18604 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

2017-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18444 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

2017-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18444 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79539/ Test FAILed. ---

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

2017-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18444 **[Test build #79539 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79539/testReport)** for PR 18444 at commit

[GitHub] spark pull request #18604: [SPARK-21219][CORE] Task retry occurs on same exe...

2017-07-11 Thread jsoltren
GitHub user jsoltren opened a pull request: https://github.com/apache/spark/pull/18604 [SPARK-21219][CORE] Task retry occurs on same executor due to race co… …ndition with blacklisting There's a race condition in the current TaskSetManager where a failed task is added

[GitHub] spark issue #15496: [SPARK-17950] [Python] Match SparseVector behavior with ...

2017-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15496 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #18598: [SPARK-19285] [SQL] Implement UDF0

2017-07-11 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18598 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #18598: [SPARK-19285] [SQL] Implement UDF0

2017-07-11 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18598 Thanks! Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18602: [SPARK-21377][YARN] Add a new configuration to extend AM...

2017-07-11 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/18602 Thanks @vanzin , based on the comment of JIRA, I will try another approach, so closing it for now. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request #18602: [SPARK-21377][YARN] Add a new configuration to ex...

2017-07-11 Thread jerryshao
Github user jerryshao closed the pull request at: https://github.com/apache/spark/pull/18602 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #18603: [SPARK-21370][SS] Add test for state reliability when on...

2017-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18603 **[Test build #79543 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79543/testReport)** for PR 18603 at commit

[GitHub] spark issue #18601: [SPARK-21373][core] Update Jetty to 9.3.20.v20170531

2017-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18601 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18601: [SPARK-21373][core] Update Jetty to 9.3.20.v20170531

2017-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18601 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79538/ Test PASSed. ---

[GitHub] spark issue #18601: [SPARK-21373][core] Update Jetty to 9.3.20.v20170531

2017-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18601 **[Test build #79538 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79538/testReport)** for PR 18601 at commit

[GitHub] spark pull request #18603: [SPARK-21370][SS] Add test for state reliability ...

2017-07-11 Thread brkyvz
GitHub user brkyvz opened a pull request: https://github.com/apache/spark/pull/18603 [SPARK-21370][SS] Add test for state reliability when one read-only state store aborts after read-write state store commits ## What changes were proposed in this pull request? During

[GitHub] spark issue #15009: [SPARK-17443][SPARK-11035] Stop Spark Application if lau...

2017-07-11 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/15009 @kishorvpatil are you planning to address the last bit of feedback remaining here? It shouldn't be that hard to make that test better. --- If your project is set up for it, you can reply to this

[GitHub] spark issue #18602: [SPARK-21377][YARN] Add a new configuration to extend AM...

2017-07-11 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/18602 I commented on the bug. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #18602: [SPARK-21377][YARN] Add a new configuration to extend AM...

2017-07-11 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/18602 CC @vanzin @tgravescs would you please help to review? Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark issue #18357: [SPARK-21146] [CORE] Master/Worker should handle and shu...

2017-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18357 **[Test build #79542 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79542/testReport)** for PR 18357 at commit

[GitHub] spark issue #18357: [SPARK-21146] [CORE] Master/Worker should handle and shu...

2017-07-11 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/18357 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #18602: [SPARK-21377][YARN] Add a new configuration to extend AM...

2017-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18602 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18602: [SPARK-21377][YARN] Add a new configuration to extend AM...

2017-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18602 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79541/ Test PASSed. ---

[GitHub] spark issue #18602: [SPARK-21377][YARN] Add a new configuration to extend AM...

2017-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18602 **[Test build #79541 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79541/testReport)** for PR 18602 at commit

[GitHub] spark issue #18357: [SPARK-21146] [CORE] Master/Worker should handle and shu...

2017-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18357 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/79537/ Test FAILed. ---

[GitHub] spark issue #18357: [SPARK-21146] [CORE] Master/Worker should handle and shu...

2017-07-11 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18357 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types ...

2017-07-11 Thread zasdfgbnm
Github user zasdfgbnm commented on a diff in the pull request: https://github.com/apache/spark/pull/18444#discussion_r126809517 --- Diff: core/src/main/scala/org/apache/spark/api/python/SerDeUtil.scala --- @@ -72,7 +72,11 @@ private[spark] object SerDeUtil extends Logging {

[GitHub] spark issue #18357: [SPARK-21146] [CORE] Master/Worker should handle and shu...

2017-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18357 **[Test build #79537 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79537/testReport)** for PR 18357 at commit

[GitHub] spark issue #18587: [SPARK-12559][Mesos] fix --packages for mesos

2017-07-11 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/18587 I'm 99% sure there's nothing to do for YARN. This line takes care of it: args.jars = mergeFileLists(args.jars, resolvedMavenCoordinates) YARN cluster mode will distribute all

[GitHub] spark issue #18602: [SPARK-21377][YARN] Add a new configuration to extend AM...

2017-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18602 **[Test build #79541 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79541/testReport)** for PR 18602 at commit

[GitHub] spark pull request #18602: [SPARK-21377][YARN] Add a new configuration to ex...

2017-07-11 Thread jerryshao
GitHub user jerryshao opened a pull request: https://github.com/apache/spark/pull/18602 [SPARK-21377][YARN] Add a new configuration to extend AM classpath in yarn client mode ## What changes were proposed in this pull request? This PR propose a new configuration

[GitHub] spark pull request #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types ...

2017-07-11 Thread zasdfgbnm
Github user zasdfgbnm commented on a diff in the pull request: https://github.com/apache/spark/pull/18444#discussion_r126806942 --- Diff: core/src/main/scala/org/apache/spark/api/python/SerDeUtil.scala --- @@ -72,7 +72,11 @@ private[spark] object SerDeUtil extends Logging {

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

2017-07-11 Thread zasdfgbnm
Github user zasdfgbnm commented on the issue: https://github.com/apache/spark/pull/18444 For some reason, I can not reproduce the error on my machine. I run the test using the following command: ```bash PYSPARK_PYTHON=$(which python2) ./bin/spark-submit

[GitHub] spark issue #18444: [SPARK-16542][SQL][PYSPARK] Fix bugs about types that re...

2017-07-11 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18444 **[Test build #79540 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/79540/testReport)** for PR 18444 at commit

  1   2   3   4   5   >