[GitHub] spark pull request #17617: [SPARK-20244][Core] Handle incorrect bytesRead me...

2017-05-30 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/17617#discussion_r119275824 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala --- @@ -143,14 +144,18 @@ class SparkHadoopUtil extends Logging { *

[GitHub] spark issue #17113: [SPARK-13669][Core] Improve the blacklist mechanism to h...

2017-05-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17113 **[Test build #77575 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77575/testReport)** for PR 17113 at commit

[GitHub] spark pull request #12646: [SPARK-14878][SQL] Trim characters string functio...

2017-05-30 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/12646#discussion_r119275552 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala --- @@ -1077,7 +1080,8 @@ class AstBuilder(conf: SQLConf)

[GitHub] spark pull request #17617: [SPARK-20244][Core] Handle incorrect bytesRead me...

2017-05-30 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/17617#discussion_r119275510 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala --- @@ -143,14 +144,18 @@ class SparkHadoopUtil extends Logging { *

[GitHub] spark pull request #18151: [SPARK-20929][ML] LinearSVC should use its own th...

2017-05-30 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/18151#discussion_r119275319 --- Diff: mllib/src/test/scala/org/apache/spark/ml/classification/LinearSVCSuite.scala --- @@ -127,6 +127,14 @@ class LinearSVCSuite extends SparkFunSuite

[GitHub] spark issue #18151: [SPARK-20929][ML] LinearSVC should use its own threshold...

2017-05-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18151 **[Test build #77574 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77574/testReport)** for PR 18151 at commit

[GitHub] spark pull request #17617: [SPARK-20244][Core] Handle incorrect bytesRead me...

2017-05-30 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/17617#discussion_r119275374 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala --- @@ -143,14 +144,18 @@ class SparkHadoopUtil extends Logging { *

[GitHub] spark issue #17603: [SPARK-20288] Avoid generating the MapStatus by stageId ...

2017-05-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17603 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17603: [SPARK-20288] Avoid generating the MapStatus by stageId ...

2017-05-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17603 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77569/ Test PASSed. ---

[GitHub] spark pull request #18151: [SPARK-20929][ML] LinearSVC should use its own th...

2017-05-30 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/18151#discussion_r119275003 --- Diff: R/pkg/R/mllib_classification.R --- @@ -62,7 +62,7 @@ setClass("NaiveBayesModel", representation(jobj = "jobj")) #'

[GitHub] spark issue #17603: [SPARK-20288] Avoid generating the MapStatus by stageId ...

2017-05-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17603 **[Test build #77569 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77569/testReport)** for PR 17603 at commit

[GitHub] spark issue #18153: [SPARK-20931][SQL] ABS function support string type.

2017-05-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18153 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77571/ Test FAILed. ---

[GitHub] spark issue #18153: [SPARK-20931][SQL] ABS function support string type.

2017-05-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18153 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18153: [SPARK-20931][SQL] ABS function support string type.

2017-05-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18153 **[Test build #77571 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77571/testReport)** for PR 18153 at commit

[GitHub] spark pull request #17617: [SPARK-20244][Core] Handle incorrect bytesRead me...

2017-05-30 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/17617#discussion_r119274153 --- Diff: core/src/main/scala/org/apache/spark/deploy/SparkHadoopUtil.scala --- @@ -143,14 +144,18 @@ class SparkHadoopUtil extends Logging { *

[GitHub] spark pull request #18104: [SPARK-20877][SPARKR][WIP] add timestamps to test...

2017-05-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18104 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17617: [SPARK-20244][Core] Handle incorrect bytesRead metrics w...

2017-05-30 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/17617 LGTM, cc @cloud-fan @ueshin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #17617: [SPARK-20244][Core] Handle incorrect bytesRead metrics w...

2017-05-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17617 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17617: [SPARK-20244][Core] Handle incorrect bytesRead metrics w...

2017-05-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17617 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77567/ Test PASSed. ---

[GitHub] spark issue #17617: [SPARK-20244][Core] Handle incorrect bytesRead metrics w...

2017-05-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17617 **[Test build #77567 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77567/testReport)** for PR 17617 at commit

[GitHub] spark issue #18147: [SPARK-19236][SQL][FOLLOW-UP] Added createOrReplaceGloba...

2017-05-30 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/18147 LGTM except for @cloud-fan's comment. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18154: [SPARK-20932][ML]CountVectorizer support handle persiste...

2017-05-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18154 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18154: [SPARK-20932][ML]CountVectorizer support handle persiste...

2017-05-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18154 **[Test build #77572 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77572/testReport)** for PR 18154 at commit

[GitHub] spark issue #18154: [SPARK-20932][ML]CountVectorizer support handle persiste...

2017-05-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18154 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77572/ Test PASSed. ---

[GitHub] spark pull request #18118: SPARK-20199 : Provided featureSubsetStrategy to G...

2017-05-30 Thread mpjlu
Github user mpjlu commented on a diff in the pull request: https://github.com/apache/spark/pull/18118#discussion_r119271935 --- Diff: project/MimaExcludes.scala --- @@ -37,11 +37,15 @@ object MimaExcludes { // Exclude rules for 2.3.x lazy val v23excludes = v22excludes

[GitHub] spark issue #18104: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-30 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/18104 LGTM. Thanks @felixcheung for the update and @marmbrus for the ping --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request #18118: SPARK-20199 : Provided featureSubsetStrategy to G...

2017-05-30 Thread mpjlu
Github user mpjlu commented on a diff in the pull request: https://github.com/apache/spark/pull/18118#discussion_r119271662 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/treeParams.scala --- @@ -441,12 +415,44 @@ private[ml] trait RandomForestParams extends

[GitHub] spark pull request #18118: SPARK-20199 : Provided featureSubsetStrategy to G...

2017-05-30 Thread mpjlu
Github user mpjlu commented on a diff in the pull request: https://github.com/apache/spark/pull/18118#discussion_r119271607 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/treeParams.scala --- @@ -420,18 +394,18 @@ private[ml] trait RandomForestParams extends

[GitHub] spark pull request #18118: SPARK-20199 : Provided featureSubsetStrategy to G...

2017-05-30 Thread mpjlu
Github user mpjlu commented on a diff in the pull request: https://github.com/apache/spark/pull/18118#discussion_r119271552 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/treeParams.scala --- @@ -305,7 +305,7 @@ private[ml] object TreeRegressorParams { }

[GitHub] spark pull request #18153: [SPARK-20931][SQL] ABS function support string ty...

2017-05-30 Thread wangyum
Github user wangyum commented on a diff in the pull request: https://github.com/apache/spark/pull/18153#discussion_r119271567 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/arithmetic.scala --- @@ -97,20 +97,30 @@ case class UnaryPositive(child:

[GitHub] spark pull request #18086: [SPARK-20854][SQL] Extend hint syntax to support ...

2017-05-30 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/18086#discussion_r119271262 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala --- @@ -533,13 +533,16 @@ class AstBuilder(conf: SQLConf) extends

[GitHub] spark pull request #18118: SPARK-20199 : Provided featureSubsetStrategy to G...

2017-05-30 Thread mpjlu
Github user mpjlu commented on a diff in the pull request: https://github.com/apache/spark/pull/18118#discussion_r119271063 --- Diff: mllib/src/main/scala/org/apache/spark/ml/regression/DecisionTreeRegressor.scala --- @@ -99,6 +99,8 @@ class DecisionTreeRegressor @Since("1.4.0")

[GitHub] spark pull request #18118: SPARK-20199 : Provided featureSubsetStrategy to G...

2017-05-30 Thread mpjlu
Github user mpjlu commented on a diff in the pull request: https://github.com/apache/spark/pull/18118#discussion_r119270999 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/GBTClassifier.scala --- @@ -136,12 +136,20 @@ class GBTClassifier @Since("1.4.0") (

[GitHub] spark issue #18118: SPARK-20199 : Provided featureSubsetStrategy to GBTClass...

2017-05-30 Thread pralabhkumar
Github user pralabhkumar commented on the issue: https://github.com/apache/spark/pull/18118 can any one of admin ,please review the pull request. It would be really helpful. Thanks --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #18155: [SPARK-20876][SQL][Backport-2.2]If the input parameter i...

2017-05-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18155 **[Test build #77573 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77573/testReport)** for PR 18155 at commit

[GitHub] spark issue #18155: [SPARK-20876][SQL][Backport-2.2]If the input parameter i...

2017-05-30 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/18155 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #12646: [SPARK-14878][SQL] Trim characters string functio...

2017-05-30 Thread kevinyu98
Github user kevinyu98 commented on a diff in the pull request: https://github.com/apache/spark/pull/12646#discussion_r119269498 --- Diff: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 --- @@ -569,7 +569,9 @@ primaryExpression | '('

[GitHub] spark pull request #12646: [SPARK-14878][SQL] Trim characters string functio...

2017-05-30 Thread kevinyu98
Github user kevinyu98 commented on a diff in the pull request: https://github.com/apache/spark/pull/12646#discussion_r119269209 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala --- @@ -1077,7 +1080,8 @@ class AstBuilder(conf: SQLConf)

[GitHub] spark pull request #18153: [SPARK-20931][SQL] ABS function support string ty...

2017-05-30 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/18153#discussion_r119269154 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/arithmetic.scala --- @@ -97,20 +97,30 @@ case class UnaryPositive(child:

[GitHub] spark issue #18152: [SPARK-20930][ML] Destroy broadcasted centers after comp...

2017-05-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18152 **[Test build #77570 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77570/testReport)** for PR 18152 at commit

[GitHub] spark issue #18152: [SPARK-20930][ML] Destroy broadcasted centers after comp...

2017-05-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18152 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18152: [SPARK-20930][ML] Destroy broadcasted centers after comp...

2017-05-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18152 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77570/ Test PASSed. ---

[GitHub] spark pull request #18086: [SPARK-20854][SQL] Extend hint syntax to support ...

2017-05-30 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18086#discussion_r119268299 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameHintSuite.scala --- @@ -0,0 +1,63 @@ +/* + * Licensed to the Apache Software

[GitHub] spark issue #18155: [SPARK-20876][SQL][Backport-2.2]If the input parameter i...

2017-05-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18155 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #17770: [SPARK-20392][SQL] Set barrier to prevent re-entering a ...

2017-05-30 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/17770 reverted, thanks for your understanding! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #18155: [SPARK-20876][SQL][Backport-2.2]If the input para...

2017-05-30 Thread 10110346
GitHub user 10110346 opened a pull request: https://github.com/apache/spark/pull/18155 [SPARK-20876][SQL][Backport-2.2]If the input parameter is float type for ceil or floor,the result is not we expected ## What changes were proposed in this pull request? This PR is to

[GitHub] spark issue #18154: [SPARK-20932][ML]CountVectorizer support handle persiste...

2017-05-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18154 **[Test build #77572 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77572/testReport)** for PR 18154 at commit

[GitHub] spark pull request #18147: [SPARK-19236][SQL][FOLLOW-UP] Added createOrRepla...

2017-05-30 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18147#discussion_r119267756 --- Diff: python/pyspark/sql/dataframe.py --- @@ -191,6 +191,23 @@ def createGlobalTempView(self, name): """

[GitHub] spark pull request #18086: [SPARK-20854][SQL] Extend hint syntax to support ...

2017-05-30 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18086#discussion_r119267579 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala --- @@ -407,7 +407,7 @@ class AstBuilder(conf: SQLConf)

[GitHub] spark pull request #18086: [SPARK-20854][SQL] Extend hint syntax to support ...

2017-05-30 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18086#discussion_r119267472 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameHintSuite.scala --- @@ -0,0 +1,63 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #18154: [SPARK-20932][ML]CountVectorizer support handle p...

2017-05-30 Thread zhengruifeng
GitHub user zhengruifeng opened a pull request: https://github.com/apache/spark/pull/18154 [SPARK-20932][ML]CountVectorizer support handle persistence ## What changes were proposed in this pull request? unpersist RDDs `input` & `wordCounts` after computation ## How was

[GitHub] spark pull request #18086: [SPARK-20854][SQL] Extend hint syntax to support ...

2017-05-30 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18086#discussion_r119266987 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/parser/PlanParserSuite.scala --- @@ -525,47 +525,117 @@ class PlanParserSuite

[GitHub] spark pull request #18086: [SPARK-20854][SQL] Extend hint syntax to support ...

2017-05-30 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18086#discussion_r119266645 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/DSLHintSuite.scala --- @@ -0,0 +1,59 @@ +/* + * Licensed to the

[GitHub] spark pull request #18086: [SPARK-20854][SQL] Extend hint syntax to support ...

2017-05-30 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18086#discussion_r119266605 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/DSLHintSuite.scala --- @@ -0,0 +1,59 @@ +/* + * Licensed to the

[GitHub] spark pull request #18086: [SPARK-20854][SQL] Extend hint syntax to support ...

2017-05-30 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18086#discussion_r119266598 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/analysis/DSLHintSuite.scala --- @@ -0,0 +1,59 @@ +/* + * Licensed to the

[GitHub] spark issue #18147: [SPARK-19236][SQL][FOLLOW-UP] Added createOrReplaceGloba...

2017-05-30 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/18147 cc @cloud-fan @ueshin --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18153: [SPARK-20931][SQL] ABS function support string type.

2017-05-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18153 **[Test build #77571 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77571/testReport)** for PR 18153 at commit

[GitHub] spark pull request #18153: [SPARK-20931][SQL] ABS function support string ty...

2017-05-30 Thread wangyum
GitHub user wangyum opened a pull request: https://github.com/apache/spark/pull/18153 [SPARK-20931][SQL] ABS function support string type. ## What changes were proposed in this pull request? ABS function support string type. Hive/MySQL support this feature. Ref:

[GitHub] spark pull request #12646: [SPARK-14878][SQL] Trim characters string functio...

2017-05-30 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/12646#discussion_r119265202 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala --- @@ -1077,7 +1080,8 @@ class AstBuilder(conf: SQLConf)

[GitHub] spark pull request #12646: [SPARK-14878][SQL] Trim characters string functio...

2017-05-30 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/12646#discussion_r119265297 --- Diff: sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 --- @@ -569,7 +569,9 @@ primaryExpression | '('

[GitHub] spark issue #17936: [SPARK-20638][Core]Optimize the CartesianRDD to reduce r...

2017-05-30 Thread ConeyLiu
Github user ConeyLiu commented on the issue: https://github.com/apache/spark/pull/17936 Hi @rxin, would you mind take a look? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17995: [SPARK-20762][ML]Make String Params Case-Insensitive

2017-05-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17995 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17995: [SPARK-20762][ML]Make String Params Case-Insensitive

2017-05-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17995 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77568/ Test PASSed. ---

[GitHub] spark issue #17995: [SPARK-20762][ML]Make String Params Case-Insensitive

2017-05-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17995 **[Test build #77568 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77568/testReport)** for PR 17995 at commit

[GitHub] spark issue #17770: [SPARK-20392][SQL] Set barrier to prevent re-entering a ...

2017-05-30 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/17770 @cloud-fan Ok. No problem for me. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17770: [SPARK-20392][SQL] Set barrier to prevent re-entering a ...

2017-05-30 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/17770 Hi @viirya , as this PR already missed the Spark 2.2 release, I'd like to revert it and re-merge it at the end of Spark 2.3, so that future analyzer related PRs won't get conflicted when

[GitHub] spark pull request #17588: [SPARK-20275][UI] Do not display "Completed" colu...

2017-05-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17588 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17588: [SPARK-20275][UI] Do not display "Completed" column for ...

2017-05-30 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/17588 LGTM, merging to master/2.2! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #18104: [SPARK-20877][SPARKR][WIP] add timestamps to test runs

2017-05-30 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/18104 ok passes. @shivaram what do you think about this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #18139: [SPARK-20787][PYTHON] PySpark can't handle dateti...

2017-05-30 Thread facaiy
Github user facaiy commented on a diff in the pull request: https://github.com/apache/spark/pull/18139#discussion_r119263608 --- Diff: python/pyspark/sql/types.py --- @@ -187,8 +187,11 @@ def needConversion(self): def toInternal(self, dt): if dt is not

[GitHub] spark issue #18152: [SPARK-20930][ML] Destroy broadcasted centers after comp...

2017-05-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18152 **[Test build #77570 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77570/testReport)** for PR 18152 at commit

[GitHub] spark pull request #17998: [SPARK-20703][SQL][WIP] Add an operator for writi...

2017-05-30 Thread viirya
Github user viirya closed the pull request at: https://github.com/apache/spark/pull/17998 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17998: [SPARK-20703][SQL][WIP] Add an operator for writing data...

2017-05-30 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/17998 #18064 is merged. Since it changes relative classes and code paths a lot. And seems an alternative approach for showing the metrics of writing data out is better. I'd close this and create a new PR

[GitHub] spark pull request #18152: [SPARK-20930][ML] Destroy broadcasted centers aft...

2017-05-30 Thread zhengruifeng
GitHub user zhengruifeng opened a pull request: https://github.com/apache/spark/pull/18152 [SPARK-20930][ML] Destroy broadcasted centers after computing cost in KMeans ## What changes were proposed in this pull request? Destroy broadcasted centers after computing cost ##

[GitHub] spark pull request #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations...

2017-05-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18064 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #17540: [SPARK-20213][SQL][UI] Fix DataFrameWriter operat...

2017-05-30 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17540 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

2017-05-30 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18064 thanks for the review, merging to master! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #18041: [SPARK-20816][CORE] MetricsConfig doen't trim the proper...

2017-05-30 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/18041 @srowen , this issue existed when reading from metrics.properties conf file, I think we should fix this part. As for SparkConf part, I don't think it is necessary to fix. --- If your project is

[GitHub] spark pull request #12646: [SPARK-14878][SQL] Trim characters string functio...

2017-05-30 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/12646#discussion_r119261589 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala --- @@ -2616,4 +2617,66 @@ class SQLQuerySuite extends QueryTest with

[GitHub] spark pull request #12646: [SPARK-14878][SQL] Trim characters string functio...

2017-05-30 Thread wzhfy
Github user wzhfy commented on a diff in the pull request: https://github.com/apache/spark/pull/12646#discussion_r119261484 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/stringExpressions.scala --- @@ -461,68 +462,269 @@ case class

[GitHub] spark issue #18120: [SPARK-20498][PYSPARK][ML] Expose getMaxDepth for ensemb...

2017-05-30 Thread facaiy
Github user facaiy commented on the issue: https://github.com/apache/spark/pull/18120 Thanks, @BryanCutler. It seems that #17849 copys `Params` from `Estimator` to `Model` automatically, which is pretty useful. However, `getter` method is still missing and need to be added

[GitHub] spark issue #17603: [SPARK-20288] Avoid generating the MapStatus by stageId ...

2017-05-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17603 **[Test build #77569 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77569/testReport)** for PR 17603 at commit

[GitHub] spark issue #17603: [SPARK-20288] Avoid generating the MapStatus by stageId ...

2017-05-30 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/17603 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #17603: [SPARK-20288] Avoid generating the MapStatus by stageId ...

2017-05-30 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/17603 @squito Thank you so much :-) :-) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17312: [SPARK-19973] Display num of executors for the stage.

2017-05-30 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/17312 Sorry, I will close it for now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #17312: [SPARK-19973] Display num of executors for the st...

2017-05-30 Thread jinxing64
Github user jinxing64 closed the pull request at: https://github.com/apache/spark/pull/17312 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17634: [SPARK-20333] HashPartitioner should be compatible with ...

2017-05-30 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/17634 @squito Thanks a lot for merging :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #17113: [SPARK-13669][Core] Improve the blacklist mechani...

2017-05-30 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/17113#discussion_r119260232 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskSchedulerImpl.scala --- @@ -54,7 +54,7 @@ import org.apache.spark.util.{AccumulatorV2,

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

2017-05-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18064 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

2017-05-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18064 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77562/ Test PASSed. ---

[GitHub] spark issue #18064: [SPARK-20213][SQL] Fix DataFrameWriter operations in SQL...

2017-05-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18064 **[Test build #77562 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77562/testReport)** for PR 18064 at commit

[GitHub] spark issue #17995: [SPARK-20762][ML]Make String Params Case-Insensitive

2017-05-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17995 **[Test build #77568 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77568/testReport)** for PR 17995 at commit

[GitHub] spark issue #17014: [SPARK-18608][ML] Fix double-caching in ML algorithms

2017-05-30 Thread zhengruifeng
Github user zhengruifeng commented on the issue: https://github.com/apache/spark/pull/17014 ping @MLnick Can you help reviewing this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #18147: [SPARK-19236][SQL][FOLLOW-UP] Added createOrReplaceGloba...

2017-05-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18147 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18147: [SPARK-19236][SQL][FOLLOW-UP] Added createOrReplaceGloba...

2017-05-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18147 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77563/ Test PASSed. ---

[GitHub] spark issue #18075: [SPARK-18016][SQL][CATALYST] Code Generation: Constant P...

2017-05-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18075 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18075: [SPARK-18016][SQL][CATALYST] Code Generation: Constant P...

2017-05-30 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18075 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/77564/ Test FAILed. ---

[GitHub] spark issue #18147: [SPARK-19236][SQL][FOLLOW-UP] Added createOrReplaceGloba...

2017-05-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18147 **[Test build #77563 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77563/testReport)** for PR 18147 at commit

[GitHub] spark issue #18075: [SPARK-18016][SQL][CATALYST] Code Generation: Constant P...

2017-05-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18075 **[Test build #77564 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77564/testReport)** for PR 18075 at commit

[GitHub] spark issue #17617: [SPARK-20244][Core] Handle incorrect bytesRead metrics w...

2017-05-30 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17617 **[Test build #77567 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/77567/testReport)** for PR 17617 at commit

  1   2   3   4   5   6   >