[GitHub] spark pull request #19047: [SPARK-21798]: No config to replace deprecated SP...

2017-08-25 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/19047#discussion_r135247004 --- Diff: launcher/src/main/java/org/apache/spark/launcher/AbstractCommandBuilder.java --- @@ -136,7 +136,8 @@ void addOptionString(List cmd, String

[GitHub] spark pull request #19053: [SPARK-21837][SQL][TESTS] UserDefinedTypeSuite lo...

2017-08-25 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/19053#discussion_r135235516 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/UserDefinedTypeSuite.scala --- @@ -203,12 +203,14 @@ class UserDefinedTypeSuite extends QueryTest

[GitHub] spark issue #18730: [SPARK-21527][CORE] Use buffer limit in order to use JAV...

2017-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18730 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #19008: [SPARK-21756][SQL]Add JSON option to allow unquoted cont...

2017-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19008 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81126/ Test PASSed. ---

[GitHub] spark issue #18730: [SPARK-21527][CORE] Use buffer limit in order to use JAV...

2017-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18730 **[Test build #81125 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81125/testReport)** for PR 18730 at commit

[GitHub] spark issue #18730: [SPARK-21527][CORE] Use buffer limit in order to use JAV...

2017-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18730 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81125/ Test PASSed. ---

[GitHub] spark issue #19008: [SPARK-21756][SQL]Add JSON option to allow unquoted cont...

2017-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19008 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #19008: [SPARK-21756][SQL]Add JSON option to allow unquoted cont...

2017-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19008 **[Test build #81126 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81126/testReport)** for PR 19008 at commit

[GitHub] spark issue #15435: [SPARK-17139][ML] Add model summary for MultinomialLogis...

2017-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15435 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15435: [SPARK-17139][ML] Add model summary for MultinomialLogis...

2017-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15435 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81124/ Test PASSed. ---

[GitHub] spark issue #15435: [SPARK-17139][ML] Add model summary for MultinomialLogis...

2017-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15435 **[Test build #81124 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81124/testReport)** for PR 15435 at commit

[GitHub] spark issue #19029: [SPARK-21818][ML][MLLIB] Fix bug of MultivariateOnlineSu...

2017-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19029 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #19029: [SPARK-21818][ML][MLLIB] Fix bug of MultivariateOnlineSu...

2017-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19029 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81129/ Test PASSed. ---

[GitHub] spark issue #19029: [SPARK-21818][ML][MLLIB] Fix bug of MultivariateOnlineSu...

2017-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19029 **[Test build #81129 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81129/testReport)** for PR 19029 at commit

[GitHub] spark issue #19029: [SPARK-21818][ML][MLLIB] Fix bug of MultivariateOnlineSu...

2017-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19029 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81127/ Test PASSed. ---

[GitHub] spark issue #19029: [SPARK-21818][ML][MLLIB] Fix bug of MultivariateOnlineSu...

2017-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19029 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #19029: [SPARK-21818][ML][MLLIB] Fix bug of MultivariateOnlineSu...

2017-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19029 **[Test build #81127 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81127/testReport)** for PR 19029 at commit

[GitHub] spark issue #19053: [SPARK-21837][SQL][TESTS] UserDefinedTypeSuite local UDF...

2017-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19053 **[Test build #81130 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81130/testReport)** for PR 19053 at commit

[GitHub] spark issue #18994: [SPARK-21784][SQL] Adds support for defining information...

2017-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18994 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18994: [SPARK-21784][SQL] Adds support for defining information...

2017-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18994 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81123/ Test PASSed. ---

[GitHub] spark pull request #19053: [SPARK-21837][SQL][TESTS] UserDefinedTypeSuite lo...

2017-08-25 Thread srowen
GitHub user srowen opened a pull request: https://github.com/apache/spark/pull/19053 [SPARK-21837][SQL][TESTS] UserDefinedTypeSuite local UDFs not actually testing what it intends ## What changes were proposed in this pull request? Adjust Local UDTs test to assert about

[GitHub] spark issue #18994: [SPARK-21784][SQL] Adds support for defining information...

2017-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18994 **[Test build #81123 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81123/testReport)** for PR 18994 at commit

[GitHub] spark issue #18787: [SPARK-21583][SQL] Create a ColumnarBatch from ArrowColu...

2017-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18787 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #18787: [SPARK-21583][SQL] Create a ColumnarBatch from ArrowColu...

2017-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18787 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81122/ Test PASSed. ---

[GitHub] spark issue #18787: [SPARK-21583][SQL] Create a ColumnarBatch from ArrowColu...

2017-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18787 **[Test build #81122 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81122/testReport)** for PR 18787 at commit

[GitHub] spark issue #18902: [SPARK-21690][ML] one-pass imputer

2017-08-25 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/18902 @zhengruifeng DataFrame-based operation is 2~3x slower than RDD-based operation is a known issue, because of the deserialization cost. If we switch to RDD-based method, we need to implement our

[GitHub] spark issue #18918: [SPARK-21707][SQL]Improvement a special case for non-det...

2017-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/18918 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #19050: [SPARK-21835][SQL][WIP] RewritePredicateSubquery should ...

2017-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19050 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81121/ Test PASSed. ---

[GitHub] spark pull request #18918: [SPARK-21707][SQL]Improvement a special case for ...

2017-08-25 Thread heary-cao
GitHub user heary-cao reopened a pull request: https://github.com/apache/spark/pull/18918 [SPARK-21707][SQL]Improvement a special case for non-deterministic filters in optimizer ## What changes were proposed in this pull request? Currently, Did a lot of special handling

[GitHub] spark issue #19050: [SPARK-21835][SQL][WIP] RewritePredicateSubquery should ...

2017-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19050 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #19050: [SPARK-21835][SQL][WIP] RewritePredicateSubquery should ...

2017-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19050 **[Test build #81121 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81121/testReport)** for PR 19050 at commit

[GitHub] spark issue #19029: [SPARK-21818][ML][MLLIB] Fix bug of MultivariateOnlineSu...

2017-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19029 **[Test build #81129 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81129/testReport)** for PR 19029 at commit

[GitHub] spark issue #19051: [MINOR][BUILD] Fix build warnings and Java lint errors

2017-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19051 **[Test build #3902 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3902/testReport)** for PR 19051 at commit

[GitHub] spark issue #18730: [SPARK-21527][CORE] Use buffer limit in order to use JAV...

2017-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18730 **[Test build #81128 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81128/testReport)** for PR 18730 at commit

[GitHub] spark issue #19051: [MINOR][BUILD] Fix build warnings and Java lint errors

2017-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19051 **[Test build #3901 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3901/testReport)** for PR 19051 at commit

[GitHub] spark issue #19029: [SPARK-21818][ML][MLLIB] Fix bug of MultivariateOnlineSu...

2017-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19029 **[Test build #81127 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81127/testReport)** for PR 19029 at commit

[GitHub] spark pull request #19029: [SPARK-21818][ML][MLLIB] Fix bug of MultivariateO...

2017-08-25 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/19029#discussion_r135216154 --- Diff: mllib/src/main/scala/org/apache/spark/ml/optim/WeightedLeastSquares.scala --- @@ -440,7 +440,7 @@ private[ml] object WeightedLeastSquares {

[GitHub] spark issue #19052: [Doc] ExchangeCoordinator description num error

2017-08-25 Thread LiShuMing
Github user LiShuMing commented on the issue: https://github.com/apache/spark/pull/19052 Sorry, don't pull this request. I will close this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #19052: [Doc] ExchangeCoordinator description num error

2017-08-25 Thread LiShuMing
Github user LiShuMing closed the pull request at: https://github.com/apache/spark/pull/19052 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #19052: [Doc] ExchangeCoordinator description num error

2017-08-25 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19052 Isn't this already fixed in https://github.com/apache/spark/commit/846bc61cf5aa522dc755d50359ef3856ef2b17bf? --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #19008: [SPARK-21756][SQL]Add JSON option to allow unquoted cont...

2017-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19008 **[Test build #81126 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81126/testReport)** for PR 19008 at commit

[GitHub] spark issue #17461: [SPARK-20082][ml] LDA incremental model learning

2017-08-25 Thread mdespriee
Github user mdespriee commented on the issue: https://github.com/apache/spark/pull/17461 Hi @hhbyyh, @jkbradley a gentle ping on this PR. It's not WIP anymore, and ready for a review. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request #18730: [SPARK-21527][CORE] Use buffer limit in order to ...

2017-08-25 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18730#discussion_r135203892 --- Diff: core/src/main/scala/org/apache/spark/internal/config/package.scala --- @@ -293,6 +293,13 @@ package object config { .booleanConf

[GitHub] spark issue #18730: [SPARK-21527][CORE] Use buffer limit in order to use JAV...

2017-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18730 **[Test build #81125 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81125/testReport)** for PR 18730 at commit

[GitHub] spark pull request #18730: [SPARK-21527][CORE] Use buffer limit in order to ...

2017-08-25 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/18730#discussion_r135203827 --- Diff: core/src/main/scala/org/apache/spark/util/io/ChunkedByteBuffer.scala --- @@ -56,7 +63,9 @@ private[spark] class ChunkedByteBuffer(var chunks:

[GitHub] spark issue #18730: [SPARK-21527][CORE] Use buffer limit in order to use JAV...

2017-08-25 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/18730 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #19052: [Doc] ExchangeCoordinator description num error

2017-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19052 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #19052: [Doc] ExchangeCoordinator description num error

2017-08-25 Thread LiShuMing
GitHub user LiShuMing opened a pull request: https://github.com/apache/spark/pull/19052 [Doc] ExchangeCoordinator description num error ## What changes were proposed in this pull request? In `ExchangeCoordinator.scala` , this maybe just a mistake occasionally which is

[GitHub] spark issue #15435: [SPARK-17139][ML] Add model summary for MultinomialLogis...

2017-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15435 **[Test build #81124 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81124/testReport)** for PR 15435 at commit

[GitHub] spark issue #15435: [SPARK-17139][ML] Add model summary for MultinomialLogis...

2017-08-25 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/15435 Jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #19025: [SPARK-21813][core] Modify TaskMemoryManager.MAXI...

2017-08-25 Thread Geek-He
Github user Geek-He commented on a diff in the pull request: https://github.com/apache/spark/pull/19025#discussion_r135200981 --- Diff: core/src/main/java/org/apache/spark/memory/TaskMemoryManager.java --- @@ -53,7 +53,7 @@ * retrieve the base object. * * This

[GitHub] spark issue #18994: [SPARK-21784][SQL] Adds support for defining information...

2017-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18994 **[Test build #81123 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81123/testReport)** for PR 18994 at commit

[GitHub] spark issue #19049: [WEB-UI]Add the 'master' column to identify the type of ...

2017-08-25 Thread guoxiaolongzte
Github user guoxiaolongzte commented on the issue: https://github.com/apache/spark/pull/19049 spark.mesos.dispatcher.historyServer.url Set the URL of the http://spark.apache.org/docs/latest/monitoring.html#viewing-after-the-fact;>history server. The dispatcher will

[GitHub] spark issue #19016: [SPARK-21805][SPARKR] Disable R vignettes code on Window...

2017-08-25 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/19016 I tested with the nightly, it passed https://builder.r-hub.io/status/SparkR_2.2.0.tar.gz-fba296d2142edeb8bcdb082e311d8462 --- If your project is set up for it, you can reply to this email

[GitHub] spark issue #18787: [SPARK-21583][SQL] Create a ColumnarBatch from ArrowColu...

2017-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/18787 **[Test build #81122 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81122/testReport)** for PR 18787 at commit

[GitHub] spark issue #18787: [SPARK-21583][SQL] Create a ColumnarBatch from ArrowColu...

2017-08-25 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/18787 Updated to use the new API for ColumnarBatch, please take a look @ueshin @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #16138: [SPARK-16609] Add to_date/to_timestamp with format funct...

2017-08-25 Thread YannByron
Github user YannByron commented on the issue: https://github.com/apache/spark/pull/16138 @anabranch I met a failure case when using `to_date`, like this: ``` spark-sql> select func(to_date('2017-08-25 12:00:00')); ``` `func` is a custom udf which extends

[GitHub] spark issue #19051: [MINOR][BUILD] Fix build warnings and Java lint errors

2017-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19051 **[Test build #3901 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3901/testReport)** for PR 19051 at commit

[GitHub] spark issue #19050: [SPARK-21835][SQL][WIP] RewritePredicateSubquery should ...

2017-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19050 **[Test build #81121 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81121/testReport)** for PR 19050 at commit

[GitHub] spark issue #19049: [WEB-UI]Add the 'master' column to identify the type of ...

2017-08-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/19049 I don't know how else to ask the question. I'd close this if there's no answer to 'why' this is of use. --- If your project is set up for it, you can reply to this email and have your reply appear

[GitHub] spark issue #19050: [SPARK-21835][SQL][WIP] RewritePredicateSubquery should ...

2017-08-25 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/19050 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #19048: [SPARK-21834] Incorrect executor request in case of dyna...

2017-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19048 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81116/ Test FAILed. ---

[GitHub] spark pull request #19025: [SPARK-21813][core] Modify TaskMemoryManager.MAXI...

2017-08-25 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/19025#discussion_r135195514 --- Diff: core/src/main/java/org/apache/spark/memory/TaskMemoryManager.java --- @@ -53,7 +53,7 @@ * retrieve the base object. * * This

[GitHub] spark issue #19048: [SPARK-21834] Incorrect executor request in case of dyna...

2017-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19048 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #19048: [SPARK-21834] Incorrect executor request in case of dyna...

2017-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19048 **[Test build #81116 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81116/testReport)** for PR 19048 at commit

[GitHub] spark issue #15435: [SPARK-17139][ML] Add model summary for MultinomialLogis...

2017-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15435 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15435: [SPARK-17139][ML] Add model summary for MultinomialLogis...

2017-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15435 **[Test build #81119 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81119/testReport)** for PR 15435 at commit

[GitHub] spark issue #19050: [SPARK-21835][SQL][WIP] RewritePredicateSubquery should ...

2017-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19050 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81117/ Test FAILed. ---

[GitHub] spark issue #19051: [MINOR][BUILD] Fix build warnings and Java lint errors

2017-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19051 **[Test build #81120 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81120/testReport)** for PR 19051 at commit

[GitHub] spark issue #19050: [SPARK-21835][SQL][WIP] RewritePredicateSubquery should ...

2017-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19050 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15435: [SPARK-17139][ML] Add model summary for MultinomialLogis...

2017-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15435 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81119/ Test FAILed. ---

[GitHub] spark issue #19050: [SPARK-21835][SQL][WIP] RewritePredicateSubquery should ...

2017-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19050 **[Test build #81117 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81117/testReport)** for PR 19050 at commit

[GitHub] spark issue #19051: [MINOR][BUILD] Fix build warnings and Java lint errors

2017-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19051 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #19051: [MINOR][BUILD] Fix build warnings and Java lint errors

2017-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19051 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81120/ Test FAILed. ---

[GitHub] spark pull request #19025: [SPARK-21813][core] Modify TaskMemoryManager.MAXI...

2017-08-25 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/19025#discussion_r135195213 --- Diff: core/src/main/java/org/apache/spark/memory/TaskMemoryManager.java --- @@ -74,7 +74,7 @@ * Maximum supported data page size (in bytes). In

[GitHub] spark issue #19049: [WEB-UI]Add the 'master' column to identify the type of ...

2017-08-25 Thread guoxiaolongzte
Github user guoxiaolongzte commented on the issue: https://github.com/apache/spark/pull/19049 When the application starts, spark will generate an app directory in the event log directory. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #19037: SPARK-21825: change Set(5, 3) to Seq(5, 3, 5) & Set(2, 3...

2017-08-25 Thread iamhumanbeing
Github user iamhumanbeing commented on the issue: https://github.com/apache/spark/pull/19037 ok. I will close this PR. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request #19037: SPARK-21825: change Set(5, 3) to Seq(5, 3, 5) & S...

2017-08-25 Thread iamhumanbeing
Github user iamhumanbeing closed the pull request at: https://github.com/apache/spark/pull/19037 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #19049: [WEB-UI]Add the 'master' column to identify the type of ...

2017-08-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/19049 When would the history server receive events from clusters with different resource managers? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark issue #19029: [SPARK-21818][ML][MLLIB] Fix bug of MultivariateOnlineSu...

2017-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19029 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/81118/ Test PASSed. ---

[GitHub] spark issue #19029: [SPARK-21818][ML][MLLIB] Fix bug of MultivariateOnlineSu...

2017-08-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19029 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #19029: [SPARK-21818][ML][MLLIB] Fix bug of MultivariateOnlineSu...

2017-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19029 **[Test build #81118 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81118/testReport)** for PR 19029 at commit

[GitHub] spark issue #19049: [WEB-UI]Add the 'master' column to identify the type of ...

2017-08-25 Thread guoxiaolongzte
Github user guoxiaolongzte commented on the issue: https://github.com/apache/spark/pull/19049 Sorry,I do not understand what you mean. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #19049: [WEB-UI]Add the 'master' column to identify the type of ...

2017-08-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/19049 This still isn't addressing the point: when would they not _all_ be YARN? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #19049: [WEB-UI]Add the 'master' column to identify the type of ...

2017-08-25 Thread guoxiaolongzte
Github user guoxiaolongzte commented on the issue: https://github.com/apache/spark/pull/19049 For example, I would like to view some of the applications of the resource schedule of yarn, I can sort the 'master' column. --- If your project is set up for it, you can reply to this

[GitHub] spark issue #19049: [WEB-UI]Add the 'master' column to identify the type of ...

2017-08-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/19049 What does knowing the resource scheduler help? but my point is, it's already known in general. A history server most certainly collects history from different users' apps, but not from different

[GitHub] spark issue #19049: [WEB-UI]Add the 'master' column to identify the type of ...

2017-08-25 Thread guoxiaolongzte
Github user guoxiaolongzte commented on the issue: https://github.com/apache/spark/pull/19049 1.It is more convenient for the observer to more easily know the resource scheduling mode of the current spark application. 2.For the 'Spark User' column. It would be identical in

[GitHub] spark pull request #18488: [SPARK-21255][SQL][WIP] Fixed NPE when creating e...

2017-08-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/18488 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #18488: [SPARK-21255][SQL][WIP] Fixed NPE when creating encoder ...

2017-08-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/18488 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #19051: [MINOR][BUILD] Fix build warnings and Java lint errors

2017-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19051 **[Test build #81120 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81120/testReport)** for PR 19051 at commit

[GitHub] spark pull request #19051: [MINOR][BUILD] Fix build warnings and Java lint e...

2017-08-25 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/19051#discussion_r135190132 --- Diff: mllib/src/test/scala/org/apache/spark/ml/tuning/CrossValidatorSuite.scala --- @@ -187,14 +187,13 @@ class CrossValidatorSuite

[GitHub] spark pull request #19051: [MINOR][BUILD] Fix build warnings and Java lint e...

2017-08-25 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/19051#discussion_r135190085 --- Diff: common/kvstore/src/main/java/org/apache/spark/util/kvstore/KVStoreIterator.java --- @@ -31,7 +32,7 @@ * */ @Private -public

[GitHub] spark pull request #19051: [MINOR][BUILD] Fix build warnings and Java lint e...

2017-08-25 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/19051#discussion_r135190194 --- Diff: pom.xml --- @@ -2058,7 +2058,7 @@ ${java.version} -target ${java.version} -

[GitHub] spark pull request #19051: [MINOR][BUILD] Fix build warnings and Java lint e...

2017-08-25 Thread srowen
GitHub user srowen opened a pull request: https://github.com/apache/spark/pull/19051 [MINOR][BUILD] Fix build warnings and Java lint errors ## What changes were proposed in this pull request? Fix build warnings and Java lint errors. This just helps a bit in evaluating

[GitHub] spark issue #19049: [WEB-UI]Add the 'master' column to identify the type of ...

2017-08-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/19049 What's the value of this column? In just about all cases it will have the same value in every row, like 'yarn'. Even if not, why is it useful? --- If your project is set up for it, you can reply to

[GitHub] spark issue #19049: [WEB-UI]Add the 'master' column to identify the type of ...

2017-08-25 Thread guoxiaolongzte
Github user guoxiaolongzte commented on the issue: https://github.com/apache/spark/pull/19049 Sorry, I did not understand what you meant. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15435: [SPARK-17139][ML] Add model summary for MultinomialLogis...

2017-08-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15435 **[Test build #81119 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/81119/testReport)** for PR 15435 at commit

[GitHub] spark issue #15435: [SPARK-17139][ML] Add model summary for MultinomialLogis...

2017-08-25 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/15435 Jenkins test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #19049: [WEB-UI]Add the 'master' column to identify the type of ...

2017-08-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/19049 Why? It would be identical in almost all use cases. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #19037: SPARK-21825: change Set(5, 3) to Seq(5, 3, 5) & Set(2, 3...

2017-08-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/19037 Same, why do you think the test can or should be more specific? There is no motivation --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

<    1   2   3   4   >