[GitHub] spark issue #17652: [SPARK-20335] [SQL] [BACKPORT-2.1] Children expressions ...

2017-04-17 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/17652 thanks, merging to 2.1! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #17623: [SPARK-20292][SQL] Clean up string representation...

2017-04-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/17623#discussion_r111717917 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/trees/TreeNode.scala --- @@ -422,40 +422,62 @@ abstract class TreeNode[BaseType <:

[GitHub] spark issue #17191: [SPARK-14471][SQL] Aliases in SELECT could be used in GR...

2017-04-17 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/17191 ping --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #17596: [SPARK-12837][CORE] Do not send the accumulator n...

2017-04-17 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/17596#discussion_r111721093 --- Diff: core/src/main/scala/org/apache/spark/util/AccumulatorV2.scala --- @@ -154,18 +154,22 @@ abstract class AccumulatorV2[IN, OUT] extends

[GitHub] spark pull request #17557: [SPARK-20208][R][DOCS] Document R fpGrowth suppor...

2017-04-17 Thread zero323
Github user zero323 commented on a diff in the pull request: https://github.com/apache/spark/pull/17557#discussion_r111722945 --- Diff: R/pkg/vignettes/sparkr-vignettes.Rmd --- @@ -906,6 +910,37 @@ predicted <- predict(model, df) head(predicted) ``` +

[GitHub] spark pull request #17620: [SPARK-20305][Spark Core]Master may keep in the s...

2017-04-17 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/17620#discussion_r111723278 --- Diff: core/src/main/scala/org/apache/spark/deploy/master/Master.scala --- @@ -561,6 +561,11 @@ private[deploy] class Master( state =

[GitHub] spark pull request #17568: [SPARK-20254][SQL] Remove unnecessary data conver...

2017-04-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/17568#discussion_r111713040 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/objects.scala --- @@ -96,3 +98,22 @@ object CombineTypedFilters extends

[GitHub] spark pull request #17568: [SPARK-20254][SQL] Remove unnecessary data conver...

2017-04-17 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/17568#discussion_r111716155 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala --- @@ -368,6 +369,8 @@ case class NullPropagation(conf:

[GitHub] spark issue #17400: [SPARK-19981][SQL] Update output partitioning info. in P...

2017-04-17 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/17400 @allengeorge yea, we could there. But, I think we should first make sure about how to fix this issue. I'm not sure that the approach of this pr is the best. cc: @gatorsmile --- If your project is

[GitHub] spark pull request #17596: [SPARK-12837][CORE] Do not send the accumulator n...

2017-04-17 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/17596#discussion_r111721127 --- Diff: core/src/main/scala/org/apache/spark/util/AccumulatorV2.scala --- @@ -154,18 +154,22 @@ abstract class AccumulatorV2[IN, OUT] extends

[GitHub] spark issue #17568: [SPARK-20254][SQL] Remove unnecessary data conversion fo...

2017-04-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17568 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75850/ Test PASSed. ---

[GitHub] spark issue #17568: [SPARK-20254][SQL] Remove unnecessary data conversion fo...

2017-04-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17568 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17568: [SPARK-20254][SQL] Remove unnecessary data conversion fo...

2017-04-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17568 **[Test build #75850 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75850/testReport)** for PR 17568 at commit

[GitHub] spark issue #17623: [SPARK-20292][SQL] Clean up string representation of Tre...

2017-04-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17623 **[Test build #75851 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75851/testReport)** for PR 17623 at commit

[GitHub] spark pull request #17657: [TEST][MINOR] Replace repartitionBy with distribu...

2017-04-17 Thread jaceklaskowski
GitHub user jaceklaskowski opened a pull request: https://github.com/apache/spark/pull/17657 [TEST][MINOR] Replace repartitionBy with distribute in CollapseRepartitionSuite ## What changes were proposed in this pull request? Replace non-existent `repartitionBy` with

[GitHub] spark issue #17656: [SPARK-20354][CORE][REST-API]When I request access to th...

2017-04-17 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17656 @squito do you have an opinion? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #17655: [SPARK-20156] [SQL] [FOLLOW-UP] Java String toLow...

2017-04-17 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/17655#discussion_r111724069 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalog.scala --- @@ -114,14 +114,14 @@ class SessionCatalog( *

[GitHub] spark issue #17596: [SPARK-12837][CORE] Do not send the accumulator name to ...

2017-04-17 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/17596 seems this breaks python accumulator anyone know how python accumulator works? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request #17568: [SPARK-20254][SQL] Remove unnecessary data conver...

2017-04-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/17568#discussion_r111712646 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala --- @@ -368,6 +369,8 @@ case class NullPropagation(conf:

[GitHub] spark pull request #17655: [SPARK-20156] [SQL] [FOLLOW-UP] Java String toLow...

2017-04-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/17655#discussion_r111713236 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala --- @@ -2295,5 +2295,27 @@ abstract class DDLSuite extends

[GitHub] spark pull request #17655: [SPARK-20156] [SQL] [FOLLOW-UP] Java String toLow...

2017-04-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/17655#discussion_r111713226 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala --- @@ -2295,5 +2295,27 @@ abstract class DDLSuite extends

[GitHub] spark issue #17656: [SPARK-20354][CORE][REST-API]When I request access to th...

2017-04-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17656 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #17657: [TEST][MINOR] Replace repartitionBy with distribute in C...

2017-04-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17657 **[Test build #75852 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75852/testReport)** for PR 17657 at commit

[GitHub] spark pull request #17623: [SPARK-20292][SQL] Clean up string representation...

2017-04-17 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17623#discussion_r111719916 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/trees/TreeNode.scala --- @@ -422,40 +422,62 @@ abstract class TreeNode[BaseType <:

[GitHub] spark pull request #17596: [SPARK-12837][CORE] Do not send the accumulator n...

2017-04-17 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/17596#discussion_r111722114 --- Diff: core/src/main/scala/org/apache/spark/util/AccumulatorV2.scala --- @@ -154,18 +154,22 @@ abstract class AccumulatorV2[IN, OUT] extends

[GitHub] spark pull request #17656: [SPARK-20354][CORE][REST-API]/api/v1/applications...

2017-04-17 Thread guoxiaolongzte
GitHub user guoxiaolongzte opened a pull request: https://github.com/apache/spark/pull/17656 [SPARK-20354][CORE][REST-API]/api/v1/applications’ return sparkUser is null in REST API. ## What changes were proposed in this pull request? When I request access to the 'http:

[GitHub] spark issue #15398: [SPARK-17647][SQL] Fix backslash escaping in 'LIKE' patt...

2017-04-17 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/15398 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #17650: [SPARK-20350] Add optimization rules to apply Complement...

2017-04-17 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/17650 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #17650: [SPARK-20350] Add optimization rules to apply Com...

2017-04-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/17650#discussion_r111716305 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/BooleanSimplificationSuite.scala --- @@ -160,4 +166,12 @@ class

[GitHub] spark pull request #17646: [SPARK-20349] [SQL] ListFunctions returns duplica...

2017-04-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/17646#discussion_r111717028 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalog.scala --- @@ -1202,15 +1203,25 @@ class SessionCatalog(

[GitHub] spark issue #17646: [SPARK-20349] [SQL] ListFunctions returns duplicate func...

2017-04-17 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/17646 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #17568: [SPARK-20254][SQL] Remove unnecessary data conver...

2017-04-17 Thread kiszk
Github user kiszk commented on a diff in the pull request: https://github.com/apache/spark/pull/17568#discussion_r111719111 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/objects.scala --- @@ -96,3 +98,22 @@ object CombineTypedFilters extends

[GitHub] spark issue #17651: [SPARK-20343][BUILD] Force Avro 1.7.7 in sbt build to re...

2017-04-17 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/17651 I'd be interested to know if this resolves the issue, and the only real way is to merge it. It's not wrong, but it is hacky. That said I don't have a better idea at the moment. --- If your project

[GitHub] spark issue #17623: [SPARK-20292][SQL] Clean up string representation of Tre...

2017-04-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17623 **[Test build #75851 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75851/testReport)** for PR 17623 at commit

[GitHub] spark issue #17623: [SPARK-20292][SQL] Clean up string representation of Tre...

2017-04-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17623 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17623: [SPARK-20292][SQL] Clean up string representation of Tre...

2017-04-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17623 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75851/ Test PASSed. ---

[GitHub] spark pull request #17658: [SPARK-20355] Add per application spark version o...

2017-04-17 Thread redsanket
GitHub user redsanket opened a pull request: https://github.com/apache/spark/pull/17658 [SPARK-20355] Add per application spark version on the history server headerpage ## What changes were proposed in this pull request? Spark Version for a specific application is not

[GitHub] spark issue #16989: [WIP][SPARK-19659] Fetch big blocks to disk when shuffle...

2017-04-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16989 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16989: [WIP][SPARK-19659] Fetch big blocks to disk when shuffle...

2017-04-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16989 **[Test build #75853 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75853/testReport)** for PR 16989 at commit

[GitHub] spark issue #17651: [SPARK-20343][BUILD] Force Avro 1.7.7 in sbt build to re...

2017-04-17 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17651 Yes... I hope anyone is able to reproduce this by the steps I did - https://github.com/apache/spark/pull/17477#issuecomment-294094092 or confirm I did this wrong. I am fine with

[GitHub] spark issue #16989: [WIP][SPARK-19659] Fetch big blocks to disk when shuffle...

2017-04-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16989 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16989: [WIP][SPARK-19659] Fetch big blocks to disk when shuffle...

2017-04-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16989 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75853/ Test FAILed. ---

[GitHub] spark issue #17647: [SPARK-20344][Scheduler]� Duplicate call in FairSchedula...

2017-04-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17647 **[Test build #3663 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3663/testReport)** for PR 17647 at commit

[GitHub] spark issue #17658: [SPARK-20355] Add per application spark version on the h...

2017-04-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17658 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #17655: [SPARK-20156] [SQL] [FOLLOW-UP] Java String toLow...

2017-04-17 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/17655#discussion_r111781782 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalog.scala --- @@ -114,14 +114,14 @@ class SessionCatalog( *

[GitHub] spark issue #17640: [SPARK-17608][SPARKR]:Long type has incorrect serializat...

2017-04-17 Thread wangmiao1981
Github user wangmiao1981 commented on the issue: https://github.com/apache/spark/pull/17640 I am adding more tests right now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #17568: [SPARK-20254][SQL] Remove unnecessary data conver...

2017-04-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/17568#discussion_r111711655 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala --- @@ -368,6 +369,8 @@ case class NullPropagation(conf:

[GitHub] spark pull request #17650: [SPARK-20350] Add optimization rules to apply Com...

2017-04-17 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/17650#discussion_r111716124 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala --- @@ -153,6 +153,11 @@ object BooleanSimplification

[GitHub] spark issue #16989: [WIP][SPARK-19659] Fetch big blocks to disk when shuffle...

2017-04-17 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/16989 Jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #17557: [SPARK-20208][R][DOCS] Document R fpGrowth support

2017-04-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17557 **[Test build #75854 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75854/testReport)** for PR 17557 at commit

[GitHub] spark issue #17657: [TEST][MINOR] Replace repartitionBy with distribute in C...

2017-04-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17657 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75852/ Test PASSed. ---

[GitHub] spark issue #17657: [TEST][MINOR] Replace repartitionBy with distribute in C...

2017-04-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17657 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #17620: [SPARK-20305][Spark Core]Master may keep in the s...

2017-04-17 Thread lvdongr
Github user lvdongr commented on a diff in the pull request: https://github.com/apache/spark/pull/17620#discussion_r111732189 --- Diff: core/src/main/scala/org/apache/spark/deploy/master/Master.scala --- @@ -561,6 +561,11 @@ private[deploy] class Master( state =

[GitHub] spark issue #16989: [WIP][SPARK-19659] Fetch big blocks to disk when shuffle...

2017-04-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16989 **[Test build #75855 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75855/testReport)** for PR 16989 at commit

[GitHub] spark issue #17557: [SPARK-20208][R][DOCS] Document R fpGrowth support

2017-04-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17557 **[Test build #75854 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75854/testReport)** for PR 17557 at commit

[GitHub] spark issue #17647: [SPARK-20344][Scheduler]� Duplicate call in FairSchedula...

2017-04-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17647 **[Test build #3663 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3663/testReport)** for PR 17647 at commit

[GitHub] spark issue #16989: [WIP][SPARK-19659] Fetch big blocks to disk when shuffle...

2017-04-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16989 **[Test build #75853 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75853/testReport)** for PR 16989 at commit

[GitHub] spark issue #17657: [TEST][MINOR] Replace repartitionBy with distribute in C...

2017-04-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17657 **[Test build #75852 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75852/testReport)** for PR 17657 at commit

[GitHub] spark pull request #17568: [SPARK-20254][SQL] Remove unnecessary data conver...

2017-04-17 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17568#discussion_r111730448 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/expressions.scala --- @@ -368,6 +369,8 @@ case class NullPropagation(conf:

[GitHub] spark pull request #17650: [SPARK-20350] Add optimization rules to apply Com...

2017-04-17 Thread ptkool
Github user ptkool commented on a diff in the pull request: https://github.com/apache/spark/pull/17650#discussion_r111733014 --- Diff: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/BooleanSimplificationSuite.scala --- @@ -160,4 +166,12 @@ class

[GitHub] spark issue #17651: [SPARK-20343][BUILD] Force Avro 1.7.7 in sbt build to re...

2017-04-17 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17651 FWIW, I at least checked this overrides the dependency (after manually mismatching the versions between pom and sbt) if I haven't done something wrong. --- If your project is set up for it,

[GitHub] spark pull request #16989: [WIP][SPARK-19659] Fetch big blocks to disk when ...

2017-04-17 Thread jinxing64
Github user jinxing64 commented on a diff in the pull request: https://github.com/apache/spark/pull/16989#discussion_r111734780 --- Diff: core/src/main/scala/org/apache/spark/scheduler/MapStatus.scala --- @@ -133,36 +135,53 @@ private[spark] class HighlyCompressedMapStatus private

[GitHub] spark issue #17557: [SPARK-20208][R][DOCS] Document R fpGrowth support

2017-04-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17557 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17557: [SPARK-20208][R][DOCS] Document R fpGrowth support

2017-04-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17557 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75854/ Test PASSed. ---

[GitHub] spark issue #16989: [WIP][SPARK-19659] Fetch big blocks to disk when shuffle...

2017-04-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16989 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75855/ Test FAILed. ---

[GitHub] spark issue #16989: [WIP][SPARK-19659] Fetch big blocks to disk when shuffle...

2017-04-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16989 **[Test build #75855 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75855/testReport)** for PR 16989 at commit

[GitHub] spark issue #14617: [SPARK-17019][Core] Expose on-heap and off-heap memory u...

2017-04-17 Thread squito
Github user squito commented on the issue: https://github.com/apache/spark/pull/14617 hi @jerryshao good points. First, we should probably move this discussion to jira so its more visible -- feel free to open two issues for these if you want, or first discuss on dev@. (Sorry its my

[GitHub] spark issue #17640: [SPARK-17608][SPARKR]:Long type has incorrect serializat...

2017-04-17 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/17640 +1 on what @felixcheung said -- It'll be good to have more tests in test_Serde.R. Other than that the change looks fine --- If your project is set up for it, you can reply to this email and have

[GitHub] spark issue #17658: [SPARK-20355] Add per application spark version on the h...

2017-04-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17658 **[Test build #75856 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75856/testReport)** for PR 17658 at commit

[GitHub] spark issue #17653: [SPARK-19828][R][FOLLOWUP] Rename asJsonArray to as.json...

2017-04-17 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17653 merged to master. thanks --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #17557: [SPARK-20208][R][DOCS] Document R fpGrowth suppor...

2017-04-17 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/17557#discussion_r111764966 --- Diff: R/pkg/vignettes/sparkr-vignettes.Rmd --- @@ -906,6 +910,37 @@ predicted <- predict(model, df) head(predicted) ``` +

[GitHub] spark issue #16989: [WIP][SPARK-19659] Fetch big blocks to disk when shuffle...

2017-04-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16989 **[Test build #75858 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75858/testReport)** for PR 16989 at commit

[GitHub] spark issue #17625: [SPARK-9103][WIP] Add Memory Tracking UI and track Netty...

2017-04-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17625 **[Test build #75857 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75857/testReport)** for PR 17625 at commit

[GitHub] spark pull request #17653: [SPARK-19828][R][FOLLOWUP] Rename asJsonArray to ...

2017-04-17 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/17653 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #17557: [SPARK-20208][R][DOCS] Document R fpGrowth suppor...

2017-04-17 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/17557#discussion_r111765227 --- Diff: R/pkg/vignettes/sparkr-vignettes.Rmd --- @@ -906,6 +910,37 @@ predicted <- predict(model, df) head(predicted) ``` +

[GitHub] spark issue #16989: [WIP][SPARK-19659] Fetch big blocks to disk when shuffle...

2017-04-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16989 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75858/ Test FAILed. ---

[GitHub] spark issue #16989: [WIP][SPARK-19659] Fetch big blocks to disk when shuffle...

2017-04-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16989 **[Test build #75858 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75858/testReport)** for PR 16989 at commit

[GitHub] spark issue #16989: [WIP][SPARK-19659] Fetch big blocks to disk when shuffle...

2017-04-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16989 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17557: [SPARK-20208][R][DOCS] Document R fpGrowth support

2017-04-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17557 **[Test build #75859 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75859/testReport)** for PR 17557 at commit

[GitHub] spark pull request #17557: [SPARK-20208][R][DOCS] Document R fpGrowth suppor...

2017-04-17 Thread zero323
Github user zero323 commented on a diff in the pull request: https://github.com/apache/spark/pull/17557#discussion_r111767880 --- Diff: R/pkg/vignettes/sparkr-vignettes.Rmd --- @@ -906,6 +910,37 @@ predicted <- predict(model, df) head(predicted) ``` +

[GitHub] spark issue #17540: [SPARK-20213][SQL][UI] Fix DataFrameWriter operations in...

2017-04-17 Thread rdblue
Github user rdblue commented on the issue: https://github.com/apache/spark/pull/17540 Removed the failing SPARK-10548 test and rebased. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #17658: [SPARK-20355] Add per application spark version on the h...

2017-04-17 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/17658 Jenkins, test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #17658: [SPARK-20355] Add per application spark version on the h...

2017-04-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17658 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17658: [SPARK-20355] Add per application spark version on the h...

2017-04-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17658 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75856/ Test FAILed. ---

[GitHub] spark issue #17658: [SPARK-20355] Add per application spark version on the h...

2017-04-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17658 **[Test build #75856 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75856/testReport)** for PR 17658 at commit

[GitHub] spark issue #17625: [SPARK-9103][WIP] Add Memory Tracking UI and track Netty...

2017-04-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17625 **[Test build #75857 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75857/testReport)** for PR 17625 at commit

[GitHub] spark issue #17625: [SPARK-9103][WIP] Add Memory Tracking UI and track Netty...

2017-04-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17625 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #17540: [SPARK-20213][SQL][UI] Fix DataFrameWriter operat...

2017-04-17 Thread rdblue
Github user rdblue commented on a diff in the pull request: https://github.com/apache/spark/pull/17540#discussion_r111766089 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SQLExecution.scala --- @@ -39,6 +39,32 @@ object SQLExecution {

[GitHub] spark issue #17625: [SPARK-9103][WIP] Add Memory Tracking UI and track Netty...

2017-04-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17625 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75857/ Test FAILed. ---

[GitHub] spark pull request #17652: [SPARK-20335] [SQL] [BACKPORT-2.1] Children expre...

2017-04-17 Thread gatorsmile
Github user gatorsmile closed the pull request at: https://github.com/apache/spark/pull/17652 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #17540: [SPARK-20213][SQL][UI] Fix DataFrameWriter operations in...

2017-04-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17540 **[Test build #75860 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75860/testReport)** for PR 17540 at commit

[GitHub] spark pull request #17646: [SPARK-20349] [SQL] ListFunctions returns duplica...

2017-04-17 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17646#discussion_r111768721 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalog.scala --- @@ -1202,15 +1203,25 @@ class SessionCatalog(

[GitHub] spark pull request #17655: [SPARK-20156] [SQL] [FOLLOW-UP] Java String toLow...

2017-04-17 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/17655#discussion_r111770874 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/SessionCatalog.scala --- @@ -114,14 +114,14 @@ class SessionCatalog(

[GitHub] spark issue #17663: [SPARK-17647][SQL][FOLLOWUP][MINOR] fix typo

2017-04-17 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/17663 Yea, I just had to note this just in case someone refers this as a reference. Thanks for bearing with me. --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request #17495: [SPARK-20172][Core] Add file permission check whe...

2017-04-17 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/17495#discussion_r111860131 --- Diff: core/src/test/scala/org/apache/spark/deploy/history/FsHistoryProviderSuite.scala --- @@ -143,12 +156,26 @@ class FsHistoryProviderSuite

[GitHub] spark issue #17662: [SPARK-20360][PYTHON] Create _repr_html_ for SparkContex...

2017-04-17 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/17662 I like it, I'm going to leave this a for a bit and see if anyone has any comments overnight :) --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #17667: Failing test for parquet predicate pushdown on dots with...

2017-04-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17667 **[Test build #75879 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75879/testReport)** for PR 17667 at commit

[GitHub] spark issue #17656: [SPARK-20354][CORE][REST-API]When I request access to th...

2017-04-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17656 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17656: [SPARK-20354][CORE][REST-API]When I request access to th...

2017-04-17 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17656 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/75870/ Test PASSed. ---

[GitHub] spark issue #17656: [SPARK-20354][CORE][REST-API]When I request access to th...

2017-04-17 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17656 **[Test build #75870 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/75870/testReport)** for PR 17656 at commit

  1   2   3   4   >