[GitHub] spark pull request: [SPARK-11105][yarn] Distribute log4j.propertie...

2015-10-14 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/9118#discussion_r42049285 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -340,6 +340,14 @@ private[spark] class Client( "for

[GitHub] spark pull request: [SPARK-10599][MLLIB] Lower communication for b...

2015-10-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8757#issuecomment-148161067 [Test build #43727 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43727/console) for PR 8757 at commit

[GitHub] spark pull request: [SPARK-11105][yarn] Distribute log4j.propertie...

2015-10-14 Thread vundela
Github user vundela commented on the pull request: https://github.com/apache/spark/pull/9118#issuecomment-148163495 @vanzin can you please review the pull request. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-7012][SQL] Add support for NOT NULL mod...

2015-10-14 Thread sabhyankar
Github user sabhyankar commented on the pull request: https://github.com/apache/spark/pull/8746#issuecomment-148177961 Hi @smola - Is there anything else that you need me to check for this PR? --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark pull request: [SPARK-10104][SQL] Consolidate different forms...

2015-10-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8453#issuecomment-148184186 [Test build #43733 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43733/consoleFull) for PR 8453 at commit

[GitHub] spark pull request: [SPARK-10104][SQL] Consolidate different forms...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8453#issuecomment-148185557 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11111] [SQL] fast null-safe join

2015-10-14 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9120#issuecomment-148185559 Can we add a test that tests the query plan explicitly? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-11111] [SQL] fast null-safe join

2015-10-14 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/9120#discussion_r42049885 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/planning/patterns.scala --- @@ -171,17 +172,24 @@ object ExtractEquiJoinKeys extends

[GitHub] spark pull request: [SPARK-10979] [SparkR] Sparkrmerge: Add merge ...

2015-10-14 Thread NarineK
Github user NarineK commented on the pull request: https://github.com/apache/spark/pull/9012#issuecomment-148192955 I see. I can remove the check --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11096] Post-hoc review Netty based RPC ...

2015-10-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9112#issuecomment-148167054 [Test build #43723 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43723/console) for PR 9112 at commit

[GitHub] spark pull request: [SPARK-11096] Post-hoc review Netty based RPC ...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9112#issuecomment-148167368 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [Spark-8426] [scheduler] enhance blacklist mec...

2015-10-14 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/8760#discussion_r42041212 --- Diff: core/src/main/scala/org/apache/spark/scheduler/BlacklistTracker.scala --- @@ -0,0 +1,243 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-8386] [SQL]add write.mode for insertInt...

2015-10-14 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9042#issuecomment-148169190 Thanks - I've merged this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-11068][SQL][follow-up] move execution l...

2015-10-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9119#issuecomment-148172164 [Test build #1901 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1901/consoleFull) for PR 9119 at commit

[GitHub] spark pull request: [SPARK-11105][yarn] Distribute log4j.propertie...

2015-10-14 Thread markgrover
Github user markgrover commented on a diff in the pull request: https://github.com/apache/spark/pull/9118#discussion_r42042421 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -340,6 +340,14 @@ private[spark] class Client( "for

[GitHub] spark pull request: [SPARK-10708] [WIP] Consolidate sort shuffle i...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8829#issuecomment-148172236 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11105][yarn] Distribute log4j.propertie...

2015-10-14 Thread markgrover
Github user markgrover commented on a diff in the pull request: https://github.com/apache/spark/pull/9118#discussion_r42042383 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -340,6 +340,14 @@ private[spark] class Client( "for

[GitHub] spark pull request: [SPARK-11096] Post-hoc review Netty based RPC ...

2015-10-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9112 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-10708] [WIP] Consolidate sort shuffle i...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8829#issuecomment-148172258 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-7012][SQL] Add support for NOT NULL mod...

2015-10-14 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/8746#discussion_r42045738 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/sources/DDLTestSuite.scala --- @@ -113,4 +113,23 @@ class DDLTestSuite extends DataSourceTest with

[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...

2015-10-14 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9067#issuecomment-148182209 Can you explain what you mean by "mixing"? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10104][SQL] Consolidate different forms...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8453#issuecomment-148185584 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11111] [SQL] fast null-safe join

2015-10-14 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/9120#discussion_r42048273 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/planning/patterns.scala --- @@ -171,17 +172,24 @@ object ExtractEquiJoinKeys extends

[GitHub] spark pull request: [SPARK-10708] [WIP] Consolidate sort shuffle i...

2015-10-14 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/8829#issuecomment-148190600 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11111] [SQL] fast null-safe join

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9120#issuecomment-148194950 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11111] [SQL] fast null-safe join

2015-10-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9120#issuecomment-148194787 [Test build #43732 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43732/console) for PR 9120 at commit

[GitHub] spark pull request: [SPARK-11068][SQL][follow-up] move execution l...

2015-10-14 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/9119 [SPARK-11068][SQL][follow-up] move execution listener to util You can merge this pull request into a Git repository by running: $ git pull https://github.com/cloud-fan/spark callback

[GitHub] spark pull request: [SPARK-11096] Post-hoc review Netty based RPC ...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9112#issuecomment-148167373 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11105][yarn] Distribute log4j.propertie...

2015-10-14 Thread vundela
Github user vundela commented on a diff in the pull request: https://github.com/apache/spark/pull/9118#discussion_r42043343 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -340,6 +340,14 @@ private[spark] class Client( "for

[GitHub] spark pull request: [SPARK-10708] [WIP] Consolidate sort shuffle i...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8829#issuecomment-148178427 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [Spark-8426] [scheduler] enhance blacklist mec...

2015-10-14 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/8760#discussion_r42044558 --- Diff: core/src/test/scala/org/apache/spark/scheduler/BlacklistTrackerSuite.scala --- @@ -0,0 +1,162 @@ +package org.apache.spark.scheduler +

[GitHub] spark pull request: [Spark-8426] [scheduler] enhance blacklist mec...

2015-10-14 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/8760#discussion_r42044542 --- Diff: core/src/test/scala/org/apache/spark/scheduler/BlacklistTrackerSuite.scala --- @@ -0,0 +1,162 @@ +package org.apache.spark.scheduler +

[GitHub] spark pull request: [SPARK-11111] [SQL] fast null-safe join

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9120#issuecomment-148182961 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11111] [SQL] fast null-safe join

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9120#issuecomment-148182936 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10104][SQL] Consolidate different forms...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8453#issuecomment-148182962 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10104][SQL] Consolidate different forms...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8453#issuecomment-148182943 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10104][SQL] Consolidate different forms...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8453#issuecomment-148192250 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10708] [WIP] Consolidate sort shuffle i...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8829#issuecomment-148191923 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10708] [WIP] Consolidate sort shuffle i...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8829#issuecomment-148191998 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10104][SQL] Consolidate different forms...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8453#issuecomment-148192252 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11111] [SQL] fast null-safe join

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9120#issuecomment-148194947 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11084][ML][PYTHON] Check if index can c...

2015-10-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9098#issuecomment-148155252 [Test build #1900 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1900/console) for PR 9098 at commit

[GitHub] spark pull request: [SPARK-11094] Strip extra strings from Java ve...

2015-10-14 Thread jodersky
Github user jodersky commented on the pull request: https://github.com/apache/spark/pull/9111#issuecomment-148156305 Ok, I updated it to use a regex --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-10599][MLLIB] Lower communication for b...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8757#issuecomment-148162329 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10599][MLLIB] Lower communication for b...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8757#issuecomment-148162325 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11105][yarn] Distribute log4j.propertie...

2015-10-14 Thread vundela
GitHub user vundela opened a pull request: https://github.com/apache/spark/pull/9118 [SPARK-11105][yarn] Distribute log4j.properties to executors Currently log4j.properties file is not uploaded to executor's which is leading them to use the default values. This fix will make sure

[GitHub] spark pull request: [SPARK-8386] [SQL]add write.mode for insertInt...

2015-10-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9042 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-10104][SQL] Consolidate different forms...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8453#issuecomment-148169366 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10104][SQL] Consolidate different forms...

2015-10-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8453#issuecomment-148169263 [Test build #43725 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43725/console) for PR 8453 at commit

[GitHub] spark pull request: [SPARK-10104][SQL] Consolidate different forms...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8453#issuecomment-148169365 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11068][SQL][follow-up] move execution l...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9119#issuecomment-148170271 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11068][SQL][follow-up] move execution l...

2015-10-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9119#issuecomment-148170142 [Test build #43730 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43730/console) for PR 9119 at commit

[GitHub] spark pull request: [SPARK-11096] Post-hoc review Netty based RPC ...

2015-10-14 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9112#issuecomment-148171964 Merging this . --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [Spark-8426] [scheduler] enhance blacklist mec...

2015-10-14 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/8760#discussion_r42043964 --- Diff: core/src/test/scala/org/apache/spark/scheduler/BlacklistTrackerSuite.scala --- @@ -0,0 +1,162 @@ +package org.apache.spark.scheduler +

[GitHub] spark pull request: [SPARK-11105][yarn] Distribute log4j.propertie...

2015-10-14 Thread vundela
Github user vundela commented on a diff in the pull request: https://github.com/apache/spark/pull/9118#discussion_r42043730 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -340,6 +340,14 @@ private[spark] class Client( "for

[GitHub] spark pull request: [Spark-8426] [scheduler] enhance blacklist mec...

2015-10-14 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/8760#discussion_r42045636 --- Diff: core/src/test/scala/org/apache/spark/scheduler/BlacklistTrackerSuite.scala --- @@ -0,0 +1,162 @@ +package org.apache.spark.scheduler +

[GitHub] spark pull request: [SPARK-11111] [SQL] fast null-safe join

2015-10-14 Thread davies
GitHub user davies opened a pull request: https://github.com/apache/spark/pull/9120 [SPARK-1] [SQL] fast null-safe join Currently, we use CartesianProduct for join with null-safe-equal condition. ``` scala> sqlContext.sql("select * from t a join t b on (a.i <=>

[GitHub] spark pull request: [SPARK-10104][SQL] Consolidate different forms...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8453#issuecomment-148187219 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10104][SQL] Consolidate different forms...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8453#issuecomment-148187196 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-14 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r42050263 --- Diff: core/src/main/scala/org/apache/spark/crypto/CipherSuite.scala --- @@ -0,0 +1,65 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-14 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r42051744 --- Diff: core/src/main/scala/org/apache/spark/crypto/CommonConfigurationKeys.scala --- @@ -0,0 +1,48 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-14 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r42051693 --- Diff: core/src/main/scala/org/apache/spark/crypto/CommonConfigurationKeys.scala --- @@ -0,0 +1,48 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-11093] [Core] ChildFirstURLClassLoader#...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9106#issuecomment-148200404 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11093] [Core] ChildFirstURLClassLoader#...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9106#issuecomment-148200402 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11093] [Core] ChildFirstURLClassLoader#...

2015-10-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9106#issuecomment-148200254 [Test build #43728 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43728/console) for PR 9106 at commit

[GitHub] spark pull request: [SPARK-10708] [WIP] Consolidate sort shuffle i...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8829#issuecomment-148201497 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11113][SQL] Remove DeveloperApi annotat...

2015-10-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9121#issuecomment-148203212 [Test build #43740 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43740/consoleFull) for PR 9121 at commit

[GitHub] spark pull request: [SPARK-10708] [WIP] Consolidate sort shuffle i...

2015-10-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8829#issuecomment-148203085 [Test build #43739 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43739/consoleFull) for PR 8829 at commit

[GitHub] spark pull request: [SPARK-11114] [PYSPARK] add getOrCreate for Sp...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9122#issuecomment-148203871 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11072][SQL] simplify self join handling

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9081#issuecomment-148205806 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11072][SQL] simplify self join handling

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9081#issuecomment-148205770 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-14 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r42057147 --- Diff: core/src/main/scala/org/apache/spark/crypto/CryptoInputStream.scala --- @@ -0,0 +1,425 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-14 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r42057527 --- Diff: core/src/main/scala/org/apache/spark/crypto/CryptoInputStream.scala --- @@ -0,0 +1,425 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [SPARK-11114] [PYSPARK] add getOrCreate for Sp...

2015-10-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9122#issuecomment-148210723 [Test build #43741 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43741/console) for PR 9122 at commit

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-14 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r42057655 --- Diff: core/src/main/scala/org/apache/spark/crypto/CryptoInputStream.scala --- @@ -0,0 +1,425 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-14 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r42059715 --- Diff: core/src/main/scala/org/apache/spark/crypto/CryptoOutputStream.scala --- @@ -0,0 +1,225 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-11093] [Core] ChildFirstURLClassLoader#...

2015-10-14 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/9106#discussion_r42060363 --- Diff: core/src/test/scala/org/apache/spark/util/MutableURLClassLoaderSuite.scala --- @@ -68,6 +79,33 @@ class MutableURLClassLoaderSuite extends

[GitHub] spark pull request: [SPARK-11114] [PYSPARK] add getOrCreate for Sp...

2015-10-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9122#issuecomment-148217785 [Test build #1902 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1902/consoleFull) for PR 9122 at commit

[GitHub] spark pull request: [SPARK-11068][SQL][follow-up] move execution l...

2015-10-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9119 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-11055][SQL] Use mixing hash-based and s...

2015-10-14 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/9067#discussion_r42060953 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/TungstenAggregationIterator.scala --- @@ -470,12 +484,27 @@ class

[GitHub] spark pull request: [SPARK-10534][SQL] ORDER BY clause allows only...

2015-10-14 Thread dilipbiswal
GitHub user dilipbiswal opened a pull request: https://github.com/apache/spark/pull/9123 [SPARK-10534][SQL] ORDER BY clause allows only columns that are present in S… Find out the missing attributes by recursively looking at the sort order expression and rest of the code

[GitHub] spark pull request: [SPARK-11078] Ensure spilling tests actually s...

2015-10-14 Thread andrewor14
GitHub user andrewor14 opened a pull request: https://github.com/apache/spark/pull/9124 [SPARK-11078] Ensure spilling tests actually spill #9084 uncovered that many tests that test spilling don't actually spill. This is a follow-up patch to fix that to ensure our unit tests

[GitHub] spark pull request: [SPARK-10668][ML] Use WeightedLeastSquares in ...

2015-10-14 Thread Lewuathe
Github user Lewuathe commented on the pull request: https://github.com/apache/spark/pull/8884#issuecomment-148227686 @dbtsai Thanks again. Could check it? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-14 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r42051545 --- Diff: core/src/main/scala/org/apache/spark/crypto/CommonConfigurationKeys.scala --- @@ -0,0 +1,48 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-10708] [WIP] Consolidate sort shuffle i...

2015-10-14 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8829#issuecomment-148196959 [Test build #43736 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/43736/consoleFull) for PR 8829 at commit

[GitHub] spark pull request: [SPARK-10708] [WIP] Consolidate sort shuffle i...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8829#issuecomment-148198224 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10708] [WIP] Consolidate sort shuffle i...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8829#issuecomment-148198263 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-14 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r42052097 --- Diff: core/src/main/scala/org/apache/spark/crypto/CommonConfigurationKeys.scala --- @@ -0,0 +1,48 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-14 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r42053251 --- Diff: core/src/main/scala/org/apache/spark/crypto/CryptoCodec.scala --- @@ -0,0 +1,93 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] spark pull request: [SPARK-11113][SQL] Remove DeveloperApi annotat...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9121#issuecomment-148201932 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10708] [WIP] Consolidate sort shuffle i...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8829#issuecomment-148201989 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10708] [WIP] Consolidate sort shuffle i...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8829#issuecomment-148201987 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9741][SQL] Approximate Count Distinct u...

2015-10-14 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/8362#discussion_r42054243 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/functions.scala --- @@ -302,3 +307,397 @@ case class Sum(child:

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-14 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r42054231 --- Diff: core/src/main/scala/org/apache/spark/crypto/CryptoInputStream.scala --- @@ -0,0 +1,425 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request: [Spark-8426] [scheduler] enhance blacklist mec...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8760#issuecomment-148207561 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [Spark-8426] [scheduler] enhance blacklist mec...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8760#issuecomment-148207609 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11114] [PYSPARK] add getOrCreate for Sp...

2015-10-14 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9122#issuecomment-148210782 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11105][yarn] Distribute log4j.propertie...

2015-10-14 Thread vundela
Github user vundela commented on a diff in the pull request: https://github.com/apache/spark/pull/9118#discussion_r42058235 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -340,6 +340,14 @@ private[spark] class Client( "for

[GitHub] spark pull request: [SPARK-11105][yarn] Distribute log4j.propertie...

2015-10-14 Thread vundela
Github user vundela commented on a diff in the pull request: https://github.com/apache/spark/pull/9118#discussion_r42058190 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -340,6 +340,14 @@ private[spark] class Client( "for

[GitHub] spark pull request: SPARK-10771: Implement the shuffle encryption ...

2015-10-14 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/8880#discussion_r42059236 --- Diff: core/src/main/scala/org/apache/spark/storage/ShuffleBlockFetcherIterator.scala --- @@ -27,7 +27,7 @@ import org.apache.spark.{Logging,

<    1   2   3   4   5   6   7   >