[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-167037362 **[Test build #48277 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48277/consoleFull)** for PR 10427 at commit

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10368#issuecomment-167038607 **[Test build #48283 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48283/consoleFull)** for PR 10368 at commit

[GitHub] spark pull request: [SPARK-12513] [Streaming] SocketReceiver hang ...

2015-12-23 Thread guoxu1231
Github user guoxu1231 commented on the pull request: https://github.com/apache/spark/pull/10464#issuecomment-167038464 Not sure why 2 commits in this PR? Do I need t re-submit this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-23 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-167040023 And you are right I think the comments I said is not related with this PR. Let's wait for their comments! --- If your project is set up for it, you can reply to

[GitHub] spark pull request: [SPARK-12375] [ML] add handleinvalid for vecto...

2015-12-23 Thread hhbyyh
GitHub user hhbyyh opened a pull request: https://github.com/apache/spark/pull/10466 [SPARK-12375] [ML] add handleinvalid for vectorindexer jira: https://issues.apache.org/jira/browse/SPARK-12375 >"Add option for allowing unknown categories, probably via a parameter like

[GitHub] spark pull request: add default RDD name for one created via sc.te...

2015-12-23 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/10456#issuecomment-167041948 LGTM as well. Could you add testcases for this change? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request: [SPARK-10359] Enumerate dependencies in a file...

2015-12-23 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/10461#issuecomment-167010169 /cc @pwendell @srowen @brennonyork @nchammas --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12505] [SQL] Pushdown a Limit on top of...

2015-12-23 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/10454#discussion_r48388578 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -858,6 +859,30 @@ object PushPredicateThroughJoin

[GitHub] spark pull request: [SPARK-12503] [SQL] Pushing Limit Through Unio...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10451#issuecomment-167013142 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12503] [SQL] Pushing Limit Through Unio...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10451#issuecomment-167013085 **[Test build #48261 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48261/consoleFull)** for PR 10451 at commit

[GitHub] spark pull request: [SPARK-12503] [SQL] Pushing Limit Through Unio...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10451#issuecomment-167013143 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-7995][SPARK-6280][Core]Remove AkkaRpcEn...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10459#issuecomment-167013686 **[Test build #48268 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48268/consoleFull)** for PR 10459 at commit

[GitHub] spark pull request: [SPARK-12505] [SQL] Pushdown a Limit on top of...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10454#issuecomment-167014215 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12505] [SQL] Pushdown a Limit on top of...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10454#issuecomment-167014216 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12486] Worker should kill the executors...

2015-12-23 Thread andrewor14
Github user andrewor14 commented on a diff in the pull request: https://github.com/apache/spark/pull/10438#discussion_r48389634 --- Diff: core/src/main/scala/org/apache/spark/util/Utils.scala --- @@ -1709,6 +1709,28 @@ private[spark] object Utils extends Logging { }

[GitHub] spark pull request: [Spark-10625] [SQL] Spark SQL JDBC read/write ...

2015-12-23 Thread tribbloid
Github user tribbloid commented on the pull request: https://github.com/apache/spark/pull/8785#issuecomment-167015238 Of course Dr. I'll finish reading in a few hours. Yours Peng On 15-12-23 05:10 AM, Sean Owen wrote: > > @tribbloid

[GitHub] spark pull request: [SPARK-7995][SPARK-6280][Core]Remove AkkaRpcEn...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10459#issuecomment-167016412 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12503] [SQL] Pushing Limit Through Unio...

2015-12-23 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/10451#discussion_r48391800 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -153,6 +153,15 @@ object SetOperationPushDown

[GitHub] spark pull request: [SPARK-12505] [SQL] Pushdown a Limit on top of...

2015-12-23 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/10454#discussion_r48392176 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -858,6 +859,30 @@ object PushPredicateThroughJoin

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10368#issuecomment-167025357 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10368#issuecomment-167025330 **[Test build #48275 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48275/consoleFull)** for PR 10368 at commit

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10368#issuecomment-167025356 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10368#issuecomment-167028329 **[Test build #48278 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48278/consoleFull)** for PR 10368 at commit

[GitHub] spark pull request: [SPARK-12218] Fixes ORC conjunction predicate ...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10377#issuecomment-167031314 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12218] Fixes ORC conjunction predicate ...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10377#issuecomment-167031310 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12505] [SQL] Pushdown a Limit on top of...

2015-12-23 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/10454#discussion_r48393687 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -858,6 +859,30 @@ object PushPredicateThroughJoin

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10368#issuecomment-167033459 **[Test build #48279 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48279/consoleFull)** for PR 10368 at commit

[GitHub] spark pull request: [SPARK-12513] [Streaming] SocketReceiver hang ...

2015-12-23 Thread guoxu1231
GitHub user guoxu1231 opened a pull request: https://github.com/apache/spark/pull/10464 [SPARK-12513] [Streaming] SocketReceiver hang in Netcat example Close client side socket connection before restart socket receiver. You can merge this pull request into a Git repository by

[GitHub] spark pull request: [SPARK-12515][SQL][DOC] minor doc update for r...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10465#issuecomment-167038901 **[Test build #48282 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48282/consoleFull)** for PR 10465 at commit

[GitHub] spark pull request: [SPARK-12375] [ML] add handleinvalid for vecto...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10466#issuecomment-167041784 **[Test build #48284 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48284/consoleFull)** for PR 10466 at commit

[GitHub] spark pull request: [SPARK-12499] [build] don't force MAVEN_OPTS

2015-12-23 Thread JoshRosen
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/10448#issuecomment-167011370 I've merged this into `master` and `branch-1.6`. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-10359] Enumerate dependencies in a file...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10461#issuecomment-167011829 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10359] Enumerate dependencies in a file...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10461#issuecomment-167011828 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12505] [SQL] Pushdown a Limit on top of...

2015-12-23 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/10454#discussion_r48388871 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -858,6 +859,30 @@ object PushPredicateThroughJoin

[GitHub] spark pull request: [SPARK-12505] [SQL] Pushdown a Limit on top of...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10454#issuecomment-167014161 **[Test build #48263 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48263/consoleFull)** for PR 10454 at commit

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/10368#discussion_r48389313 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskResult.scala --- @@ -46,6 +46,8 @@ class DirectTaskResult[T](var valueBytes: ByteBuffer, var

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/10368#discussion_r48389325 --- Diff: core/src/test/scala/org/apache/spark/HeartbeatReceiverSuite.scala --- @@ -220,7 +222,7 @@ class HeartbeatReceiverSuite } else {

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/10368#issuecomment-167014071 LGTM except some nits. Thanks a lot for fixing this @tedyu --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10368#issuecomment-167014373 **[Test build #48269 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48269/consoleFull)** for PR 10368 at commit

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread tedyu
Github user tedyu commented on a diff in the pull request: https://github.com/apache/spark/pull/10368#discussion_r48389541 --- Diff: core/src/main/scala/org/apache/spark/scheduler/TaskResult.scala --- @@ -46,6 +46,8 @@ class DirectTaskResult[T](var valueBytes: ByteBuffer, var

[GitHub] spark pull request: [SPARK-7995][SPARK-6280][Core]Remove AkkaRpcEn...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10459#issuecomment-167016380 **[Test build #48265 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48265/consoleFull)** for PR 10459 at commit

[GitHub] spark pull request: [SPARK-7995][SPARK-6280][Core]Remove AkkaRpcEn...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10459#issuecomment-167016413 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12218] Fixes ORC conjunction predicate ...

2015-12-23 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/10377#discussion_r48390319 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/orc/OrcFilters.scala --- @@ -26,15 +26,47 @@ import org.apache.spark.Logging import

[GitHub] spark pull request: [SPARK-12218] Fixes ORC conjunction predicate ...

2015-12-23 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/10377#discussion_r48390328 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/orc/OrcSourceSuite.scala --- @@ -174,4 +175,33 @@ class OrcSourceSuite extends OrcSuite {

[GitHub] spark pull request: [SPARK-12218] Fixes ORC conjunction predicate ...

2015-12-23 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/10377#discussion_r48390324 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/orc/OrcHadoopFsRelationSuite.scala --- @@ -23,6 +23,7 @@ import

[GitHub] spark pull request: [SPARK-12331][ML] R^2 for regression through t...

2015-12-23 Thread dbtsai
Github user dbtsai commented on the pull request: https://github.com/apache/spark/pull/10384#issuecomment-167017269 LGTM except minor issues. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread tedyu
Github user tedyu commented on the pull request: https://github.com/apache/spark/pull/10368#issuecomment-167018650 Here was why I implemented equals for Map (from #48257): {code} [info] - Bug: SPARK-12415 *** FAILED *** (3 milliseconds) [info]

[GitHub] spark pull request: [SPARK-12503] [SQL] Pushing Limit Through Unio...

2015-12-23 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/10451#discussion_r48392104 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -153,6 +153,15 @@ object SetOperationPushDown

[GitHub] spark pull request: [SPARK-7995][SPARK-6280][Core]Remove AkkaRpcEn...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10459#issuecomment-167024785 **[Test build #48268 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48268/consoleFull)** for PR 10459 at commit

[GitHub] spark pull request: [SPARK-7995][SPARK-6280][Core]Remove AkkaRpcEn...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10459#issuecomment-167024834 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-7995][SPARK-6280][Core]Remove AkkaRpcEn...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10459#issuecomment-167024832 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10368#issuecomment-167030489 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10368#issuecomment-167030479 **[Test build #48278 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48278/consoleFull)** for PR 10368 at commit

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10368#issuecomment-167030488 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12480][SQL] add Hash expression that ca...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10435#issuecomment-167033978 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12480][SQL] add Hash expression that ca...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10435#issuecomment-167033952 **[Test build #48274 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48274/consoleFull)** for PR 10435 at commit

[GitHub] spark pull request: [SPARK-12480][SQL] add Hash expression that ca...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10435#issuecomment-167033976 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12439][SQL] Fix toCatalystArray and Map...

2015-12-23 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/10391#issuecomment-167033940 @cloud-fan @marmbrus Are you ok for latest updates? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-23 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-167039644 @maropu I believe it is a Parquet stuff. AFAIK, the columns in filters should be set to `requestedSchema` for Parquet. But

[GitHub] spark pull request: [SPARK-12476][SQL] Implement JdbcRelation#unha...

2015-12-23 Thread maropu
Github user maropu commented on the pull request: https://github.com/apache/spark/pull/10427#issuecomment-167042101 Adding a special handing for Parquet is better? I think that required columns for push-down filters should be passed to each data sources, and this is a more natural

[GitHub] spark pull request: add default RDD name for one created via sc.te...

2015-12-23 Thread wyaron
GitHub user wyaron opened a pull request: https://github.com/apache/spark/pull/10456 add default RDD name for one created via sc.textFile The feature was first added at commit: 7b877b27053bfb7092e250e01a3b887e1b50a109 but was later removed (probably by mistake) at commit:

[GitHub] spark pull request: [SPARK-12510][Streaming]Refactor ActorReceiver...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10457#issuecomment-166997004 **[Test build #48256 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48256/consoleFull)** for PR 10457 at commit

[GitHub] spark pull request: [SPARK-12510][Streaming]Refactor ActorReceiver...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10457#issuecomment-166997026 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-7995][SPARK-6280][Core]Remove AkkaRpcEn...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10459#issuecomment-167004663 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-7995][SPARK-6280][Core]Remove AkkaRpcEn...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10459#issuecomment-167004641 **[Test build #48259 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48259/consoleFull)** for PR 10459 at commit

[GitHub] spark pull request: [SPARK-7995][SPARK-6280][Core]Remove AkkaRpcEn...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10459#issuecomment-167004661 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-7995][SPARK-6280][Core]Remove AkkaRpcEn...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10459#issuecomment-167006863 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-7995][SPARK-6280][Core]Remove AkkaRpcEn...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10459#issuecomment-167008339 **[Test build #48265 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48265/consoleFull)** for PR 10459 at commit

[GitHub] spark pull request: [SPARK-12507][Streaming][Document]Update Strea...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10453#issuecomment-166978434 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12218] Fixes ORC conjunction predicate ...

2015-12-23 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/10377#discussion_r48374725 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/orc/OrcFilters.scala --- @@ -50,37 +82,18 @@ private[orc] object OrcFilters extends Logging {

[GitHub] spark pull request: [SPARK-12218] Fixes ORC conjunction predicate ...

2015-12-23 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/10377#discussion_r48374780 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/orc/OrcHadoopFsRelationSuite.scala --- @@ -23,6 +23,7 @@ import

[GitHub] spark pull request: [SPARK-12503] [SQL] Pushing Limit Through Unio...

2015-12-23 Thread gatorsmile
Github user gatorsmile commented on the pull request: https://github.com/apache/spark/pull/10451#issuecomment-166980946 @marmbrus @rxin Could you check if this is an appropriate improvement for Spark too? Thanks! --- If your project is set up for it, you can reply to this

[GitHub] spark pull request: [SPARK-12508][PROJECT-INFRA] Fix minor bugs in...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10455#issuecomment-166983395 **[Test build #48253 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48253/consoleFull)** for PR 10455 at commit

[GitHub] spark pull request: [SPARK-12510][Streaming]Refactor ActorReceiver...

2015-12-23 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/10457 [SPARK-12510][Streaming]Refactor ActorReceiver to support Java This PR includes the following changes: 1. Rename `ActorReceiver` to `ActorReceiverSupervisor` 2. Remove `ActorHelper`

[GitHub] spark pull request: [SPARK-12509] [SQL] Fixed error messages for D...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10458#issuecomment-166989463 **[Test build #48255 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48255/consoleFull)** for PR 10458 at commit

[GitHub] spark pull request: [SPARK-12500] [CORE] Fix Tachyon deprecations;...

2015-12-23 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/10449#issuecomment-166992625 Ah OK - we can revert if there is a problem. Sorry about that. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-12415] Do not use closure serializer to...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10368#issuecomment-166999771 **[Test build #48257 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48257/consoleFull)** for PR 10368 at commit

[GitHub] spark pull request: [SPARK-7995][SPARK-6280][Core]Remove AkkaRpcEn...

2015-12-23 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/10459 [SPARK-7995][SPARK-6280][Core]Remove AkkaRpcEnv and remove systemName from setupEndpointRef Keep `SparkEnv.actorSystem` because Streaming still uses it. Will remove it and AkkaUtils after

[GitHub] spark pull request: [SPARK-12505] [SQL] Pushdown a Limit on top of...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10454#issuecomment-167005833 **[Test build #48263 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48263/consoleFull)** for PR 10454 at commit

[GitHub] spark pull request: [SPARK-12505] [SQL] Pushdown a Limit on top of...

2015-12-23 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/10454#discussion_r48385881 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -858,6 +859,30 @@ object PushPredicateThroughJoin

[GitHub] spark pull request: [SPARK-12505] [SQL] Pushdown a Limit on top of...

2015-12-23 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/10454#discussion_r48386444 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -858,6 +859,30 @@ object PushPredicateThroughJoin

[GitHub] spark pull request: [SPARK-10359] Enumerate Spark's dependencies i...

2015-12-23 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/8531#discussion_r48386999 --- Diff: .rat-excludes --- @@ -83,3 +83,5 @@ gen-java.* .*avpr org.apache.spark.sql.sources.DataSourceRegister .*parquet

[GitHub] spark pull request: [SPARK-12218] Fixes ORC conjunction predicate ...

2015-12-23 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/10377#discussion_r48374926 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/orc/OrcSourceSuite.scala --- @@ -174,4 +175,33 @@ class OrcSourceSuite extends OrcSuite {

[GitHub] spark pull request: [SPARK-12503] [SQL] Pushing Limit Through Unio...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10451#issuecomment-166980561 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12503] [SQL] Pushing Limit Through Unio...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10451#issuecomment-166980563 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12481] [CORE] [STREAMING] [SQL] Remove ...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10446#issuecomment-166982259 **[Test build #2253 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2253/consoleFull)** for PR 10446 at commit

[GitHub] spark pull request: [SPARK-11315] [YARN] Add YARN extension servic...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8744#issuecomment-166987958 **[Test build #48250 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48250/consoleFull)** for PR 8744 at commit

[GitHub] spark pull request: [SPARK-11315] [YARN] Add YARN extension servic...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8744#issuecomment-166988047 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11315] [YARN] Add YARN extension servic...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8744#issuecomment-166988048 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12509] [SQL] Fixed error messages for D...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10458#issuecomment-166989628 **[Test build #48255 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48255/consoleFull)** for PR 10458 at commit

[GitHub] spark pull request: [SPARK-12510][Streaming]Refactor ActorReceiver...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10457#issuecomment-166989549 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12509] [SQL] Fixed error messages for D...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10458#issuecomment-166989629 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12509] [SQL] Fixed error messages for D...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10458#issuecomment-166989630 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12510][Streaming]Refactor ActorReceiver...

2015-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10457#issuecomment-166989550 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12510][Streaming]Refactor ActorReceiver...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10457#issuecomment-166989544 **[Test build #48254 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48254/consoleFull)** for PR 10457 at commit

[GitHub] spark pull request: [SPARK-12510][Streaming]Refactor ActorReceiver...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10457#issuecomment-166993023 **[Test build #48256 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48256/consoleFull)** for PR 10457 at commit

[GitHub] spark pull request: [SPARK-12510][Streaming]Refactor ActorReceiver...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10457#issuecomment-167004009 **[Test build #48260 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48260/consoleFull)** for PR 10457 at commit

[GitHub] spark pull request: [SPARK-12503] [SQL] Pushing Limit Through Unio...

2015-12-23 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10451#issuecomment-167005403 **[Test build #48261 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/48261/consoleFull)** for PR 10451 at commit

[GitHub] spark pull request: [SPARK-12505] [SQL] Pushdown a Limit on top of...

2015-12-23 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/10454#discussion_r48386195 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -858,6 +859,30 @@ object PushPredicateThroughJoin

[GitHub] spark pull request: [SPARK-12505] [SQL] Pushdown a Limit on top of...

2015-12-23 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/10454#discussion_r48386235 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -858,6 +859,30 @@ object PushPredicateThroughJoin

<    1   2   3   4   5   >