[GitHub] spark pull request: [SPARK-11990][SQL] Don't collapse projections ...

2015-11-25 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/9993 [SPARK-11990][SQL] Don't collapse projections if UDFs are referred in multiple aliases JIRA: https://issues.apache.org/jira/browse/SPARK-11990 We should not collapse projections in UDFs are

[GitHub] spark pull request: [SPARK-11973] [SQL] push filter through aggreg...

2015-11-25 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/9959#issuecomment-159840334 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-11973] [SQL] push filter through aggreg...

2015-11-25 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/9959#discussion_r45950794 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -690,12 +684,24 @@ object PushPredicateThroughAggregat

[GitHub] spark pull request: [SPARK-6521][Core] Bypass unnecessary network ...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9478#issuecomment-159839408 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-12009][Yarn]Avoid to re-allocating yarn...

2015-11-25 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/9992#discussion_r45950678 --- Diff: core/src/main/scala/org/apache/spark/scheduler/cluster/CoarseGrainedSchedulerBackend.scala --- @@ -163,6 +163,8 @@ class CoarseGrainedSchedulerBa

[GitHub] spark pull request: [SPARK-6521][Core] Bypass unnecessary network ...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9478#issuecomment-159839409 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-6521][Core] Bypass unnecessary network ...

2015-11-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9478#issuecomment-159839358 **[Test build #46741 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46741/consoleFull)** for PR 9478 at commit [`4ca2d72`](https://git

[GitHub] spark pull request: [SPARK-11973] [SQL] push filter through aggreg...

2015-11-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9959#issuecomment-159838880 **[Test build #2116 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2116/consoleFull)** for PR 9959 at commit [`951fe7a`](https://gi

[GitHub] spark pull request: [SPARK-11982] [SQL] improve performance of car...

2015-11-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9969#issuecomment-159837934 **[Test build #2117 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2117/consoleFull)** for PR 9969 at commit [`d3edd4f`](https://git

[GitHub] spark pull request: [SPARK-11982] [SQL] improve performance of car...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9969#issuecomment-159837266 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-11982] [SQL] improve performance of car...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9969#issuecomment-159837265 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11859][Mesos] SparkContext accepts inva...

2015-11-25 Thread toddwan
Github user toddwan commented on the pull request: https://github.com/apache/spark/pull/9886#issuecomment-159836411 @andrewor14 I am not sure about the cause of the unit test failure, but the failed test reported in the latest test build can pass on my machine. --- If your project is

[GitHub] spark pull request: [SPARK-11999][Core]Fix the issue that ThreadUt...

2015-11-25 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/9978#issuecomment-159835906 merged to master/1.6/1.5/1.4 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not hav

[GitHub] spark pull request: [SPARK-11999][Core]Fix the issue that ThreadUt...

2015-11-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9978 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-11206] (Followup) Fix SQLListenerMemory...

2015-11-25 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9991#discussion_r45949524 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/ui/SQLListenerSuite.scala --- @@ -343,6 +343,8 @@ class SQLListenerMemoryLeakSuite extends S

[GitHub] spark pull request: [SPARK-11980] [SQL] Fix json_tuple and add tes...

2015-11-25 Thread gatorsmile
Github user gatorsmile commented on the pull request: https://github.com/apache/spark/pull/9977#issuecomment-159834627 Thank you for your help! @rxin @davies Just let me know if you need me to do any JIRA. Have a good holiday! --- If your project is set up for it, you can r

[GitHub] spark pull request: [SPARK-11980] [SQL] Fix json_tuple and add tes...

2015-11-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9977 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-11980] [SQL] Fix json_tuple and add tes...

2015-11-25 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9977#issuecomment-159834358 Thanks - I'm going to merge this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11982] [SQL] improve performance of car...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9969#issuecomment-159834158 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11982] [SQL] improve performance of car...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9969#issuecomment-159834159 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-11627] Add initial input rate limit for...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9593#issuecomment-159833994 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11982] [SQL] improve performance of car...

2015-11-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9969#issuecomment-159834036 **[Test build #46755 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46755/consoleFull)** for PR 9969 at commit [`074f2a7`](https://gith

[GitHub] spark pull request: [SPARK-11627] Add initial input rate limit for...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9593#issuecomment-159833997 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-11627] Add initial input rate limit for...

2015-11-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9593#issuecomment-159833901 **[Test build #46733 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46733/consoleFull)** for PR 9593 at commit [`8a324ff`](https://git

[GitHub] spark pull request: [SPARK-11980] [SQL] Fix json_tuple and add tes...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9977#issuecomment-159833495 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-11980] [SQL] Fix json_tuple and add tes...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9977#issuecomment-159833491 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11980] [SQL] Fix json_tuple and add tes...

2015-11-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9977#issuecomment-159833284 **[Test build #46750 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46750/consoleFull)** for PR 9977 at commit [`b83525a`](https://git

[GitHub] spark pull request: [SPARK-11206] (Followup) Fix SQLListenerMemory...

2015-11-25 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9991#discussion_r45949221 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/ui/SQLListenerSuite.scala --- @@ -343,6 +343,8 @@ class SQLListenerMemoryLeakSuite extends S

[GitHub] spark pull request: [SPARK-12009][Yarn]Avoid to re-allocating yarn...

2015-11-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9992#issuecomment-159830195 **[Test build #46754 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46754/consoleFull)** for PR 9992 at commit [`771b33c`](https://gith

[GitHub] spark pull request: [SPARK-11206] (Followup) Fix SQLListenerMemory...

2015-11-25 Thread carsonwang
Github user carsonwang commented on a diff in the pull request: https://github.com/apache/spark/pull/9991#discussion_r45948964 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/ui/SQLListenerSuite.scala --- @@ -343,6 +343,8 @@ class SQLListenerMemoryLeakSuite extend

[GitHub] spark pull request: [SPARK-12009][Yarn]Avoid to re-allocating yarn...

2015-11-25 Thread suyanNone
GitHub user suyanNone opened a pull request: https://github.com/apache/spark/pull/9992 [SPARK-12009][Yarn]Avoid to re-allocating yarn container while driver want to stop all Executors You can merge this pull request into a Git repository by running: $ git pull https://github.

[GitHub] spark pull request: [SPARK-11619][SQL] cannot use UDTF in DataFram...

2015-11-25 Thread dilipbiswal
Github user dilipbiswal commented on the pull request: https://github.com/apache/spark/pull/9981#issuecomment-159829308 @cloud-fan failed again in the same way. Looks like its some intermittent issue and its more friendly to me :-). Wenchen, is there a way i can issue a retest request

[GitHub] spark pull request: [SPARK-11982] [SQL] improve performance of car...

2015-11-25 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9969#discussion_r45948599 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/CartesianProduct.scala --- @@ -17,16 +17,69 @@ package org.apache.spark.sql.

[GitHub] spark pull request: [SPARK-11982] [SQL] improve performance of car...

2015-11-25 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9969#discussion_r45948611 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/joins/CartesianProduct.scala --- @@ -17,16 +17,69 @@ package org.apache.spark.sql.

[GitHub] spark pull request: [SPARK-9552] Return "false" while nothing to k...

2015-11-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9796#issuecomment-159827044 **[Test build #46752 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46752/consoleFull)** for PR 9796 at commit [`154ab31`](https://gith

[GitHub] spark pull request: [SPARK-11206] (Followup) Fix SQLListenerMemory...

2015-11-25 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9991#discussion_r45948582 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/ui/SQLListenerSuite.scala --- @@ -343,6 +343,8 @@ class SQLListenerMemoryLeakSuite extends S

[GitHub] spark pull request: [SPARK-11980] [SQL] Fix json_tuple and add tes...

2015-11-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9977#issuecomment-159826133 **[Test build #46750 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46750/consoleFull)** for PR 9977 at commit [`b83525a`](https://gith

[GitHub] spark pull request: [SPARK-11206] (Followup) Fix SQLListenerMemory...

2015-11-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9991#issuecomment-159825648 **[Test build #46751 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46751/consoleFull)** for PR 9991 at commit [`8ca3031`](https://gith

[GitHub] spark pull request: [SPARK-11206] Support SQL UI on the history se...

2015-11-25 Thread carsonwang
Github user carsonwang commented on the pull request: https://github.com/apache/spark/pull/9297#issuecomment-159825154 I just submitted #9991 to fix the test failure. Details are described in the new PR. Thanks all! --- If your project is set up for it, you can reply to this email an

[GitHub] spark pull request: [SPARK-11932][STREAMING] Partition previous Tr...

2015-11-25 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9988#discussion_r45948174 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/TrackStateDStream.scala --- @@ -132,22 +132,39 @@ class InternalTrackStateDStream[K: Cl

[GitHub] spark pull request: [SPARK-11206] (Followup) Fix SQLListenerMemory...

2015-11-25 Thread carsonwang
GitHub user carsonwang opened a pull request: https://github.com/apache/spark/pull/9991 [SPARK-11206] (Followup) Fix SQLListenerMemoryLeakSuite test error A followup to #9297, fix the SQLListenerMemoryLeakSuite test error. The [failure](https://amplab.cs.berkeley.edu/jenkins/job/Spa

[GitHub] spark pull request: [SPARK-9552] Return "false" while nothing to k...

2015-11-25 Thread GraceH
Github user GraceH commented on the pull request: https://github.com/apache/spark/pull/9796#issuecomment-159824727 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request: [SPARK-11619][SQL] cannot use UDTF in DataFram...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9981#issuecomment-159823505 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-11619][SQL] cannot use UDTF in DataFram...

2015-11-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9981#issuecomment-159823369 **[Test build #46747 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46747/consoleFull)** for PR 9981 at commit [`9bee82b`](https://git

[GitHub] spark pull request: [SPARK-11619][SQL] cannot use UDTF in DataFram...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9981#issuecomment-159823502 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11932][STREAMING] Partition previous Tr...

2015-11-25 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9988#discussion_r45947853 --- Diff: streaming/src/main/scala/org/apache/spark/streaming/dstream/TrackStateDStream.scala --- @@ -132,22 +132,39 @@ class InternalTrackStateDStream[K: Cl

[GitHub] spark pull request: [SPARK-11700] [SQL] use weak reference to avoi...

2015-11-25 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/9990#issuecomment-159821847 There are other places need to be fixed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11973] [SQL] push filter through aggreg...

2015-11-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9959#issuecomment-159818068 **[Test build #46749 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46749/consoleFull)** for PR 9959 at commit [`37b3088`](https://gith

[GitHub] spark pull request: [SPARK-12007] [network] Avoid copies in the ne...

2015-11-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9987#issuecomment-159816190 **[Test build #46729 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46729/consoleFull)** for PR 9987 at commit [`83acf37`](https://git

[GitHub] spark pull request: [SPARK-9552] Return "false" while nothing to k...

2015-11-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9796#issuecomment-159816201 **[Test build #46728 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46728/consoleFull)** for PR 9796 at commit [`154ab31`](https://git

[GitHub] spark pull request: [SPARK-12007] [network] Avoid copies in the ne...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9987#issuecomment-159816212 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-9552] Return "false" while nothing to k...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9796#issuecomment-159816229 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-12007] [network] Avoid copies in the ne...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9987#issuecomment-159816209 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-9552] Return "false" while nothing to k...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9796#issuecomment-159816226 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11700] [SQL] use weak reference to avoi...

2015-11-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9990#issuecomment-159816094 **[Test build #46748 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46748/consoleFull)** for PR 9990 at commit [`6b5ff4f`](https://git

[GitHub] spark pull request: [SPARK-11700] [SQL] use weak reference to avoi...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9990#issuecomment-159816096 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-11700] [SQL] use weak reference to avoi...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9990#issuecomment-159816095 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11973] [SQL] push filter through aggreg...

2015-11-25 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9959#discussion_r45946958 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala --- @@ -2028,4 +2028,25 @@ class SQLQuerySuite extends QueryTest with SharedSQLCont

[GitHub] spark pull request: [SPARK-11980] [SQL] Fix json_tuple and add tes...

2015-11-25 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/9977#issuecomment-159815798 I'd just simply the test case as Davies suggested, and then merge this in. In parallel you can work on a patch to fix whatever bugs you find. --- If your project is set u

[GitHub] spark pull request: [SPARK-11700] [SQL] use weak reference to avoi...

2015-11-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9990#issuecomment-159815609 **[Test build #46748 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46748/consoleFull)** for PR 9990 at commit [`6b5ff4f`](https://gith

[GitHub] spark pull request: [SPARK-11973] [SQL] push filter through aggreg...

2015-11-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9959#issuecomment-159815023 **[Test build #2116 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2116/consoleFull)** for PR 9959 at commit [`951fe7a`](https://git

[GitHub] spark pull request: [SPARK-11980] [SQL] Fix json_tuple and add tes...

2015-11-25 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/9977#discussion_r45946595 --- Diff: python/pyspark/sql/functions.py --- @@ -1468,22 +1481,47 @@ def get_json_object(col, path): :param col: string column in json forma

[GitHub] spark pull request: [SPARK-11700] [SQL] use weak reference to avoi...

2015-11-25 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/9990#issuecomment-159814445 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled a

[GitHub] spark pull request: [SPARK-11878][SQL]: Eliminate distribute by in...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9858#issuecomment-159814436 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11878][SQL]: Eliminate distribute by in...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9858#issuecomment-159814439 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-11700] [SQL] use weak reference to avoi...

2015-11-25 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/9990#discussion_r45946448 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/SQLContext.scala --- @@ -45,9 +45,10 @@ import org.apache.spark.sql.execution.datasources._ import

[GitHub] spark pull request: [SPARK-11878][SQL]: Eliminate distribute by in...

2015-11-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9858#issuecomment-159814177 **[Test build #46742 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46742/consoleFull)** for PR 9858 at commit [`31a31a2`](https://git

[GitHub] spark pull request: [SPARK-11700] [SQL] use weak reference to avoi...

2015-11-25 Thread davies
GitHub user davies opened a pull request: https://github.com/apache/spark/pull/9990 [SPARK-11700] [SQL] use weak reference to avoid memory leak cc @zsxwing You can merge this pull request into a Git repository by running: $ git pull https://github.com/davies/spark leak_context

[GitHub] spark pull request: [SPARK-11619][SQL] cannot use UDTF in DataFram...

2015-11-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9981#issuecomment-159812459 **[Test build #46747 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46747/consoleFull)** for PR 9981 at commit [`9bee82b`](https://gith

[GitHub] spark pull request: [SPARK-11985][STREAMING][KINESIS] Update Kines...

2015-11-25 Thread brkyvz
Github user brkyvz commented on a diff in the pull request: https://github.com/apache/spark/pull/9970#discussion_r45946153 --- Diff: R/pkg/DESCRIPTION --- @@ -18,10 +18,10 @@ Collate: 'schema.R' 'generics.R' 'jobj.R' -'RDD.R' -'pairRDD.R'

[GitHub] spark pull request: [SPARK-11980] [SQL] Fix json_tuple and add tes...

2015-11-25 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9977#discussion_r45945922 --- Diff: python/pyspark/sql/functions.py --- @@ -1468,22 +1481,47 @@ def get_json_object(col, path): :param col: string column in json format

[GitHub] spark pull request: [SPARK-11619][SQL] cannot use UDTF in DataFram...

2015-11-25 Thread cloud-fan
Github user cloud-fan commented on the pull request: https://github.com/apache/spark/pull/9981#issuecomment-159810727 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark pull request: [SPARK-11996][Core]Make the executor thread du...

2015-11-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9976#issuecomment-159810562 **[Test build #46746 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46746/consoleFull)** for PR 9976 at commit [`d626bfc`](https://gith

[GitHub] spark pull request: [SPARK-12004] Preserve the RDD partitioner thr...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9983#issuecomment-159809986 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-12004] Preserve the RDD partitioner thr...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9983#issuecomment-159809987 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-12004] Preserve the RDD partitioner thr...

2015-11-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9983#issuecomment-159809957 **[Test build #46724 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46724/consoleFull)** for PR 9983 at commit [`4dfa265`](https://git

[GitHub] spark pull request: [SPARK-11996][Core]Make the executor thread du...

2015-11-25 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/9976#issuecomment-159809862 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this fea

[GitHub] spark pull request: [SPARK-12003] [SQL] remove the prefix for name...

2015-11-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9984 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-159808553 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-159808552 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2015-11-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-159808549 **[Test build #46745 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46745/consoleFull)** for PR 8880 at commit [`a1a8b0c`](https://git

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2015-11-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-159808163 **[Test build #46745 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46745/consoleFull)** for PR 8880 at commit [`a1a8b0c`](https://gith

[GitHub] spark pull request: [SPARK-11999][Core]Fix the issue that ThreadUt...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9978#issuecomment-159808039 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11999][Core]Fix the issue that ThreadUt...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9978#issuecomment-159808042 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-11999][Core]Fix the issue that ThreadUt...

2015-11-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9978#issuecomment-159807974 **[Test build #46735 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46735/consoleFull)** for PR 9978 at commit [`b870612`](https://git

[GitHub] spark pull request: [SPARK-6521][Core] Bypass unnecessary network ...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9478#issuecomment-159806939 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-6521][Core] Bypass unnecessary network ...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9478#issuecomment-159806935 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-6521][Core] Bypass unnecessary network ...

2015-11-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9478#issuecomment-159806689 **[Test build #46739 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46739/consoleFull)** for PR 9478 at commit [`1653691`](https://git

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2015-11-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-159806521 **[Test build #46744 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46744/consoleFull)** for PR 8880 at commit [`4b89893`](https://gith

[GitHub] spark pull request: [SPARK-11619][SQL] cannot use UDTF in DataFram...

2015-11-25 Thread dilipbiswal
Github user dilipbiswal commented on the pull request: https://github.com/apache/spark/pull/9981#issuecomment-159806047 @cloud-fan can you please help trigger a retest. Looks like an unrelated failure --- If your project is set up for it, you can reply to this email and have your rep

[GitHub] spark pull request: [SPARK-11961][DOC] Add docs of ChiSqSelector

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9965#issuecomment-159805218 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-11961][DOC] Add docs of ChiSqSelector

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9965#issuecomment-159805216 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11961][DOC] Add docs of ChiSqSelector

2015-11-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9965#issuecomment-159804986 **[Test build #46743 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46743/consoleFull)** for PR 9965 at commit [`a77743f`](https://git

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2015-11-25 Thread winningsix
Github user winningsix commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-159804799 retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-11619][SQL] cannot use UDTF in DataFram...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9981#issuecomment-159804528 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

[GitHub] spark pull request: [SPARK-11619][SQL] cannot use UDTF in DataFram...

2015-11-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9981#issuecomment-159804507 **[Test build #46737 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46737/consoleFull)** for PR 9981 at commit [`9bee82b`](https://git

[GitHub] spark pull request: [SPARK-11619][SQL] cannot use UDTF in DataFram...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9981#issuecomment-159804527 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-12001] Allow partially-stopped Streamin...

2015-11-25 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9982#issuecomment-159803737 **[Test build #46721 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/46721/consoleFull)** for PR 9982 at commit [`77df0ce`](https://git

[GitHub] spark pull request: [SPARK-12001] Allow partially-stopped Streamin...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9982#issuecomment-159803869 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-12001] Allow partially-stopped Streamin...

2015-11-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9982#issuecomment-159803871 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/4

  1   2   3   4   5   6   7   >