[GitHub] spark pull request: [SPARK-11448][SQL] Skip caching part-files in ...

2015-11-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9405#issuecomment-153017266 **[Test build #44805 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44805/consoleFull)** for PR 9405 at commit

[GitHub] spark pull request: [SPARK-11448][SQL] Skip caching part-files in ...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9405#issuecomment-153017384 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10786][SQL]Take the whole statement to ...

2015-11-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8895 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: SPARK-11344: Made ApplicationDescription and D...

2015-11-02 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9299#issuecomment-153020674 Looking good to me. Let me leave it a bit for other input. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark pull request: [SPARK-11450][SQL] Add Unsafe Row processing t...

2015-11-02 Thread hvanhovell
GitHub user hvanhovell opened a pull request: https://github.com/apache/spark/pull/9414 [SPARK-11450][SQL] Add Unsafe Row processing to Expand This PR enables the Expand operator to process and produce Unsafe Rows. You can merge this pull request into a Git repository by running:

[GitHub] spark pull request: [SPARK-10533] [SQL] handle scientific notation...

2015-11-02 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/9085#discussion_r43633782 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/AbstractSparkSQLParser.scala --- @@ -102,8 +106,12 @@ class SqlLexical extends

[GitHub] spark pull request: Spark-6373 Add SSL/TLS for the Netty based Blo...

2015-11-02 Thread turp1twin
GitHub user turp1twin opened a pull request: https://github.com/apache/spark/pull/9416 Spark-6373 Add SSL/TLS for the Netty based BlockTransferService Sorry if this pull request is premature, but I have received very little feedback, so I am going ahead and creating it. I am still

[GitHub] spark pull request: [SPARK-11449][Core] PortableDataStream should ...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9417#issuecomment-153059875 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11448][SQL] Skip caching part-files in ...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9405#issuecomment-153017380 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11458][SQL] add word count example for ...

2015-11-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9415#issuecomment-153050470 **[Test build #44813 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44813/consoleFull)** for PR 9415 at commit

[GitHub] spark pull request: [SPARK-9104][SPARK-9105][SPARK-9106][SPARK-910...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7753#issuecomment-153050399 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11458][SQL] add word count example for ...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9415#issuecomment-153050637 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11458][SQL] add word count example for ...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9415#issuecomment-153050635 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11449][Core] PortableDataStream should ...

2015-11-02 Thread hvanhovell
GitHub user hvanhovell opened a pull request: https://github.com/apache/spark/pull/9417 [SPARK-11449][Core] PortableDataStream should be a factory ```PortableDataStream``` maintains some internal state. This makes it tricky to reuse a stream (one needs to call ```close``` on both

[GitHub] spark pull request: [SPARK-10978] [SQL] Allow data sources to elim...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9399#issuecomment-153012486 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-10786][SQL]Take the whole statement to ...

2015-11-02 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/8895#issuecomment-153014703 LGTM. Thanks for fixing this! Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-11450][SQL] Add Unsafe Row processing t...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9414#issuecomment-153028650 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9836] [ML] Provide R-like summary stati...

2015-11-02 Thread yanboliang
Github user yanboliang commented on the pull request: https://github.com/apache/spark/pull/9413#issuecomment-153031528 In the current implementation we provide ```Std. Error``` for ```coefficients``` excepts ```intercept```, because that we use optimized method to calculate

[GitHub] spark pull request: [SPARK-11112] DAG visualization: display RDD c...

2015-11-02 Thread andrewor14
Github user andrewor14 commented on the pull request: https://github.com/apache/spark/pull/9398#issuecomment-153050315 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-9104][SPARK-9105][SPARK-9106][SPARK-910...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7753#issuecomment-153050402 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-9104][SPARK-9105][SPARK-9106][SPARK-910...

2015-11-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/7753#issuecomment-153050394 **[Test build #44815 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44815/consoleFull)** for PR 7753 at commit

[GitHub] spark pull request: [SPARK-11455][SQL] fix case sensitivity of par...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9410#issuecomment-153030063 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-9836] [ML] Provide R-like summary stati...

2015-11-02 Thread yanboliang
Github user yanboliang commented on the pull request: https://github.com/apache/spark/pull/9413#issuecomment-153031344 In the current implementation we provide ```Std. Error``` for ```coefficients``` excepts ```intercept```, because that we use optimized method to calculate

[GitHub] spark pull request: [SPARK-9836] [ML] Provide R-like summary stati...

2015-11-02 Thread yanboliang
Github user yanboliang commented on the pull request: https://github.com/apache/spark/pull/9413#issuecomment-153031428 In the current implementation we provide ```Std. Error``` for ```coefficients``` excepts ```intercept```, because that we use optimized method to calculate

[GitHub] spark pull request: [SPARK-9836] [ML] Provide R-like summary stati...

2015-11-02 Thread yanboliang
Github user yanboliang commented on the pull request: https://github.com/apache/spark/pull/9413#issuecomment-153031391 In the current implementation we provide ```Std. Error``` for ```coefficients``` excepts ```intercept```, because that we use optimized method to calculate

[GitHub] spark pull request: [SPARK-10533] [SQL] handle scientific notation...

2015-11-02 Thread liancheng
Github user liancheng commented on a diff in the pull request: https://github.com/apache/spark/pull/9085#discussion_r43633899 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala --- @@ -169,6 +169,26 @@ class DataFrameSuite extends QueryTest with

[GitHub] spark pull request: [SPARK-9104][SPARK-9105][SPARK-9106][SPARK-910...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7753#issuecomment-153048340 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10978] [SQL] Allow data sources to elim...

2015-11-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9399#issuecomment-153050846 **[Test build #44814 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44814/consoleFull)** for PR 9399 at commit

[GitHub] spark pull request: [SPARK-11112] DAG visualization: display RDD c...

2015-11-02 Thread sarutak
Github user sarutak commented on the pull request: https://github.com/apache/spark/pull/9398#issuecomment-153057423 Thanks @andrewor14 , I'll look into this soon! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-9836] [ML] Provide R-like summary stati...

2015-11-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9413#issuecomment-153029589 **[Test build #44812 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44812/consoleFull)** for PR 9413 at commit

[GitHub] spark pull request: [SPARK-11458][SQL] add word count example for ...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9415#issuecomment-153040844 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11458][SQL] add word count example for ...

2015-11-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9415#issuecomment-153043608 **[Test build #44813 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44813/consoleFull)** for PR 9415 at commit

[GitHub] spark pull request: [SPARK-11449][Core] PortableDataStream should ...

2015-11-02 Thread srowen
Github user srowen commented on the pull request: https://github.com/apache/spark/pull/9417#issuecomment-153059923 @kmader what do you think of this one? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-11453][SQL] append data to partitioned ...

2015-11-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9408#issuecomment-153013113 **[Test build #44804 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44804/consoleFull)** for PR 9408 at commit

[GitHub] spark pull request: [SPARK-10978] [SQL] Allow data sources to elim...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9399#issuecomment-153012488 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11457][Streaming][YARN] Fix incorrect A...

2015-11-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9412#issuecomment-153013074 **[Test build #44810 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44810/consoleFull)** for PR 9412 at commit

[GitHub] spark pull request: [SPARK-10978] [SQL] Allow data sources to elim...

2015-11-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9399#issuecomment-153012481 **[Test build #44811 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44811/consoleFull)** for PR 9399 at commit

[GitHub] spark pull request: [SPARK-11458][SQL] add word count example for ...

2015-11-02 Thread cloud-fan
GitHub user cloud-fan opened a pull request: https://github.com/apache/spark/pull/9415 [SPARK-11458][SQL] add word count example for Dataset You can merge this pull request into a Git repository by running: $ git pull https://github.com/cloud-fan/spark wordcount

[GitHub] spark pull request: [SPARK-9836] [ML] Provide R-like summary stati...

2015-11-02 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/9413#discussion_r43634982 --- Diff: mllib/src/main/scala/org/apache/spark/ml/regression/LinearRegression.scala --- @@ -471,6 +484,59 @@ class LinearRegressionSummary

[GitHub] spark pull request: [SPARK-11456] [TESTS] Remove deprecated junit....

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9411#issuecomment-153028631 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11456] [TESTS] Remove deprecated junit....

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9411#issuecomment-153028628 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11457][Streaming][YARN] Fix incorrect A...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9412#issuecomment-153028669 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11456] [TESTS] Remove deprecated junit....

2015-11-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9411#issuecomment-153028484 **[Test build #44809 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44809/consoleFull)** for PR 9411 at commit

[GitHub] spark pull request: [SPARK-11457][Streaming][YARN] Fix incorrect A...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9412#issuecomment-153028668 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11458][SQL] add word count example for ...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9415#issuecomment-153040919 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: Spark-6373 Add SSL/TLS for the Netty based Blo...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9416#issuecomment-153058457 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11449][Core] PortableDataStream should ...

2015-11-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9417#issuecomment-153060623 **[Test build #1967 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1967/consoleFull)** for PR 9417 at commit

[GitHub] spark pull request: [SPARK-11453][SQL] append data to partitioned ...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9408#issuecomment-153013228 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11453][SQL] append data to partitioned ...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9408#issuecomment-153013229 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-9836] [ML] Provide R-like summary stati...

2015-11-02 Thread yanboliang
GitHub user yanboliang opened a pull request: https://github.com/apache/spark/pull/9413 [SPARK-9836] [ML] Provide R-like summary statistics for OLS via normal equation solver https://issues.apache.org/jira/browse/SPARK-9836 You can merge this pull request into a Git repository by

[GitHub] spark pull request: [SPARK-11457][Streaming][YARN] Fix incorrect A...

2015-11-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9412#issuecomment-153028495 **[Test build #44810 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44810/consoleFull)** for PR 9412 at commit

[GitHub] spark pull request: [SPARK-11455][SQL] fix case sensitivity of par...

2015-11-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9410#issuecomment-153029895 **[Test build #44806 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44806/consoleFull)** for PR 9410 at commit

[GitHub] spark pull request: [SPARK-11311] [SQL] spark cannot describe temp...

2015-11-02 Thread liancheng
Github user liancheng commented on the pull request: https://github.com/apache/spark/pull/9277#issuecomment-153044589 LGTM, merging to master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-9104][SPARK-9105][SPARK-9106][SPARK-910...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/7753#issuecomment-153048362 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10978] [SQL] Allow data sources to elim...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9399#issuecomment-153048329 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10978] [SQL] Allow data sources to elim...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9399#issuecomment-153048363 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11112] DAG visualization: display RDD c...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9398#issuecomment-153051220 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11112] DAG visualization: display RDD c...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9398#issuecomment-153051172 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10978] [SQL] Allow data sources to elim...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9399#issuecomment-153011716 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11457][Streaming][YARN] Fix incorrect A...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9412#issuecomment-153011717 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11457][Streaming][YARN] Fix incorrect A...

2015-11-02 Thread jerryshao
GitHub user jerryshao opened a pull request: https://github.com/apache/spark/pull/9412 [SPARK-11457][Streaming][YARN] Fix incorrect AM proxy filter conf recovery from checkpoint Currently Yarn AM proxy filter configuration is recovered from checkpoint file when Spark Streaming

[GitHub] spark pull request: [SPARK-10978] [SQL] Allow data sources to elim...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9399#issuecomment-153011694 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11457][Streaming][YARN] Fix incorrect A...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9412#issuecomment-153011679 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10978] [SQL] Allow data sources to elim...

2015-11-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9399#issuecomment-153012036 **[Test build #44811 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44811/consoleFull)** for PR 9399 at commit

[GitHub] spark pull request: [SPARK-8467][MLlib][PySpark] Add LDAModel.desc...

2015-11-02 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/8643#discussion_r43657655 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/api/python/LDAModelWrapper.scala --- @@ -0,0 +1,45 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-5354] [SQL] Cached tables should preser...

2015-11-02 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/9404#issuecomment-153099394 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-5354] [SQL] Cached tables should preser...

2015-11-02 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/9404#issuecomment-153099409 test this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-5354] [SQL] Cached tables should preser...

2015-11-02 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/9404#issuecomment-153099382 add to whitelist --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-9162][SQL] Implement code generation fo...

2015-11-02 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/9270#discussion_r43658099 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ScalaUDF.scala --- @@ -959,6 +963,122 @@ case class ScalaUDF( }

[GitHub] spark pull request: SPARK-11371 Make "mean" an alias for "avg" ope...

2015-11-02 Thread yhuai
Github user yhuai commented on the pull request: https://github.com/apache/spark/pull/9332#issuecomment-153103900 @ted-yu Can you modify a test to use this alias? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11457][Streaming][YARN] Fix incorrect A...

2015-11-02 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9412#issuecomment-153115388 LGTM as far as I understand this code. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark pull request: [SPARK-10997] [core] Add "client mode" to nett...

2015-11-02 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/9210#issuecomment-153116416 Merging this to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-10622] [core] [yarn] Differentiate dead...

2015-11-02 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/8887#issuecomment-153117330 Hi @kayousterhout , are you ok with my explanation above? I'd like to get this is soon. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request: SPARK-11420 Updating Stddev support via Impera...

2015-11-02 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/9380#discussion_r43662570 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/functions.scala --- @@ -1135,7 +992,76 @@ abstract class

[GitHub] spark pull request: [SPARK-10622] [core] [yarn] Differentiate dead...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8887#issuecomment-153117844 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-5354] [SQL] Cached tables should preser...

2015-11-02 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9404#discussion_r43662693 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/CachedTableSuite.scala --- @@ -353,4 +354,44 @@ class CachedTableSuite extends QueryTest with

[GitHub] spark pull request: [SPARK-11425] Improve Hybrid aggregation

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9383#issuecomment-153119257 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-10997] [core] Add "client mode" to nett...

2015-11-02 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/9210#issuecomment-153119171 Just took another look. LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11425] Improve Hybrid aggregation

2015-11-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9383#issuecomment-153121113 **[Test build #44820 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44820/consoleFull)** for PR 9383 at commit

[GitHub] spark pull request: [SPARK-10827] [CORE] AppClient should not use ...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9317#issuecomment-153121675 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11425] Improve Hybrid aggregation

2015-11-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9383#issuecomment-153121656 **[Test build #44820 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/44820/consoleFull)** for PR 9383 at commit

[GitHub] spark pull request: [SPARK-11425] Improve Hybrid aggregation

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9383#issuecomment-153121664 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11458][SQL] add word count example for ...

2015-11-02 Thread marmbrus
Github user marmbrus commented on a diff in the pull request: https://github.com/apache/spark/pull/9415#discussion_r43648991 --- Diff: examples/src/main/scala/org/apache/spark/examples/sql/DatasetWordCount.scala --- @@ -0,0 +1,42 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-10978] [SQL] Allow data sources to elim...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9399#issuecomment-153095366 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-10978] [SQL] Allow data sources to elim...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9399#issuecomment-153095363 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-8467][MLlib][PySpark] Add LDAModel.desc...

2015-11-02 Thread yu-iskw
Github user yu-iskw commented on a diff in the pull request: https://github.com/apache/spark/pull/8643#discussion_r43658405 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/api/python/LDAModelWrapper.scala --- @@ -0,0 +1,45 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request: [SPARK-5354] [SQL] Cached tables should preser...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9404#issuecomment-153100427 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-5354] [SQL] Cached tables should preser...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9404#issuecomment-153100484 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-11437] [PySpark] Don't .take when conve...

2015-11-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9392#issuecomment-153104431 **[Test build #1969 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/1969/consoleFull)** for PR 9392 at commit

[GitHub] spark pull request: [SPARK-11437] [PySpark] Don't .take when conve...

2015-11-02 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/9392#issuecomment-153104500 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark pull request: [SPARK-9858][SPARK-9859][SPARK-9861][SQL] Add ...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9276#issuecomment-153106533 Merged build started. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-9817][YARN] Improve the locality calcul...

2015-11-02 Thread vanzin
Github user vanzin commented on the pull request: https://github.com/apache/spark/pull/8100#issuecomment-153115647 Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-11425] Improve Hybrid aggregation

2015-11-02 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/9383#issuecomment-153118810 After some benchmark, realized that using hashcode as prefix in timsort will cause regression in timsort and snappy compression (especially for aggregation after join,

[GitHub] spark pull request: [SPARK-8029][core] first successful shuffle ta...

2015-11-02 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/9214#discussion_r43664109 --- Diff: core/src/main/java/org/apache/spark/shuffle/sort/BypassMergeSortShuffleWriter.java --- @@ -121,13 +125,22 @@ public BypassMergeSortShuffleWriter(

[GitHub] spark pull request: [SPARK-8029][core] first successful shuffle ta...

2015-11-02 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/9214#discussion_r43664703 --- Diff: core/src/main/java/org/apache/spark/shuffle/sort/BypassMergeSortShuffleWriter.java --- @@ -121,13 +125,22 @@ public BypassMergeSortShuffleWriter(

[GitHub] spark pull request: [SPARK-11437] [PySpark] Don't .take when conve...

2015-11-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9392 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-8029][core] first successful shuffle ta...

2015-11-02 Thread vanzin
Github user vanzin commented on a diff in the pull request: https://github.com/apache/spark/pull/9214#discussion_r43664936 --- Diff: core/src/main/scala/org/apache/spark/shuffle/FileShuffleBlockResolver.scala --- @@ -132,6 +134,15 @@ private[spark] class

[GitHub] spark pull request: [SPARK-11438] [SQL] Allow users to define nond...

2015-11-02 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9393#discussion_r43657874 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/UDFSuite.scala --- @@ -191,4 +193,86 @@ class UDFSuite extends QueryTest with SharedSQLContext {

[GitHub] spark pull request: [SPARK-9858][SPARK-9859][SPARK-9861][SQL] Add ...

2015-11-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9276#issuecomment-153106415 Merged build triggered. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-5354] [SQL] Cached tables should preser...

2015-11-02 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/9404#discussion_r43660128 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/CachedTableSuite.scala --- @@ -353,4 +354,44 @@ class CachedTableSuite extends QueryTest with

  1   2   3   4   5   6   7   8   9   10   >