[GitHub] spark pull request: [SPARK-11892] Model export/import for spark.ml...

2016-03-28 Thread yinxusen
Github user yinxusen commented on the pull request: https://github.com/apache/spark/pull/9934#issuecomment-202726190 @jkbradley Ready to review. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-202725864 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-202725865 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-202725859 **[Test build #54412 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54412/consoleFull)** for PR 8880 at commit

[GitHub] spark pull request: [SPARK-5682][Core] Add encrypted shuffle in sp...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/8880#issuecomment-202725270 **[Test build #54412 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54412/consoleFull)** for PR 8880 at commit

[GitHub] spark pull request: [Spark-13784][ML][WIP] Model export/import for...

2016-03-28 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/12023#issuecomment-202724996 I made an initial pass with high-level comments. It will be important to reuse more code. I'll stay tuned for updates. Thanks! --- If your project is set up for

[GitHub] spark pull request: [Spark-13784][ML][WIP] Model export/import for...

2016-03-28 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/12023#discussion_r57674664 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/RandomForestClassifier.scala --- @@ -240,12 +250,66 @@ final class

[GitHub] spark pull request: [Spark-13784][ML][WIP] Model export/import for...

2016-03-28 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/12023#discussion_r57674667 --- Diff: mllib/src/main/scala/org/apache/spark/ml/regression/RandomForestRegressor.scala --- @@ -199,21 +210,71 @@ final class

[GitHub] spark pull request: [Spark-13784][ML][WIP] Model export/import for...

2016-03-28 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/12023#discussion_r57674670 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/treeModels.scala --- @@ -238,3 +238,128 @@ private[ml] object DecisionTreeModelReadWrite {

[GitHub] spark pull request: [Spark-13784][ML][WIP] Model export/import for...

2016-03-28 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/12023#discussion_r57674668 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/treeModels.scala --- @@ -238,3 +238,128 @@ private[ml] object DecisionTreeModelReadWrite {

[GitHub] spark pull request: [Spark-13784][ML][WIP] Model export/import for...

2016-03-28 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/12023#discussion_r57674671 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/treeModels.scala --- @@ -238,3 +238,128 @@ private[ml] object DecisionTreeModelReadWrite {

[GitHub] spark pull request: [Spark-13784][ML][WIP] Model export/import for...

2016-03-28 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/12023#discussion_r57674663 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/RandomForestClassifier.scala --- @@ -136,7 +144,8 @@ object RandomForestClassifier {

[GitHub] spark pull request: [SPARK-13902][SCHEDULER] Make DAGScheduler.get...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11720#issuecomment-202722356 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [Spark-13784][ML][WIP] Model export/import for...

2016-03-28 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/12023#issuecomment-202722392 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request: [SPARK-13902][SCHEDULER] Make DAGScheduler.get...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11720#issuecomment-202722352 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13902][SCHEDULER] Make DAGScheduler.get...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11720#issuecomment-202721624 **[Test build #54407 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54407/consoleFull)** for PR 11720 at commit

[GitHub] spark pull request: [SPARK-14100][ML] Merging Estimator and Model:...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11983#issuecomment-202718460 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-14071][PySpark][ML]Change MLWritable.wr...

2016-03-28 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/11945#issuecomment-202718417 @wangmiao1981 @mengxr @yanboliang Do you know if Python users often add property tags to classmethods? We would ideally to do that for MLReader.read to make things

[GitHub] spark pull request: [SPARK-14100][ML] Merging Estimator and Model:...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11983#issuecomment-202718456 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14100][ML] Merging Estimator and Model:...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11983#issuecomment-202718037 **[Test build #54408 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54408/consoleFull)** for PR 11983 at commit

[GitHub] spark pull request: [SPARK-14071][PySpark][ML]Change MLWritable.wr...

2016-03-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11945 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-14071][PySpark][ML]Change MLWritable.wr...

2016-03-28 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/11945#issuecomment-202717314 LGTM Merging with master Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11730][ML] Add feature importances for ...

2016-03-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11961 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-11730][ML] Add feature importances for ...

2016-03-28 Thread jkbradley
Github user jkbradley commented on the pull request: https://github.com/apache/spark/pull/11961#issuecomment-202715900 LGTM Merging with master Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13674][SQL] Add wholestage codegen supp...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11517#issuecomment-202715746 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13674][SQL] Add wholestage codegen supp...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11517#issuecomment-202715747 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11730][ML] Add feature importances for ...

2016-03-28 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/11961#discussion_r57673061 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/RandomForestClassifier.scala --- @@ -222,19 +222,15 @@ final class

[GitHub] spark pull request: [SPARK-13607][SQL] Improve compression perform...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11461#issuecomment-202715550 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13674][SQL] Add wholestage codegen supp...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11517#issuecomment-202715594 **[Test build #54409 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54409/consoleFull)** for PR 11517 at commit

[GitHub] spark pull request: [SPARK-13607][SQL] Improve compression perform...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11461#issuecomment-202715552 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13607][SQL] Improve compression perform...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11461#issuecomment-202715170 **[Test build #54410 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54410/consoleFull)** for PR 11461 at commit

[GitHub] spark pull request: [SPARK-14114][SQL] implement buildReader for t...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11934#issuecomment-202713243 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14114][SQL] implement buildReader for t...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11934#issuecomment-202713247 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-14114][SQL] implement buildReader for t...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11934#issuecomment-202712888 **[Test build #54398 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54398/consoleFull)** for PR 11934 at commit

[GitHub] spark pull request: [SPARK-11892] Model export/import for spark.ml...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9934#issuecomment-202712339 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-14114][SQL] implement buildReader for t...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11934#issuecomment-202712337 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-11892] Model export/import for spark.ml...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/9934#issuecomment-202712341 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-14114][SQL] implement buildReader for t...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11934#issuecomment-202712338 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-11892] Model export/import for spark.ml...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9934#issuecomment-202712245 **[Test build #54411 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54411/consoleFull)** for PR 9934 at commit

[GitHub] spark pull request: [SPARK-14114][SQL] implement buildReader for t...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11934#issuecomment-202712224 **[Test build #54396 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54396/consoleFull)** for PR 11934 at commit

[GitHub] spark pull request: [SPARK-14219][GRAPHX] Fix `pickRandomVertex` n...

2016-03-28 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the pull request: https://github.com/apache/spark/pull/12021#issuecomment-202711699 Thank you! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-14219][GRAPHX] Fix `pickRandomVertex` n...

2016-03-28 Thread dongjoon-hyun
Github user dongjoon-hyun closed the pull request at: https://github.com/apache/spark/pull/12021 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request: [SPARK-14143] Options for parsing NaNs, Infini...

2016-03-28 Thread HyukjinKwon
Github user HyukjinKwon commented on the pull request: https://github.com/apache/spark/pull/11947#issuecomment-202711498 I found both `NaN` and `Infinity` are handled in JSON data source and it was fixed in this PR,

[GitHub] spark pull request: [SPARK-3533][Core] Add saveAsTextFileByKey() m...

2016-03-28 Thread saurfang
Github user saurfang closed the pull request at: https://github.com/apache/spark/pull/8375 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-3533][Core] Add saveAsTextFileByKey() m...

2016-03-28 Thread saurfang
Github user saurfang commented on the pull request: https://github.com/apache/spark/pull/8375#issuecomment-202711183 Thanks @davies. This looks to be a very reasonable workaround. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request: Experiments: Aggregate w/ keys

2016-03-28 Thread sameeragarwal
Github user sameeragarwal closed the pull request at: https://github.com/apache/spark/pull/12027 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request: Experiments: Aggregate w/ keys

2016-03-28 Thread sameeragarwal
GitHub user sameeragarwal opened a pull request: https://github.com/apache/spark/pull/12027 Experiments: Aggregate w/ keys You can merge this pull request into a Git repository by running: $ git pull https://github.com/sameeragarwal/spark hashmap Alternatively you can review

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/12024 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-28 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/12024#issuecomment-202710390 Merging into master, thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12024#issuecomment-202709467 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12024#issuecomment-202709463 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-12792][SPARKR] Refactor RRDD to support...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12024#issuecomment-202708781 **[Test build #54405 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54405/consoleFull)** for PR 12024 at commit

[GitHub] spark pull request: [SPARK-14210][SQL] Add a metric for time spent...

2016-03-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/12007 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-14210][SQL] Add a metric for time spent...

2016-03-28 Thread davies
Github user davies commented on the pull request: https://github.com/apache/spark/pull/12007#issuecomment-202705564 LGTM, merging this into master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark pull request: [Spark-14230][STREAMING] Config the start time...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12026#issuecomment-202705472 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [Spark-14230][STREAMING] Config the start time...

2016-03-28 Thread liyintang
GitHub user liyintang opened a pull request: https://github.com/apache/spark/pull/12026 [Spark-14230][STREAMING] Config the start time (jitter) for streaming… ## What changes were proposed in this pull request? Currently, RecurringTimer will normalize the start time. For

[GitHub] spark pull request: [SPARK-14210][SQL] Add a metric for time spent...

2016-03-28 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/12007#discussion_r57671055 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ExistingRDD.scala --- @@ -241,73 +256,89 @@ private[sql] case class DataSourceScan(

[GitHub] spark pull request: [SPARK-14210][SQL] Add a metric for time spent...

2016-03-28 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/12007#discussion_r57670804 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ExistingRDD.scala --- @@ -241,73 +256,89 @@ private[sql] case class DataSourceScan(

[GitHub] spark pull request: [SPARK-14215] [SQL] [PYSPARK] Support chained ...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12014#issuecomment-202702741 **[Test build #2707 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2707/consoleFull)** for PR 12014 at commit

[GitHub] spark pull request: [SPARK-14215] [SQL] [PYSPARK] Support chained ...

2016-03-28 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/12014#discussion_r57670559 --- Diff: python/pyspark/worker.py --- @@ -95,10 +107,23 @@ def main(infile, outfile): _broadcastRegistry.pop(bid)

[GitHub] spark pull request: [SPARK-11892] Model export/import for spark.ml...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/9934#issuecomment-202702573 **[Test build #54411 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54411/consoleFull)** for PR 9934 at commit

[GitHub] spark pull request: [SPARK-13801][SQL] DataFrame.col should return...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11632#issuecomment-202699312 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13801][SQL] DataFrame.col should return...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11632#issuecomment-202699315 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13801][SQL] DataFrame.col should return...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11632#issuecomment-202699082 **[Test build #54403 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54403/consoleFull)** for PR 11632 at commit

[GitHub] spark pull request: [SPARK-14219][GRAPHX] Fix `pickRandomVertex` n...

2016-03-28 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/12021#issuecomment-202698860 Thanks - I've merged this. Can you close the pull request? Because it is not merged in master it wouldn't auto close. --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-14086][SQL] Add DDL commands to ANTLR4 ...

2016-03-28 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/12011#issuecomment-202698770 @hvanhovell can you create a jira ticket for the follow-up tasks? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] spark pull request: [SPARK-13992][WIP] Add support for off-heap ca...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11805#issuecomment-202696168 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13992][WIP] Add support for off-heap ca...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11805#issuecomment-202696162 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-13992][WIP] Add support for off-heap ca...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11805#issuecomment-202696165 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13992][WIP] Add support for off-heap ca...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11805#issuecomment-202696161 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13674][SQL] Add wholestage codegen supp...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11517#issuecomment-202695911 **[Test build #54409 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54409/consoleFull)** for PR 11517 at commit

[GitHub] spark pull request: [SPARK-13607][SQL] Improve compression perform...

2016-03-28 Thread maropu
Github user maropu commented on the pull request: https://github.com/apache/spark/pull/11461#issuecomment-202695897 @nongli okay, fixed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request: [SPARK-13607][SQL] Improve compression perform...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11461#issuecomment-202695912 **[Test build #54410 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54410/consoleFull)** for PR 11461 at commit

[GitHub] spark pull request: [SPARK-13992][WIP] Add support for off-heap ca...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11805#issuecomment-202695926 **[Test build #54400 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54400/consoleFull)** for PR 11805 at commit

[GitHub] spark pull request: [SPARK-14100][ML] Merging Estimator and Model:...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11983#issuecomment-202695914 **[Test build #54408 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54408/consoleFull)** for PR 11983 at commit

[GitHub] spark pull request: [SPARK-13992][WIP] Add support for off-heap ca...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11805#issuecomment-202695991 **[Test build #54401 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54401/consoleFull)** for PR 11805 at commit

[GitHub] spark pull request: [SPARK-13902][SCHEDULER] Make DAGScheduler.get...

2016-03-28 Thread markhamstra
Github user markhamstra commented on a diff in the pull request: https://github.com/apache/spark/pull/11720#discussion_r57668558 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -286,6 +286,7 @@ class DAGScheduler( case None =>

[GitHub] spark pull request: [SPARK-13904][Scheduler]Add support for plugga...

2016-03-28 Thread hbhanawat
Github user hbhanawat commented on the pull request: https://github.com/apache/spark/pull/11723#issuecomment-202692781 @tejasapatil if you are done with the review, can we ask @rxin to have a look at this? --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: [SPARK-13981][SQL] Defer evaluating variables ...

2016-03-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/11792 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-13981][SQL] Defer evaluating variables ...

2016-03-28 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11792#issuecomment-202691066 Thanks - merging in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request: [SPARK-12343][YARN] Simplify Yarn client and c...

2016-03-28 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/11603#discussion_r57668125 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/Client.scala --- @@ -510,10 +516,12 @@ private[spark] class Client( * (3) whether to

[GitHub] spark pull request: [SPARK-14210][SQL] Add a metric for time spent...

2016-03-28 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/12007#issuecomment-202690321 cc @davies would be great if this can make it into our nightly perf run --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request: [SPARK-13902][SCHEDULER] Make DAGScheduler.get...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11720#issuecomment-202689229 **[Test build #54407 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54407/consoleFull)** for PR 11720 at commit

[GitHub] spark pull request: [DO_NOT_MERGE]Try to reproduce StateStoreRDDSu...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12005#issuecomment-202689266 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [DO_NOT_MERGE]Try to reproduce StateStoreRDDSu...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12005#issuecomment-202689263 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [DO_NOT_MERGE]Try to reproduce StateStoreRDDSu...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12005#issuecomment-202689236 **[Test build #54377 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54377/consoleFull)** for PR 12005 at commit

[GitHub] spark pull request: [SPARK-13607][SQL] Improve compression perform...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11461#issuecomment-202688055 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark pull request: [SPARK-13607][SQL] Improve compression perform...

2016-03-28 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11461#issuecomment-202688057 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] spark pull request: [SPARK-14124] [SQL] Implement Database-related...

2016-03-28 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/12009#issuecomment-202687564 I just merged https://github.com/apache/spark/pull/12015 Can you update to use the new ANTLR4 parser instead? We are going to remove the ANTLR3 one in the next

[GitHub] spark pull request: [SPARK-13607][SQL] Improve compression perform...

2016-03-28 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11461#issuecomment-202687485 **[Test build #54402 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/54402/consoleFull)** for PR 11461 at commit

[GitHub] spark pull request: [SPARK-12343][YARN] Simplify Yarn client and c...

2016-03-28 Thread jerryshao
Github user jerryshao commented on a diff in the pull request: https://github.com/apache/spark/pull/11603#discussion_r57667617 --- Diff: yarn/src/main/scala/org/apache/spark/deploy/yarn/ApplicationMasterArguments.scala --- @@ -101,12 +91,8 @@ class ApplicationMasterArguments(val

[GitHub] spark pull request: [SPARK-14184][SQL] Support native execution of...

2016-03-28 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11991#issuecomment-202687185 I just merged https://github.com/apache/spark/pull/12015 Can you update to use the new ANTLR4 parser instead? We are going to remove the ANTLR3 one in the next

[GitHub] spark pull request: [SPARK-14213][SQL] Migrate HiveQl parsing to A...

2016-03-28 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/12015 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request: [SPARK-14182] [SQL] Parse DDL Command: Alter V...

2016-03-28 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/11987#issuecomment-202687275 I just merged https://github.com/apache/spark/pull/12015 Can you update to use the new ANTLR4 parser instead? We are going to remove the ANTLR3 one in the next

[GitHub] spark pull request: [SPARK-13902][SCHEDULER] Make DAGScheduler.get...

2016-03-28 Thread ueshin
Github user ueshin commented on a diff in the pull request: https://github.com/apache/spark/pull/11720#discussion_r57667547 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -286,6 +286,7 @@ class DAGScheduler( case None =>

[GitHub] spark pull request: [SPARK-14213][SQL] Migrate HiveQl parsing to A...

2016-03-28 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/12015#issuecomment-202686717 Thanks - I've merged this in master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does

[GitHub] spark pull request: [SPARK-14215] [SQL] [PYSPARK] Support chained ...

2016-03-28 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/12014#discussion_r57667387 --- Diff: python/pyspark/worker.py --- @@ -95,10 +107,23 @@ def main(infile, outfile): _broadcastRegistry.pop(bid)

[GitHub] spark pull request: [SPARK-14227] [SQL] Add method for printing ou...

2016-03-28 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/12025#issuecomment-202686070 Can you update the pr description to include the full output? Right now it looks like you are only printing the 1st level. --- If your project is set up for it, you can

[GitHub] spark pull request: [SPARK-14227] [SQL] Add method for printing ou...

2016-03-28 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/12025#discussion_r57667158 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/debug/package.scala --- @@ -62,12 +62,34 @@ package object debug { visited +=

[GitHub] spark pull request: [SPARK-14227] [SQL] Add method for printing ou...

2016-03-28 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/12025#discussion_r57667080 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/WholeStageCodegen.scala --- @@ -297,7 +297,7 @@ case class WholeStageCodegen(child:

  1   2   3   4   5   6   7   8   9   10   >