[GitHub] spark issue #17945: [SPARK-20704][SPARKR] change CRAN test to run single thr...

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17945 **[Test build #76778 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76778/testReport)** for PR 17945 at commit

[GitHub] spark issue #17945: [SPARK-20704][SPARKR] change CRAN test to run single thr...

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17945 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17945: [SPARK-20704][SPARKR] change CRAN test to run single thr...

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17945 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76778/ Test PASSed. ---

[GitHub] spark pull request #17945: [SPARK-20704][SPARKR] change CRAN test to run sin...

2017-05-10 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/17945#discussion_r115909228 --- Diff: R/pkg/inst/tests/testthat/jarTest.R --- @@ -16,7 +16,7 @@ # library(SparkR) -sc <- sparkR.session() +sc <-

[GitHub] spark pull request #17945: [SPARK-20704][SPARKR] change CRAN test to run sin...

2017-05-10 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/17945#discussion_r115909188 --- Diff: R/pkg/DESCRIPTION --- @@ -13,6 +13,7 @@ Authors@R: c(person("Shivaram", "Venkataraman", role = c("aut", "cre"), License: Apache License

[GitHub] spark issue #17887: [SPARK-20399][SQL] Add a config to fallback string liter...

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17887 **[Test build #76782 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76782/testReport)** for PR 17887 at commit

[GitHub] spark issue #17644: [SPARK-17729] [SQL] Enable creating hive bucketed tables

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17644 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #17887: [SPARK-20399][SQL] Add a config to fallback strin...

2017-05-10 Thread viirya
Github user viirya commented on a diff in the pull request: https://github.com/apache/spark/pull/17887#discussion_r115908703 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/regexpExpressions.scala --- @@ -144,7 +151,31 @@ case class Like(left:

[GitHub] spark issue #17644: [SPARK-17729] [SQL] Enable creating hive bucketed tables

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17644 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76767/ Test PASSed. ---

[GitHub] spark issue #17644: [SPARK-17729] [SQL] Enable creating hive bucketed tables

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17644 **[Test build #76767 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76767/testReport)** for PR 17644 at commit

[GitHub] spark issue #17910: [SPARK-20669][ML] LogisticRegression family should be ca...

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17910 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17910: [SPARK-20669][ML] LogisticRegression family should be ca...

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17910 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76777/ Test FAILed. ---

[GitHub] spark issue #17910: [SPARK-20669][ML] LogisticRegression family should be ca...

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17910 **[Test build #76777 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76777/testReport)** for PR 17910 at commit

[GitHub] spark issue #17711: [SPARK-19951][SQL] Add string concatenate operator || to...

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17711 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17711: [SPARK-19951][SQL] Add string concatenate operator || to...

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17711 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76769/ Test PASSed. ---

[GitHub] spark pull request #17945: [SPARK-20704][SPARKR] change CRAN test to run sin...

2017-05-10 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/17945#discussion_r115907813 --- Diff: R/pkg/inst/tests/testthat/jarTest.R --- @@ -16,7 +16,7 @@ # library(SparkR) -sc <- sparkR.session() +sc <-

[GitHub] spark issue #17711: [SPARK-19951][SQL] Add string concatenate operator || to...

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17711 **[Test build #76769 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76769/testReport)** for PR 17711 at commit

[GitHub] spark pull request #17945: [SPARK-20704][SPARKR] change CRAN test to run sin...

2017-05-10 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/17945#discussion_r115907978 --- Diff: R/pkg/inst/tests/testthat/test_Serde.R --- @@ -17,7 +17,7 @@ context("SerDe functionality") -sparkSession <-

[GitHub] spark pull request #17945: [SPARK-20704][SPARKR] change CRAN test to run sin...

2017-05-10 Thread shivaram
Github user shivaram commented on a diff in the pull request: https://github.com/apache/spark/pull/17945#discussion_r115907770 --- Diff: R/pkg/DESCRIPTION --- @@ -13,6 +13,7 @@ Authors@R: c(person("Shivaram", "Venkataraman", role = c("aut", "cre"), License: Apache License (==

[GitHub] spark issue #17739: [SPARK-20443][MLLIB][ML] set ALS blockify size

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17739 **[Test build #76781 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76781/testReport)** for PR 17739 at commit

[GitHub] spark issue #17819: [SPARK-20542][ML][SQL] Add a Bucketizer that can bin mul...

2017-05-10 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/17819 @barrybecker4 `withColumns` API is first introduced in this PR. So you won't see it in Spark 2.1.1 or current codebase. Thanks for letting me know SPARK-12225. Yes, it is related. --- If your

[GitHub] spark issue #17945: [SPARK-20704][SPARKR] change CRAN test to run single thr...

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17945 **[Test build #76780 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76780/testReport)** for PR 17945 at commit

[GitHub] spark issue #17935: [SPARK-20690][SQL][WIP] Analyzer shouldn't add missing a...

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17935 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76772/ Test FAILed. ---

[GitHub] spark issue #17935: [SPARK-20690][SQL][WIP] Analyzer shouldn't add missing a...

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17935 **[Test build #76772 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76772/testReport)** for PR 17935 at commit

[GitHub] spark issue #17935: [SPARK-20690][SQL][WIP] Analyzer shouldn't add missing a...

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17935 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17945: [SPARK-20704][SPARKR] change CRAN test to run single thr...

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17945 **[Test build #76778 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76778/testReport)** for PR 17945 at commit

[GitHub] spark issue #17910: [SPARK-20669][ML] LogisticRegression family should be ca...

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17910 **[Test build #76779 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76779/testReport)** for PR 17910 at commit

[GitHub] spark pull request #17945: [SPARK-20704][SPARKR] change CRAN test to run sin...

2017-05-10 Thread felixcheung
GitHub user felixcheung opened a pull request: https://github.com/apache/spark/pull/17945 [SPARK-20704][SPARKR] change CRAN test to run single thread ## What changes were proposed in this pull request? also target unix only - [ ] need to test devtools

[GitHub] spark issue #17943: [SPARK-20682][SQL] Implement new ORC data source based o...

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17943 **[Test build #76776 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76776/testReport)** for PR 17943 at commit

[GitHub] spark issue #17910: [SPARK-20669][ML] LogisticRegression family should be ca...

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17910 **[Test build #76777 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76777/testReport)** for PR 17910 at commit

[GitHub] spark issue #14615: [SPARK-17029] make toJSON not go through rdd form but op...

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14615 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14615: [SPARK-17029] make toJSON not go through rdd form but op...

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14615 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76766/ Test PASSed. ---

[GitHub] spark issue #14615: [SPARK-17029] make toJSON not go through rdd form but op...

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14615 **[Test build #76766 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76766/testReport)** for PR 14615 at commit

[GitHub] spark issue #17719: [SPARK-20431][SQL] Specify a schema by using a DDL-forma...

2017-05-10 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/17719 Sure, I'd love to do tough, I probably missed your point. What's the scenario of the conflict you described? [The current logic in

[GitHub] spark issue #17739: [SPARK-20443][MLLIB][ML] set ALS blockify size

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17739 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76775/ Test FAILed. ---

[GitHub] spark issue #17739: [SPARK-20443][MLLIB][ML] set ALS blockify size

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17739 **[Test build #76775 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76775/testReport)** for PR 17739 at commit

[GitHub] spark issue #17739: [SPARK-20443][MLLIB][ML] set ALS blockify size

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17739 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17739: [SPARK-20443][MLLIB][ML] set ALS blockify size

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17739 **[Test build #76775 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76775/testReport)** for PR 17739 at commit

[GitHub] spark issue #17943: [SPARK-20682][SQL] Implement new ORC data source based o...

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17943 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76764/ Test FAILed. ---

[GitHub] spark issue #17858: [SPARK-20594][SQL]The staging directory should be a chil...

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17858 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76765/ Test PASSed. ---

[GitHub] spark issue #17943: [SPARK-20682][SQL] Implement new ORC data source based o...

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17943 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17858: [SPARK-20594][SQL]The staging directory should be a chil...

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17858 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17858: [SPARK-20594][SQL]The staging directory should be a chil...

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17858 **[Test build #76765 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76765/testReport)** for PR 17858 at commit

[GitHub] spark issue #17943: [SPARK-20682][SQL] Implement new ORC data source based o...

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17943 **[Test build #76764 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76764/testReport)** for PR 17943 at commit

[GitHub] spark issue #17719: [SPARK-20431][SQL] Specify a schema by using a DDL-forma...

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17719 **[Test build #76774 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76774/testReport)** for PR 17719 at commit

[GitHub] spark issue #17926: [MINOR][SQL][PYSPARK] Allow user to specify numSlices in...

2017-05-10 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17926 FYI we added `numPartitions` in R - but that's primarily because we don't have `sc.parallelize` https://github.com/apache/spark/blob/master/R/pkg/R/SQLContext.R#L190 --- If your project

[GitHub] spark issue #17719: [SPARK-20431][SQL] Specify a schema by using a DDL-forma...

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17719 **[Test build #76773 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76773/testReport)** for PR 17719 at commit

[GitHub] spark issue #17935: [SPARK-20690][SQL][WIP] Analyzer shouldn't add missing a...

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17935 **[Test build #76772 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76772/testReport)** for PR 17935 at commit

[GitHub] spark pull request #17934: [SPARK-20501] [ML] ML 2.2 QA: New Scala APIs, doc...

2017-05-10 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/17934#discussion_r115900532 --- Diff: mllib/src/main/scala/org/apache/spark/ml/classification/LinearSVC.scala --- @@ -51,6 +51,7 @@ private[classification] trait LinearSVCParams

[GitHub] spark issue #17935: [SPARK-20690][SQL][WIP] Analyzer shouldn't add missing a...

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17935 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76771/ Test FAILed. ---

[GitHub] spark issue #17935: [SPARK-20690][SQL][WIP] Analyzer shouldn't add missing a...

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17935 **[Test build #76771 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76771/testReport)** for PR 17935 at commit

[GitHub] spark issue #17935: [SPARK-20690][SQL][WIP] Analyzer shouldn't add missing a...

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17935 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17935: [SPARK-20690][SQL][WIP] Analyzer shouldn't add missing a...

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17935 **[Test build #76771 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76771/testReport)** for PR 17935 at commit

[GitHub] spark issue #17928: [SPARK-20311][SQL] Support aliases for table value funct...

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17928 **[Test build #76770 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76770/testReport)** for PR 17928 at commit

[GitHub] spark issue #17944: Revert "[SPARK-20606][ML] ML 2.2 QA: Remove deprecated m...

2017-05-10 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17944 ok I saw #17867 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark pull request #17944: Revert "[SPARK-20606][ML] ML 2.2 QA: Remove depre...

2017-05-10 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/17944#discussion_r115898938 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tree/treeParams.scala --- @@ -109,24 +109,80 @@ private[ml] trait DecisionTreeParams extends

[GitHub] spark issue #17774: [SPARK-18371][Streaming] Spark Streaming backpressure ge...

2017-05-10 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17774 @brkyvz @zsxwing --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #17867: [SPARK-20606][ML] ML 2.2 QA: Remove deprecated methods f...

2017-05-10 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/17867 I'm OK to revert this change and change the deprecation comments to say the items will be removed in ```3.0.0``` instead of ```2.x```. Will do them in two follow-up PRs. Thanks. --- If your

[GitHub] spark issue #17711: [SPARK-19951][SQL] Add string concatenate operator || to...

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17711 **[Test build #76769 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76769/testReport)** for PR 17711 at commit

[GitHub] spark issue #17944: Revert "[SPARK-20606][ML] ML 2.2 QA: Remove deprecated m...

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17944 **[Test build #76768 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76768/testReport)** for PR 17944 at commit

[GitHub] spark pull request #17944: Revert "[SPARK-20606][ML] ML 2.2 QA: Remove depre...

2017-05-10 Thread yanboliang
GitHub user yanboliang opened a pull request: https://github.com/apache/spark/pull/17944 Revert "[SPARK-20606][ML] ML 2.2 QA: Remove deprecated methods for ML" This reverts commit b8733e0ad9f5a700f385e210450fd2c10137293e. Revert SPARK-20606. ## How was this patch

[GitHub] spark issue #17942: [SPARK-20702][Core]TaskContextImpl.markTaskCompleted sho...

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17942 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76762/ Test PASSed. ---

[GitHub] spark issue #17942: [SPARK-20702][Core]TaskContextImpl.markTaskCompleted sho...

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17942 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17644: [SPARK-17729] [SQL] Enable creating hive bucketed tables

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17644 **[Test build #76767 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76767/testReport)** for PR 17644 at commit

[GitHub] spark issue #17942: [SPARK-20702][Core]TaskContextImpl.markTaskCompleted sho...

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17942 **[Test build #76762 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76762/testReport)** for PR 17942 at commit

[GitHub] spark pull request #17910: [SPARK-20669][ML] LogisticRegression family shoul...

2017-05-10 Thread zhengruifeng
Github user zhengruifeng commented on a diff in the pull request: https://github.com/apache/spark/pull/17910#discussion_r115896918 --- Diff: mllib/src/test/scala/org/apache/spark/ml/classification/LogisticRegressionSuite.scala --- @@ -2318,8 +2319,8 @@ class

[GitHub] spark issue #17698: [SPARK-20403][SQL]Modify the instructions of some functi...

2017-05-10 Thread 10110346
Github user 10110346 commented on the issue: https://github.com/apache/spark/pull/17698 I have updated it , and test passed please review it again,thanks @srowen @rxin @HyukjinKwon --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark pull request #17719: [SPARK-20431][SQL] Specify a schema by using a DD...

2017-05-10 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/17719#discussion_r115895776 --- Diff: python/pyspark/sql/readwriter.py --- @@ -96,14 +96,17 @@ def schema(self, schema): By specifying the schema here, the underlying data

[GitHub] spark pull request #17928: [SPARK-20311][SQL] Support aliases for table valu...

2017-05-10 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/17928#discussion_r115895718 --- Diff: sql/core/src/test/resources/sql-tests/inputs/table-valued-functions.sql --- @@ -24,3 +24,7 @@ select * from RaNgE(2); -- Explain

[GitHub] spark issue #17941: [SPARK-20684][R] Expose createGlobalTempView and dropGlo...

2017-05-10 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/17941 actually, it was intentional that we didn't add it in R since there's always one session only. Could you elaborate how global view helps with cross language? --- If your project is set up

[GitHub] spark issue #14615: [SPARK-17029] make toJSON not go through rdd form but op...

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14615 **[Test build #76766 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76766/testReport)** for PR 14615 at commit

[GitHub] spark issue #17858: [SPARK-20594][SQL]The staging directory should be a chil...

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17858 **[Test build #76765 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76765/testReport)** for PR 17858 at commit

[GitHub] spark pull request #17858: [SPARK-20594][SQL]The staging directory should be...

2017-05-10 Thread zuotingbing
Github user zuotingbing commented on a diff in the pull request: https://github.com/apache/spark/pull/17858#discussion_r115893632 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/InsertIntoHiveTableSuite.scala --- @@ -494,4 +494,34 @@ class InsertIntoHiveTableSuite

[GitHub] spark issue #17913: [SPARK-20672][SS] Keep the `isStreaming` property in tri...

2017-05-10 Thread uncleGen
Github user uncleGen commented on the issue: https://github.com/apache/spark/pull/17913 @zsxwing Great! Close this pr then. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #17913: [SPARK-20672][SS] Keep the `isStreaming` property...

2017-05-10 Thread uncleGen
Github user uncleGen closed the pull request at: https://github.com/apache/spark/pull/17913 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #17943: [SPARK-20682][SQL] Implement new ORC data source based o...

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17943 **[Test build #76764 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76764/testReport)** for PR 17943 at commit

[GitHub] spark issue #17924: [SPARK-20682][SQL] Support a new faster ORC data source ...

2017-05-10 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/17924 Hi, All. For further discussion and easy comparision, I made another PR (#17943) except `ColumnarBatch`. --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark pull request #17943: [SPARK-20682][SQL] Implement new ORC data source ...

2017-05-10 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/17943 [SPARK-20682][SQL] Implement new ORC data source based on Apache ORC ## What changes were proposed in this pull request? Since

[GitHub] spark issue #17865: [SPARK-20456][Docs] Add examples for functions collectio...

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17865 **[Test build #76763 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76763/testReport)** for PR 17865 at commit

[GitHub] spark issue #17865: [SPARK-20456][Docs] Add examples for functions collectio...

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17865 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17865: [SPARK-20456][Docs] Add examples for functions collectio...

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17865 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76763/ Test PASSed. ---

[GitHub] spark issue #17713: [SPARK-20417][SQL] Move subquery error handling to check...

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17713 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76761/ Test FAILed. ---

[GitHub] spark issue #17713: [SPARK-20417][SQL] Move subquery error handling to check...

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17713 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17713: [SPARK-20417][SQL] Move subquery error handling to check...

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17713 **[Test build #76761 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76761/testReport)** for PR 17713 at commit

[GitHub] spark issue #17644: [SPARK-17729] [SQL] Enable creating hive bucketed tables

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17644 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17644: [SPARK-17729] [SQL] Enable creating hive bucketed tables

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17644 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76758/ Test FAILed. ---

[GitHub] spark issue #17644: [SPARK-17729] [SQL] Enable creating hive bucketed tables

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17644 **[Test build #76758 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76758/testReport)** for PR 17644 at commit

[GitHub] spark pull request #17938: [SPARK-20694][DOCS][SQL] Document DataFrameWriter...

2017-05-10 Thread tejasapatil
Github user tejasapatil commented on a diff in the pull request: https://github.com/apache/spark/pull/17938#discussion_r115890492 --- Diff: docs/sql-programming-guide.md --- @@ -581,6 +581,46 @@ Starting from Spark 2.1, persistent datasource tables have per-partition metadat

[GitHub] spark issue #17742: [Spark-11968][ML][MLLIB]Optimize MLLIB ALS recommendForA...

2017-05-10 Thread mpjlu
Github user mpjlu commented on the issue: https://github.com/apache/spark/pull/17742 F2Jblas is faster than MKL blas. The following test is based on F2jBLAS. Method 1: BLAS 3 + quickselect on each row and select top k. Method 2: this PR BLOCK size: 256 512 1024 2048

[GitHub] spark issue #17923: [SPARK-20591][WEB UI] Succeeded tasks num not equal in a...

2017-05-10 Thread fjh100456
Github user fjh100456 commented on the issue: https://github.com/apache/spark/pull/17923 The description of @pwendell 's jira looks as if it only because the number of tasks completed will exceed the total number of tasks. But I think this excess can remind the user that the

[GitHub] spark issue #17890: [MINOR][BUILD] Fix lint-java breaks.

2017-05-10 Thread ConeyLiu
Github user ConeyLiu commented on the issue: https://github.com/apache/spark/pull/17890 thanks a lot. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #17865: [SPARK-20456][Docs] Add examples for functions collectio...

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17865 **[Test build #76763 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76763/testReport)** for PR 17865 at commit

[GitHub] spark issue #17865: [SPARK-20456][Docs] Add examples for functions collectio...

2017-05-10 Thread map222
Github user map222 commented on the issue: https://github.com/apache/spark/pull/17865 Most recent commit reverts the "if" to "iff", changes all the backticks for column names to single backtick, and tried new `:param:` option for angle columns. --- If your project is set up for it,

[GitHub] spark pull request #17865: [SPARK-20456][Docs] Add examples for functions co...

2017-05-10 Thread map222
Github user map222 commented on a diff in the pull request: https://github.com/apache/spark/pull/17865#discussion_r115889357 --- Diff: python/pyspark/sql/functions.py --- @@ -153,7 +173,7 @@ def _(): # math functions that take two arguments as input _binary_mathfunctions

[GitHub] spark pull request #17938: [SPARK-20694][DOCS][SQL] Document DataFrameWriter...

2017-05-10 Thread tejasapatil
Github user tejasapatil commented on a diff in the pull request: https://github.com/apache/spark/pull/17938#discussion_r115888674 --- Diff: docs/sql-programming-guide.md --- @@ -581,6 +581,46 @@ Starting from Spark 2.1, persistent datasource tables have per-partition metadat

[GitHub] spark pull request #17938: [SPARK-20694][DOCS][SQL] Document DataFrameWriter...

2017-05-10 Thread tejasapatil
Github user tejasapatil commented on a diff in the pull request: https://github.com/apache/spark/pull/17938#discussion_r115888199 --- Diff: docs/sql-programming-guide.md --- @@ -1766,12 +1806,6 @@ Spark SQL supports the vast majority of Hive features, such as: Below is a list

[GitHub] spark pull request #17925: [SPARK-20205][core] Make sure StageInfo is update...

2017-05-10 Thread squito
Github user squito commented on a diff in the pull request: https://github.com/apache/spark/pull/17925#discussion_r115887910 --- Diff: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala --- @@ -1054,15 +1053,17 @@ class DAGScheduler( return }

[GitHub] spark issue #17941: [SPARK-20684][R] Expose createGlobalTempView and dropGlo...

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17941 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/76760/ Test PASSed. ---

[GitHub] spark issue #17941: [SPARK-20684][R] Expose createGlobalTempView and dropGlo...

2017-05-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17941 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #17941: [SPARK-20684][R] Expose createGlobalTempView and dropGlo...

2017-05-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17941 **[Test build #76760 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/76760/testReport)** for PR 17941 at commit

  1   2   3   4   5   >