[GitHub] spark pull request #14557: [SPARK-16709][CORE] Kill the running task if stag...

2016-08-08 Thread shenh062326
GitHub user shenh062326 opened a pull request: https://github.com/apache/spark/pull/14557 [SPARK-16709][CORE] Kill the running task if stage failed ## What changes were proposed in this pull request? At SPARK-16709, when a stage failed, but the running task is still runnin

[GitHub] spark issue #14556: [SPARK-16966][Core] Make App Name to the valid name inst...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14556 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark pull request #14555: [SPARK-16965][MLLIB][PYSPARK] Fix bound checking ...

2016-08-08 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14555#discussion_r74006226 --- Diff: mllib-local/src/main/scala/org/apache/spark/ml/linalg/Vectors.scala --- @@ -560,11 +554,25 @@ class SparseVector @Since("2.0.0") ( @Since("

[GitHub] spark pull request #14555: [SPARK-16965][MLLIB][PYSPARK] Fix bound checking ...

2016-08-08 Thread zjffdu
Github user zjffdu commented on a diff in the pull request: https://github.com/apache/spark/pull/14555#discussion_r74006057 --- Diff: mllib-local/src/main/scala/org/apache/spark/ml/linalg/Vectors.scala --- @@ -560,11 +554,25 @@ class SparseVector @Since("2.0.0") ( @Since("

[GitHub] spark pull request #14556: [SPARK-16966][Core] Make App Name to the valid na...

2016-08-08 Thread Sherry302
GitHub user Sherry302 opened a pull request: https://github.com/apache/spark/pull/14556 [SPARK-16966][Core] Make App Name to the valid name instead of a rand… ## What changes were proposed in this pull request? In the SparkSession, before setting "spark.app.name" to "java.util

[GitHub] spark pull request #14551: [SPARK-16961][CORE] Fixed off-by-one error that b...

2016-08-08 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14551#discussion_r74005725 --- Diff: core/src/test/scala/org/apache/spark/util/UtilsSuite.scala --- @@ -874,4 +874,38 @@ class UtilsSuite extends SparkFunSuite with ResetSystemPropertie

[GitHub] spark pull request #14551: [SPARK-16961][CORE] Fixed off-by-one error that b...

2016-08-08 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14551#discussion_r74005704 --- Diff: core/src/test/scala/org/apache/spark/util/UtilsSuite.scala --- @@ -874,4 +874,38 @@ class UtilsSuite extends SparkFunSuite with ResetSystemPropertie

[GitHub] spark pull request #14551: [SPARK-16961][CORE] Fixed off-by-one error that b...

2016-08-08 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14551#discussion_r74005614 --- Diff: core/src/test/scala/org/apache/spark/util/UtilsSuite.scala --- @@ -874,4 +874,38 @@ class UtilsSuite extends SparkFunSuite with ResetSystemPropertie

[GitHub] spark pull request #14551: [SPARK-16961][CORE] Fixed off-by-one error that b...

2016-08-08 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14551#discussion_r74005685 --- Diff: core/src/test/scala/org/apache/spark/util/UtilsSuite.scala --- @@ -874,4 +874,38 @@ class UtilsSuite extends SparkFunSuite with ResetSystemPropertie

[GitHub] spark issue #14554: [SPARK-16964][SQL] Remove private[sql] and private[spark...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14554 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark pull request #14551: [SPARK-16961][CORE] Fixed off-by-one error that b...

2016-08-08 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14551#discussion_r74005625 --- Diff: core/src/test/scala/org/apache/spark/util/UtilsSuite.scala --- @@ -874,4 +874,38 @@ class UtilsSuite extends SparkFunSuite with ResetSystemPropertie

[GitHub] spark issue #14554: [SPARK-16964][SQL] Remove private[sql] and private[spark...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14554 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63415/ Test PASSed. ---

[GitHub] spark issue #14554: [SPARK-16964][SQL] Remove private[sql] and private[spark...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14554 **[Test build #63415 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63415/consoleFull)** for PR 14554 at commit [`d9ba88f`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14555: [SPARK-16965][MLLIB][PYSPARK] Fix bound checking ...

2016-08-08 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14555#discussion_r74005289 --- Diff: mllib-local/src/main/scala/org/apache/spark/ml/linalg/Vectors.scala --- @@ -560,11 +554,25 @@ class SparseVector @Since("2.0.0") ( @Since("

[GitHub] spark pull request #14555: [SPARK-16965][MLLIB][PYSPARK] Fix bound checking ...

2016-08-08 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14555#discussion_r74005178 --- Diff: mllib-local/src/main/scala/org/apache/spark/ml/linalg/Vectors.scala --- @@ -560,11 +554,25 @@ class SparseVector @Since("2.0.0") ( @Since("

[GitHub] spark pull request #14555: [SPARK-16965][MLLIB][PYSPARK] Fix bound checking ...

2016-08-08 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/14555#discussion_r74005184 --- Diff: mllib-local/src/main/scala/org/apache/spark/ml/linalg/Vectors.scala --- @@ -560,11 +554,25 @@ class SparseVector @Since("2.0.0") ( @Since("

[GitHub] spark issue #13701: [SPARK-15639][SPARK-16321][SQL] Push down filter at RowG...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13701 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13701: [SPARK-15639][SPARK-16321][SQL] Push down filter at RowG...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13701 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63412/ Test PASSed. ---

[GitHub] spark issue #13701: [SPARK-15639][SPARK-16321][SQL] Push down filter at RowG...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13701 **[Test build #63412 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63412/consoleFull)** for PR 13701 at commit [`cee74b7`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14531: [SPARK-16943] [SPARK-16942] [SQL] Fix multiple bu...

2016-08-08 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14531#discussion_r74004679 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -80,13 +83,49 @@ case class CreateTableLikeCommand(

[GitHub] spark pull request #14531: [SPARK-16943] [SPARK-16942] [SQL] Fix multiple bu...

2016-08-08 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14531#discussion_r74004636 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -80,13 +83,49 @@ case class CreateTableLikeCommand(

[GitHub] spark issue #14531: [SPARK-16943] [SPARK-16942] [SQL] Fix multiple bugs in C...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14531 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14531: [SPARK-16943] [SPARK-16942] [SQL] Fix multiple bugs in C...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14531 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63413/ Test PASSed. ---

[GitHub] spark issue #14531: [SPARK-16943] [SPARK-16942] [SQL] Fix multiple bugs in C...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14531 **[Test build #63413 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63413/consoleFull)** for PR 14531 at commit [`b820be8`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14537: [SPARK-16948][SQL] Querying empty partitioned orc tables...

2016-08-08 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/14537 @rajeshbalamohan, the changes to `HiveMetastoreCatalog.scala` look reasonable. This mirrors the behavior of this method before the `if (fileType.equals("parquet"))` expression was introduced in 1e8

[GitHub] spark issue #13701: [SPARK-15639][SPARK-16321][SQL] Push down filter at RowG...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13701 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63410/ Test PASSed. ---

[GitHub] spark issue #13701: [SPARK-15639][SPARK-16321][SQL] Push down filter at RowG...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13701 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13701: [SPARK-15639][SPARK-16321][SQL] Push down filter at RowG...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13701 **[Test build #63410 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63410/consoleFull)** for PR 13701 at commit [`0b38ba1`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14537: [SPARK-16948][SQL] Querying empty partitioned orc...

2016-08-08 Thread mallman
Github user mallman commented on a diff in the pull request: https://github.com/apache/spark/pull/14537#discussion_r74003788 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala --- @@ -294,7 +294,9 @@ private[hive] class HiveMetastoreCatalog(spark

[GitHub] spark issue #14520: [SPARK-16934][ML][MLLib] Improve LogisticCostFun to avoi...

2016-08-08 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/14520 @sethah Thanks for your careful review! The PR here already passing the bcFeaturesStd and bcCoeffs as constructor args to the `LogisticAggregator`, like your PR #14109 You mean

[GitHub] spark issue #14546: [SPARK-16955][SQL] Using ordinals in ORDER BY and GROUP ...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14546 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14546: [SPARK-16955][SQL] Using ordinals in ORDER BY and GROUP ...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14546 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63408/ Test PASSed. ---

[GitHub] spark issue #14546: [SPARK-16955][SQL] Using ordinals in ORDER BY and GROUP ...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14546 **[Test build #63408 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63408/consoleFull)** for PR 14546 at commit [`7c3d732`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13146: [SPARK-13081][PYSPARK][SPARK_SUBMIT]. Allow set pythonEx...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13146 **[Test build #63420 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63420/consoleFull)** for PR 13146 at commit [`8119f6d`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #14546: [SPARK-16955][SQL] Using ordinals in ORDER BY and GROUP ...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14546 **[Test build #63419 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63419/consoleFull)** for PR 14546 at commit [`1dc193a`](https://github.com/apache/spark/commit/1

[GitHub] spark pull request #14531: [SPARK-16943] [SPARK-16942] [SQL] Fix multiple bu...

2016-08-08 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14531#discussion_r74001311 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -80,13 +83,49 @@ case class CreateTableLikeCommand(

[GitHub] spark pull request #14531: [SPARK-16943] [SPARK-16942] [SQL] Fix multiple bu...

2016-08-08 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14531#discussion_r74001182 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -80,13 +83,49 @@ case class CreateTableLikeCommand(

[GitHub] spark issue #14546: [SPARK-16955][SQL] Using ordinals in ORDER BY and GROUP ...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14546 **[Test build #63418 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63418/consoleFull)** for PR 14546 at commit [`1ca8d59`](https://github.com/apache/spark/commit/1

[GitHub] spark pull request #14554: [SPARK-16964][SQL] Remove private[sql] and privat...

2016-08-08 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14554#discussion_r74000577 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/PartitioningUtils.scala --- @@ -41,22 +42,23 @@ object PartitionDirectory {

[GitHub] spark pull request #14554: [SPARK-16964][SQL] Remove private[sql] and privat...

2016-08-08 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14554#discussion_r74000543 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/udaf.scala --- @@ -266,7 +266,7 @@ private[sql] class MutableAggregationBufferIm

[GitHub] spark pull request #14554: [SPARK-16964][SQL] Remove private[sql] and privat...

2016-08-08 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14554#discussion_r74000537 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/udaf.scala --- @@ -204,7 +204,7 @@ sealed trait BufferSetterGetterUtils { /

[GitHub] spark issue #14555: [SPARK-16965][MLLIB][PYSPARK] Fix bound checking for Spa...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14555 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14555: [SPARK-16965][MLLIB][PYSPARK] Fix bound checking for Spa...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14555 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63416/ Test FAILed. ---

[GitHub] spark issue #14555: [SPARK-16965][MLLIB][PYSPARK] Fix bound checking for Spa...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14555 **[Test build #63416 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63416/consoleFull)** for PR 14555 at commit [`57b9c84`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14531: [SPARK-16943] [SPARK-16942] [SQL] Fix multiple bu...

2016-08-08 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14531#discussion_r74000488 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -80,13 +83,49 @@ case class CreateTableLikeCommand(

[GitHub] spark pull request #14554: [SPARK-16964][SQL] Remove private[sql] and privat...

2016-08-08 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14554#discussion_r74000462 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkPlanInfo.scala --- @@ -47,7 +47,7 @@ class SparkPlanInfo( } } -

[GitHub] spark issue #13146: [SPARK-13081][PYSPARK][SPARK_SUBMIT]. Allow set pythonEx...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13146 **[Test build #63417 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63417/consoleFull)** for PR 13146 at commit [`3826f33`](https://github.com/apache/spark/commit/3

[GitHub] spark pull request #14531: [SPARK-16943] [SPARK-16942] [SQL] Fix multiple bu...

2016-08-08 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14531#discussion_r74000396 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -80,13 +83,49 @@ case class CreateTableLikeCommand(

[GitHub] spark issue #14555: [SPARK-16965][MLLIB][PYSPARK] Fix bound checking for Spa...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14555 **[Test build #63416 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63416/consoleFull)** for PR 14555 at commit [`57b9c84`](https://github.com/apache/spark/commit/5

[GitHub] spark pull request #14555: [SPARK-16965][MLLIB][PYSPARK] Fix bound checking ...

2016-08-08 Thread zjffdu
GitHub user zjffdu opened a pull request: https://github.com/apache/spark/pull/14555 [SPARK-16965][MLLIB][PYSPARK] Fix bound checking for SparseVector. ## What changes were proposed in this pull request? 1. In scala, add negative low bound checking and put all the low/upper

[GitHub] spark issue #14492: [SPARK-16887] Add SPARK_DIST_CLASSPATH to LAUNCH_CLASSPA...

2016-08-08 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/14492 That's a good point. Let me close this. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabl

[GitHub] spark pull request #14492: [SPARK-16887] Add SPARK_DIST_CLASSPATH to LAUNCH_...

2016-08-08 Thread yhuai
Github user yhuai closed the pull request at: https://github.com/apache/spark/pull/14492 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request #14546: [SPARK-16955][SQL] Using ordinals in ORDER BY and...

2016-08-08 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/14546#discussion_r73999422 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1252,7 +1252,9 @@ class Analyzer( c

[GitHub] spark pull request #14384: [Spark-16443][SparkR] Alternating Least Squares (...

2016-08-08 Thread NarineK
Github user NarineK commented on a diff in the pull request: https://github.com/apache/spark/pull/14384#discussion_r73999377 --- Diff: R/pkg/R/mllib.R --- @@ -632,3 +642,147 @@ setMethod("predict", signature(object = "AFTSurvivalRegressionModel"), function(object, ne

[GitHub] spark pull request #14384: [Spark-16443][SparkR] Alternating Least Squares (...

2016-08-08 Thread NarineK
Github user NarineK commented on a diff in the pull request: https://github.com/apache/spark/pull/14384#discussion_r73999041 --- Diff: R/pkg/R/mllib.R --- @@ -632,3 +642,147 @@ setMethod("predict", signature(object = "AFTSurvivalRegressionModel"), function(object, ne

[GitHub] spark pull request #14546: [SPARK-16955][SQL] Using ordinals in ORDER BY and...

2016-08-08 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/14546#discussion_r73998920 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1252,7 +1252,9 @@ class Analyzer( c

[GitHub] spark issue #14517: [SPARK-16931][PYTHON] PySpark APIS for bucketBy and sort...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14517 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13775: [SPARK-16060][SQL] Vectorized Orc reader

2016-08-08 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/13775 ping @hvanhovell @rxin @liancheng @yhuai Could you review this now? Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark issue #14517: [SPARK-16931][PYTHON] PySpark APIS for bucketBy and sort...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14517 **[Test build #63414 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63414/consoleFull)** for PR 14517 at commit [`96df186`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14517: [SPARK-16931][PYTHON] PySpark APIS for bucketBy and sort...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14517 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63414/ Test FAILed. ---

[GitHub] spark pull request #14546: [SPARK-16955][SQL] Using ordinals in ORDER BY and...

2016-08-08 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14546#discussion_r73998693 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1252,7 +1252,9 @@ class Analyzer( case

[GitHub] spark issue #14222: [SPARK-16391][SQL] KeyValueGroupedDataset.reduceGroups s...

2016-08-08 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14222 ping @rxin any thoughts on this? It is waiting for a while. Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project doe

[GitHub] spark issue #14517: [SPARK-16931][PYTHON] PySpark APIS for bucketBy and sort...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14517 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14517: [SPARK-16931][PYTHON] PySpark APIS for bucketBy and sort...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14517 **[Test build #63411 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63411/consoleFull)** for PR 14517 at commit [`0bc078a`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #14384: [Spark-16443][SparkR] Alternating Least Squares (...

2016-08-08 Thread NarineK
Github user NarineK commented on a diff in the pull request: https://github.com/apache/spark/pull/14384#discussion_r73998522 --- Diff: R/pkg/R/mllib.R --- @@ -632,3 +642,147 @@ setMethod("predict", signature(object = "AFTSurvivalRegressionModel"), function(object, ne

[GitHub] spark issue #14517: [SPARK-16931][PYTHON] PySpark APIS for bucketBy and sort...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14517 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63411/ Test FAILed. ---

[GitHub] spark issue #14554: [SPARK-16964][SQL] Remove private[sql] and private[spark...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14554 **[Test build #63415 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63415/consoleFull)** for PR 14554 at commit [`d9ba88f`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #14452: [SPARK-16849][SQL] Improve subquery execution in CTE by ...

2016-08-08 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14452 ping @cloud-fan @hvanhovell @liancheng Could you review this change? Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pr

[GitHub] spark issue #14554: [SPARK-16964][SQL] Remove private[sql] and private[spark...

2016-08-08 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14554 cc @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if th

[GitHub] spark pull request #14531: [SPARK-16943] [SPARK-16942] [SQL] Fix multiple bu...

2016-08-08 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14531#discussion_r73998018 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -80,13 +83,49 @@ case class CreateTableLikeCommand(

[GitHub] spark pull request #14531: [SPARK-16943] [SPARK-16942] [SQL] Fix multiple bu...

2016-08-08 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/14531#discussion_r73997983 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -80,13 +83,49 @@ case class CreateTableLikeCommand(

[GitHub] spark pull request #14546: [SPARK-16955][SQL] Using ordinals in ORDER BY and...

2016-08-08 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/14546#discussion_r73997535 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala --- @@ -1252,7 +1252,9 @@ class Analyzer( case

[GitHub] spark issue #14087: [SPARK-16411][SQL][STREAMING] Add textFile to Structured...

2016-08-08 Thread ScrapCodes
Github user ScrapCodes commented on the issue: https://github.com/apache/spark/pull/14087 @tdas Ping ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[GitHub] spark issue #14102: [SPARK-16434][SQL] Avoid per-record type dispatch in JSO...

2016-08-08 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14102 @yhuai Could you please take another look? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat

[GitHub] spark issue #14151: [SPARK-16496][SQL] Add wholetext as option for reading t...

2016-08-08 Thread ScrapCodes
Github user ScrapCodes commented on the issue: https://github.com/apache/spark/pull/14151 @rxin Ping ! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or i

[GitHub] spark issue #13146: [SPARK-13081][PYSPARK][SPARK_SUBMIT]. Allow set pythonEx...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13146 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63406/ Test PASSed. ---

[GitHub] spark pull request #13907: [SPARK-16209] [SQL] Convert Hive Tables in PARQUE...

2016-08-08 Thread gatorsmile
Github user gatorsmile closed the pull request at: https://github.com/apache/spark/pull/13907 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #13146: [SPARK-13081][PYSPARK][SPARK_SUBMIT]. Allow set pythonEx...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13146 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14531: [SPARK-16943] [SPARK-16942] [SQL] Fix multiple bugs in C...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14531 **[Test build #63413 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63413/consoleFull)** for PR 14531 at commit [`b820be8`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #14517: [SPARK-16931][PYTHON] PySpark APIS for bucketBy and sort...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14517 **[Test build #63414 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63414/consoleFull)** for PR 14517 at commit [`96df186`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #13907: [SPARK-16209] [SQL] Convert Hive Tables in PARQUET/ORC t...

2016-08-08 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/13907 I see. Let me close it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wish

[GitHub] spark issue #13146: [SPARK-13081][PYSPARK][SPARK_SUBMIT]. Allow set pythonEx...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13146 **[Test build #63406 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63406/consoleFull)** for PR 13146 at commit [`8e1600e`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14547: [SPARK-16718][MLlib] gbm-style treeboost [WIP]

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14547 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63407/ Test FAILed. ---

[GitHub] spark issue #14547: [SPARK-16718][MLlib] gbm-style treeboost [WIP]

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14547 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14547: [SPARK-16718][MLlib] gbm-style treeboost [WIP]

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14547 **[Test build #63407 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63407/consoleFull)** for PR 14547 at commit [`cfaee0f`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14517: [SPARK-16931][PYTHON] PySpark APIS for bucketBy and sort...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14517 **[Test build #63411 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63411/consoleFull)** for PR 14517 at commit [`0bc078a`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #13701: [SPARK-15639][SPARK-16321][SQL] Push down filter at RowG...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13701 **[Test build #63412 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63412/consoleFull)** for PR 13701 at commit [`cee74b7`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #14517: [SPARK-16931][PYTHON] PySpark APIS for bucketBy and sort...

2016-08-08 Thread GregBowyer
Github user GregBowyer commented on the issue: https://github.com/apache/spark/pull/14517 Amended commit with style changes from MLNick. Can someone call the OK to test please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as we

[GitHub] spark issue #14489: [MINOR][SparkR] R API documentation for "coltypes" is co...

2016-08-08 Thread shivaram
Github user shivaram commented on the issue: https://github.com/apache/spark/pull/14489 LGTM. @felixcheung feel free to merge this and let me know if the commit scripts work fine --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[GitHub] spark issue #14554: [SPARK-16964][SQL] Remove private[sql] and private[spark...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14554 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63409/ Test FAILed. ---

[GitHub] spark issue #14554: [SPARK-16964][SQL] Remove private[sql] and private[spark...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14554 **[Test build #63409 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63409/consoleFull)** for PR 14554 at commit [`78d1381`](https://github.com/apache/spark/commit/

[GitHub] spark issue #14554: [SPARK-16964][SQL] Remove private[sql] and private[spark...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14554 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14065: [SPARK-14743][YARN] Add a configurable credential manage...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14065 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #14065: [SPARK-14743][YARN] Add a configurable credential manage...

2016-08-08 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14065 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/63405/ Test PASSed. ---

[GitHub] spark issue #14065: [SPARK-14743][YARN] Add a configurable credential manage...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14065 **[Test build #63405 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63405/consoleFull)** for PR 14065 at commit [`71df428`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13701: [SPARK-15639][SPARK-16321][SQL] Push down filter at RowG...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13701 **[Test build #63410 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63410/consoleFull)** for PR 13701 at commit [`0b38ba1`](https://github.com/apache/spark/commit/0

[GitHub] spark issue #14554: [SPARK-16964][SQL] Remove private[sql] and private[spark...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14554 **[Test build #63409 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63409/consoleFull)** for PR 14554 at commit [`78d1381`](https://github.com/apache/spark/commit/7

[GitHub] spark pull request #14554: [SPARK-16964][SQL] Remove private[sql] and privat...

2016-08-08 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/14554 [SPARK-16964][SQL] Remove private[sql] and private[spark] from sql.execution package ## What changes were proposed in this pull request? This package is meant to be internal, and as a result it do

[GitHub] spark issue #14546: [SPARK-16955][SQL] Using ordinals in ORDER BY and GROUP ...

2016-08-08 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14546 **[Test build #63408 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/63408/consoleFull)** for PR 14546 at commit [`7c3d732`](https://github.com/apache/spark/commit/7

[GitHub] spark pull request #14298: [SPARK-16283][SQL] Implement `percentile_approx` ...

2016-08-08 Thread lw-lin
Github user lw-lin commented on a diff in the pull request: https://github.com/apache/spark/pull/14298#discussion_r73995159 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/PercentileApprox.scala --- @@ -0,0 +1,462 @@ +/* + * Licens

  1   2   3   4   5   6   7   >