[GitHub] spark issue #15640: [SPARK-18106][SQL] ANALYZE TABLE should raise a ParseExc...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15640 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67588/ Test PASSed. ---

[GitHub] spark issue #15640: [SPARK-18106][SQL] ANALYZE TABLE should raise a ParseExc...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15640 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15640: [SPARK-18106][SQL] ANALYZE TABLE should raise a ParseExc...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15640 **[Test build #67588 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67588/consoleFull)** for PR 15640 at commit [`2a7707e`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15640: [SPARK-18106][SQL] ANALYZE TABLE should raise a ParseExc...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15640 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67587/ Test PASSed. ---

[GitHub] spark issue #15640: [SPARK-18106][SQL] ANALYZE TABLE should raise a ParseExc...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15640 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15640: [SPARK-18106][SQL] ANALYZE TABLE should raise a ParseExc...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15640 **[Test build #67587 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67587/consoleFull)** for PR 15640 at commit [`c92b6f1`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #15555: [Minor][ML] Refactor clustering summary.

2016-10-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15555: [Minor][ML] Refactor clustering summary.

2016-10-26 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/1 LGTM I'll merge this with master Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #15413: [SPARK-17847][ML] Reduce shuffled data size of Ga...

2016-10-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15413#discussion_r85185547 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/GaussianMixture.scala --- @@ -316,24 +319,129 @@ class GaussianMixture @Since("2.0.0") (

[GitHub] spark pull request #15413: [SPARK-17847][ML] Reduce shuffled data size of Ga...

2016-10-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15413#discussion_r85186676 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/GaussianMixture.scala --- @@ -316,24 +319,129 @@ class GaussianMixture @Since("2.0.0") (

[GitHub] spark pull request #15413: [SPARK-17847][ML] Reduce shuffled data size of Ga...

2016-10-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15413#discussion_r85160212 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/GaussianMixture.scala --- @@ -350,6 +458,145 @@ object GaussianMixture extends DefaultParamsRea

[GitHub] spark pull request #15413: [SPARK-17847][ML] Reduce shuffled data size of Ga...

2016-10-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15413#discussion_r85188373 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/GaussianMixture.scala --- @@ -350,6 +458,145 @@ object GaussianMixture extends DefaultParamsRea

[GitHub] spark pull request #15413: [SPARK-17847][ML] Reduce shuffled data size of Ga...

2016-10-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15413#discussion_r85025434 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/GaussianMixture.scala --- @@ -316,24 +319,129 @@ class GaussianMixture @Since("2.0.0") (

[GitHub] spark pull request #13557: [SPARK-15819][PYSPARK][ML] Add KMeanSummary in KM...

2016-10-26 Thread jkbradley
Github user jkbradley commented on a diff in the pull request: https://github.com/apache/spark/pull/13557#discussion_r85192407 --- Diff: python/pyspark/ml/clustering.py --- @@ -201,7 +202,74 @@ def computeCost(self, dataset): """ return self._call_java("com

[GitHub] spark pull request #15413: [SPARK-17847][ML] Reduce shuffled data size of Ga...

2016-10-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15413#discussion_r85175966 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/GaussianMixture.scala --- @@ -350,6 +458,145 @@ object GaussianMixture extends DefaultParamsRea

[GitHub] spark pull request #15413: [SPARK-17847][ML] Reduce shuffled data size of Ga...

2016-10-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15413#discussion_r85151727 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/GaussianMixture.scala --- @@ -350,6 +458,145 @@ object GaussianMixture extends DefaultParamsRea

[GitHub] spark pull request #15413: [SPARK-17847][ML] Reduce shuffled data size of Ga...

2016-10-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15413#discussion_r85176823 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/GaussianMixture.scala --- @@ -350,6 +458,145 @@ object GaussianMixture extends DefaultParamsRea

[GitHub] spark pull request #15413: [SPARK-17847][ML] Reduce shuffled data size of Ga...

2016-10-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15413#discussion_r85157509 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/GaussianMixture.scala --- @@ -350,6 +458,145 @@ object GaussianMixture extends DefaultParamsRea

[GitHub] spark pull request #15413: [SPARK-17847][ML] Reduce shuffled data size of Ga...

2016-10-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15413#discussion_r85186038 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/GaussianMixture.scala --- @@ -316,24 +319,129 @@ class GaussianMixture @Since("2.0.0") (

[GitHub] spark pull request #15413: [SPARK-17847][ML] Reduce shuffled data size of Ga...

2016-10-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15413#discussion_r85179044 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/GaussianMixture.scala --- @@ -316,24 +319,129 @@ class GaussianMixture @Since("2.0.0") (

[GitHub] spark pull request #15413: [SPARK-17847][ML] Reduce shuffled data size of Ga...

2016-10-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15413#discussion_r85175762 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/GaussianMixture.scala --- @@ -350,6 +458,145 @@ object GaussianMixture extends DefaultParamsRea

[GitHub] spark pull request #15413: [SPARK-17847][ML] Reduce shuffled data size of Ga...

2016-10-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15413#discussion_r85187274 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/GaussianMixture.scala --- @@ -350,6 +458,145 @@ object GaussianMixture extends DefaultParamsRea

[GitHub] spark pull request #15413: [SPARK-17847][ML] Reduce shuffled data size of Ga...

2016-10-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15413#discussion_r85152196 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/GaussianMixture.scala --- @@ -350,6 +458,145 @@ object GaussianMixture extends DefaultParamsRea

[GitHub] spark pull request #15413: [SPARK-17847][ML] Reduce shuffled data size of Ga...

2016-10-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15413#discussion_r85175523 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/GaussianMixture.scala --- @@ -350,6 +458,145 @@ object GaussianMixture extends DefaultParamsRea

[GitHub] spark pull request #15413: [SPARK-17847][ML] Reduce shuffled data size of Ga...

2016-10-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15413#discussion_r85179222 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/GaussianMixture.scala --- @@ -316,24 +319,129 @@ class GaussianMixture @Since("2.0.0") (

[GitHub] spark pull request #15413: [SPARK-17847][ML] Reduce shuffled data size of Ga...

2016-10-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15413#discussion_r85177022 --- Diff: python/pyspark/ml/clustering.py --- @@ -95,15 +95,10 @@ class GaussianMixture(JavaEstimator, HasFeaturesCol, HasPredictionCol, HasMaxIte >>

[GitHub] spark pull request #15413: [SPARK-17847][ML] Reduce shuffled data size of Ga...

2016-10-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15413#discussion_r85178523 --- Diff: mllib/src/test/scala/org/apache/spark/ml/clustering/GaussianMixtureSuite.scala --- @@ -130,4 +230,29 @@ object GaussianMixtureSuite { "max

[GitHub] spark pull request #15413: [SPARK-17847][ML] Reduce shuffled data size of Ga...

2016-10-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15413#discussion_r85189028 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/GaussianMixture.scala --- @@ -316,24 +319,129 @@ class GaussianMixture @Since("2.0.0") (

[GitHub] spark pull request #15413: [SPARK-17847][ML] Reduce shuffled data size of Ga...

2016-10-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15413#discussion_r85176006 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/GaussianMixture.scala --- @@ -350,6 +458,145 @@ object GaussianMixture extends DefaultParamsRea

[GitHub] spark pull request #15413: [SPARK-17847][ML] Reduce shuffled data size of Ga...

2016-10-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15413#discussion_r85189652 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/GaussianMixture.scala --- @@ -350,6 +458,145 @@ object GaussianMixture extends DefaultParamsRea

[GitHub] spark pull request #15413: [SPARK-17847][ML] Reduce shuffled data size of Ga...

2016-10-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15413#discussion_r85188183 --- Diff: mllib/src/main/scala/org/apache/spark/ml/clustering/GaussianMixture.scala --- @@ -350,6 +458,145 @@ object GaussianMixture extends DefaultParamsRea

[GitHub] spark issue #15647: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15647 **[Test build #67593 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67593/consoleFull)** for PR 15647 at commit [`1ead234`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #15634: [SPARK-18103] [SQL] Rename *FileCatalog to *FileProvider

2016-10-26 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/15634 Hmm, any other suggestions? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishe

[GitHub] spark pull request #15630: [SPARK-18104][DOC]Don't build KafkaSource doc

2016-10-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15630 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15630: [SPARK-18104][DOC]Don't build KafkaSource doc

2016-10-26 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15630 Discussed with @tdas offline. I'm going to merge to master and 2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project do

[GitHub] spark pull request #15597: [SPARK-18063][SQL] Failed to infer constraints ov...

2016-10-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15597 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15597: [SPARK-18063][SQL] Failed to infer constraints over mult...

2016-10-26 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15597 Merging this in master/branch-2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled an

[GitHub] spark pull request #15612: [SPARK-18078] Add zipPartitionsWithPreferredLocat...

2016-10-26 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15612#discussion_r85184978 --- Diff: core/src/main/scala/org/apache/spark/rdd/ZippedPartitionsRDD.scala --- @@ -45,7 +45,8 @@ private[spark] class ZippedPartitionsPartition( private[

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-26 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r85184948 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/xml/xpath.scala --- @@ -68,11 +76,21 @@ case class XPathBoolean(xml: Expr

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-26 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r85184825 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/xml/xpath.scala --- @@ -120,9 +168,19 @@ case class XPathFloat(xml: Expre

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-26 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r85184742 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/xml/xpath.scala --- @@ -107,9 +145,19 @@ case class XPathLong(xml: Expres

[GitHub] spark pull request #15612: [SPARK-18078] Add zipPartitionsWithPreferredLocat...

2016-10-26 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15612#discussion_r85184643 --- Diff: core/src/main/scala/org/apache/spark/util/ZipPartitionsRDDUtils.scala --- @@ -0,0 +1,87 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-26 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r85184264 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/xml/xpath.scala --- @@ -94,9 +122,19 @@ case class XPathInt(xml: Expressi

[GitHub] spark pull request #15513: [SPARK-17963][SQL][Documentation] Add examples (e...

2016-10-26 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15513#discussion_r85183882 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/xml/xpath.scala --- @@ -56,8 +56,16 @@ abstract class XPathExtract extend

[GitHub] spark issue #15647: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15647 **[Test build #67590 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67590/consoleFull)** for PR 15647 at commit [`10f8b26`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15647: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15647 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15590: [SPARK-17949][SQL] A JVM object based aggregate operator

2016-10-26 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/15590 @hvanhovell That's a great point. This is actually one of my pain points while writing this new operator. These problems are: 1. `HashAggregateExec` and `SortAggregateExec` have s

[GitHub] spark issue #15647: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15647 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67590/ Test FAILed. ---

[GitHub] spark issue #15520: [SPARK-13747][SQL]Fix concurrent executions in ForkJoinP...

2016-10-26 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15520 There are conflicts with 2.0. #15646 is the backport for 2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #15647: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15647 **[Test build #67590 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67590/consoleFull)** for PR 15647 at commit [`10f8b26`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15644 **[Test build #67592 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67592/consoleFull)** for PR 15644 at commit [`46aae86`](https://github.com/apache/spark/commit/4

[GitHub] spark issue #15646: [SPARK-13747][SQL] Fix concurrent executions in ForkJoin...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15646 **[Test build #67591 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67591/consoleFull)** for PR 15646 at commit [`eba011a`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #15647: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-10-26 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/15647 CC: @mpjlu @srowen @yanboliang --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled a

[GitHub] spark pull request #15647: [SPARK-18088][ML] Various ChiSqSelector cleanups

2016-10-26 Thread jkbradley
GitHub user jkbradley opened a pull request: https://github.com/apache/spark/pull/15647 [SPARK-18088][ML] Various ChiSqSelector cleanups ## What changes were proposed in this pull request? * Renamed kbest to numTopFeatures * Renamed alpha to fpr * Added missing Since

[GitHub] spark pull request #15646: [SPARK-13747][SQL] Fix concurrent executions in F...

2016-10-26 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/15646 [SPARK-13747][SQL] Fix concurrent executions in ForkJoinPool for SQL (branch 2.0) ## What changes were proposed in this pull request? Backport #15520 to 2.0. ## How was this patch

[GitHub] spark pull request #15520: [SPARK-13747][SQL]Fix concurrent executions in Fo...

2016-10-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15520 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15520: [SPARK-13747][SQL]Fix concurrent executions in ForkJoinP...

2016-10-26 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/15520 Thanks! Merging to master and 2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15520: [SPARK-13747][SQL]Fix concurrent executions in ForkJoinP...

2016-10-26 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/15520 lgtm --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #15597: [SPARK-18063][SQL] Failed to infer constraints over mult...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15597 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67583/ Test PASSed. ---

[GitHub] spark issue #15645: [DO-NOT-MERGE] complex type creator should always output...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15645 Build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #15597: [SPARK-18063][SQL] Failed to infer constraints over mult...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15597 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15645: [DO-NOT-MERGE] complex type creator should always output...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15645 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67584/ Test FAILed. ---

[GitHub] spark issue #15597: [SPARK-18063][SQL] Failed to infer constraints over mult...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15597 **[Test build #67583 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67583/consoleFull)** for PR 15597 at commit [`3f07493`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15645: [DO-NOT-MERGE] complex type creator should always output...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15645 **[Test build #67584 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67584/consoleFull)** for PR 15645 at commit [`9f5bb11`](https://github.com/apache/spark/commit/

[GitHub] spark issue #13982: [SPARK-16304] LinkageError should not crash Spark execut...

2016-10-26 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/13982 thanks! Merging to 2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-10-26 Thread squito
Github user squito commented on the issue: https://github.com/apache/spark/pull/15644 @kayousterhout here are the tests that should have been in SPARK-17675. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #15515: [SPARK-17970][SQL] store partition spec in metastore for...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15515 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67586/ Test FAILed. ---

[GitHub] spark issue #15515: [SPARK-17970][SQL] store partition spec in metastore for...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15515 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15515: [SPARK-17970][SQL] store partition spec in metastore for...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15515 **[Test build #67586 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67586/consoleFull)** for PR 15515 at commit [`05fd862`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15632: [SPARK-18105] fix buffer overflow in LZ4

2016-10-26 Thread davies
Github user davies commented on the issue: https://github.com/apache/spark/pull/15632 Thanks to @viirya, this is a false alarm, I will continue to looking for the real cause. @srowen The reason we have a fork here is that the upstream does not support concated stream, we send

[GitHub] spark pull request #15632: [SPARK-18105] fix buffer overflow in LZ4

2016-10-26 Thread davies
Github user davies closed the pull request at: https://github.com/apache/spark/pull/15632 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15631: [Spark-Core][Test][Minor]: Fix the wrong comment in test

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15631 **[Test build #67589 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67589/consoleFull)** for PR 15631 at commit [`9fc3537`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #15634: [SPARK-18103] [SQL] Rename *FileCatalog to *FileProvider

2016-10-26 Thread marmbrus
Github user marmbrus commented on the issue: https://github.com/apache/spark/pull/15634 This is okay, but note that "Provider" is equally overloaded in the Data Source API. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark pull request #15632: [SPARK-18105] fix buffer overflow in LZ4

2016-10-26 Thread davies
Github user davies commented on a diff in the pull request: https://github.com/apache/spark/pull/15632#discussion_r85173398 --- Diff: core/src/main/java/org/apache/spark/io/LZ4BlockInputStream.java --- @@ -197,7 +197,7 @@ private void refill() throws IOException { read

[GitHub] spark pull request #15640: [SPARK-18106][SQL] ANALYZE TABLE should raise a P...

2016-10-26 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/15640#discussion_r85168358 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/SparkSqlParserSuite.scala --- @@ -220,4 +220,12 @@ class SparkSqlParserSuite extends

[GitHub] spark issue #15640: [SPARK-18106][SQL] ANALYZE TABLE should raise a ParseExc...

2016-10-26 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/15640 Hi, @srinathshankar . For the test suite, I'll update again if you give more opinion. So far, I didn't update that because I'm not sure. --- If your project is set up for it, you can repl

[GitHub] spark issue #15640: [SPARK-18106][SQL] ANALYZE TABLE should raise a ParseExc...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15640 **[Test build #67588 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67588/consoleFull)** for PR 15640 at commit [`2a7707e`](https://github.com/apache/spark/commit/2

[GitHub] spark issue #15640: [SPARK-18106][SQL] ANALYZE TABLE should raise a ParseExc...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15640 **[Test build #67587 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67587/consoleFull)** for PR 15640 at commit [`c92b6f1`](https://github.com/apache/spark/commit/c

[GitHub] spark pull request #15640: [SPARK-18106][SQL] ANALYZE TABLE should raise a P...

2016-10-26 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/15640#discussion_r85168739 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -98,9 +98,10 @@ class SparkSqlAstBuilder(conf: SQLConf) ex

[GitHub] spark pull request #15640: [SPARK-18106][SQL] ANALYZE TABLE should raise a P...

2016-10-26 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/15640#discussion_r85167755 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/SparkSqlParserSuite.scala --- @@ -220,4 +220,12 @@ class SparkSqlParserSuite extends

[GitHub] spark pull request #15640: [SPARK-18106][SQL] ANALYZE TABLE should raise a P...

2016-10-26 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/15640#discussion_r85166515 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/SparkSqlParserSuite.scala --- @@ -220,4 +220,12 @@ class SparkSqlParserSuite extends

[GitHub] spark pull request #15621: [SPARK-17748][FOLLOW-UP][ML] Reorg variables of W...

2016-10-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15621 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request #15640: [SPARK-18106][SQL] ANALYZE TABLE should raise a P...

2016-10-26 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/15640#discussion_r85164920 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -98,9 +98,10 @@ class SparkSqlAstBuilder(conf: SQLConf) ex

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15644 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67581/ Test PASSed. ---

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15644 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15621: [SPARK-17748][FOLLOW-UP][ML] Reorg variables of Weighted...

2016-10-26 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/15621 I'll merge it into master. Thanks for reviewing! @sethah --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #15644: [SPARK-18117][CORE] Add test for TaskSetBlacklist

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15644 **[Test build #67581 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67581/consoleFull)** for PR 15644 at commit [`63bfb0c`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #15640: [SPARK-18106][SQL] ANALYZE TABLE should raise a P...

2016-10-26 Thread srinathshankar
Github user srinathshankar commented on a diff in the pull request: https://github.com/apache/spark/pull/15640#discussion_r85163515 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/SparkSqlParser.scala --- @@ -98,9 +98,10 @@ class SparkSqlAstBuilder(conf: SQLConf) e

[GitHub] spark pull request #15640: [SPARK-18106][SQL] ANALYZE TABLE should raise a P...

2016-10-26 Thread srinathshankar
Github user srinathshankar commented on a diff in the pull request: https://github.com/apache/spark/pull/15640#discussion_r85163883 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/SparkSqlParserSuite.scala --- @@ -220,4 +220,12 @@ class SparkSqlParserSuite extends

[GitHub] spark pull request #15621: [SPARK-17748][FOLLOW-UP][ML] Reorg variables of W...

2016-10-26 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/15621#discussion_r85163715 --- Diff: mllib/src/main/scala/org/apache/spark/ml/optim/WeightedLeastSquares.scala --- @@ -137,65 +133,82 @@ private[ml] class WeightedLeastSquares(

[GitHub] spark pull request #15621: [SPARK-17748][FOLLOW-UP][ML] Reorg variables of W...

2016-10-26 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15621#discussion_r85161018 --- Diff: mllib/src/main/scala/org/apache/spark/ml/optim/WeightedLeastSquares.scala --- @@ -137,65 +133,82 @@ private[ml] class WeightedLeastSquares(

[GitHub] spark pull request #15623: [SPARK-18093][SQL] Fix default value test in SQLC...

2016-10-26 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15623 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark issue #15623: [SPARK-18093][SQL] Fix default value test in SQLConfSuit...

2016-10-26 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/15623 Merging to master / 2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15556: [SPARK-18010][Core] Reduce work performed for building u...

2016-10-26 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/15556 If it's a clean backport I'm ok with it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature ena

[GitHub] spark issue #13557: [SPARK-15819][PYSPARK][ML] Add KMeanSummary in KMeans of...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13557 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67585/ Test PASSed. ---

[GitHub] spark issue #13557: [SPARK-15819][PYSPARK][ML] Add KMeanSummary in KMeans of...

2016-10-26 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13557 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #13557: [SPARK-15819][PYSPARK][ML] Add KMeanSummary in KMeans of...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13557 **[Test build #67585 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67585/consoleFull)** for PR 13557 at commit [`c11b6a0`](https://github.com/apache/spark/commit/

[GitHub] spark pull request #15621: [SPARK-17748][FOLLOW-UP][ML] Reorg variables of W...

2016-10-26 Thread yanboliang
Github user yanboliang commented on a diff in the pull request: https://github.com/apache/spark/pull/15621#discussion_r85154993 --- Diff: mllib/src/main/scala/org/apache/spark/ml/optim/WeightedLeastSquares.scala --- @@ -137,65 +133,82 @@ private[ml] class WeightedLeastSquares(

[GitHub] spark issue #15516: [SPARK-17961][SparkR][SQL] Add storageLevel to DataFrame...

2016-10-26 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15516 To clarify, we have the method name in the @rdname tag. In this case it should be @rdname storageLevel And not storageLevel-methods --- If your project is set up for it, y

[GitHub] spark issue #15515: [SPARK-17970][SQL] store partition spec in metastore for...

2016-10-26 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15515 **[Test build #67586 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67586/consoleFull)** for PR 15515 at commit [`05fd862`](https://github.com/apache/spark/commit/0

<    1   2   3   4   5   6   >