[GitHub] spark pull request #16186: [SPARK-18758][SS] StreamingQueryListener events f...

2016-12-06 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/16186#discussion_r91240700 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamingQueryListenerBus.scala --- @@ -63,18 +83,29 @@ class

[GitHub] spark issue #16192: [SPARK-18764][Core]Add a warning log when skipping a cor...

2016-12-06 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16192 LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #16191: spark decision tree

2016-12-06 Thread lklong
Github user lklong commented on the issue: https://github.com/apache/spark/pull/16191 hi ,could somebody help to rely this question? thanks very much! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #16192: [SPARK-18764][Core]Add a warning log when skipping a cor...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16192 **[Test build #69782 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69782/consoleFull)** for PR 16192 at commit

[GitHub] spark pull request #16192: [SPARK-18764][Core]Add a warning log when skippin...

2016-12-06 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/16192 [SPARK-18764][Core]Add a warning log when skipping a corrupted file ## What changes were proposed in this pull request? It's better to add a warning log when skipping a corrupted file. It

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK][WIP] Classification and regre...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16171 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69780/ Test FAILed. ---

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK][WIP] Classification and regre...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16171 **[Test build #69780 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69780/consoleFull)** for PR 16171 at commit

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK][WIP] Classification and regre...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16171 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16191: spark decision tree

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16191 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #16191: spark decision tree

2016-12-06 Thread zhuangxue
GitHub user zhuangxue opened a pull request: https://github.com/apache/spark/pull/16191 spark decision tree What algorithm is used in spark decision tree (is ID3, C4.5 or CART)? You can merge this pull request into a Git repository by running: $ git pull

[GitHub] spark issue #16190: [SPARK-18762][WEBUI][WIP] Web UI should be http:4040 ins...

2016-12-06 Thread sarutak
Github user sarutak commented on the issue: https://github.com/apache/spark/pull/16190 @viirya Thanks! I've fixed it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16190: [SPARK-18761][WEBUI][WIP] Web UI should be http:4040 ins...

2016-12-06 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/16190 I think the jira number should be SPARK-18762, instead of SPARK-18761. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #16190: [SPARK-18761][WEBUI][WIP] Web UI should be http:4040 ins...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16190 **[Test build #69781 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69781/consoleFull)** for PR 16190 at commit

[GitHub] spark pull request #16190: [SPARK-18761][WEBUI] Web UI should be http:4040 i...

2016-12-06 Thread sarutak
GitHub user sarutak opened a pull request: https://github.com/apache/spark/pull/16190 [SPARK-18761][WEBUI] Web UI should be http:4040 instead of https:4040 ## What changes were proposed in this pull request? When SSL is enabled, the Spark shell shows: ``` Spark

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK][WIP] Classification and regre...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16171 **[Test build #69780 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69780/consoleFull)** for PR 16171 at commit

[GitHub] spark issue #16187: [SPARK-18760][SQL] Consistent format specification for F...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16187 **[Test build #69779 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69779/consoleFull)** for PR 16187 at commit

[GitHub] spark issue #15422: [SPARK-17850][Core]Add a flag to ignore corrupt files

2016-12-06 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15422 @zsxwing shouldn't we at least log the exception? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK][WIP] Classification and regre...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16171 **[Test build #69777 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69777/consoleFull)** for PR 16171 at commit

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK][WIP] Classification and regre...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16171 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK][WIP] Classification and regre...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16171 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69777/ Test FAILed. ---

[GitHub] spark issue #16043: [SPARK-18601][SQL] Simplify Create/Get complex expressio...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16043 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16043: [SPARK-18601][SQL] Simplify Create/Get complex expressio...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16043 **[Test build #69778 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69778/consoleFull)** for PR 16043 at commit

[GitHub] spark issue #16043: [SPARK-18601][SQL] Simplify Create/Get complex expressio...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16043 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69778/ Test FAILed. ---

[GitHub] spark issue #16043: [SPARK-18601][SQL] Simplify Create/Get complex expressio...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16043 **[Test build #69778 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69778/consoleFull)** for PR 16043 at commit

[GitHub] spark issue #16187: [SPARK-18760][SQL] Consistent format specification for F...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16187 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69772/ Test FAILed. ---

[GitHub] spark issue #16187: [SPARK-18760][SQL] Consistent format specification for F...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16187 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16187: [SPARK-18760][SQL] Consistent format specification for F...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16187 **[Test build #69772 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69772/consoleFull)** for PR 16187 at commit

[GitHub] spark issue #16168: [SPARK-18209][SQL] More robust view canonicalization wit...

2016-12-06 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/16168 @hvanhovell @nsyca @gatorsmile @rxin Thank you for your suggestions! I will try to make a better approach ASAP! Thank you! --- If your project is set up for it, you can reply to this email

[GitHub] spark issue #16173: [SPARK-18742][CORE]readd spark.broadcast.factory conf to...

2016-12-06 Thread windpiger
Github user windpiger commented on the issue: https://github.com/apache/spark/pull/16173 ok, the BroadcastFactory' comment shows `SparkContext uses a user-specified BroadcastFactory implementation to instantiate a particular broadcast for the entire Spark job.` so I think it

[GitHub] spark pull request #16168: [SPARK-18209][SQL] More robust view canonicalizat...

2016-12-06 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/16168#discussion_r91235259 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLViewSuite.scala --- @@ -448,19 +476,105 @@ class SQLViewSuite extends

[GitHub] spark pull request #16168: [SPARK-18209][SQL] More robust view canonicalizat...

2016-12-06 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/16168#discussion_r91235206 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveSessionCatalog.scala --- @@ -55,16 +55,19 @@ private[sql] class HiveSessionCatalog(

[GitHub] spark pull request #16168: [SPARK-18209][SQL] More robust view canonicalizat...

2016-12-06 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/16168#discussion_r91235152 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala --- @@ -126,6 +146,55 @@ private[hive] class

[GitHub] spark pull request #16189: [SPARK-18761][CORE][WIP] Introduce "task reaper" ...

2016-12-06 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/16189#discussion_r91235127 --- Diff: core/src/main/scala/org/apache/spark/executor/Executor.scala --- @@ -432,6 +435,57 @@ private[spark] class Executor( } /**

[GitHub] spark pull request #16189: [SPARK-18761][CORE][WIP] Introduce "task reaper" ...

2016-12-06 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/16189#discussion_r91235062 --- Diff: core/src/main/scala/org/apache/spark/executor/Executor.scala --- @@ -432,6 +435,57 @@ private[spark] class Executor( } /**

[GitHub] spark pull request #16189: [SPARK-18761][CORE][WIP] Introduce "task reaper" ...

2016-12-06 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/16189#discussion_r91235005 --- Diff: core/src/main/scala/org/apache/spark/executor/Executor.scala --- @@ -161,12 +163,7 @@ private[spark] class Executor( * @param

[GitHub] spark pull request #16168: [SPARK-18209][SQL] More robust view canonicalizat...

2016-12-06 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/16168#discussion_r91234885 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala --- @@ -114,9 +117,26 @@ private[hive] class

[GitHub] spark pull request #16168: [SPARK-18209][SQL] More robust view canonicalizat...

2016-12-06 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/16168#discussion_r91234770 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveMetastoreCatalog.scala --- @@ -114,9 +117,26 @@ private[hive] class

[GitHub] spark pull request #16189: [SPARK-18761][CORE][WIP] Introduce "task reaper" ...

2016-12-06 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/16189#discussion_r91234781 --- Diff: core/src/test/scala/org/apache/spark/JobCancellationSuite.scala --- @@ -209,6 +209,41 @@ class JobCancellationSuite extends SparkFunSuite with

[GitHub] spark pull request #16121: [SPARK-16589][PYTHON] Chained cartesian produces ...

2016-12-06 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/16121#discussion_r91234665 --- Diff: python/pyspark/serializers.py --- @@ -278,50 +278,51 @@ def __repr__(self): return "AutoBatchedSerializer(%s)" % self.serializer

[GitHub] spark pull request #16121: [SPARK-16589][PYTHON] Chained cartesian produces ...

2016-12-06 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/16121#discussion_r91232276 --- Diff: python/pyspark/serializers.py --- @@ -96,7 +96,7 @@ def load_stream(self, stream): raise NotImplementedError def

[GitHub] spark pull request #16121: [SPARK-16589][PYTHON] Chained cartesian produces ...

2016-12-06 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/16121#discussion_r91234619 --- Diff: python/pyspark/serializers.py --- @@ -278,50 +278,51 @@ def __repr__(self): return "AutoBatchedSerializer(%s)" % self.serializer

[GitHub] spark pull request #16189: [SPARK-18761][CORE][WIP] Introduce "task reaper" ...

2016-12-06 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/16189#discussion_r91234733 --- Diff: core/src/main/scala/org/apache/spark/executor/Executor.scala --- @@ -432,6 +435,57 @@ private[spark] class Executor( } /**

[GitHub] spark pull request #16189: [SPARK-18761][CORE][WIP] Introduce "task reaper" ...

2016-12-06 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/16189#discussion_r91234634 --- Diff: core/src/main/scala/org/apache/spark/executor/Executor.scala --- @@ -229,9 +230,11 @@ private[spark] class Executor( //

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK][WIP] Classification and regre...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16171 **[Test build #69777 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69777/consoleFull)** for PR 16171 at commit

[GitHub] spark pull request #16189: [SPARK-18761][CORE][WIP] Introduce "task reaper" ...

2016-12-06 Thread JoshRosen
Github user JoshRosen commented on a diff in the pull request: https://github.com/apache/spark/pull/16189#discussion_r91234685 --- Diff: core/src/main/scala/org/apache/spark/executor/Executor.scala --- @@ -192,13 +189,17 @@ private[spark] class Executor( serializedTask:

[GitHub] spark issue #16189: [SPARK-18761][CORE][WIP] Introduce "task reaper" to over...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16189 **[Test build #69776 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69776/consoleFull)** for PR 16189 at commit

[GitHub] spark pull request #16168: [SPARK-18209][SQL] More robust view canonicalizat...

2016-12-06 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/16168#discussion_r91234443 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/views.scala --- @@ -207,31 +205,56 @@ case class CreateViewCommand( }

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK][WIP] Classification and regre...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16171 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69775/ Test FAILed. ---

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK][WIP] Classification and regre...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16171 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16189: [SPARK-18761][CORE][WIP] Introduce "task reaper" ...

2016-12-06 Thread JoshRosen
GitHub user JoshRosen opened a pull request: https://github.com/apache/spark/pull/16189 [SPARK-18761][CORE][WIP] Introduce "task reaper" to oversee task killing in executors ## What changes were proposed in this pull request? Spark's current task cancellation / task

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK][WIP] Classification and regre...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16171 **[Test build #69775 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69775/consoleFull)** for PR 16171 at commit

[GitHub] spark pull request #16168: [SPARK-18209][SQL] More robust view canonicalizat...

2016-12-06 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/16168#discussion_r91234292 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/views.scala --- @@ -207,31 +205,56 @@ case class CreateViewCommand( }

[GitHub] spark issue #16171: [SPARK-18739][ML][PYSPARK][WIP] Classification and regre...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16171 **[Test build #69775 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69775/consoleFull)** for PR 16171 at commit

[GitHub] spark pull request #16168: [SPARK-18209][SQL] More robust view canonicalizat...

2016-12-06 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/16168#discussion_r91234171 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/views.scala --- @@ -207,31 +205,56 @@ case class CreateViewCommand( }

[GitHub] spark issue #16131: [SPARK-18701][ML] Fix Poisson GLM failure due to wrong i...

2016-12-06 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/16131 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #16131: [SPARK-18701][ML] Fix Poisson GLM failure due to wrong i...

2016-12-06 Thread actuaryzhang
Github user actuaryzhang commented on the issue: https://github.com/apache/spark/pull/16131 @srowen Is this ready to be merged? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16150: [SPARK-18349][SparkR]:Update R API documentation ...

2016-12-06 Thread wangmiao1981
Github user wangmiao1981 commented on a diff in the pull request: https://github.com/apache/spark/pull/16150#discussion_r91232450 --- Diff: R/pkg/R/mllib.R --- @@ -1389,7 +1399,9 @@ setMethod("spark.gaussianMixture", signature(data = "SparkDataFrame", formula = # Get the

[GitHub] spark issue #16186: [SPARK-18758][SS] StreamingQueryListener events from a S...

2016-12-06 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/16186 @marmbrus @zsxwing @brkyvz Please review. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #16150: [SPARK-18349][SparkR]:Update R API documentation ...

2016-12-06 Thread wangmiao1981
Github user wangmiao1981 commented on a diff in the pull request: https://github.com/apache/spark/pull/16150#discussion_r91232063 --- Diff: R/pkg/R/mllib.R --- @@ -1852,9 +1867,9 @@ summary.treeEnsemble <- function(model) { # Get the summary of a Random Forest

[GitHub] spark issue #16187: [SPARK-18760][SQL] Consistent format specification for F...

2016-12-06 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16187 Actually if possible please merge this in branch-2.1. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #16182: [SPARK-18754][SS] Rename recentProgresses to recentProgr...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16182 **[Test build #3471 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3471/consoleFull)** for PR 16182 at commit

[GitHub] spark issue #16182: [SPARK-18754][SS] Rename recentProgresses to recentProgr...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16182 **[Test build #69774 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69774/consoleFull)** for PR 16182 at commit

[GitHub] spark issue #16182: [SPARK-18754][SS] Rename recentProgresses to recentProgr...

2016-12-06 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/16182 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #16150: [SPARK-18349][SparkR]:Update R API documentation ...

2016-12-06 Thread wangmiao1981
Github user wangmiao1981 commented on a diff in the pull request: https://github.com/apache/spark/pull/16150#discussion_r91231575 --- Diff: R/pkg/R/mllib.R --- @@ -661,7 +665,10 @@ setMethod("fitted", signature(object = "KMeansModel"), # Get the summary of a k-means model

[GitHub] spark issue #16165: [SPARK-8617] [WEBUI] HistoryServer: Include in-progress ...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16165 **[Test build #69773 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69773/consoleFull)** for PR 16165 at commit

[GitHub] spark pull request #16150: [SPARK-18349][SparkR]:Update R API documentation ...

2016-12-06 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/16150#discussion_r91231272 --- Diff: R/pkg/R/mllib.R --- @@ -1389,7 +1399,9 @@ setMethod("spark.gaussianMixture", signature(data = "SparkDataFrame", formula = # Get the

[GitHub] spark issue #16186: [SPARK-18758][SS] StreamingQueryListener events from a S...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16186 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16186: [SPARK-18758][SS] StreamingQueryListener events from a S...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16186 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69769/ Test PASSed. ---

[GitHub] spark issue #16186: [SPARK-18758][SS] StreamingQueryListener events from a S...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16186 **[Test build #69769 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69769/consoleFull)** for PR 16186 at commit

[GitHub] spark pull request #16150: [SPARK-18349][SparkR]:Update R API documentation ...

2016-12-06 Thread felixcheung
Github user felixcheung commented on a diff in the pull request: https://github.com/apache/spark/pull/16150#discussion_r91231151 --- Diff: R/pkg/R/mllib.R --- @@ -661,7 +665,10 @@ setMethod("fitted", signature(object = "KMeansModel"), # Get the summary of a k-means model

[GitHub] spark issue #16188: Branch 1.6 decision tree

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16188 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #16182: [SPARK-18754][SS] Rename recentProgresses to recentProgr...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16182 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69771/ Test FAILed. ---

[GitHub] spark pull request #16188: Branch 1.6 decision tree

2016-12-06 Thread zhuangxue
GitHub user zhuangxue opened a pull request: https://github.com/apache/spark/pull/16188 Branch 1.6 decision tree What algorithm is used in spark decision tree (is ID3, C4.5 or CART) You can merge this pull request into a Git repository by running: $ git pull

[GitHub] spark issue #16182: [SPARK-18754][SS] Rename recentProgresses to recentProgr...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16182 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16182: [SPARK-18754][SS] Rename recentProgresses to recentProgr...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16182 **[Test build #69771 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69771/consoleFull)** for PR 16182 at commit

[GitHub] spark pull request #16183: [SPARK-18671][SS][test-maven] Follow up PR to fix...

2016-12-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16183 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16183: [SPARK-18671][SS][test-maven] Follow up PR to fix test f...

2016-12-06 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/16183 Merging this to master and 2.1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16187: [SPARK-18760][SQL] Consistent format specification for F...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16187 **[Test build #69772 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69772/consoleFull)** for PR 16187 at commit

[GitHub] spark issue #16187: [SPARK-18760][SQL] Consistent format specification for F...

2016-12-06 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16187 cc @cloud-fan --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #16187: [SPARK-18760][SQL] Consistent format specificatio...

2016-12-06 Thread rxin
GitHub user rxin opened a pull request: https://github.com/apache/spark/pull/16187 [SPARK-18760][SQL] Consistent format specification for FileFormats ## What changes were proposed in this pull request? We currently rely on FileFormat implementations to override toString in

[GitHub] spark issue #11119: [SPARK-10780][ML] Add an initial model to kmeans

2016-12-06 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/9 ping? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #15628: [SPARK-17471][ML] Add compressed method to ML matrices

2016-12-06 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/15628 ping @dbtsai :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #14537: [SPARK-16948][SQL] Use metastore schema instead o...

2016-12-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14537 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #6848: [SPARK-8398][CORE] Hadoop input/output format adva...

2016-12-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/6848 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #16181: Branch 2.1

2016-12-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/16181 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #8318: [SPARK-1267][PYSPARK] Adds pip installer for pyspa...

2016-12-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/8318 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #9543: [SPARK-11482][SQL] Make maven repo for Hive metast...

2016-12-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/9543 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #7265: [SPARK-7263] Add new shuffle manager which stores ...

2016-12-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/7265 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #16184: [SPARK-18753][SQL] Keep pushed-down null literal as a fi...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16184 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69767/ Test PASSed. ---

[GitHub] spark issue #16184: [SPARK-18753][SQL] Keep pushed-down null literal as a fi...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16184 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16184: [SPARK-18753][SQL] Keep pushed-down null literal as a fi...

2016-12-06 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/16184 **[Test build #69767 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/69767/consoleFull)** for PR 16184 at commit

[GitHub] spark issue #9543: [SPARK-11482][SQL] Make maven repo for Hive metastore jar...

2016-12-06 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/9543 I'm going to close this one for now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled

[GitHub] spark issue #8785: [Spark-10625] [SQL] Spark SQL JDBC read/write is unable t...

2016-12-06 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/8785 @tribbloid is this a problem that needs to be fixed? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #7265: [SPARK-7263] Add new shuffle manager which stores shuffle...

2016-12-06 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/7265 I'm gong to close this for now. Next year we might actually come back and revisit this - probably not with the current parquet implementation since it is not very efficient, but some sort of columnar

[GitHub] spark issue #6848: [SPARK-8398][CORE] Hadoop input/output format advanced co...

2016-12-06 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/6848 I'm going to close this for now. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #16135: [SPARK-18700][SQL] Add ReadWriteLock for each table's re...

2016-12-06 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/16135 cc @ericl can you take a look at this? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #16129: [SPARK-18678][ML] Skewed feature subsampling in Random f...

2016-12-06 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/16129 This LGTM. Now that I'm looking at it, the test suite **never actually tests for correctness**, just basic input/output sizes. We really should have better tests, but it's ok with me if it's done in

[GitHub] spark issue #16122: [SPARK-18681][SQL] Fix filtering to compatible with part...

2016-12-06 Thread mallman
Github user mallman commented on the issue: https://github.com/apache/spark/pull/16122 I haven't been able to get a proper unit test environment running where the embedded metastore conf is different from the client conf. I did validate that Spark without this patch failed to execute

[GitHub] spark issue #14537: [SPARK-16948][SQL] Use metastore schema instead of infer...

2016-12-06 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/14537 The schema inferring is replaced with metastore schema completely in #14690. I think we can close this now? cc @cloud-fan @liancheng --- If your project is set up for it, you can reply to this

[GitHub] spark issue #16183: [SPARK-18671][SS][test-maven] Follow up PR to fix test f...

2016-12-06 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16183 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/69764/ Test PASSed. ---

  1   2   3   4   5   6   >