[GitHub] spark issue #14355: [SPARK-16726][SQL] Improve error message for `Union` que...

2016-07-25 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/14355 @dongjoon-hyun Do you mind if I ask a question please? It seems it works in MySQL supports `UNION ALL` for the compatible types, for example, numeric compatible types. If my

[GitHub] spark issue #14354: [SPARK-16722][Tests]Fix a StreamingContext leak in Strea...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14354 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62849/ Test PASSed. ---

[GitHub] spark issue #14354: [SPARK-16722][Tests]Fix a StreamingContext leak in Strea...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14354 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14354: [SPARK-16722][Tests]Fix a StreamingContext leak in Strea...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14354 **[Test build #62849 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62849/consoleFull)** for PR 14354 at commit

[GitHub] spark issue #14284: [SPARK-16633] [SPARK-16642] [SPARK-16721] [SQL] Fixes th...

2016-07-25 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/14284 this this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark pull request #13620: [SPARK-15590] [WEBUI] Paginate Job Table in Jobs ...

2016-07-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13620 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14241: [SPARK-16596] [SQL] Refactor DataSourceScanExec to do pa...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14241 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14241: [SPARK-16596] [SQL] Refactor DataSourceScanExec to do pa...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14241 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62847/ Test PASSed. ---

[GitHub] spark issue #14241: [SPARK-16596] [SQL] Refactor DataSourceScanExec to do pa...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14241 **[Test build #62847 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62847/consoleFull)** for PR 14241 at commit

[GitHub] spark issue #13620: [SPARK-15590] [WEBUI] Paginate Job Table in Jobs tab

2016-07-25 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/13620 Merging to master. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #13620: [SPARK-15590] [WEBUI] Paginate Job Table in Jobs tab

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13620 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62846/ Test PASSed. ---

[GitHub] spark issue #13620: [SPARK-15590] [WEBUI] Paginate Job Table in Jobs tab

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13620 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13620: [SPARK-15590] [WEBUI] Paginate Job Table in Jobs tab

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13620 **[Test build #62846 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62846/consoleFull)** for PR 13620 at commit

[GitHub] spark issue #36: Added a unit test for PairRDDFunctions.lookup

2016-07-25 Thread databricks-jenkins
Github user databricks-jenkins commented on the issue: https://github.com/apache/spark/pull/36 **[Test build #66 has finished](https://jenkins.test.databricks.com/job/spark-pull-request-builder/66/consoleFull)** for PR 36 at commit

[GitHub] spark issue #36: Added a unit test for PairRDDFunctions.lookup

2016-07-25 Thread databricks-jenkins
Github user databricks-jenkins commented on the issue: https://github.com/apache/spark/pull/36 **[Test build #66 has started](https://jenkins.test.databricks.com/job/spark-pull-request-builder/66/consoleFull)** for PR 36 at commit

[GitHub] spark issue #14355: [SPARK-16726][SQL] Improve error message for `Union` que...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14355 **[Test build #62850 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62850/consoleFull)** for PR 14355 at commit

[GitHub] spark issue #13571: [SPARK-15369][WIP][RFC][PySpark][SQL] Expose potential t...

2016-07-25 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/13571 Now that 2.0 is in the final RC would maybe @davies have a chance to take a look and see if this is something that would be interesting? --- If your project is set up for it, you can reply to this

[GitHub] spark pull request #14355: [SPARK-16726][SQL] Improve error message for `Uni...

2016-07-25 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/14355 [SPARK-16726][SQL] Improve error message for `Union` queries for incompatible types ## What changes were proposed in this pull request? Currently, `UNION` queries on incompatible

[GitHub] spark issue #13571: [SPARK-15369][WIP][RFC][PySpark][SQL] Expose potential t...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13571 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13571: [SPARK-15369][WIP][RFC][PySpark][SQL] Expose potential t...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13571 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62843/ Test PASSed. ---

[GitHub] spark issue #13571: [SPARK-15369][WIP][RFC][PySpark][SQL] Expose potential t...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13571 **[Test build #62843 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62843/consoleFull)** for PR 13571 at commit

[GitHub] spark pull request #14231: [SPARK-16586] Change the way the exit code of lau...

2016-07-25 Thread zasdfgbnm
Github user zasdfgbnm commented on a diff in the pull request: https://github.com/apache/spark/pull/14231#discussion_r72167441 --- Diff: bin/spark-class --- @@ -65,24 +65,25 @@ fi # characters that would be otherwise interpreted by the shell. Read that in a while loop,

[GitHub] spark pull request #14231: [SPARK-16586] Change the way the exit code of lau...

2016-07-25 Thread zasdfgbnm
Github user zasdfgbnm commented on a diff in the pull request: https://github.com/apache/spark/pull/14231#discussion_r72167136 --- Diff: bin/spark-class --- @@ -65,24 +65,25 @@ fi # characters that would be otherwise interpreted by the shell. Read that in a while loop,

[GitHub] spark issue #13920: [SPARK-16166][Core] Also take off-heap memory usage into...

2016-07-25 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/13920 Thanks a lot @JoshRosen . --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14354: [SPARK-16722][Tests]Fix a StreamingContext leak in Strea...

2016-07-25 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/14354 LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #14354: [SPARK-16722][Tests]Fix a StreamingContext leak in Strea...

2016-07-25 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/14354 This is an example of this leak: http://spark-tests.appspot.com/builds/spark-master-test-sbt-hadoop-2.2/1429 --- If your project is set up for it, you can reply to this email and have your reply

[GitHub] spark issue #14354: [SPARK-16722][Tests]Fix a StreamingContext leak in Strea...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14354 **[Test build #62849 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62849/consoleFull)** for PR 14354 at commit

[GitHub] spark pull request #14354: [SPARK-16722][Tests]Fix a StreamingContext leak i...

2016-07-25 Thread zsxwing
Github user zsxwing commented on a diff in the pull request: https://github.com/apache/spark/pull/14354#discussion_r72163631 --- Diff: streaming/src/test/scala/org/apache/spark/streaming/StreamingContextSuite.scala --- @@ -819,10 +819,13 @@ class StreamingContextSuite extends

[GitHub] spark pull request #14354: [SPARK-16722][Tests]Fix a StreamingContext leak i...

2016-07-25 Thread zsxwing
GitHub user zsxwing opened a pull request: https://github.com/apache/spark/pull/14354 [SPARK-16722][Tests]Fix a StreamingContext leak in StreamingContextSuite when eventually fails ## What changes were proposed in this pull request? This PR moves `ssc.stop()` into

[GitHub] spark issue #14349: [SPARK-16524][SQL] Add RowBatch and RowBasedHashMapGener...

2016-07-25 Thread sameeragarwal
Github user sameeragarwal commented on the issue: https://github.com/apache/spark/pull/14349 LGTM (from https://github.com/apache/spark/pull/14174) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] spark issue #14269: [SPARK-15703] [Scheduler][Core][WebUI] Make ListenerBus ...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14269 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62842/ Test PASSed. ---

[GitHub] spark issue #14269: [SPARK-15703] [Scheduler][Core][WebUI] Make ListenerBus ...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14269 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14269: [SPARK-15703] [Scheduler][Core][WebUI] Make ListenerBus ...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14269 **[Test build #62842 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62842/consoleFull)** for PR 14269 at commit

[GitHub] spark pull request #14292: [SPARK-14131][SQL[STREAMING] Improved fix for avo...

2016-07-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14292 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #14350: [SPARK-16715][Tests]Fix a potential ExprId confli...

2016-07-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14350 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14292: [SPARK-14131][SQL[STREAMING] Improved fix for avoiding p...

2016-07-25 Thread tdas
Github user tdas commented on the issue: https://github.com/apache/spark/pull/14292 Tests have passed. Merging this to master and 2.0. Thanks for reviewing @zsxwing @jaceklaskowski --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #14350: [SPARK-16715][Tests]Fix a potential ExprId conflict for ...

2016-07-25 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/14350 Merging to master and 2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #14350: [SPARK-16715][Tests]Fix a potential ExprId conflict for ...

2016-07-25 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/14350 LGTM --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark pull request #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-25 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r72160752 --- Diff: core/src/main/scala/org/apache/spark/scheduler/BlacklistTracker.scala --- @@ -0,0 +1,216 @@ +/* + * Licensed to the Apache Software

[GitHub] spark issue #14353: [SPARK-16714][SQL] `array` should create a decimal array...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14353 **[Test build #62848 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62848/consoleFull)** for PR 14353 at commit

[GitHub] spark issue #14350: [SPARK-16715][Tests]Fix a potential ExprId conflict for ...

2016-07-25 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/14350 /cc @yhuai --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark pull request #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-25 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r72160650 --- Diff: core/src/main/scala/org/apache/spark/internal/config/package.scala --- @@ -97,6 +97,49 @@ package object config { .toSequence

[GitHub] spark pull request #14079: [SPARK-8425][CORE] New Blacklist Mechanism

2016-07-25 Thread kayousterhout
Github user kayousterhout commented on a diff in the pull request: https://github.com/apache/spark/pull/14079#discussion_r72160497 --- Diff: core/src/main/scala/org/apache/spark/TaskEndReason.scala --- @@ -204,6 +213,7 @@ case object TaskResultLost extends TaskFailedReason {

[GitHub] spark pull request #14353: [SPARK-16714][SQL] `array` should create a decima...

2016-07-25 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/14353 [SPARK-16714][SQL] `array` should create a decimal array from decimals with different precisions and scales ## What changes were proposed in this pull request? In Spark 2.0, we will

[GitHub] spark issue #14292: [SPARK-14131][SQL[STREAMING] Improved fix for avoiding p...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14292 **[Test build #3190 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3190/consoleFull)** for PR 14292 at commit

[GitHub] spark issue #14350: [SPARK-16715][Tests]Fix a potential ExprId conflict for ...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14350 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62838/ Test PASSed. ---

[GitHub] spark issue #14350: [SPARK-16715][Tests]Fix a potential ExprId conflict for ...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14350 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14350: [SPARK-16715][Tests]Fix a potential ExprId conflict for ...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14350 **[Test build #62838 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62838/consoleFull)** for PR 14350 at commit

[GitHub] spark issue #14241: [SPARK-16596] [SQL] Refactor DataSourceScanExec to do pa...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14241 **[Test build #62847 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62847/consoleFull)** for PR 14241 at commit

[GitHub] spark issue #14349: [SPARK-16524][SQL] Add RowBatch and RowBasedHashMapGener...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14349 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62839/ Test PASSed. ---

[GitHub] spark issue #14349: [SPARK-16524][SQL] Add RowBatch and RowBasedHashMapGener...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14349 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14349: [SPARK-16524][SQL] Add RowBatch and RowBasedHashMapGener...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14349 **[Test build #62839 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62839/consoleFull)** for PR 14349 at commit

[GitHub] spark issue #14333: [SPARK-16696][ML][MLLib] destroy KMeans bcNewCenters whe...

2016-07-25 Thread WeichenXu123
Github user WeichenXu123 commented on the issue: https://github.com/apache/spark/pull/14333 @srowen The sparkContext, by default, will running a cleaner to release not referenced RDD/broadcasts on background. But, I think, we'd better to release them by ourselves because the

[GitHub] spark issue #13585: [SPARK-15859][SQL] Optimize the partition pruning within...

2016-07-25 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/13585 @chenghao-intel Will you have time to update this PR? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #14352: Fix description of spark.speculation.quantile

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14352 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark pull request #14352: Fix description of spark.speculation.quantile

2016-07-25 Thread nwbvt
GitHub user nwbvt opened a pull request: https://github.com/apache/spark/pull/14352 Fix description of spark.speculation.quantile ## What changes were proposed in this pull request? Minor doc fix regarding the spark.speculation.quantile configuration parameter. It

[GitHub] spark issue #14351: [SQL][DOC] Fix a default name for parquet compression

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14351 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14351: [SQL][DOC] Fix a default name for parquet compression

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14351 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62844/ Test PASSed. ---

[GitHub] spark issue #14241: [SPARK-16596] [SQL] Refactor DataSourceScanExec to do pa...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14241 **[Test build #62845 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62845/consoleFull)** for PR 14241 at commit

[GitHub] spark issue #14241: [SPARK-16596] [SQL] Refactor DataSourceScanExec to do pa...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14241 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62845/ Test FAILed. ---

[GitHub] spark issue #14351: [SQL][DOC] Fix a default name for parquet compression

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14351 **[Test build #62844 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62844/consoleFull)** for PR 14351 at commit

[GitHub] spark issue #14241: [SPARK-16596] [SQL] Refactor DataSourceScanExec to do pa...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14241 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark pull request #13920: [SPARK-16166][Core] Also take off-heap memory usa...

2016-07-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/13920 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #13620: [SPARK-15590] [WEBUI] Paginate Job Table in Jobs tab

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13620 **[Test build #62846 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62846/consoleFull)** for PR 13620 at commit

[GitHub] spark issue #13920: [SPARK-16166][Core] Also take off-heap memory usage into...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13920 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62837/ Test PASSed. ---

[GitHub] spark issue #13920: [SPARK-16166][Core] Also take off-heap memory usage into...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/13920 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #13920: [SPARK-16166][Core] Also take off-heap memory usage into...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13920 **[Test build #62837 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62837/consoleFull)** for PR 13920 at commit

[GitHub] spark issue #13620: [SPARK-15590] [WEBUI] Paginate Job Table in Jobs tab

2016-07-25 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/13620 LGTM. Let's run the test again since this is a pretty old PR. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #13620: [SPARK-15590] [WEBUI] Paginate Job Table in Jobs tab

2016-07-25 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/13620 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #14241: [SPARK-16596] [SQL] Refactor DataSourceScanExec to do pa...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14241 **[Test build #62845 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62845/consoleFull)** for PR 14241 at commit

[GitHub] spark pull request #14351: [SQL][DOC] Fix a default name for parquet compres...

2016-07-25 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/14351 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #14351: [SQL][DOC] Fix a default name for parquet compression

2016-07-25 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/14351 Thanks - merging in master/2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #14241: [SPARK-16596] [SQL] Refactor DataSourceScanExec t...

2016-07-25 Thread ericl
Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/14241#discussion_r72154191 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ExistingRDD.scala --- @@ -275,62 +271,152 @@ private[sql] case class RowDataSourceScanExec(

[GitHub] spark pull request #14241: [SPARK-16596] [SQL] Refactor DataSourceScanExec t...

2016-07-25 Thread ericl
Github user ericl commented on a diff in the pull request: https://github.com/apache/spark/pull/14241#discussion_r72154195 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ExistingRDD.scala --- @@ -275,62 +271,152 @@ private[sql] case class RowDataSourceScanExec(

[GitHub] spark issue #14174: [SPARK-16524][SQL] Add RowBatch and RowBasedHashMapGener...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14174 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62836/ Test PASSed. ---

[GitHub] spark issue #14174: [SPARK-16524][SQL] Add RowBatch and RowBasedHashMapGener...

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14174 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14174: [SPARK-16524][SQL] Add RowBatch and RowBasedHashMapGener...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14174 **[Test build #62836 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62836/consoleFull)** for PR 14174 at commit

[GitHub] spark issue #14351: [SQL][DOC] Fix a default name for parquet compression

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14351 **[Test build #62844 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62844/consoleFull)** for PR 14351 at commit

[GitHub] spark issue #14351: [SQL][DOC] Fix a default name for parquet compression

2016-07-25 Thread maropu
Github user maropu commented on the issue: https://github.com/apache/spark/pull/14351 @rxin could you check this before the v2.0 release? An actual default seems to be `snappy`:

[GitHub] spark pull request #14351: [SQL][DOC] Fix a default name for parquet compres...

2016-07-25 Thread maropu
GitHub user maropu opened a pull request: https://github.com/apache/spark/pull/14351 [SQL][DOC] Fix a default name for parquet compression ## What changes were proposed in this pull request? This pr is to fix a wrong description for parquet default compression. You can

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-07-25 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/11105 Now that 2.0 is mostly ready to go out (with the new accumulator API) - does maybe @squito have some cycles to look at this? I know @rxin is probably pretty busy with the packaging but after 2.0 is

[GitHub] spark issue #14311: [SPARK-16550] [core] Certain classes fail to deserialize...

2016-07-25 Thread ericl
Github user ericl commented on the issue: https://github.com/apache/spark/pull/14311 Weird, both `core/test-only *DistributedSuite*` and `repl/test-only *ReplSuite*` pass locally for me (jdk-8). I'll look into it tomorrow when I have access to my desktop. --- If your project is set

[GitHub] spark issue #9524: [SPARK-10387][ML] Add code gen for gbt

2016-07-25 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/9524 Now that 2.0 is mostly out - does @dbtsai have some cycles to review it? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #9207: [SPARK-11171][SPARK-11237][SPARK-11241][ML] Try adding PM...

2016-07-25 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/9207 Now that 2.0 RC5 has passed - maybe it would be an OK time to revisit this? I think it can also be an ok base for adding more formats if we need to. --- If your project is set up for it, you can

[GitHub] spark issue #13571: [SPARK-15369][WIP][RFC][PySpark][SQL] Expose potential t...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/13571 **[Test build #62843 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62843/consoleFull)** for PR 13571 at commit

[GitHub] spark pull request #14292: [SPARK-14131][SQL[STREAMING] Improved fix for avo...

2016-07-25 Thread jaceklaskowski
Github user jaceklaskowski commented on a diff in the pull request: https://github.com/apache/spark/pull/14292#discussion_r72148282 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/test/SQLTestUtils.scala --- @@ -247,6 +248,46 @@ private[sql] trait SQLTestUtils }

[GitHub] spark pull request #14292: [SPARK-14131][SQL[STREAMING] Improved fix for avo...

2016-07-25 Thread jaceklaskowski
Github user jaceklaskowski commented on a diff in the pull request: https://github.com/apache/spark/pull/14292#discussion_r72148009 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/StreamExecution.scala --- @@ -269,19 +273,11 @@ class StreamExecution(

[GitHub] spark issue #14269: [SPARK-15703] [Scheduler][Core][WebUI] Make ListenerBus ...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14269 **[Test build #62842 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62842/consoleFull)** for PR 14269 at commit

[GitHub] spark pull request #14284: [SPARK-16633] [SPARK-16642] Fixes three issues re...

2016-07-25 Thread hvanhovell
Github user hvanhovell commented on a diff in the pull request: https://github.com/apache/spark/pull/14284#discussion_r72144974 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/WindowExec.scala --- @@ -625,10 +643,12 @@ private[execution] final class

[GitHub] spark issue #14269: [SPARK-15703] [Scheduler][Core][WebUI] Make ListenerBus ...

2016-07-25 Thread dhruve
Github user dhruve commented on the issue: https://github.com/apache/spark/pull/14269 Removed unused import. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #14269: [SPARK-15703] [Scheduler][Core][WebUI] Make ListenerBus ...

2016-07-25 Thread tgravescs
Github user tgravescs commented on the issue: https://github.com/apache/spark/pull/14269 one minor issue with import otherwise changes LGTM. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #14275: [SPARK-16637] Unified containerizer

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14275 **[Test build #62841 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62841/consoleFull)** for PR 14275 at commit

[GitHub] spark pull request #14269: [SPARK-15703] [Scheduler][Core][WebUI] Make Liste...

2016-07-25 Thread tgravescs
Github user tgravescs commented on a diff in the pull request: https://github.com/apache/spark/pull/14269#discussion_r72143443 --- Diff: core/src/main/scala/org/apache/spark/internal/config/package.scala --- @@ -19,6 +19,7 @@ package org.apache.spark.internal import

[GitHub] spark issue #14275: [SPARK-16637] Unified containerizer

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14275 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62841/ Test FAILed. ---

[GitHub] spark issue #14275: [SPARK-16637] Unified containerizer

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14275 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14275: [SPARK-16637] Unified containerizer

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14275 **[Test build #62841 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62841/consoleFull)** for PR 14275 at commit

[GitHub] spark issue #14292: [SPARK-14131][SQL[STREAMING] Improved fix for avoiding p...

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14292 **[Test build #3190 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3190/consoleFull)** for PR 14292 at commit

[GitHub] spark issue #14275: [SPARK-16637] Unified containerizer

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14275 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/62840/ Test FAILed. ---

[GitHub] spark issue #14275: [SPARK-16637] Unified containerizer

2016-07-25 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14275 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14275: [SPARK-16637] Unified containerizer

2016-07-25 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14275 **[Test build #62840 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/62840/consoleFull)** for PR 14275 at commit

<    1   2   3   4   5   6   7   >