[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-09-12 Thread cenyuhai
Github user cenyuhai commented on the issue: https://github.com/apache/spark/pull/14737 thank you! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-09-12 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14737 Merged to master --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-09-12 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14737 I looked one more time and the only thing that crossed my mind is whether spark.ui.dagGraph.retainedRootRDDs is the rightest naming convention, but, it's a hidden internal property at the moment,

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14737 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65209/ Test PASSed. ---

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-09-10 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14737 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-09-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14737 **[Test build #65209 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65209/consoleFull)** for PR 14737 at commit

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-09-10 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14737 **[Test build #65209 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65209/consoleFull)** for PR 14737 at commit

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-09-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14737 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65190/ Test PASSed. ---

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-09-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14737 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-09-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14737 **[Test build #65190 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65190/consoleFull)** for PR 14737 at commit

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-09-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14737 **[Test build #65190 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65190/consoleFull)** for PR 14737 at commit

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-09-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14737 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-09-09 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14737 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/65152/ Test FAILed. ---

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-09-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14737 **[Test build #65152 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65152/consoleFull)** for PR 14737 at commit

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-09-09 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14737 **[Test build #65152 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/65152/consoleFull)** for PR 14737 at commit

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-09-08 Thread cenyuhai
Github user cenyuhai commented on the issue: https://github.com/apache/spark/pull/14737 @srowen If it is ok,can you merge this pr to master?thank you. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-08-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14737 OK, another config eh. If there's no default change in behavior, and it's undocumented and it doesn't introduce much complexity, seems OK --- If your project is set up for it, you can reply to this

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-08-25 Thread cenyuhai
Github user cenyuhai commented on the issue: https://github.com/apache/spark/pull/14737 @srowen Why I set this value 2, because a "JOIN" action needs 2 elements.Because Users always don't care about how many partitions the graphs has, they just want to know the relations from DAG

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-08-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14737 I can see the value in this, but it also removes any indication that there are more elements to the graph that are not displayed. I wonder if there is any easy way to do that or do I misunderstand?

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-08-25 Thread cenyuhai
Github user cenyuhai commented on the issue: https://github.com/apache/spark/pull/14737 I am very sorry about, the first picture is for stage, the second picture is for job, but it is the same job "select count(1) from partitionedTables " --- If your project is set up for it, you

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-08-25 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/14737 Pardon the dumb question, but your before and after pictures seem like different graphs. Is that really showing the before and after of one display? --- If your project is set up for it, you can

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-08-25 Thread cenyuhai
Github user cenyuhai commented on the issue: https://github.com/apache/spark/pull/14737 @srowen please review the latest codes, thank you. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-08-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14737 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-08-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14737 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64173/ Test PASSed. ---

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-08-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14737 **[Test build #64173 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64173/consoleFull)** for PR 14737 at commit

[GitHub] spark issue #14737: [SPARK-17171][WEB UI] DAG will list all partitions in th...

2016-08-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14737 **[Test build #64173 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64173/consoleFull)** for PR 14737 at commit

[GitHub] spark issue #14737: [Spark-17171][WEB UI] DAG will list all partitions in th...

2016-08-21 Thread cenyuhai
Github user cenyuhai commented on the issue: https://github.com/apache/spark/pull/14737 @srowen --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] spark issue #14737: [Spark-17171][WEB UI] DAG will list all partitions in th...

2016-08-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14737 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64167/ Test PASSed. ---

[GitHub] spark issue #14737: [Spark-17171][WEB UI] DAG will list all partitions in th...

2016-08-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14737 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14737: [Spark-17171][WEB UI] DAG will list all partitions in th...

2016-08-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14737 **[Test build #64167 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64167/consoleFull)** for PR 14737 at commit

[GitHub] spark issue #14737: [Spark-17171][WEB UI] DAG will list all partitions in th...

2016-08-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14737 **[Test build #64167 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64167/consoleFull)** for PR 14737 at commit

[GitHub] spark issue #14737: [Spark-17171][WEB UI] DAG will list all partitions in th...

2016-08-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14737 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/64158/ Test PASSed. ---

[GitHub] spark issue #14737: [Spark-17171][WEB UI] DAG will list all partitions in th...

2016-08-21 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/14737 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #14737: [Spark-17171][WEB UI] DAG will list all partitions in th...

2016-08-21 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14737 **[Test build #64158 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64158/consoleFull)** for PR 14737 at commit

[GitHub] spark issue #14737: [Spark-17171][WEB UI] DAG will list all partitions in th...

2016-08-20 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/14737 **[Test build #64158 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/64158/consoleFull)** for PR 14737 at commit