[jira] [Commented] (SPARK-23475) The "stages" page doesn't show any completed stages
[ https://issues.apache.org/jira/browse/SPARK-23475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16375254#comment-16375254 ] Marcelo Vanzin commented on SPARK-23475: https://github.com/apache/spark/pull/20662 was merged to 2.3, but not in time for rc5, so probably will only be in 2.3.1. > The "stages" page doesn't show any completed stages > --- > > Key: SPARK-23475 > URL: https://issues.apache.org/jira/browse/SPARK-23475 > Project: Spark > Issue Type: Bug > Components: Web UI >Affects Versions: 2.3.0 >Reporter: Shixiong Zhu >Assignee: Shixiong Zhu >Priority: Blocker > Fix For: 2.3.0 > > Attachments: Screen Shot 2018-02-21 at 12.39.39 AM.png > > > Run "bin/spark-shell --conf spark.ui.retainedJobs=10 --conf > spark.ui.retainedStages=10", type the following codes and click the "stages" > page, it will not show completed stages: > {code} > val rdd = sc.parallelize(0 to 100, 100).repartition(10).cache() > (1 to 20).foreach { i => >rdd.repartition(10).count() > } > {code} > Please see the attached screenshots. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-23475) The "stages" page doesn't show any completed stages
[ https://issues.apache.org/jira/browse/SPARK-23475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374360#comment-16374360 ] Apache Spark commented on SPARK-23475: -- User 'mgaido91' has created a pull request for this issue: https://github.com/apache/spark/pull/20663 > The "stages" page doesn't show any completed stages > --- > > Key: SPARK-23475 > URL: https://issues.apache.org/jira/browse/SPARK-23475 > Project: Spark > Issue Type: Bug > Components: Web UI >Affects Versions: 2.3.0 >Reporter: Shixiong Zhu >Assignee: Shixiong Zhu >Priority: Blocker > Fix For: 2.3.0 > > Attachments: Screen Shot 2018-02-21 at 12.39.39 AM.png > > > Run "bin/spark-shell --conf spark.ui.retainedJobs=10 --conf > spark.ui.retainedStages=10", type the following codes and click the "stages" > page, it will not show completed stages: > {code} > val rdd = sc.parallelize(0 to 100, 100).repartition(10).cache() > (1 to 20).foreach { i => >rdd.repartition(10).count() > } > {code} > Please see the attached screenshots. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-23475) The "stages" page doesn't show any completed stages
[ https://issues.apache.org/jira/browse/SPARK-23475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16374139#comment-16374139 ] Apache Spark commented on SPARK-23475: -- User 'mgaido91' has created a pull request for this issue: https://github.com/apache/spark/pull/20662 > The "stages" page doesn't show any completed stages > --- > > Key: SPARK-23475 > URL: https://issues.apache.org/jira/browse/SPARK-23475 > Project: Spark > Issue Type: Bug > Components: Web UI >Affects Versions: 2.3.0 >Reporter: Shixiong Zhu >Assignee: Shixiong Zhu >Priority: Blocker > Fix For: 2.3.0 > > Attachments: Screen Shot 2018-02-21 at 12.39.39 AM.png > > > Run "bin/spark-shell --conf spark.ui.retainedJobs=10 --conf > spark.ui.retainedStages=10", type the following codes and click the "stages" > page, it will not show completed stages: > {code} > val rdd = sc.parallelize(0 to 100, 100).repartition(10).cache() > (1 to 20).foreach { i => >rdd.repartition(10).count() > } > {code} > Please see the attached screenshots. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-23475) The "stages" page doesn't show any completed stages
[ https://issues.apache.org/jira/browse/SPARK-23475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16373254#comment-16373254 ] Marcelo Vanzin commented on SPARK-23475: Marco's PR was also merged into master: https://github.com/apache/spark/pull/20651 > The "stages" page doesn't show any completed stages > --- > > Key: SPARK-23475 > URL: https://issues.apache.org/jira/browse/SPARK-23475 > Project: Spark > Issue Type: Bug > Components: Web UI >Affects Versions: 2.3.0 >Reporter: Shixiong Zhu >Assignee: Shixiong Zhu >Priority: Blocker > Fix For: 2.3.0 > > Attachments: Screen Shot 2018-02-21 at 12.39.39 AM.png > > > Run "bin/spark-shell --conf spark.ui.retainedJobs=10 --conf > spark.ui.retainedStages=10", type the following codes and click the "stages" > page, it will not show completed stages: > {code} > val rdd = sc.parallelize(0 to 100, 100).repartition(10).cache() > (1 to 20).foreach { i => >rdd.repartition(10).count() > } > {code} > Please see the attached screenshots. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-23475) The "stages" page doesn't show any completed stages
[ https://issues.apache.org/jira/browse/SPARK-23475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16372135#comment-16372135 ] Apache Spark commented on SPARK-23475: -- User 'zsxwing' has created a pull request for this issue: https://github.com/apache/spark/pull/20656 > The "stages" page doesn't show any completed stages > --- > > Key: SPARK-23475 > URL: https://issues.apache.org/jira/browse/SPARK-23475 > Project: Spark > Issue Type: Bug > Components: Web UI >Affects Versions: 2.3.0 >Reporter: Shixiong Zhu >Priority: Blocker > Attachments: Screen Shot 2018-02-21 at 12.39.39 AM.png > > > Run "bin/spark-shell --conf spark.ui.retainedJobs=10 --conf > spark.ui.retainedStages=10", type the following codes and click the "stages" > page, it will not show completed stages: > {code} > val rdd = sc.parallelize(0 to 100, 100).repartition(10).cache() > (1 to 20).foreach { i => >rdd.repartition(10).count() > } > {code} > Please see the attached screenshots. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-23475) The "stages" page doesn't show any completed stages
[ https://issues.apache.org/jira/browse/SPARK-23475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371897#comment-16371897 ] Shixiong Zhu commented on SPARK-23475: -- The job page issue is a separated issue. Created SPARK-23481 to track it instead. > The "stages" page doesn't show any completed stages > --- > > Key: SPARK-23475 > URL: https://issues.apache.org/jira/browse/SPARK-23475 > Project: Spark > Issue Type: Bug > Components: Web UI >Affects Versions: 2.3.0 >Reporter: Shixiong Zhu >Priority: Blocker > Attachments: Screen Shot 2018-02-21 at 12.39.39 AM.png, Screen Shot > 2018-02-21 at 12.39.46 AM.png > > > Run "bin/spark-shell --conf spark.ui.retainedJobs=10 --conf > spark.ui.retainedStages=10", type the following codes and click the "stages" > page, it will not show completed stages: > {code} > val rdd = sc.parallelize(0 to 100, 100).repartition(10).cache() > (1 to 20).foreach { i => >rdd.repartition(10).count() > } > {code} > The stages in the job page is also wrong. Please see the attached screenshots. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-23475) The "stages" page doesn't show any completed stages
[ https://issues.apache.org/jira/browse/SPARK-23475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371378#comment-16371378 ] Apache Spark commented on SPARK-23475: -- User 'mgaido91' has created a pull request for this issue: https://github.com/apache/spark/pull/20651 > The "stages" page doesn't show any completed stages > --- > > Key: SPARK-23475 > URL: https://issues.apache.org/jira/browse/SPARK-23475 > Project: Spark > Issue Type: Bug > Components: Web UI >Affects Versions: 2.3.0 >Reporter: Shixiong Zhu >Priority: Blocker > Attachments: Screen Shot 2018-02-21 at 12.39.39 AM.png, Screen Shot > 2018-02-21 at 12.39.46 AM.png > > > Run "bin/spark-shell --conf spark.ui.retainedJobs=10 --conf > spark.ui.retainedStages=10", type the following codes and click the "stages" > page, it will not show completed stages: > {code} > val rdd = sc.parallelize(0 to 100, 100).repartition(10).cache() > (1 to 20).foreach { i => >rdd.repartition(10).count() > } > {code} > The stages in the job page is also wrong. Please see the attached screenshots. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-23475) The "stages" page doesn't show any completed stages
[ https://issues.apache.org/jira/browse/SPARK-23475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371347#comment-16371347 ] Marco Gaido commented on SPARK-23475: - The reason of this behavior is that SKIPPED stages, which were previously shown in the PENDING table, are not shown anymore. This was introduced by SPARK-20648. I will submit a fix soon. > The "stages" page doesn't show any completed stages > --- > > Key: SPARK-23475 > URL: https://issues.apache.org/jira/browse/SPARK-23475 > Project: Spark > Issue Type: Bug > Components: Web UI >Affects Versions: 2.3.0 >Reporter: Shixiong Zhu >Priority: Blocker > Attachments: Screen Shot 2018-02-21 at 12.39.39 AM.png, Screen Shot > 2018-02-21 at 12.39.46 AM.png > > > Run "bin/spark-shell --conf spark.ui.retainedJobs=10 --conf > spark.ui.retainedStages=10", type the following codes and click the "stages" > page, it will not show completed stages: > {code} > val rdd = sc.parallelize(0 to 100, 100).repartition(10).cache() > (1 to 20).foreach { i => >rdd.repartition(10).count() > } > {code} > The stages in the job page is also wrong. Please see the attached screenshots. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-23475) The "stages" page doesn't show any completed stages
[ https://issues.apache.org/jira/browse/SPARK-23475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16371098#comment-16371098 ] Shixiong Zhu commented on SPARK-23475: -- cc [~vanzin] > The "stages" page doesn't show any completed stages > --- > > Key: SPARK-23475 > URL: https://issues.apache.org/jira/browse/SPARK-23475 > Project: Spark > Issue Type: Bug > Components: Web UI >Affects Versions: 2.3.0 >Reporter: Shixiong Zhu >Priority: Blocker > Attachments: Screen Shot 2018-02-21 at 12.39.39 AM.png, Screen Shot > 2018-02-21 at 12.39.46 AM.png > > > Run "bin/spark-shell --conf spark.ui.retainedJobs=10 --conf > spark.ui.retainedStages=10", type the following codes and click the "stages" > page, it will not show completed stages: > {code} > val rdd = sc.parallelize(0 to 100, 100).repartition(10).cache() > (1 to 20).foreach { i => >rdd.repartition(10).count() > } > {code} > The stages in the job page is also wrong. Please see the attached screenshots. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org