[
https://issues.apache.org/jira/browse/SPARK-50356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Peter Toth updated SPARK-50356:
-------------------------------
Description:
The following snipett produces inconsitent UI state:
{noformat}
import scala.collection.mutable
import scala.concurrent.{ExecutionContext, Future, Await}
import scala.concurrent.duration.Duration
val rdd = sc.parallelize(1 to 1000, 100).repartition(10)
rdd.count
val futures = mutable.ListBuffer.empty[Future[Unit]]
implicit val xc =
ExecutionContext.fromExecutorService(java.util.concurrent.Executors.newFixedThreadPool(5))
futures += Future { rdd.count }
futures += Future { rdd.count }
futures += Future { rdd.count }
Await.result(Future.sequence(futures), Duration.Inf)
{noformat}
The jobs page doesn't show the skipped tasks propery:
!Screenshot 2024-11-19 at 16.06.48.png!
was:
The following snipett produces inconsitent UI state:
{noformat}
import scala.collection.mutable
import scala.concurrent.{ExecutionContext, Future, Await}
import scala.concurrent.duration.Duration
val rdd = sc.parallelize(1 to 1000, 100).repartition(10)
rdd.count
val futures = mutable.ListBuffer.empty[Future[Unit]]
implicit val xc =
ExecutionContext.fromExecutorService(java.util.concurrent.Executors.newFixedThreadPool(5))
futures += Future { rdd.count }
futures += Future { rdd.count }
futures += Future { rdd.count }
Await.result(Future.sequence(futures), Duration.Inf)
{noformat}
> Skipped stages are inconsitent on UI
> ------------------------------------
>
> Key: SPARK-50356
> URL: https://issues.apache.org/jira/browse/SPARK-50356
> Project: Spark
> Issue Type: Bug
> Components: Spark Core, UI
> Affects Versions: 4.0.0
> Reporter: Peter Toth
> Priority: Major
> Attachments: Screenshot 2024-11-19 at 16.06.48.png, Screenshot
> 2024-11-19 at 16.07.06.png, Screenshot 2024-11-19 at 16.07.20.png
>
>
> The following snipett produces inconsitent UI state:
> {noformat}
> import scala.collection.mutable
> import scala.concurrent.{ExecutionContext, Future, Await}
> import scala.concurrent.duration.Duration
> val rdd = sc.parallelize(1 to 1000, 100).repartition(10)
> rdd.count
> val futures = mutable.ListBuffer.empty[Future[Unit]]
> implicit val xc =
> ExecutionContext.fromExecutorService(java.util.concurrent.Executors.newFixedThreadPool(5))
> futures += Future { rdd.count }
> futures += Future { rdd.count }
> futures += Future { rdd.count }
> Await.result(Future.sequence(futures), Duration.Inf)
> {noformat}
> The jobs page doesn't show the skipped tasks propery:
> !Screenshot 2024-11-19 at 16.06.48.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
