[
https://issues.apache.org/jira/browse/SPARK-55387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruifeng Zheng updated SPARK-55387:
----------------------------------
Description:
The DAG is not properly rendered
{code:java}
scala> sc.range(0, 10, 1, 4).count()
val res0: Long = 10 {code}
It is broken in both Jobs and Stages
Jobs
{code:java}
digraph G {
id="graph_0";
subgraph graph_stage_0 {
id="graph_stage_0";
isCluster="true";
label="Stage 0";
subgraph cluster_0 {
id="cluster_0";
isCluster="true";
label="range";
0 [id="node_0" labelType="html" label="ParallelCollectionRDD [0]<br>range
at <console>:1}"];
1 [id="node_1" labelType="html" label="MapPartitionsRDD [1]<br>range at
<console>:1}"];
}
}
0->1;
}
{code}
Stages
{code:java}
digraph G {
id="graph_0";
subgraph graph_stage_0 {
id="graph_stage_0";
isCluster="true";
label="Stage 0";
subgraph cluster_0 {
id="cluster_0";
isCluster="true";
label="range";
0 [id="node_0" labelType="html" label="ParallelCollectionRDD [0]<br>range
at <console>:1}"];
1 [id="node_1" labelType="html" label="MapPartitionsRDD [1]<br>range at
<console>:1}"];
}
}
0->1;
}
{code}
I checked with Firefox, Edge and Chrome, Spark-shell and PySpark, the results
are similar.
was:
The DAG is not properly rendered
{code:java}
scala> sc.range(0, 10, 1, 4).count()
val res0: Long = 10 {code}
It is broken in both Jobs and Stages
Jobs
{code:java}
digraph G {
id="graph_0";
subgraph graph_stage_0 {
id="graph_stage_0";
isCluster="true";
label="Stage 0";
subgraph cluster_0 {
id="cluster_0";
isCluster="true";
label="range";
0 [id="node_0" labelType="html" label="ParallelCollectionRDD [0]<br>range
at <console>:1}"];
1 [id="node_1" labelType="html" label="MapPartitionsRDD [1]<br>range at
<console>:1}"];
}
}
0->1;
}
{code}
Stages
{code:java}
digraph G {
id="graph_0";
subgraph graph_stage_0 {
id="graph_stage_0";
isCluster="true";
label="Stage 0";
subgraph cluster_0 {
id="cluster_0";
isCluster="true";
label="range";
0 [id="node_0" labelType="html" label="ParallelCollectionRDD [0]<br>range
at <console>:1}"];
1 [id="node_1" labelType="html" label="MapPartitionsRDD [1]<br>range at
<console>:1}"];
}
}
0->1;
}
{code}
I checked with Firefox, Edge and Chrome, the result is the same.
> Broken DAG Visualization in Spark UI
> ------------------------------------
>
> Key: SPARK-55387
> URL: https://issues.apache.org/jira/browse/SPARK-55387
> Project: Spark
> Issue Type: Bug
> Components: UI
> Affects Versions: 4.2.0
> Reporter: Ruifeng Zheng
> Priority: Major
> Attachments: Jobs.png, Stages.png
>
>
> The DAG is not properly rendered
>
> {code:java}
> scala> sc.range(0, 10, 1, 4).count()
> val res0: Long = 10 {code}
>
> It is broken in both Jobs and Stages
> Jobs
> {code:java}
>
> digraph G {
> id="graph_0";
> subgraph graph_stage_0 {
> id="graph_stage_0";
> isCluster="true";
> label="Stage 0";
> subgraph cluster_0 {
> id="cluster_0";
> isCluster="true";
> label="range";
> 0 [id="node_0" labelType="html" label="ParallelCollectionRDD
> [0]<br>range at <console>:1}"];
> 1 [id="node_1" labelType="html" label="MapPartitionsRDD [1]<br>range at
> <console>:1}"];
> }
> }
> 0->1;
> }
>
>
>
>
> {code}
>
> Stages
> {code:java}
>
> digraph G {
> id="graph_0";
> subgraph graph_stage_0 {
> id="graph_stage_0";
> isCluster="true";
> label="Stage 0";
> subgraph cluster_0 {
> id="cluster_0";
> isCluster="true";
> label="range";
> 0 [id="node_0" labelType="html" label="ParallelCollectionRDD
> [0]<br>range at <console>:1}"];
> 1 [id="node_1" labelType="html" label="MapPartitionsRDD [1]<br>range at
> <console>:1}"];
> }
> }
> 0->1;
> }
>
>
>
>
> {code}
>
> I checked with Firefox, Edge and Chrome, Spark-shell and PySpark, the results
> are similar.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
