[
https://issues.apache.org/jira/browse/FLINK-37073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17927892#comment-17927892
]
Yi Zhang edited comment on FLINK-37073 at 2/19/25 6:59 AM:
-----------------------------------------------------------
Verification results:
The results match the description.
Verification steps:
# Start the Flink cluster, construct the test case with data, and submit the
batch job from sql client.
# From the Flink UI, the job vertices of completed and running nodes can be
observed. There is a 'show pending operators' button in the top-left corner,
which, when selected, displays the stream nodes that have not yet run, as shown
in Attachment. The verification results match the description.
Verification case：
```
SET 'execution.runtime-mode' = 'batch';
CREATE TABLE dim1 (
a int NOT NULL,
b int NOT NULL
);
CREATE TABLE IF NOT EXISTS fact1 (
a int NOT NULL,
c int
);
CREATE TEMPORARY TABLE sink (
a int NOT NULL,
b int NOT NULL,
c int
)
WITH ('connector' = 'blackhole');
INSERT INTO sink
SELECT /*+ SHUFFLE_HASH(dim1) */ dim1.a AS a, b, c
FROM dim1, fact1_index
WHERE dim1.a = fact1_index.a AND dim1.b = 0;
```
was (Author: JIRAUSER307600):
Verification Steps:
# Start the Flink cluster, construct the test case with data, and submit the
batch job from sql client.
# From the Flink UI, the job vertices of completed and running nodes can be
observed. There is a 'show pending operators' button in the top-left corner,
which, when selected, displays the stream nodes that have not yet run, as shown
in Attachment. The verification results match the description.
Verification case：
```
SET 'execution.runtime-mode' = 'batch';
CREATE TABLE dim1 (
a int NOT NULL,
b int NOT NULL
);
CREATE TABLE IF NOT EXISTS fact1 (
a int NOT NULL,
c int
);
CREATE TEMPORARY TABLE sink (
a int NOT NULL,
b int NOT NULL,
c int
)
WITH ('connector' = 'blackhole');
INSERT INTO sink
SELECT /*+ SHUFFLE_HASH(dim1) */ dim1.a AS a, b, c
FROM dim1, fact1_index
WHERE dim1.a = fact1_index.a AND dim1.b = 0;
```
> Cross-team verification for "Adaptive optimization for batch jobs"
> ------------------------------------------------------------------
>
> Key: FLINK-37073
> URL: https://issues.apache.org/jira/browse/FLINK-37073
> Project: Flink
> Issue Type: Sub-task
> Reporter: Xintong Song
> Assignee: Yi Zhang
> Priority: Blocker
> Fix For: 2.0.0
>
> Attachments: adaptive-image.png
>
>
> In Flink 2.0, we introduced adaptive batch execution. In this mode, the job
> graph is incrementally generated, and the web UI has been adapted
> accordingly. We need to follow the steps below to verify:
> # Submit a multi-jobVertex batch job.
> # Check if the job graph displayed in the web UI unfolds as the job vertices
> are created, and if not all job vertices are created, there is a 'show
> pending operators' button in the top-left corner of the job overview page.
> Clicking this button should display the job graph along with the remaining
> stream nodes that have not yet been transfer to job vertices.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
