[ 
https://issues.apache.org/jira/browse/FLINK-35036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17834859#comment-17834859
 ] 

Fly365 commented on FLINK-35036:
--------------------------------

[~bgeng777] [~renqs] ,Thank you for your help!

Eenglish description: I adjusted the timeout of the Flink client to 180s; There 
are 5 million data records in the Oracle database table. When the data records 
were captured to 833120, I used a command to cancel the task and save the 
savepoint. At this time, the CDC client timed out for a long time, and the task 
cancellation failed. At this time, the CDC task is still in the full data 
capture stage. During the initial full data capture, the Oracle CDC task 
defaults to being done through rowId. The checkpoint of the task is saved 
normally, but when canceling and saving the savepoint, why can't the task 
status be stored normally?
After the initial full data capture is completed, the task enters the 
incremental data capture phase. At this point, the task can be cancelled and 
saved normally. Is this a Flink issue or a Flink CDC related issue? Request 
help to answer, thank you!

 
中文描述: 我将flink client 
的超时时间调整成了180s;Oracle数据库表有500万条数据,当数据记录抓取到833,120条时,我使用命令取消任务并保存savepoint,此时CDC客户端长时间直到超时,任务取消失败,此时CDC任务仍在全量数据抓取阶段,在初始全量数据抓取时,Oracle
 CDC任务默认是通过rowId进行做的chunk,任务的checkpoint保存正常,但是取消并存储savepoint时,为何不能正常存储任务状态呢?
当初始全量数据抓取完成后,任务进入到增量数据抓取阶段,此时任务能够正常取消并保存savepoint,这种情况是Flink 问题还是 Flink CDC 
相关的问题呢?请求帮助解答,谢谢!
!image-2024-04-08-17-20-37-320.png!
!image-2024-04-08-17-21-25-111.png!
!image-2024-04-08-17-21-58-127.png!
 

> Flink CDC Job cancel with savepoint failed
> ------------------------------------------
>
>                 Key: FLINK-35036
>                 URL: https://issues.apache.org/jira/browse/FLINK-35036
>             Project: Flink
>          Issue Type: Bug
>          Components: Flink CDC
>         Environment: Flink 1.15.2
> Flink CDC 2.4.2
> Oracle 19C
> Doris 2.0.3
>            Reporter: Fly365
>            Priority: Major
>         Attachments: image-2024-04-07-17-35-23-136.png, 
> image-2024-04-08-17-20-37-320.png, image-2024-04-08-17-21-25-111.png, 
> image-2024-04-08-17-21-58-127.png
>
>
> With the Flink CDC job, I want oracle data to doris, in the  snapshot,canel 
> the Flink CDC Job with savepoint,the job cancel failed.
> Using Flink CDC, synchronize the data tables of Oracle 19C to Doris. During 
> the initialization snapshot phase, some data was synchronized but has not yet 
> reached the incremental phase. At this time, cancel the CDC task and save 
> Flink Savepoint, but the task cancellation fails; After the task enters the 
> incremental phase, it is possible to cancel the task and save the savepoint. 
> Why did the savepoint fail during the stock data synchronization phase?
> 使用Flink CDC,将Oracle 
> 19C的数据表同步到Doris中,在初始化快照阶段,同步了一部分数据但还没有到增量阶段,此时取消CDC任务并保存Flink 
> Savepoint,取消任务失败;而在任务进入增量阶段后,取消任务并保存savepoint是可以的,请问存量数据同步阶段,为何savepoint失败?
> !image-2024-04-07-17-35-23-136.png!
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to