[jira] [Assigned] (FLINK-29802) ChangelogStateBackend supports native savepoint

2024-01-15 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu reassigned FLINK-29802: Assignee: Hangxiang Yu > ChangelogStateBackend supports native savepoint >

[jira] [Resolved] (FLINK-34078) Move InternalKeyContext classes from o.a.f.runtime.state.heap to o.a.f.runtime.state package

2024-01-15 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu resolved FLINK-34078. -- Fix Version/s: 1.19.0 Resolution: Fixed merged 6bdb4f75 into master > Move

[jira] [Assigned] (FLINK-34078) Move InternalKeyContext classes from o.a.f.runtime.state.heap to o.a.f.runtime.state package

2024-01-14 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu reassigned FLINK-34078: Assignee: Jinzhong Li > Move InternalKeyContext classes from o.a.f.runtime.state.heap to

[jira] [Commented] (FLINK-34078) Move InternalKeyContext classes from o.a.f.runtime.state.heap to o.a.f.runtime.state package

2024-01-14 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806660#comment-17806660 ] Hangxiang Yu commented on FLINK-34078: -- Thanks for reporting this. It makes sense to move it to

[jira] [Assigned] (FLINK-34050) Rocksdb state has space amplification after rescaling with DeleteRange

2024-01-14 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu reassigned FLINK-34050: Assignee: Jinzhong Li > Rocksdb state has space amplification after rescaling with

[jira] [Commented] (FLINK-34050) Rocksdb state has space amplification after rescaling with DeleteRange

2024-01-14 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17806659#comment-17806659 ] Hangxiang Yu commented on FLINK-34050: -- [~lijinzhong] Yeah, I think this benchmark result should be

[jira] [Resolved] (FLINK-33057) Add options to disable creating job-id subdirectories under the checkpoint directory

2024-01-14 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu resolved FLINK-33057. -- Fix Version/s: 1.19.0 Resolution: Fixed merged 73b036c3 into master > Add options to

[jira] [Resolved] (FLINK-30613) Improve resolving schema compatibility -- Milestone one

2024-01-14 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu resolved FLINK-30613. -- Resolution: Fixed merged 13921a08...0e5de813 into master > Improve resolving schema

[jira] [Commented] (FLINK-34009) Apache flink: Checkpoint restoration issue on Application Mode of deployment

2024-01-12 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805937#comment-17805937 ] Hangxiang Yu commented on FLINK-34009: -- [~vrang...@in.ibm.com] Hi, You could reorganize the info

[jira] [Commented] (FLINK-34050) Rocksdb state has space amplification after rescaling with DeleteRange

2024-01-11 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805915#comment-17805915 ] Hangxiang Yu commented on FLINK-34050: -- Thanks [~lijinzhong] and [~mayuehappy] providing this

[jira] [Resolved] (FLINK-33946) RocksDb sets setAvoidFlushDuringShutdown to true to speed up Task Cancel

2024-01-11 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu resolved FLINK-33946. -- Resolution: Fixed merged aa0c1b5e into master > RocksDb sets setAvoidFlushDuringShutdown to

[jira] [Resolved] (FLINK-34051) Fix equals/hashCode/toString for SavepointRestoreSettings

2024-01-11 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu resolved FLINK-34051. -- Fix Version/s: 1.19.0 Resolution: Fixed merged 7745ef83 and ecb68704 into master >

[jira] [Commented] (FLINK-33932) Support Retry Mechanism in RocksDBStateDataTransfer

2024-01-11 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805467#comment-17805467 ] Hangxiang Yu commented on FLINK-33932: -- Sure, already assigned to you. Please take a look my extra

[jira] [Assigned] (FLINK-33932) Support Retry Mechanism in RocksDBStateDataTransfer

2024-01-11 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu reassigned FLINK-33932: Assignee: xiangyu feng > Support Retry Mechanism in RocksDBStateDataTransfer >

[jira] [Resolved] (FLINK-33881) [TtlListState]Avoid copy and update value in TtlListState#getUnexpiredOrNull

2024-01-10 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu resolved FLINK-33881. -- Resolution: Fixed Thanks [~lijinzhong] for the great work! merged 907d0f32 into master >

[jira] [Assigned] (FLINK-33819) Support setting CompressType in RocksDBStateBackend

2024-01-10 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu reassigned FLINK-33819: Assignee: Yue Ma > Support setting CompressType in RocksDBStateBackend >

[jira] [Assigned] (FLINK-33946) RocksDb sets setAvoidFlushDuringShutdown to true to speed up Task Cancel

2024-01-10 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu reassigned FLINK-33946: Assignee: Yue Ma (was: Hangxiang Yu) > RocksDb sets setAvoidFlushDuringShutdown to true

[jira] [Assigned] (FLINK-33946) RocksDb sets setAvoidFlushDuringShutdown to true to speed up Task Cancel

2024-01-10 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu reassigned FLINK-33946: Assignee: Hangxiang Yu > RocksDb sets setAvoidFlushDuringShutdown to true to speed up

[jira] [Commented] (FLINK-34015) Setting `execution.savepoint.ignore-unclaimed-state` does not take effect when passing this parameter by dynamic properties

2024-01-10 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805359#comment-17805359 ] Hangxiang Yu commented on FLINK-34015: -- [~zhourenxiang] Fine, it's vaild. I have assigned it to

[jira] [Assigned] (FLINK-34015) Setting `execution.savepoint.ignore-unclaimed-state` does not take effect when passing this parameter by dynamic properties

2024-01-10 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu reassigned FLINK-34015: Assignee: Hangxiang Yu > Setting `execution.savepoint.ignore-unclaimed-state` does not

[jira] [Assigned] (FLINK-34015) Setting `execution.savepoint.ignore-unclaimed-state` does not take effect when passing this parameter by dynamic properties

2024-01-10 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu reassigned FLINK-34015: Assignee: Renxiang Zhou (was: Hangxiang Yu) > Setting

[jira] [Updated] (FLINK-30088) Excessive state updates for TtlMapState and TtlListState

2024-01-10 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu updated FLINK-30088: - Component/s: Runtime / State Backends > Excessive state updates for TtlMapState and

[jira] [Created] (FLINK-34051) Fix equals/hashCode/toString for SavepointRestoreSettings

2024-01-10 Thread Hangxiang Yu (Jira)
Hangxiang Yu created FLINK-34051: Summary: Fix equals/hashCode/toString for SavepointRestoreSettings Key: FLINK-34051 URL: https://issues.apache.org/jira/browse/FLINK-34051 Project: Flink

[jira] [Commented] (FLINK-34015) Setting `execution.savepoint.ignore-unclaimed-state` does not take effect when passing this parameter by dynamic properties

2024-01-10 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805160#comment-17805160 ] Hangxiang Yu commented on FLINK-34015: -- [~zhourenxiang] Thanks for reporting this. IIUC, it's

[jira] [Commented] (FLINK-33819) Support setting CompressType in RocksDBStateBackend

2024-01-10 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805154#comment-17805154 ] Hangxiang Yu commented on FLINK-33819: -- {quote}It is obvious that closing Compression is not only

[jira] [Commented] (FLINK-33946) RocksDb sets setAvoidFlushDuringShutdown to true to speed up Task Cancel

2024-01-10 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17805137#comment-17805137 ] Hangxiang Yu commented on FLINK-33946: -- [~mayuehappy] Thanks for reporting this. It makes sense.

[jira] [Commented] (FLINK-33932) Support retry mechanism for rocksdb uploader

2024-01-09 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17804951#comment-17804951 ] Hangxiang Yu commented on FLINK-33932: -- Thanks for pinging me here. Retry machanism is common when

[jira] [Updated] (FLINK-34030) Avoid using negative value for periodic-materialize.interval

2024-01-09 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu updated FLINK-34030: - Affects Version/s: 1.19.0 > Avoid using negative value for periodic-materialize.interval >

[jira] [Resolved] (FLINK-34030) Avoid using negative value for periodic-materialize.interval

2024-01-09 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu resolved FLINK-34030. -- Fix Version/s: 1.19.0 Resolution: Fixed merged a6c1f308 and 96d62017 into master >

[jira] [Updated] (FLINK-34032) Cleanup local-recovery dir when switching local-recovery from enabled to disabled

2024-01-08 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu updated FLINK-34032: - Summary: Cleanup local-recovery dir when switching local-recovery from enabled to disabled

[jira] [Created] (FLINK-34032) Cleanup local=recovery dir when switching local-recovery from enabled to disabled

2024-01-08 Thread Hangxiang Yu (Jira)
Hangxiang Yu created FLINK-34032: Summary: Cleanup local=recovery dir when switching local-recovery from enabled to disabled Key: FLINK-34032 URL: https://issues.apache.org/jira/browse/FLINK-34032

[jira] [Created] (FLINK-34030) Avoid using negative value for periodic-materialize.interval

2024-01-08 Thread Hangxiang Yu (Jira)
Hangxiang Yu created FLINK-34030: Summary: Avoid using negative value for periodic-materialize.interval Key: FLINK-34030 URL: https://issues.apache.org/jira/browse/FLINK-34030 Project: Flink

[jira] [Commented] (FLINK-33856) Add metrics to monitor the interaction performance between task and external storage system in the process of checkpoint making

2023-12-26 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17800683#comment-17800683 ] Hangxiang Yu commented on FLINK-33856: -- [~Weijie Guo] Thanks for pinging me here. [~hejufang001]

[jira] [Resolved] (FLINK-32881) Client supports making savepoints in detach mode

2023-12-26 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu resolved FLINK-32881. -- Resolution: Fixed merged into master via 81598f8a...d0dbd51c > Client supports making

[jira] [Resolved] (FLINK-20772) RocksDBValueState with TTL occurs NullPointerException when calling update(null) method

2023-12-15 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu resolved FLINK-20772. -- Fix Version/s: 1.19.0 Resolution: Fixed merged ac1ed6b6 and 9aa7a3cd into master >

[jira] [Commented] (FLINK-33819) Support setting CompressType in RocksDBStateBackend

2023-12-14 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17796992#comment-17796992 ] Hangxiang Yu commented on FLINK-33819: -- Linked FLINK-20684 as it has been discussed before. Linked 

[jira] [Resolved] (FLINK-33723) Disallow triggering incremental checkpoint explicitly from REST API

2023-12-13 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu resolved FLINK-33723. -- Resolution: Fixed merged 07d159bf into master > Disallow triggering incremental checkpoint

[jira] [Commented] (FLINK-26585) State Processor API: Loading a state set buffers the whole state set in memory before starting to process

2023-12-11 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17795627#comment-17795627 ] Hangxiang Yu commented on FLINK-26585: -- [~jingge] I saw 1.18.1 is releasing. Could this PR be

[jira] [Commented] (FLINK-26586) FileSystem uses unbuffered read I/O

2023-12-11 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17795577#comment-17795577 ] Hangxiang Yu commented on FLINK-26586: -- [~Matthias Schwalbe] Sure. Just feel free to contribute it.

[jira] [Assigned] (FLINK-26586) FileSystem uses unbuffered read I/O

2023-12-11 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu reassigned FLINK-26586: Assignee: Matthias Schwalbe > FileSystem uses unbuffered read I/O >

[jira] [Commented] (FLINK-33798) Automatically clean up rocksdb logs when the task failover.

2023-12-11 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17795576#comment-17795576 ] Hangxiang Yu commented on FLINK-33798: -- Thanks [~fanrui] pinging me here. I think you are right.

[jira] [Commented] (FLINK-27681) Improve the availability of Flink when the RocksDB file is corrupted.

2023-12-07 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17794190#comment-17794190 ] Hangxiang Yu commented on FLINK-27681: -- {quote}Yes, I think we don't need any extra protection for

[jira] [Commented] (FLINK-27681) Improve the availability of Flink when the RocksDB file is corrupted.

2023-12-05 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17793189#comment-17793189 ] Hangxiang Yu commented on FLINK-27681: -- Sorry for the late reply. {quote}However,  the job must

[jira] [Commented] (FLINK-27681) Improve the availability of Flink when the RocksDB file is corrupted.

2023-11-29 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17791409#comment-17791409 ] Hangxiang Yu commented on FLINK-27681: -- {quote}Fail job directly is fine for me, but I guess the PR

[jira] [Commented] (FLINK-33679) RestoreMode uses NO_CLAIM as default instead of LEGACY

2023-11-29 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33679?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17791403#comment-17791403 ] Hangxiang Yu commented on FLINK-33679: -- Hi, NO_CLAIM should be more production friendly than Legacy

[jira] [Comment Edited] (FLINK-27681) Improve the availability of Flink when the RocksDB file is corrupted.

2023-11-26 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17789903#comment-17789903 ] Hangxiang Yu edited comment on FLINK-27681 at 11/27/23 4:33 AM:

[jira] [Commented] (FLINK-27681) Improve the availability of Flink when the RocksDB file is corrupted.

2023-11-26 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17789903#comment-17789903 ] Hangxiang Yu commented on FLINK-27681: -- [~pnowojski] [~fanrui]  Thanks for joining in the

[jira] [Resolved] (FLINK-30235) Comprehensive benchmarks on changelog checkpointing

2023-11-19 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu resolved FLINK-30235. -- Fix Version/s: 1.17.0 Assignee: Rui Xia Resolution: Fixed Resolved this in

[jira] [Commented] (FLINK-18473) Optimize RocksDB disk load balancing strategy

2023-11-15 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17786602#comment-17786602 ] Hangxiang Yu commented on FLINK-18473: -- Thanks [~fanrui] for pinging me here. [~yigress] It should

[jira] [Resolved] (FLINK-26585) State Processor API: Loading a state set buffers the whole state set in memory before starting to process

2023-11-08 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu resolved FLINK-26585. -- Fix Version/s: 1.19.0 Resolution: Fixed merged eb4ae5d4 into master > State Processor

[jira] [Updated] (FLINK-33060) Fix the javadoc of ListState.update/addAll about not allowing null value

2023-11-07 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu updated FLINK-33060: - Fix Version/s: 1.19.0 > Fix the javadoc of ListState.update/addAll about not allowing null

[jira] [Resolved] (FLINK-33060) Fix the javadoc of ListState.update/addAll about not allowing null value

2023-11-07 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu resolved FLINK-33060. -- Resolution: Fixed merged e0240c78 into master. > Fix the javadoc of ListState.update/addAll

[jira] [Updated] (FLINK-33060) Fix the javadoc of ListState.update/addAll about not allowing null value

2023-11-07 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu updated FLINK-33060: - Component/s: Runtime / State Backends > Fix the javadoc of ListState.update/addAll about not

[jira] [Commented] (FLINK-33437) Flink 1.17 sink commited legacy Committable state, but it was not removed from state backend

2023-11-06 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17783134#comment-17783134 ] Hangxiang Yu commented on FLINK-33437: -- [~dyccode] Thanks for reporting this. Already assigned to

[jira] [Assigned] (FLINK-33437) Flink 1.17 sink commited legacy Committable state, but it was not removed from state backend

2023-11-06 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu reassigned FLINK-33437: Assignee: Yuchi Duan > Flink 1.17 sink commited legacy Committable state, but it was not

[jira] [Updated] (FLINK-5865) Throw original exception in states

2023-11-05 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-5865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu updated FLINK-5865: Fix Version/s: 1.19.0 > Throw original exception in states > -- >

[jira] [Resolved] (FLINK-5865) Throw original exception in states

2023-11-05 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-5865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu resolved FLINK-5865. - Resolution: Fixed merged cee2611e into master. About the [FLIP-368.

[jira] [Assigned] (FLINK-5865) Throw original exception in states

2023-11-05 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-5865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu reassigned FLINK-5865: --- Assignee: Zakelly Lan > Throw original exception in states >

[jira] [Commented] (FLINK-27681) Improve the availability of Flink when the RocksDB file is corrupted.

2023-11-02 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782014#comment-17782014 ] Hangxiang Yu commented on FLINK-27681: -- [~mayuehappy] Thanks for the reminder. I think it's doable.

[jira] [Assigned] (FLINK-27681) Improve the availability of Flink when the RocksDB file is corrupted.

2023-11-02 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu reassigned FLINK-27681: Assignee: Yue Ma > Improve the availability of Flink when the RocksDB file is corrupted.

[jira] [Resolved] (FLINK-33122) [Benchmark] Null checkpoint directory in rescaling benchmarks

2023-10-20 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu resolved FLINK-33122. -- Resolution: Fixed > [Benchmark] Null checkpoint directory in rescaling benchmarks >

[jira] [Updated] (FLINK-33122) [Benchmark] Null checkpoint directory in rescaling benchmarks

2023-10-20 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu updated FLINK-33122: - Fix Version/s: 1.19.0 > [Benchmark] Null checkpoint directory in rescaling benchmarks >

[jira] [Commented] (FLINK-33122) [Benchmark] Null checkpoint directory in rescaling benchmarks

2023-10-20 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1663#comment-1663 ] Hangxiang Yu commented on FLINK-33122: -- merged into master via ddaafee5 > [Benchmark] Null

[jira] [Updated] (FLINK-30863) Register local recovery files of changelog before notifyCheckpointComplete()

2023-10-20 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu updated FLINK-30863: - Fix Version/s: 1.19.0 > Register local recovery files of changelog before

[jira] [Assigned] (FLINK-33156) Remove flakiness from tests in OperatorStateBackendTest.java

2023-09-28 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu reassigned FLINK-33156: Assignee: Asha Boyapati > Remove flakiness from tests in OperatorStateBackendTest.java >

[jira] [Commented] (FLINK-26586) FileSystem uses unbuffered read I/O

2023-09-28 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17769942#comment-17769942 ] Hangxiang Yu commented on FLINK-26586: -- {quote} * it can not be configured (enabling/buffer

[jira] [Commented] (FLINK-33127) HeapKeyedStateBackend: use buffered I/O to speed up local recovery

2023-09-25 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17768610#comment-17768610 ] Hangxiang Yu commented on FLINK-33127: -- Actually I have taked a second review last month but not

[jira] [Commented] (FLINK-26585) State Processor API: Loading a state set buffers the whole state set in memory before starting to process

2023-09-25 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17768607#comment-17768607 ] Hangxiang Yu commented on FLINK-26585: -- [~Matthias Schwalbe] I have taked a second review last

[jira] [Commented] (FLINK-33127) HeapKeyedStateBackend: use buffered I/O to speed up local recovery

2023-09-24 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17768481#comment-17768481 ] Hangxiang Yu commented on FLINK-33127: -- IIUC, it's duplicated one with FLINK-26586 and FLINK-19911.

[jira] [Commented] (FLINK-33090) CheckpointsCleaner clean individual checkpoint states in parallel

2023-09-17 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17766182#comment-17766182 ] Hangxiang Yu commented on FLINK-33090: -- Sure. Thanks for the pr. I will take a look asap. >

[jira] [Assigned] (FLINK-33090) CheckpointsCleaner clean individual checkpoint states in parallel

2023-09-15 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu reassigned FLINK-33090: Assignee: Yi Zhang > CheckpointsCleaner clean individual checkpoint states in parallel >

[jira] [Commented] (FLINK-33090) CheckpointsCleaner clean individual checkpoint states in parallel

2023-09-14 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17765423#comment-17765423 ] Hangxiang Yu commented on FLINK-33090: -- Thanks for the proposal. We also saw related problem in

[jira] [Updated] (FLINK-32953) [State TTL]resolve data correctness problem after ttl was changed

2023-09-14 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu updated FLINK-32953: - Fix Version/s: 1.19.0 > [State TTL]resolve data correctness problem after ttl was changed >

[jira] [Commented] (FLINK-32953) [State TTL]resolve data correctness problem after ttl was changed

2023-09-14 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17765422#comment-17765422 ] Hangxiang Yu commented on FLINK-32953: -- merged 9a891f117c3a44a633316b84f9cbf2a541b80d11 into master

[jira] [Resolved] (FLINK-14032) Make the cache size of RocksDBPriorityQueueSetFactory configurable

2023-09-13 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu resolved FLINK-14032. -- Fix Version/s: 1.19.0 (was: 1.18.0) Resolution: Fixed merged

[jira] [Resolved] (FLINK-33034) Incorrect StateBackendTestBase#testGetKeysAndNamespaces

2023-09-12 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu resolved FLINK-33034. -- Fix Version/s: 1.19.0 Resolution: Fixed merged

[jira] [Updated] (FLINK-23411) Expose Flink checkpoint details metrics

2023-09-12 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu updated FLINK-23411: - Component/s: Runtime / Checkpointing > Expose Flink checkpoint details metrics >

[jira] [Commented] (FLINK-23411) Expose Flink checkpoint details metrics

2023-09-12 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17764477#comment-17764477 ] Hangxiang Yu commented on FLINK-23411: -- Thanks for the quick reply. {quote}Anyway, I think best way

[jira] [Commented] (FLINK-32953) [State TTL]resolve data correctness problem after ttl was changed

2023-09-12 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17764041#comment-17764041 ] Hangxiang Yu commented on FLINK-32953: -- [~lijinzhong] Thanks for the effort. As disscussed

[jira] [Commented] (FLINK-23411) Expose Flink checkpoint details metrics

2023-09-12 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17764038#comment-17764038 ] Hangxiang Yu commented on FLINK-23411: -- Hi, [~pnowojski] , Thanks for picking this up. I think it's

[jira] [Resolved] (FLINK-33055) Correct the error value about 'state.backend.type' in the document

2023-09-08 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu resolved FLINK-33055. -- Fix Version/s: 1.19.0 Resolution: Fixed merged

[jira] [Resolved] (FLINK-30217) Use ListState#update() to replace clear + add mode.

2023-09-07 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30217?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu resolved FLINK-30217. -- Fix Version/s: 1.19.0 Resolution: Fixed merged

[jira] [Commented] (FLINK-33055) Correct the error value about 'state.backend.type' in the document

2023-09-07 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762950#comment-17762950 ] Hangxiang Yu commented on FLINK-33055: -- [~lijinzhong] Thanks for volunteering, already assigned to

[jira] [Assigned] (FLINK-33055) Correct the error value about 'state.backend.type' in the document

2023-09-07 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu reassigned FLINK-33055: Assignee: Jinzhong Li > Correct the error value about 'state.backend.type' in the

[jira] [Resolved] (FLINK-15922) Show "Warn - received late message for checkpoint" only when checkpoint actually expired

2023-09-07 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu resolved FLINK-15922. -- Fix Version/s: 1.19.0 Resolution: Fixed merged

[jira] [Commented] (FLINK-33057) Add options to disable creating job-id subdirectories under the checkpoint directory

2023-09-07 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762627#comment-17762627 ] Hangxiang Yu commented on FLINK-33057: -- Thanks for picking this up. +1 for introducing such an

[jira] [Comment Edited] (FLINK-9631) use Files.createDirectories instead of directory.mkdirs

2023-09-07 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-9631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762601#comment-17762601 ] Hangxiang Yu edited comment on FLINK-9631 at 9/7/23 7:51 AM: - [~zhangyy91]

[jira] [Assigned] (FLINK-9631) use Files.createDirectories instead of directory.mkdirs

2023-09-07 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-9631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu reassigned FLINK-9631: --- Assignee: Yangyang ZHANG > use Files.createDirectories instead of directory.mkdirs >

[jira] [Commented] (FLINK-9631) use Files.createDirectories instead of directory.mkdirs

2023-09-07 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-9631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762601#comment-17762601 ] Hangxiang Yu commented on FLINK-9631: - Thanks for picking this up. Already assigned to you, please

[jira] [Commented] (FLINK-31685) Checkpoint job folder not deleted after job is cancelled

2023-09-07 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17762597#comment-17762597 ] Hangxiang Yu commented on FLINK-31685: -- [~Zakelly]  This makes sense to me.

[jira] [Updated] (FLINK-33055) Correct the error value about 'state.backend.type' in the document

2023-09-07 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu updated FLINK-33055: - Description:   {code:java} state.backend.type: The state backend to use. This defines the data

[jira] [Created] (FLINK-33055) Correct the error value about 'state.backend.type' in the document

2023-09-07 Thread Hangxiang Yu (Jira)
Hangxiang Yu created FLINK-33055: Summary: Correct the error value about 'state.backend.type' in the document Key: FLINK-33055 URL: https://issues.apache.org/jira/browse/FLINK-33055 Project: Flink

[jira] [Assigned] (FLINK-15922) Show "Warn - received late message for checkpoint" only when checkpoint actually expired

2023-09-06 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu reassigned FLINK-15922: Assignee: Zakelly Lan > Show "Warn - received late message for checkpoint" only when

[jira] [Resolved] (FLINK-5279) Improve error message when trying to access keyed state in non-keyed operator

2023-09-06 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-5279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu resolved FLINK-5279. - Fix Version/s: 1.19.0 Resolution: Fixed merged 7b6243bb0ba55aafad1ca5a17bc457d229763433

[jira] [Updated] (FLINK-32523) NotifyCheckpointAbortedITCase.testNotifyCheckpointAborted fails with timeout on AZP

2023-08-31 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu updated FLINK-32523: - Fix Version/s: 1.16.3 1.17.2 >

[jira] [Updated] (FLINK-32523) NotifyCheckpointAbortedITCase.testNotifyCheckpointAborted fails with timeout on AZP

2023-08-31 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu updated FLINK-32523: - Affects Version/s: 1.17.1 > NotifyCheckpointAbortedITCase.testNotifyCheckpointAborted fails

[jira] [Commented] (FLINK-32523) NotifyCheckpointAbortedITCase.testNotifyCheckpointAborted fails with timeout on AZP

2023-08-31 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17760847#comment-17760847 ] Hangxiang Yu commented on FLINK-32523: -- picked 66cc21d4e2c091c0f5211bf558d1a69364519f9b and merged

[jira] [Resolved] (FLINK-32975) Enhance equal() for all MapState's iterator

2023-08-30 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hangxiang Yu resolved FLINK-32975. -- Fix Version/s: 1.19.0 Resolution: Fixed merge

[jira] [Commented] (FLINK-32963) Make the test "testKeyedMapStateStateMigration" stable

2023-08-30 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17760699#comment-17760699 ] Hangxiang Yu commented on FLINK-32963: -- This is just a simple improvement to make this UT case more

[jira] [Commented] (FLINK-32523) NotifyCheckpointAbortedITCase.testNotifyCheckpointAborted fails with timeout on AZP

2023-08-30 Thread Hangxiang Yu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17760695#comment-17760695 ] Hangxiang Yu commented on FLINK-32523: -- [~mapohl] Thanks for the reminder. I will merge them into

<    1   2   3   4   5   >