[jira] [Commented] (FLINK-25315) Add new extensions and classes to help the JUnit5 migration

2022-06-28 Thread Yun Tang (Jira)
Title: Message Title Yun Tang commented

[jira] [Commented] (FLINK-28206) EOFException on Checkpoint Recovery

2022-06-28 Thread Yun Tang (Jira)
Title: Message Title Yun Tang commented

[jira] [Commented] (FLINK-24932) Frocksdb cannot run on Apple M1

2022-06-28 Thread Yun Tang (Jira)
Title: Message Title Yun Tang commented

[jira] [Commented] (FLINK-24932) Frocksdb cannot run on Apple M1

2022-06-28 Thread Yun Tang (Jira)
Title: Message Title Yun Tang commented

[jira] [Commented] (FLINK-28178) Show the delegated StateBackend and whether changelog is enabled in the UI

2022-06-28 Thread Yun Tang (Jira)
Title: Message Title Yun Tang commented

[jira] [Updated] (FLINK-28178) Show the delegated StateBackend and whether changelog is enabled in the UI

2022-06-28 Thread Yun Tang (Jira)
Title: Message Title Yun Tang updated an

[jira] [Assigned] (FLINK-28178) Show the delegated StateBackend and whether changelog is enabled in the UI

2022-06-28 Thread Yun Tang (Jira)
Title: Message Title Yun Tang assigned an

[jira] [Commented] (FLINK-28178) Show the delegated StateBackend and whether changelog is enabled in the UI

2022-06-27 Thread Yun Tang (Jira)
Title: Message Title Yun Tang commented

[jira] [Assigned] (FLINK-27941) [JUnit5 Migration] Module: flink-connector-kinesis

2022-06-27 Thread Yun Tang (Jira)
Title: Message Title Yun Tang assigned an

[jira] [Resolved] (FLINK-16078) Translate "Tuning Checkpoints and Large State" page into Chinese

2022-06-25 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-16078. -- Resolution: Fixed merged in master: f9ba9d10f53515d904680327ea4bbd07a9e3bfab > Translate "Tuning

[jira] [Assigned] (FLINK-27939) [JUnit5 Migration] Module: flink-connector-hive

2022-06-24 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-27939: Assignee: Yuan Kui (was: yuankui) > [JUnit5 Migration] Module: flink-connector-hive >

[jira] [Assigned] (FLINK-27885) [JUnit5 Migration] Module: flink-csv

2022-06-24 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-27885: Assignee: (was: Yuan Kui) > [JUnit5 Migration] Module: flink-csv >

[jira] [Assigned] (FLINK-27885) [JUnit5 Migration] Module: flink-csv

2022-06-24 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-27885: Assignee: Yuan Kui > [JUnit5 Migration] Module: flink-csv >

[jira] [Assigned] (FLINK-27939) [JUnit5 Migration] Module: flink-connector-hive

2022-06-24 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-27939: Assignee: yuankui > [JUnit5 Migration] Module: flink-connector-hive >

[jira] [Commented] (FLINK-28206) EOFException on Checkpoint Recovery

2022-06-23 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558290#comment-17558290 ] Yun Tang commented on FLINK-28206: -- [~chenya_zhang] I don't think your problem is the same as this

[jira] [Commented] (FLINK-16686) [State TTL] Make user class loader available in native RocksDB compaction thread

2022-06-23 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17558028#comment-17558028 ] Yun Tang commented on FLINK-16686: -- [~asardaes] The RocksDB version is different between Flink-1.13 and

[jira] [Commented] (FLINK-24932) Frocksdb cannot run on Apple M1

2022-06-23 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17557966#comment-17557966 ] Yun Tang commented on FLINK-24932: -- If you really build the new FRocksDB from

[jira] [Closed] (FLINK-27879) Translate the "Documentation Style Guide" page into Chinese

2022-06-20 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-27879. Resolution: Fixed merged in flink-web: 17ea48f8883f72d9323c8e05776cd292e90d2611 > Translate the

[jira] [Updated] (FLINK-27734) Not showing checkpoint interval properly in WebUI when checkpoint is disabled

2022-06-20 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-27734: - Fix Version/s: 1.15.1 > Not showing checkpoint interval properly in WebUI when checkpoint is disabled

[jira] [Commented] (FLINK-27734) Not showing checkpoint interval properly in WebUI when checkpoint is disabled

2022-06-20 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17556232#comment-17556232 ] Yun Tang commented on FLINK-27734: -- merged in release-1.15: efee7405c3acf54bf2cc79b676cb881ac5f2c362 >

[jira] [Commented] (FLINK-16686) [State TTL] Make user class loader available in native RocksDB compaction thread

2022-06-16 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17555357#comment-17555357 ] Yun Tang commented on FLINK-16686: -- [~asardaes] To be honest, I am not sure whether a customized

[jira] [Commented] (FLINK-24932) Frocksdb cannot run on Apple M1

2022-06-15 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554575#comment-17554575 ] Yun Tang commented on FLINK-24932: -- [~smattheis] What's the progress now? > Frocksdb cannot run on

[jira] [Commented] (FLINK-28032) Checkpointing hangs and times out with some jobs

2022-06-15 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554392#comment-17554392 ] Yun Tang commented on FLINK-28032: -- [~pgandhijr] First of all, thanks for using Apache Flink and

[jira] [Commented] (FLINK-28065) A never reached code in ProcessMemoryUtils Class

2022-06-15 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554393#comment-17554393 ] Yun Tang commented on FLINK-28065: -- [~Tomm] already assigned to you, please go ahead. > A never

[jira] [Assigned] (FLINK-28065) A never reached code in ProcessMemoryUtils Class

2022-06-15 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-28065: Assignee: zhuyufeng > A never reached code in ProcessMemoryUtils Class >

[jira] [Assigned] (FLINK-28057) LD_PRELOAD is hardcoded to x64 on flink-docker

2022-06-14 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-28057: Assignee: Nicolas Ferrario > LD_PRELOAD is hardcoded to x64 on flink-docker >

[jira] [Commented] (FLINK-28057) LD_PRELOAD is hardcoded to x64 on flink-docker

2022-06-14 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554383#comment-17554383 ] Yun Tang commented on FLINK-28057: -- Thanks for the information [~chesnay]. [~nferrario] I have already

[jira] [Commented] (FLINK-16686) [State TTL] Make user class loader available in native RocksDB compaction thread

2022-06-14 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554381#comment-17554381 ] Yun Tang commented on FLINK-16686: -- [~asardaes] If I remember correctly, the problem would disappear if

[jira] [Commented] (FLINK-27734) Not showing checkpoint interval properly in WebUI when checkpoint is disabled

2022-06-14 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554378#comment-17554378 ] Yun Tang commented on FLINK-27734: -- [~Feifan Wang] I think it deserves to merge to release-1.15.

[jira] [Commented] (FLINK-28057) LD_PRELOAD is hardcoded to x64 on flink-docker

2022-06-14 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17554106#comment-17554106 ] Yun Tang commented on FLINK-28057: -- Thanks for creating this issue. Flink seems do not have official

[jira] [Closed] (FLINK-28032) Checkpointing hangs and times out with some jobs

2022-06-14 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-28032. Resolution: Information Provided The thread dump on taskmanager does not have a good format for people to

[jira] [Closed] (FLINK-28029) Checkpoint always hangs when running some jobs

2022-06-13 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-28029. Resolution: Duplicate > Checkpoint always hangs when running some jobs >

[jira] [Closed] (FLINK-28030) Checkpoint always hangs when running some jobs

2022-06-13 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-28030. Resolution: Duplicate > Checkpoint always hangs when running some jobs >

[jira] [Closed] (FLINK-28031) Checkpoint always hangs when running some jobs

2022-06-13 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-28031. Resolution: Duplicate > Checkpoint always hangs when running some jobs >

[jira] [Resolved] (FLINK-27734) Not showing checkpoint interval properly in WebUI when checkpoint is disabled

2022-06-10 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-27734. -- Assignee: Feifan Wang Resolution: Fixed merged in master:

[jira] [Updated] (FLINK-27734) Not showing checkpoint interval properly in WebUI when checkpoint is disabled

2022-06-10 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-27734: - Fix Version/s: 1.16.0 > Not showing checkpoint interval properly in WebUI when checkpoint is disabled

[jira] [Commented] (FLINK-23721) Flink SQL state TTL has no effect when using non-incremental RocksDBStateBackend

2022-06-05 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17550260#comment-17550260 ] Yun Tang commented on FLINK-23721: -- [~xiaokunBit], the managed memory is fully used as you use RocksDB

[jira] [Comment Edited] (FLINK-24932) Frocksdb cannot run on Apple M1

2022-06-05 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17550259#comment-17550259 ] Yun Tang edited comment on FLINK-24932 at 6/6/22 1:54 AM: -- [~smattheis] Would

[jira] [Commented] (FLINK-24932) Frocksdb cannot run on Apple M1

2022-06-05 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17550259#comment-17550259 ] Yun Tang commented on FLINK-24932: -- Would you mind to share something related to performance changes

[jira] [Commented] (FLINK-24932) Frocksdb cannot run on Apple M1

2022-06-01 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17544937#comment-17544937 ] Yun Tang commented on FLINK-24932: -- [~maver1ck] I think you can refer to

[jira] [Commented] (FLINK-27841) RocksDB cache miss increase in 1.15

2022-06-01 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17544932#comment-17544932 ] Yun Tang commented on FLINK-27841: -- [~Feifan Wang] The cache miss should be related with the frequency

[jira] [Closed] (FLINK-27504) State compaction not happening with sliding window and incremental RocksDB backend

2022-05-20 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-27504. Resolution: Information Provided > State compaction not happening with sliding window and incremental

[jira] [Commented] (FLINK-27504) State compaction not happening with sliding window and incremental RocksDB backend

2022-05-20 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17539944#comment-17539944 ] Yun Tang commented on FLINK-27504: -- [~asardaes], one specific round of compaction is just for one

[jira] [Commented] (FLINK-27504) State compaction not happening with sliding window and incremental RocksDB backend

2022-05-18 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17539200#comment-17539200 ] Yun Tang commented on FLINK-27504: -- [~asardaes] I have already repiled to you in the mail. I will close

[jira] [Commented] (FLINK-27504) State compaction not happening with sliding window and incremental RocksDB backend

2022-05-16 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17537383#comment-17537383 ] Yun Tang commented on FLINK-27504: -- If most key-values are expired, the output of compaction would be

[jira] [Resolved] (FLINK-27260) Expose changelog configuration in RestAPI and WebUI

2022-05-11 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-27260. -- Fix Version/s: 1.16.0 Assignee: Yanfei Lei Resolution: Fixed merged in master:

[jira] [Commented] (FLINK-27504) State compaction not happening with sliding window and incremental RocksDB backend

2022-05-09 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17534105#comment-17534105 ] Yun Tang commented on FLINK-27504: -- I think you'd better to read RocksDB docs on compaction to know how

[jira] [Closed] (FLINK-27559) Some question about flink operator state

2022-05-09 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-27559. Resolution: Information Provided > Some question about flink operator state >

[jira] [Commented] (FLINK-27559) Some question about flink operator state

2022-05-09 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17534103#comment-17534103 ] Yun Tang commented on FLINK-27559: -- [~Underwood] Flink's JIRA is not a place to ask questions, please

[jira] [Commented] (FLINK-27504) State compaction not happening with sliding window and incremental RocksDB backend

2022-05-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17533593#comment-17533593 ] Yun Tang commented on FLINK-27504: -- First of all, the compaction frequecny of RocksDB is not related to

[jira] [Created] (FLINK-27531) Add explict doc on data consistency problem of RocksDB's map state iterator

2022-05-06 Thread Yun Tang (Jira)
Yun Tang created FLINK-27531: Summary: Add explict doc on data consistency problem of RocksDB's map state iterator Key: FLINK-27531 URL: https://issues.apache.org/jira/browse/FLINK-27531 Project: Flink

[jira] [Resolved] (FLINK-26052) Update chinese documentation regarding FLIP-203

2022-05-06 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-26052. -- Fix Version/s: 1.16.0 1.15.1 Resolution: Fixed merged in master:

[jira] [Assigned] (FLINK-27433) E2E log artifacts contain several thousand rocksdb logs

2022-04-28 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-27433: Assignee: Yun Tang > E2E log artifacts contain several thousand rocksdb logs >

[jira] [Commented] (FLINK-27433) E2E log artifacts contain several thousand rocksdb logs

2022-04-27 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17529174#comment-17529174 ] Yun Tang commented on FLINK-27433: -- This is caused by FLINK-24785 and FLINK-26998. We moved the logs of

[jira] [Resolved] (FLINK-23252) Support recovery (from checkpoints) after disabling changelog backend

2022-04-25 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-23252. -- Resolution: Fixed merged in master: 7b48eae6b448963e0aed2b33d06e105311a48e05 and

[jira] [Commented] (FLINK-27155) Reduce multiple reads to the same Changelog file in the same taskmanager during restore

2022-04-23 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17526973#comment-17526973 ] Yun Tang commented on FLINK-27155: -- > I think Yun Tang means waiting for all task of a TM to switch

[jira] [Commented] (FLINK-27155) Reduce multiple reads to the same Changelog file in the same taskmanager during restore

2022-04-22 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17526258#comment-17526258 ] Yun Tang commented on FLINK-27155: -- >From my experiences, serializing the acesses to the same file coud

[jira] [Updated] (FLINK-27315) Fix the demo of MemoryStateBackendMigration

2022-04-20 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-27315: - Summary: Fix the demo of MemoryStateBackendMigration (was: [docs] Fix the demo of

[jira] [Resolved] (FLINK-27315) [docs] Fix the demo of MemoryStateBackendMigration

2022-04-20 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-27315. -- Fix Version/s: 1.16.0 1.14.5 Resolution: Fixed merged in master:

[jira] [Commented] (FLINK-27332) org.apache.flink.streaming.api.functions.sink.filesystem.Bucket can't receive completion notification for savepoint

2022-04-20 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17525392#comment-17525392 ] Yun Tang commented on FLINK-27332: -- This is by design, which is introduced by FLINK-25191. And you can

[jira] [Closed] (FLINK-27332) org.apache.flink.streaming.api.functions.sink.filesystem.Bucket can't receive completion notification for savepoint

2022-04-20 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-27332. Resolution: Information Provided > org.apache.flink.streaming.api.functions.sink.filesystem.Bucket can't

[jira] [Assigned] (FLINK-27327) Add description about changing max parallelism explicitly leads to state incompatibility

2022-04-20 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-27327: Assignee: Hangxiang Yu > Add description about changing max parallelism explicitly leads to

[jira] [Commented] (FLINK-25470) Add/Expose/Differentiate metrics of checkpoint size between changelog size vs materialization size

2022-04-20 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17524854#comment-17524854 ] Yun Tang commented on FLINK-25470: -- [~masteryhx] Already assigned to you. > Add/Expose/Differentiate

[jira] [Assigned] (FLINK-25470) Add/Expose/Differentiate metrics of checkpoint size between changelog size vs materialization size

2022-04-20 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-25470: Assignee: Hangxiang Yu > Add/Expose/Differentiate metrics of checkpoint size between changelog

[jira] [Commented] (FLINK-27311) Rocksdb mapstate behaves unexpectedly

2022-04-19 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17524691#comment-17524691 ] Yun Tang commented on FLINK-27311: -- [~JonathanDiamant] , what do you mean for {{"it seems that not all

[jira] [Commented] (FLINK-27315) Fix the demo of MemoryStateBackendMigration

2022-04-19 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17524677#comment-17524677 ] Yun Tang commented on FLINK-27315: -- [~Echo Lee]  Thanks for creating this ticket, already assigned to

[jira] [Assigned] (FLINK-27315) Fix the demo of MemoryStateBackendMigration

2022-04-19 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-27315: Assignee: Echo Lee > Fix the demo of MemoryStateBackendMigration >

[jira] [Resolved] (FLINK-27278) Fix wrong indentation in doc dev/datastream/operators/windows.md

2022-04-19 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-27278. -- Fix Version/s: 1.16.0 Resolution: Fixed merged in master:

[jira] [Commented] (FLINK-25470) Add/Expose/Differentiate metrics of checkpoint size between changelog size vs materialization size

2022-04-18 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17524033#comment-17524033 ] Yun Tang commented on FLINK-25470: -- I think the incremental size of materialization part is something

[jira] [Resolved] (FLINK-25867) [ZH] Add ChangelogBackend documentation

2022-04-18 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-25867. -- Fix Version/s: 1.15.0 Resolution: Fixed Merged in master:

[jira] [Updated] (FLINK-27295) UnalignedCheckpointITCase failed due to OperatorCoordinatorHolder cannot mark checkpoint

2022-04-18 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-27295: - Description:   {code:java} 09:17:42,931 [flink-akka.actor.default-dispatcher-9] INFO

[jira] [Created] (FLINK-27295) UnalignedCheckpointITCase failed due to OperatorCoordinatorHolder cannot mark checkpoint

2022-04-18 Thread Yun Tang (Jira)
Yun Tang created FLINK-27295: Summary: UnalignedCheckpointITCase failed due to OperatorCoordinatorHolder cannot mark checkpoint Key: FLINK-27295 URL: https://issues.apache.org/jira/browse/FLINK-27295

[jira] [Assigned] (FLINK-27278) Fix wrong indentation in doc dev/datastream/operators/windows.md

2022-04-18 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-27278: Assignee: Mingliang Liu > Fix wrong indentation in doc dev/datastream/operators/windows.md >

[jira] [Commented] (FLINK-27218) Serializer in OperatorState has not been updated when new Serializers are NOT incompatible

2022-04-17 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17523488#comment-17523488 ] Yun Tang commented on FLINK-27218: -- [~mayuehappy] Already assigned to you, please go ahead. >

[jira] [Assigned] (FLINK-27218) Serializer in OperatorState has not been updated when new Serializers are NOT incompatible

2022-04-17 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-27218: Assignee: Yue Ma > Serializer in OperatorState has not been updated when new Serializers are NOT

[jira] [Commented] (FLINK-27218) Serializer in OperatorState has not been updated when new Serializers are NOT incompatible

2022-04-14 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27218?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522634#comment-17522634 ] Yun Tang commented on FLINK-27218: -- [~mayuehappy] I think you're right, this would affect the

[jira] [Commented] (FLINK-24932) Frocksdb cannot run on Apple M1

2022-04-14 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17522624#comment-17522624 ] Yun Tang commented on FLINK-24932: -- [~maver1ck] Thanks for your information. We actually always watch

[jira] [Resolved] (FLINK-27214) Build Failed on state backend benchmark

2022-04-14 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-27214. -- Resolution: Fixed Merged in flink-benchmark master: 989e4fae452ecdd3c749d9f4493c34e63e0c41c2 > Build

[jira] [Assigned] (FLINK-27214) Build Failed on state backend benchmark

2022-04-13 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-27214: Assignee: Yanfei Lei > Build Failed on state backend benchmark >

[jira] [Commented] (FLINK-27214) Build Failed on state backend benchmark

2022-04-13 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17521509#comment-17521509 ] Yun Tang commented on FLINK-27214: -- I think the direct cause is chaning from {{Level.Invocation}} to

[jira] [Commented] (FLINK-27101) Periodically break the chain of incremental checkpoint

2022-04-12 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17521426#comment-17521426 ] Yun Tang commented on FLINK-27101: -- Just like the factory of checkpoint store, from my mind, we can

[jira] [Commented] (FLINK-27205) Translate "Concepts -> Glossary" page into Chinese

2022-04-12 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17521424#comment-17521424 ] Yun Tang commented on FLINK-27205: -- [~liu zhuang] Already assigned to you, please go ahead. >

[jira] [Assigned] (FLINK-27205) Translate "Concepts -> Glossary" page into Chinese

2022-04-12 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-27205: Assignee: Zhuang Liu > Translate "Concepts -> Glossary" page into Chinese >

[jira] [Updated] (FLINK-27205) Translate "Concepts -> Glossary" page into Chinese

2022-04-12 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-27205: - Fix Version/s: (was: 1.15.0) > Translate "Concepts -> Glossary" page into Chinese >

[jira] [Assigned] (FLINK-25872) Restoring from non-changelog checkpoint with changelog state-backend enabled in CLAIM mode discards state in use

2022-04-12 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-25872: Assignee: Yanfei Lei > Restoring from non-changelog checkpoint with changelog state-backend

[jira] [Resolved] (FLINK-26757) change the default value of state.backend.rocksdb.restore-overlap-fraction-threshold

2022-04-11 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-26757. -- Resolution: Fixed merged in master: 4034d3cd6d13e88e2e5ca101510bf333e94a53fa > change the default

[jira] [Updated] (FLINK-26757) change the default value of state.backend.rocksdb.restore-overlap-fraction-threshold

2022-04-11 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-26757: - Fix Version/s: 1.16.0 > change the default value of >

[jira] [Resolved] (FLINK-23399) Add a performance benchmark for statebackend rescaling

2022-04-11 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-23399. -- Resolution: Fixed Merged in flink-benchmarks repo: 57cc8064db4a9f934f77a5fa5038712cb01e5183 > Add a

[jira] [Commented] (FLINK-27101) Periodically break the chain of incremental checkpoint

2022-04-11 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17520387#comment-17520387 ] Yun Tang commented on FLINK-27101: -- I think the root cause to ask for this feature is because you want

[jira] [Resolved] (FLINK-26852) RocksDBMapState#clear not forwarding exceptions

2022-04-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-26852. -- Fix Version/s: 1.16.0 Resolution: Fixed merged in master:

[jira] [Assigned] (FLINK-16078) Translate "Tuning Checkpoints and Large State" page into Chinese

2022-04-06 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-16078: Assignee: Zhuang Liu > Translate "Tuning Checkpoints and Large State" page into Chinese >

[jira] [Commented] (FLINK-16078) Translate "Tuning Checkpoints and Large State" page into Chinese

2022-04-06 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17517865#comment-17517865 ] Yun Tang commented on FLINK-16078: -- [~liu zhuang], already assigned this ticket to you, please go

[jira] [Resolved] (FLINK-14998) Remove FileUtils#deletePathIfEmpty

2022-04-03 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-14998. -- Resolution: Fixed merged in master: 5f21d15a0937c1ab438a863b59aa9ac113efeeca > Remove

[jira] [Resolved] (FLINK-26998) Remove log-related configuration from predefined options in RocksDB state backend

2022-04-03 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-26998. -- Resolution: Fixed merged in master: 428bb6584ff867e5b121185fac604f71ad0afbdd release-1.15:

[jira] [Resolved] (FLINK-26738) Default value of StateDescriptor is valid when enable state ttl config

2022-04-02 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-26738. -- Fix Version/s: 1.15.0 1.16.0 1.14.5 Resolution: Fixed

[jira] [Commented] (FLINK-26515) RetryingExecutorTest.testTimeout failed on azure

2022-04-02 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17516237#comment-17516237 ] Yun Tang commented on FLINK-26515: -- Another instance

[jira] [Assigned] (FLINK-26998) Remove log-related configuration from predefined options in RocksDB state backend

2022-04-01 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-26998: Assignee: Zakelly Lan > Remove log-related configuration from predefined options in RocksDB

[jira] [Updated] (FLINK-26998) Remove log-related configuration from predefined options in RocksDB state backend

2022-04-01 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-26998: - Fix Version/s: 1.16.0 > Remove log-related configuration from predefined options in RocksDB state >

[jira] [Commented] (FLINK-23399) Add a performance benchmark for statebackend rescaling

2022-04-01 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17515858#comment-17515858 ] Yun Tang commented on FLINK-23399: -- The benchmark code in flink repo merged in master:

[jira] [Updated] (FLINK-26985) With legacy restore mode, incremantal checkpoints would be deleted by mistake

2022-04-01 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-26985: - Description: Before flink-1.15, the restored checkpoint would be regsiterd and not discard on subsume,

<    1   2   3   4   5   6   7   8   9   10   >