[jira] [Commented] (FLINK-31133) PartiallyFinishedSourcesITCase hangs if a checkpoint fails

2023-03-02 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695540#comment-17695540 ] Yu Li commented on FLINK-31133: --- Thanks for the quick action [~roman] > PartiallyFinishedSourcesITCase

[jira] [Commented] (FLINK-31133) PartiallyFinishedSourcesITCase hangs if a checkpoint fails

2023-03-01 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17695501#comment-17695501 ] Yu Li commented on FLINK-31133: --- The 1.15.4 version is about to release with [RC under

[jira] [Comment Edited] (FLINK-28910) CDC From Mysql To Hbase Bugs

2022-09-07 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601628#comment-17601628 ] Yu Li edited comment on FLINK-28910 at 9/8/22 4:47 AM: --- >From my point of view, a

[jira] [Commented] (FLINK-28910) CDC From Mysql To Hbase Bugs

2022-09-07 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17601628#comment-17601628 ] Yu Li commented on FLINK-28910: --- >From my point of view, a better solution is to facilitate the atomic

[jira] [Updated] (FLINK-27655) Implement Avro File statistic collector

2022-08-24 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-27655: -- Component/s: Table Store > Implement Avro File statistic collector > ---

[jira] [Updated] (FLINK-27517) Introduce rolling file writer to write one record each time for append-only table.

2022-08-24 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-27517: -- Component/s: Table Store > Introduce rolling file writer to write one record each time for append-only >

[jira] [Updated] (FLINK-27546) Add append only writer which implements the RecordWriter interface.

2022-08-24 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-27546: -- Component/s: Table Store > Add append only writer which implements the RecordWriter interface. >

[jira] [Updated] (FLINK-27580) Implement filter pushdown for TableStoreHiveStorageHandler

2022-08-24 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-27580: -- Component/s: Table Store > Implement filter pushdown for TableStoreHiveStorageHandler >

[jira] [Updated] (FLINK-27656) Add parquet file format

2022-08-24 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-27656: -- Component/s: Table Store > Add parquet file format > > > Key:

[jira] [Updated] (FLINK-27706) Refactor all subclasses of FileStoreTableITCase to use the batchSql.

2022-08-24 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-27706: -- Component/s: Table Store > Refactor all subclasses of FileStoreTableITCase to use the batchSql. >

[jira] [Updated] (FLINK-27696) Add bin-pack strategy to split the whole bucket data files into several small splits

2022-08-24 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-27696: -- Component/s: Table Store > Add bin-pack strategy to split the whole bucket data files into several small >

[jira] [Updated] (FLINK-27678) Support append-only table for file store.

2022-08-24 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-27678: -- Component/s: Table Store > Support append-only table for file store. >

[jira] [Updated] (FLINK-27708) Add background compaction task for append-only table when ingesting.

2022-08-24 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-27708: -- Component/s: Table Store > Add background compaction task for append-only table when ingesting. >

[jira] [Commented] (FLINK-12005) [State TTL] Event time support

2022-01-09 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17471675#comment-17471675 ] Yu Li commented on FLINK-12005: --- Update the ML discussion link for better history tracking > [State TTL]

[jira] [Updated] (FLINK-25317) ApplicationDispatcherBootstrapITCase blocked on azure

2021-12-15 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-25317: -- Fix Version/s: 1.14.3 (was: 1.14.2) > ApplicationDispatcherBootstrapITCase blocked on

[jira] [Commented] (FLINK-20044) Disposal of RocksDB could last forever

2021-11-01 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17436637#comment-17436637 ] Yu Li commented on FLINK-20044: --- Thanks for the quick response [~wind_ljy]. Sure, let's keep watching. >

[jira] [Commented] (FLINK-20044) Disposal of RocksDB could last forever

2021-10-31 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17436616#comment-17436616 ] Yu Li commented on FLINK-20044: --- [~wind_ljy] are we still observing the same issue in product environment?

[jira] [Commented] (FLINK-21321) Change RocksDB incremental checkpoint re-scaling to use deleteRange

2021-10-31 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17436506#comment-17436506 ] Yu Li commented on FLINK-21321: --- Since we've upgraded FRocksDB version to 6.20.3 in 1.14, it's possible to

[jira] [Assigned] (FLINK-24475) Remove no longer used NestedMap* classes

2021-10-08 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li reassigned FLINK-24475: - Assignee: Zakelly Lan Thanks for creating the ticket [~pnowojski], and yes this is some consensus

[jira] [Updated] (FLINK-23791) Enable RocksDB log again

2021-08-30 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-23791: -- Fix Version/s: 1.15.0 > Enable RocksDB log again > > > Key:

[jira] [Commented] (FLINK-13448) Support ARM architecture

2021-08-29 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17406553#comment-17406553 ] Yu Li commented on FLINK-13448: --- Thanks for the feedback [~wangxiyuan], and thanks for analyzing the root

[jira] [Updated] (FLINK-19303) Disable WAL in RocksDB recovery

2021-08-26 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-19303: -- Labels: (was: auto-deprioritized-major auto-unassigned) > Disable WAL in RocksDB recovery >

[jira] [Assigned] (FLINK-19303) Disable WAL in RocksDB recovery

2021-08-26 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li reassigned FLINK-19303: - Assignee: Juha Mynttinen Thanks [~juha.mynttinen], I've assigned the JIRA back to you. > Disable WAL

[jira] [Commented] (FLINK-13448) Support ARM architecture

2021-08-16 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400124#comment-17400124 ] Yu Li commented on FLINK-13448: --- [~sewen] [~wangxiyuan] From the already created sub-tasks and status, it

[jira] [Commented] (FLINK-13652) Setup instructions for creating an ARM environment

2021-08-16 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17400120#comment-17400120 ] Yu Li commented on FLINK-13652: --- Ok, maybe I'm a little bit too optimistic about the progress, and I agree

[jira] [Assigned] (FLINK-14086) PrometheusReporterEndToEndITCase doesn't support ARM arch

2021-08-16 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li reassigned FLINK-14086: - Assignee: wangxiyuan > PrometheusReporterEndToEndITCase doesn't support ARM arch >

[jira] [Commented] (FLINK-13652) Setup instructions for creating an ARM environment

2021-08-16 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17399570#comment-17399570 ] Yu Li commented on FLINK-13652: --- [~autophagy] [~chesnay] This seems to be the only sub-task left for ARM

[jira] [Updated] (FLINK-14482) Bump up rocksdb version

2021-08-16 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-14482: -- Labels: pull-request-available (was: auto-deprioritized-major auto-unassigned pull-request-available)

[jira] [Commented] (FLINK-19303) Disable WAL in RocksDB recovery

2021-08-16 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17399543#comment-17399543 ] Yu Li commented on FLINK-19303: --- [~juha.mynttinen] Since we've already upgraded FRocksDB version to

[jira] [Updated] (FLINK-15532) Enable strict capacity limit for memory usage for RocksDB

2021-08-16 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-15532: -- Labels: pull-request-available (was: auto-deprioritized-major auto-unassigned pull-request-available)

[jira] [Updated] (FLINK-19710) Fix performance regression to rebase FRocksDB with higher version RocksDB

2021-08-15 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-19710: -- Labels: (was: auto-deprioritized-major auto-unassigned) Priority: Major (was: Minor) > Fix

[jira] [Comment Edited] (FLINK-14482) Bump up rocksdb version

2021-08-15 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17399497#comment-17399497 ] Yu Li edited comment on FLINK-14482 at 8/16/21, 4:39 AM: - Uploading the

[jira] [Commented] (FLINK-14482) Bump up rocksdb version

2021-08-15 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17399497#comment-17399497 ] Yu Li commented on FLINK-14482: --- Uploading the screenshot of micro-benchmark performance regression since

[jira] [Updated] (FLINK-14482) Bump up rocksdb version

2021-08-15 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-14482: -- Attachment: Screenshot-for-perf-regression-after-FRocksDB-upgrade-2.png > Bump up rocksdb version >

[jira] [Updated] (FLINK-14482) Bump up rocksdb version

2021-08-15 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-14482: -- Attachment: Screenshot-for-perf-regression-after-FRocksDB-upgrade-1.png > Bump up rocksdb version >

[jira] [Commented] (FLINK-23756) Release FRocksDB-6.20.3 binaries

2021-08-15 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17399493#comment-17399493 ] Yu Li commented on FLINK-23756: --- [~autophagy] Thanks for the efforts! How about the progress of the

[jira] [Updated] (FLINK-23577) CoordinatedSourceRescaleITCase.testUpscaling fails with NoSuchFileException

2021-08-02 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-23577: -- Fix Version/s: (was: 1.12.5) 1.12.6 Moved out of 1.12.5 since the RC is in progress

[jira] [Commented] (FLINK-23239) HiveTableSinkITCase hangs on azure

2021-07-30 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390330#comment-17390330 ] Yu Li commented on FLINK-23239: --- [~lirui] Thanks for the efforts. Any reason we still haven't marked the

[jira] [Updated] (FLINK-23418) 'Run kubernetes application HA test' fail on Azure

2021-07-30 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-23418: -- Fix Version/s: (was: 1.13.2) 1.13.3 Move the fix version from 1.13.2 to 1.13.3 since

[jira] [Updated] (FLINK-23315) Bump log4j to 2.14.1 for version 1.13.2

2021-07-30 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-23315: -- Fix Version/s: (was: 1.13.2) 1.13.3 Change fix version to 1.13.3 since we're checking

[jira] [Commented] (FLINK-14482) Bump up rocksdb version

2021-07-19 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17383180#comment-17383180 ] Yu Li commented on FLINK-14482: --- Sorry for the late response [~trohrmann], just noticed... [~yunta] is

[jira] [Assigned] (FLINK-21831) Add Changelog state for timers (PQ)

2021-06-18 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li reassigned FLINK-21831: - Assignee: Piotr Nowojski > Add Changelog state for timers (PQ) >

[jira] [Assigned] (FLINK-22678) Hide ChangelogStateBackend From Users

2021-06-18 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li reassigned FLINK-22678: - Assignee: Zakelly Lan (was: Yuan Mei) > Hide ChangelogStateBackend From Users >

[jira] [Assigned] (FLINK-21804) Create and wire changelog writer with backend

2021-06-17 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li reassigned FLINK-21804: - Assignee: Zakelly Lan Thanks for volunteering [~Zakelly]! Just assigned to you. > Create and wire

[jira] [Updated] (FLINK-5601) Window operator does not checkpoint watermarks

2021-04-19 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-5601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-5601: - Labels: pull-request-available (was: pull-request-available stale-assigned) Thanks for the quick response

[jira] [Updated] (FLINK-15507) Activate local recovery for RocksDB backends by default

2021-04-19 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-15507: -- Labels: pull-request-available (was: pull-request-available stale-assigned) This is something we're still

[jira] [Updated] (FLINK-19303) Disable WAL in RocksDB recovery

2021-04-19 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-19303: -- Labels: (was: stale-assigned) > Disable WAL in RocksDB recovery > --- > >

[jira] [Commented] (FLINK-19303) Disable WAL in RocksDB recovery

2021-04-19 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19303?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324785#comment-17324785 ] Yu Li commented on FLINK-19303: --- Marking as blocked by FLINK-14482 > Disable WAL in RocksDB recovery >

[jira] [Updated] (FLINK-15532) Enable strict capacity limit for memory usage for RocksDB

2021-04-19 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-15532: -- Labels: (was: stale-assigned) > Enable strict capacity limit for memory usage for RocksDB >

[jira] [Commented] (FLINK-15532) Enable strict capacity limit for memory usage for RocksDB

2021-04-19 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324781#comment-17324781 ] Yu Li commented on FLINK-15532: --- This is still something in the plan and currently blocked by FLINK-14482.

[jira] [Commented] (FLINK-15424) Make all AppendingState#add respect the java doc

2021-04-19 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324774#comment-17324774 ] Yu Li commented on FLINK-15424: --- [~klion26] are you still actively working on this one? Thanks. > Make

[jira] [Commented] (FLINK-15012) Checkpoint directory not cleaned up

2021-04-19 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324765#comment-17324765 ] Yu Li commented on FLINK-15012: --- I guess we cannot make this in 1.13 already and need to postpone to 1.14?

[jira] [Assigned] (FLINK-13194) Add explicit clarification about thread-safety of state in document

2021-04-19 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li reassigned FLINK-13194: - Assignee: Yun Tang (was: Yu Li) Labels: pull-request-available (was: pull-request-available

[jira] [Updated] (FLINK-14032) Make the cache size of RocksDBPriorityQueueSetFactory configurable

2021-04-19 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-14032: -- Fix Version/s: (was: 1.13.0) 1.14.0 Labels: usability (was: stale-assigned

[jira] [Updated] (FLINK-14482) Bump up rocksdb version

2021-04-19 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-14482: -- Labels: pull-request-available (was: pull-request-available stale-assigned) This is something we're still

[jira] [Updated] (FLINK-19710) Fix performance regression to rebase FRocksDB with higher version RocksDB

2021-04-19 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-19710: -- Labels: (was: stale-assigned) This is something we're still actively tracking. > Fix performance

[jira] [Commented] (FLINK-5601) Window operator does not checkpoint watermarks

2021-04-19 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-5601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17324741#comment-17324741 ] Yu Li commented on FLINK-5601: -- I believe this is still something we need to follow up. [~wind_ljy] are you

[jira] [Updated] (FLINK-10954) Hardlink from files of previous local stored state might cross devices

2021-04-19 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-10954: -- Labels: (was: stale-assigned) This is something we still need to fix, although the priority seems to be not

[jira] [Closed] (FLINK-11254) Unify serialization format of savepoint for switching state backends

2021-04-19 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li closed FLINK-11254. - Resolution: Duplicate This feature is already implemented by FLINK_20976, closing as duplicate. > Unify

[jira] [Updated] (FLINK-13251) Add bandwidth throttling for checkpoint uploading/downloading

2021-04-19 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-13251: -- Labels: (was: stale-assigned) I think this is still nice to have but I won't be able to work on it in the

[jira] [Updated] (FLINK-13815) Implement the SpaceAllocator

2021-04-19 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-13815: -- Labels: pull-request-available (was: pull-request-available stale-assigned) The work was put into backlog

[jira] [Updated] (FLINK-13803) Introduce SpillableHeapKeyedStateBackend and all necessities

2021-04-19 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-13803: -- Labels: (was: stale-assigned) The work was put into backlog due to priority and lack of review resource but

[jira] [Updated] (FLINK-13801) Introduce a HybridStateTable to combine everything together

2021-04-19 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-13801: -- Labels: (was: stale-assigned) The work was put into backlog due to priority and lack of review resource but

[jira] [Updated] (FLINK-12698) Implement a SpillLoadManager

2021-04-19 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-12698: -- Labels: (was: stale-assigned) The work was put into backlog due to priority and lack of review resource but

[jira] [Updated] (FLINK-12696) Implement a MmapManager

2021-04-19 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-12696: -- Labels: (was: stale-assigned) The work was put into backlog due to priority and lack of review resource but

[jira] [Updated] (FLINK-12699) Reduce CPU consumption when snapshot/restore the spilled key-group

2021-04-19 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12699?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-12699: -- Labels: (was: stale-assigned) The work was put into backlog due to priority and lack of review resource but

[jira] [Updated] (FLINK-12695) Implement a HeapStatusMonitor

2021-04-19 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-12695: -- Labels: (was: stale-assigned) The work was put into backlog due to priority and lack of review resource but

[jira] [Updated] (FLINK-12694) Implement a HeapAccountingManager

2021-04-19 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-12694: -- Labels: (was: stale-assigned) The work was put into backlog due to priority and lack of review resource but

[jira] [Commented] (FLINK-20496) RocksDB partitioned index filter option

2021-04-09 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317703#comment-17317703 ] Yu Li commented on FLINK-20496: --- [~maver1ck] Sorry that somehow I missed the ping and just noticed the

[jira] [Commented] (FLINK-20496) RocksDB partitioned index filter option

2021-04-09 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317697#comment-17317697 ] Yu Li commented on FLINK-20496: --- [~sewen] According to the RocksDB

[jira] [Commented] (FLINK-21694) Increase default value of "state.backend.rocksdb.checkpoint.transfer.thread.num"

2021-04-08 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17316939#comment-17316939 ] Yu Li commented on FLINK-21694: --- btw, my JIRA id is `liyu` and `liyu2` is another person, so I didn't

[jira] [Commented] (FLINK-21694) Increase default value of "state.backend.rocksdb.checkpoint.transfer.thread.num"

2021-04-08 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17316934#comment-17316934 ] Yu Li commented on FLINK-21694: --- +1 to increase the default value of

[jira] [Updated] (FLINK-15507) Activate local recovery for RocksDB backends by default

2021-04-07 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-15507: -- Fix Version/s: (was: 1.13.0) 1.14.0 Thanks for checking [~dwysakowicz]. I'm afraid we

[jira] [Closed] (FLINK-21413) TtlMapState and TtlListState cannot be clean completely with Filesystem StateBackend

2021-03-31 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li closed FLINK-21413. - Fix Version/s: 1.13.0 Resolution: Fixed Merged into master via 1e17621e65bfa8f4f3aff379118654ed77a82bd2

[jira] [Assigned] (FLINK-22004) Translate Flink Roadmap to Chinese.

2021-03-29 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li reassigned FLINK-22004: - Assignee: Yuan Mei Thanks for following this up [~ym], assigned to you. > Translate Flink Roadmap to

[jira] [Commented] (FLINK-18712) Flink RocksDB statebackend memory leak issue

2021-03-26 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309526#comment-17309526 ] Yu Li commented on FLINK-18712: --- [~yunta] Maybe some description of the newly attached demo package?

[jira] [Commented] (FLINK-21935) Remove "state.backend.async" option.

2021-03-23 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17307562#comment-17307562 ] Yu Li commented on FLINK-21935: --- +1 to remove the option and synchronous snapshot support for heap

[jira] [Commented] (FLINK-21695) Increase default value for number of KeyGroups

2021-03-09 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21695?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17298572#comment-17298572 ] Yu Li commented on FLINK-21695: --- Thanks for the note [~sewen], I also noticed the blog through twitter and

[jira] [Updated] (FLINK-21103) E2e tests time out on azure

2021-03-03 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-21103: -- Component/s: (was: Runtime / State Backends) Thanks for the follow up [~dwysakowicz] and [~rmetzger]!

[jira] [Closed] (FLINK-20496) RocksDB partitioned index filter option

2021-03-03 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li closed FLINK-20496. - Resolution: Implemented Merged into master via: be78727ae125c036cbb297d020e8a7ad23aae083

[jira] [Commented] (FLINK-21103) E2e tests time out on azure

2021-03-02 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21103?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17293582#comment-17293582 ] Yu Li commented on FLINK-21103: --- Checking the latest two building logs in the above comments, we could see

[jira] [Updated] (FLINK-21515) SourceStreamTaskTest.testStopWithSavepointShouldNotInterruptTheSource is failing

2021-03-01 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-21515: -- Fix Version/s: (was: 1.12.2) 1.12.3 Change fix version from 1.12.2 to 1.12.3 since the

[jira] [Assigned] (FLINK-21413) TtlMapState and TtlListState cannot be clean completely with Filesystem StateBackend

2021-02-22 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li reassigned FLINK-21413: - Assignee: Jiayi Liao Thanks [~wind_ljy], JIRA assigned. > TtlMapState and TtlListState cannot be

[jira] [Commented] (FLINK-21413) TtlMapState and TtlListState cannot be clean completely with Filesystem StateBackend

2021-02-21 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17288229#comment-17288229 ] Yu Li commented on FLINK-21413: --- [~wind_ljy] would you like to work on the PR following the above

[jira] [Commented] (FLINK-21413) TtlMapState and TtlListState cannot be clean completely with Filesystem StateBackend

2021-02-20 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17287862#comment-17287862 ] Yu Li commented on FLINK-21413: --- Checking the [state TTL FLIP

[jira] [Commented] (FLINK-21413) TtlMapState and TtlListState cannot be clean completely with Filesystem StateBackend

2021-02-19 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17287550#comment-17287550 ] Yu Li commented on FLINK-21413: --- Indeed, thanks for reporting the issue [~wind_ljy]. Would you like to

[jira] [Commented] (FLINK-16444) Count the read/write/seek/next latency of RocksDB as metrics

2021-02-18 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17286910#comment-17286910 ] Yu Li commented on FLINK-16444: --- After some more investigation, the metrics we plan to add here should

[jira] [Commented] (FLINK-16444) Count the read/write/seek/next latency of RocksDB as metrics

2021-02-18 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17286615#comment-17286615 ] Yu Li commented on FLINK-16444: --- [~yunta] Besides these metrics, let's also check and confirm whether more

[jira] [Assigned] (FLINK-20496) RocksDB partitioned index filter option

2020-12-07 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li reassigned FLINK-20496: - Fix Version/s: 1.13.0 Affects Version/s: 1.12.0 1.10.2

[jira] [Resolved] (FLINK-20287) Add documentation of how to switch memory allocator in Flink docker image

2020-11-30 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li resolved FLINK-20287. --- Resolution: Done Merged into: master via b457225208f41f593a1a795e988be21b646c55b6 release-1.12 via

[jira] [Closed] (FLINK-19172) [AbstractFileStateBackend]

2020-11-29 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li closed FLINK-19172. - Resolution: Not A Problem In Flink we use the code convention that method parameters are non-null unless

[jira] [Resolved] (FLINK-20288) Correct documentation about savepoint self-contained

2020-11-29 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li resolved FLINK-20288. --- Resolution: Duplicate [~klion26] thanks for the reminder, closing this one as duplication of FLINK-19381

[jira] [Updated] (FLINK-19125) Avoid memory fragmentation when running flink docker image

2020-11-22 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-19125: -- Release Note: After FLINK-19125 Jemalloc is adopted as the default memory allocator in flink docker image to

[jira] [Commented] (FLINK-15507) Activate local recovery for RocksDB backends by default

2020-11-22 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236881#comment-17236881 ] Yu Li commented on FLINK-15507: --- I second that. Let's revive the discussion and get this done in 1.13

[jira] [Commented] (FLINK-19125) Avoid memory fragmentation when running flink docker image

2020-11-22 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236880#comment-17236880 ] Yu Li commented on FLINK-19125: --- Thanks all for the efforts! As mentioned in [ML

[jira] [Updated] (FLINK-15747) Enable setting RocksDB log level from configuration

2020-11-22 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-15747: -- Fix Version/s: (was: 1.12.0) 1.13.0 > Enable setting RocksDB log level from

[jira] [Commented] (FLINK-20269) The flush happens too frequent in SavepoinV2Serializer

2020-11-22 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17236867#comment-17236867 ] Yu Li commented on FLINK-20269: --- [~wind_ljy] Please check and confirm whether this is a duplication of

[jira] [Updated] (FLINK-14482) Bump up rocksdb version

2020-11-11 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu Li updated FLINK-14482: -- Description: This JIRA aims at rebasing frocksdb to [newer

[jira] [Commented] (FLINK-15747) Enable setting RocksDB log level from configuration

2020-11-09 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17229002#comment-17229002 ] Yu Li commented on FLINK-15747: --- [~qinjunjerry] I'm afraid not, checking the

[jira] [Commented] (FLINK-14482) Bump up rocksdb version

2020-11-09 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17228997#comment-17228997 ] Yu Li commented on FLINK-14482: --- Some update here: [~yunta] and I have verified that 5.18.3 with the fix

  1   2   3   4   5   6   7   8   9   10   >