[jira] [Closed] (FLINK-5374) Extend Unit Tests for RegisteredBackendStateMetaInfo

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-5374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-5374. --- Resolution: Information Provided {{RegisteredBackendStateMetaInfo}} had been dropped. > Extend Unit Tests

[jira] [Closed] (FLINK-5436) UDF state without CheckpointedRestoring can result in restarting loop

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-5436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-5436. --- Resolution: Information Provided The API of {{CheckpointedRestoring}} had been dropped. > UDF state without

[jira] [Closed] (FLINK-5437) Make CheckpointedRestoring error message more detailed

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-5437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-5437. --- Resolution: Information Provided The API of {{CheckpointedRestoring}} has been dropped. > Make

[jira] [Closed] (FLINK-5439) Adjust max parallelism when migrating

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-5439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-5439. --- Resolution: Information Provided Closing this ticket due to lack of activity and v1 savepoint have been too

[jira] [Closed] (FLINK-5440) Misleading error message when migrating and scaling down from savepoint

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-5440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-5440. --- Resolution: Information Provided Closing this ticket due to lack of activity. > Misleading error message

[jira] [Closed] (FLINK-5707) Find better keys for backend configuration parameters for state backends

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-5707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-5707. --- Resolution: Information Provided Closing this ticket as already done in current Flink. > Find better keys

[jira] [Closed] (FLINK-5730) Users can concurrently modify state metadata of RocksDB asynchronous snapshots

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-5730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-5730. --- Resolution: Invalid Current RocksDB snapshots would copy the kv state information in the sync phase to

[jira] [Closed] (FLINK-5761) ClassNotFoundException during cancel job

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-5761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-5761. --- Resolution: Information Provided Closing this ticket due to lack of activity. > ClassNotFoundException

[jira] [Closed] (FLINK-6054) Add new state backend that dynamically stores data in memory and external storage

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-6054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-6054. --- Resolution: Information Provided The idea is like spillable state-backend:

[jira] [Closed] (FLINK-6408) Repeated loading of configuration files in hadoop filesystem code paths

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-6408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-6408. --- Resolution: Information Provided Closing this ticket due to lack of activity. > Repeated loading of

[jira] [Closed] (FLINK-6481) Encapsulate different snapshot algorithms (full, incremental) slightly clearer into strategy pattern

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-6481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-6481. --- Resolution: Information Provided Current Flink already has {{RocksFullSnapshotStrategy}} and

[jira] [Closed] (FLINK-19918) RocksIncrementalCheckpointRescalingTest.testScalingDown/Up fails on Windows with NPE

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-19918. Resolution: Information Provided Closing this ticket as lack of activity. >

[jira] [Closed] (FLINK-21593) RocksDBListStatePerformanceTest.testRocksDbListStateAPI fail because of timeout

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-21593. Resolution: Information Provided {{RocksDBListStatePerformanceTest}} has been removed. >

[jira] [Closed] (FLINK-6647) Fail-fast on invalid RocksDBStateBackend configuration

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-6647. --- Resolution: Information Provided Current {{FileSystemCheckpointStorage}} would already check whether the

[jira] [Closed] (FLINK-7883) Make savepoints atomic with respect to state and side effects

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-7883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-7883. --- Resolution: Information Provided Closing this as we already have the feature of stopping with savepoint. >

[jira] [Closed] (FLINK-8969) Move TimerService into state backend

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-8969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-8969. --- Resolution: Information Provided Closing this ticket due to lack of activity and details. > Move

[jira] [Closed] (FLINK-9116) Introduce getAll and removeAll for MapState

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-9116. --- Resolution: Information Provided There is no actual need for these two methods currently. Closing this

[jira] [Closed] (FLINK-9268) RockDB errors from WindowOperator

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-9268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-9268. --- Resolution: Information Provided The JNI limit has been resolved via

[jira] [Closed] (FLINK-9328) RocksDBStateBackend might use PlaceholderStreamStateHandle to restore due to StateBackendTestBase class not register snapshots in some UTs

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-9328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-9328. --- Resolution: Duplicate Closing this ticket as already resolved by FLINK-9887. > RocksDBStateBackend might

[jira] [Closed] (FLINK-9831) Too many open files for RocksDB

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-9831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-9831. --- Resolution: Information Provided Closing this due to lack of activity. > Too many open files for RocksDB >

[jira] [Closed] (FLINK-9945) RocksDB state backend Checkpointing Failed

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-9945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-9945. --- Resolution: Information Provided Closing this as lack of activity. > RocksDB state backend Checkpointing

[jira] [Closed] (FLINK-10040) Decompose RocksDBKeyedStateBackend

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-10040. Resolution: Resolved All sub-tasks have been resolved. > Decompose RocksDBKeyedStateBackend >

[jira] [Closed] (FLINK-10297) PostVersionedIOReadableWritable ignores result of InputStream.read(...)

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-10297. Resolution: Information Provided Closing this as already resolved by FLINK-19300. >

[jira] [Closed] (FLINK-10372) There is no API to configure the timer state backend

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-10372. Resolution: Duplicate > There is no API to configure the timer state backend >

[jira] [Closed] (FLINK-10387) StateBackend create methods should return interface not abstract KeyedStateBackend classes

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-10387. Resolution: Information Provided Current method would return {{CheckpointableKeyedStateBackend}}

[jira] [Closed] (FLINK-10950) RocksDB backend does not work on Windows due to path issue

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-10950. Resolution: Duplicate > RocksDB backend does not work on Windows due to path issue >

[jira] [Closed] (FLINK-10949) When use flink-1.6.2's intervalJoin funtion, the thread is stucked in rockdb's seek for too long time

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-10949. Resolution: Information Provided Closing this ticket due to lack of activity. > When use flink-1.6.2's

[jira] [Closed] (FLINK-14197) Increasing trend for state size of keyed stream using ProcessWindowFunction with ProcessingTimeSessionWindows

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-14197. Resolution: Information Provided > Increasing trend for state size of keyed stream using

[jira] [Commented] (FLINK-14197) Increasing trend for state size of keyed stream using ProcessWindowFunction with ProcessingTimeSessionWindows

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17455040#comment-17455040 ] Yun Tang commented on FLINK-14197: -- [~loliver] Do you still meet the problem? If the state size is

[jira] [Closed] (FLINK-14379) Supplement documentation about raw state

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-14379. Fix Version/s: (was: 1.15.0) Resolution: Information Provided Current latest documentation has

[jira] [Closed] (FLINK-14833) Remove hierachy of SnapshotStrategySynchronicityBehavior in HeapSnapshotStrategy

2021-12-08 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-14833. Resolution: Information Provided Closing this ticket as related code have been refactored. > Remove

[jira] [Closed] (FLINK-18165) When savingpoint is restored, select the checkpoint directory and stateBackend

2021-12-07 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-18165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-18165. Resolution: Fixed This ticket has been resolved by FLINK-20976 > When savingpoint is restored, select

[jira] [Closed] (FLINK-19008) Flink Job runs slow after restore + downscale from an incremental checkpoint (rocksdb)

2021-12-07 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-19008. Resolution: Information Provided Flink has bumpped RocksDB version to 6.20.3 which adopts this compaction

[jira] [Commented] (FLINK-20996) Using a cryptographically weak Pseudo Random Number Generator (PRNG)

2021-12-07 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17455009#comment-17455009 ] Yun Tang commented on FLINK-20996: -- [~yaxiao] AbstractTtlStateVerifier is just a class for unit test

[jira] [Closed] (FLINK-21726) Fix checkpoint stuck

2021-12-07 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-21726. Fix Version/s: (was: 1.15.0) (was: 1.14.1) Resolution: Information

[jira] [Commented] (FLINK-22962) Key group is not in KeyGroupRange error while checkpointing

2021-12-07 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-22962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17454991#comment-17454991 ] Yun Tang commented on FLINK-22962: -- [~prateekkohli2112] After flink-1.13, we unify the format of

[jira] [Assigned] (FLINK-25195) Use duplicating API for shared artefacts in RocksDB snapshots

2021-12-06 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-25195: Assignee: Yun Tang > Use duplicating API for shared artefacts in RocksDB snapshots >

[jira] [Closed] (FLINK-24479) Bug fix RocksIteratorWrapper#seekToLast method

2021-12-06 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-24479. Resolution: Information Provided > Bug fix RocksIteratorWrapper#seekToLast method >

[jira] [Commented] (FLINK-24479) Bug fix RocksIteratorWrapper#seekToLast method

2021-12-06 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17454001#comment-17454001 ] Yun Tang commented on FLINK-24479: -- Sorry for ignoring this ticket, this bug had been resolved in

[jira] [Resolved] (FLINK-25163) Add more options for rocksdb state backend to make configuration more flexible

2021-12-06 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-25163. -- Fix Version/s: 1.15.0 Resolution: Fixed Merged in master:

[jira] [Resolved] (FLINK-24777) Processed (persisted) in-flight data description miss on Monitoring Checkpointing page

2021-12-06 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-24777. -- Fix Version/s: 1.15.0 1.14.1 Resolution: Fixed Merged master:

[jira] [Resolved] (FLINK-21027) Add isStateKeyValueSerialized() method to KeyedStateBackend interface

2021-12-06 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-21027. -- Resolution: Fixed Merged in master: bd4b0aa2ace713ca81ab3aa1ffe3bd86822d365c > Add

[jira] [Commented] (FLINK-23493) python tests hang on Azure

2021-12-05 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17453794#comment-17453794 ] Yun Tang commented on FLINK-23493: -- Another instance

[jira] [Commented] (FLINK-25163) Add more options for rocksdb state backend to make configuration more flexible

2021-12-05 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17453775#comment-17453775 ] Yun Tang commented on FLINK-25163: -- [~liufangqi] already assigned to you, please go ahead. > Add more

[jira] [Assigned] (FLINK-25163) Add more options for rocksdb state backend to make configuration more flexible

2021-12-05 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-25163: Assignee: 刘方奇 > Add more options for rocksdb state backend to make configuration more flexible >

[jira] [Comment Edited] (FLINK-25163) Add more options for rocksdb state backend to make configuration more flexible

2021-12-05 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17453766#comment-17453766 ] Yun Tang edited comment on FLINK-25163 at 12/6/21, 3:34 AM: The methods of 

[jira] [Commented] (FLINK-25163) Add more options for rocksdb state backend to make configuration more flexible

2021-12-05 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17453766#comment-17453766 ] Yun Tang commented on FLINK-25163: -- The methods of {{setMaxBackgroundFlushes}} and

[jira] [Resolved] (FLINK-23791) Enable RocksDB log again

2021-12-02 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-23791. -- Resolution: Fixed Merged in master: 754914a98df8791693245d889e195818c3bf1e49 > Enable RocksDB log

[jira] [Updated] (FLINK-23791) Enable RocksDB log again

2021-12-02 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-23791: - Fix Version/s: (was: 1.14.1) > Enable RocksDB log again > > >

[jira] [Assigned] (FLINK-24320) Show in the Job / Checkpoints / Configuration if checkpoints are incremental

2021-12-02 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-24320: Assignee: Hangxiang Yu > Show in the Job / Checkpoints / Configuration if checkpoints are

[jira] [Assigned] (FLINK-24777) Processed (persisted) in-flight data description miss on Monitoring Checkpointing page

2021-12-01 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-24777: Assignee: camilesing > Processed (persisted) in-flight data description miss on Monitoring >

[jira] [Resolved] (FLINK-24046) Refactor the relationship bwtween PredefinedOptions and RocksDBConfigurableOptions

2021-11-30 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-24046. -- Resolution: Fixed merged in master: 2d2d92e9812851091d7cee9c9c1764a0f7b4fdc8 > Refactor the

[jira] [Updated] (FLINK-24046) Refactor the relationship bwtween PredefinedOptions and RocksDBConfigurableOptions

2021-11-30 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-24046: - Fix Version/s: 1.15.0 (was: 1.14.1) > Refactor the relationship bwtween

[jira] [Created] (FLINK-25116) Fabric8FlinkKubeClientITCase hangs on Azure

2021-11-30 Thread Yun Tang (Jira)
Yun Tang created FLINK-25116: Summary: Fabric8FlinkKubeClientITCase hangs on Azure Key: FLINK-25116 URL: https://issues.apache.org/jira/browse/FLINK-25116 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-24926) Key group is not in KeyGroupRange when joining two streams with table API

2021-11-29 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450874#comment-17450874 ] Yun Tang commented on FLINK-24926: -- Thanks for the explanation [~lincoln.86xy]. You might need to pick

[jira] [Updated] (FLINK-25094) The verify code in LatencyTrackingMapStateTest#verifyIterator is not actually executed

2021-11-29 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-25094: - Fix Version/s: 1.15.0 > The verify code in LatencyTrackingMapStateTest#verifyIterator is not actually

[jira] [Assigned] (FLINK-25094) The verify code in LatencyTrackingMapStateTest#verifyIterator is not actually executed

2021-11-29 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-25094: Assignee: Jinzhong Li > The verify code in LatencyTrackingMapStateTest#verifyIterator is not

[jira] [Closed] (FLINK-21823) RocksDB on FreeBSD

2021-11-28 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang closed FLINK-21823. Resolution: Information Provided Closing this issue due to inactivity. > RocksDB on FreeBSD >

[jira] [Updated] (FLINK-23798) Avoid using reflection to get filter when partition filter is enabled

2021-11-28 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-23798: - Release Note: (was: Merged master: 7d7a97477a50753e38e5b499effc62bb00dfcfe2 release-1.14:

[jira] [Commented] (FLINK-23798) Avoid using reflection to get filter when partition filter is enabled

2021-11-28 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17450169#comment-17450169 ] Yun Tang commented on FLINK-23798: -- Merged master: 7d7a97477a50753e38e5b499effc62bb00dfcfe2

[jira] [Resolved] (FLINK-23798) Avoid using reflection to get filter when partition filter is enabled

2021-11-28 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-23798. -- Release Note: Merged master: 7d7a97477a50753e38e5b499effc62bb00dfcfe2 release-1.14:

[jira] [Updated] (FLINK-23798) Avoid using reflection to get filter when partition filter is enabled

2021-11-28 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-23798: - Fix Version/s: 1.14.1 > Avoid using reflection to get filter when partition filter is enabled >

[jira] [Resolved] (FLINK-25067) Correct the description of RocksDB's background threads

2021-11-26 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-25067. -- Resolution: Fixed Merged in master: 832d412e8c34a28849b346ac1088c704622a08e1 release-1.14:

[jira] [Updated] (FLINK-21027) Add isStateKeyValueSerialized() method to KeyedStateBackend interface

2021-11-25 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-21027: - Fix Version/s: 1.15.0 > Add isStateKeyValueSerialized() method to KeyedStateBackend interface >

[jira] [Assigned] (FLINK-21027) Add isStateKeyValueSerialized() method to KeyedStateBackend interface

2021-11-25 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-21027: Assignee: Yun Tang > Add isStateKeyValueSerialized() method to KeyedStateBackend interface >

[jira] [Created] (FLINK-25067) Correct the description of RocksDB's background threads

2021-11-25 Thread Yun Tang (Jira)
Yun Tang created FLINK-25067: Summary: Correct the description of RocksDB's background threads Key: FLINK-25067 URL: https://issues.apache.org/jira/browse/FLINK-25067 Project: Flink Issue Type:

[jira] [Commented] (FLINK-24926) Key group is not in KeyGroupRange when joining two streams with table API

2021-11-25 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449172#comment-17449172 ] Yun Tang commented on FLINK-24926: -- I am not sure whether Flink SQL supports to join on the stream

[jira] [Commented] (FLINK-21321) Change RocksDB incremental checkpoint re-scaling to use deleteRange

2021-11-25 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17449065#comment-17449065 ] Yun Tang commented on FLINK-21321: -- [~legojoey17] Would you please update the PR? > Change RocksDB

[jira] [Commented] (FLINK-24611) Prevent JM from discarding state on checkpoint abortion

2021-11-24 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448454#comment-17448454 ] Yun Tang commented on FLINK-24611: -- Sorry for missing the notification as I was in the two days'

[jira] [Commented] (FLINK-15571) Create a Redis Streams Connector for Flink

2021-11-23 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448413#comment-17448413 ] Yun Tang commented on FLINK-15571: -- [~monster#12] Already assigned to you. > Create a Redis Streams

[jira] [Assigned] (FLINK-15571) Create a Redis Streams Connector for Flink

2021-11-23 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-15571: Assignee: ZhuoYu Chen > Create a Redis Streams Connector for Flink >

[jira] [Assigned] (FLINK-11868) [filesystems] Introduce listStatusIterator API to file system

2021-11-23 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-11868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-11868: Assignee: Yun Tang > [filesystems] Introduce listStatusIterator API to file system >

[jira] [Comment Edited] (FLINK-15571) Create a Redis Streams Connector for Flink

2021-11-23 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448382#comment-17448382 ] Yun Tang edited comment on FLINK-15571 at 11/24/21, 6:21 AM: - [~monster#12]

[jira] [Commented] (FLINK-15571) Create a Redis Streams Connector for Flink

2021-11-23 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448382#comment-17448382 ] Yun Tang commented on FLINK-15571: -- [~monster#12] Currently, Flink community would encourage

[jira] [Commented] (FLINK-24815) Reduce the cpu cost of calculating stateSize during state allocation

2021-11-23 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17448334#comment-17448334 ] Yun Tang commented on FLINK-24815: -- Apart from calucating the state size lazily, I like the idea of

[jira] [Commented] (FLINK-24785) Relocate RocksDB's log under flink log directory by default

2021-11-22 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17447345#comment-17447345 ] Yun Tang commented on FLINK-24785: -- I think you have forgotten the configuration of

[jira] [Assigned] (FLINK-24785) Relocate RocksDB's log under flink log directory by default

2021-11-22 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-24785: Assignee: Nicholas Jiang > Relocate RocksDB's log under flink log directory by default >

[jira] [Commented] (FLINK-24918) Support to specify the data dir for state benchmark

2021-11-21 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17447188#comment-17447188 ] Yun Tang commented on FLINK-24918: -- Merged in flink-master: 726eead617bb3392df6a6ef1681de62c631bbeb5 >

[jira] [Commented] (FLINK-24926) Key group is not in KeyGroupRange when joining two streams with table API

2021-11-21 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17447187#comment-17447187 ] Yun Tang commented on FLINK-24926: -- [~liuhb86] Can you repeat this error every time? I use test code

[jira] [Commented] (FLINK-24967) Make the IO pattern configureable in state benchmarks

2021-11-21 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17447186#comment-17447186 ] Yun Tang commented on FLINK-24967: -- I think introducing various size of state related operations should

[jira] [Commented] (FLINK-24918) Support to specify the data dir for state benchmark

2021-11-18 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17445744#comment-17445744 ] Yun Tang commented on FLINK-24918: -- [~aitozi] Already assigned to you, please go ahead. > Support to

[jira] [Assigned] (FLINK-24918) Support to specify the data dir for state benchmark

2021-11-18 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-24918: Assignee: Aitozi > Support to specify the data dir for state benchmark >

[jira] [Commented] (FLINK-24918) Support to specify the data dir for state benchmark

2021-11-16 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17444970#comment-17444970 ] Yun Tang commented on FLINK-24918: -- [~aitozi], I think the suggestion make sense as different disk

[jira] [Created] (FLINK-24932) Frocksdb cannot run on Apple M1

2021-11-16 Thread Yun Tang (Jira)
Yun Tang created FLINK-24932: Summary: Frocksdb cannot run on Apple M1 Key: FLINK-24932 URL: https://issues.apache.org/jira/browse/FLINK-24932 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-13598) frocksdb doesn't have arm release

2021-11-16 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17444959#comment-17444959 ] Yun Tang commented on FLINK-13598: -- [~rmetzger], RocksJava does not support Apple M1 yet. (see

[jira] [Resolved] (FLINK-24784) Enable state.backend.latency-track.state-name-as-variable by default

2021-11-14 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-24784. -- Resolution: Fixed merged in master: 07d2585e9db734f080a672fd8884a1906259cfab > Enable

[jira] [Assigned] (FLINK-24784) Enable state.backend.latency-track.state-name-as-variable by default

2021-11-14 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-24784: Assignee: Nicholas Jiang > Enable state.backend.latency-track.state-name-as-variable by default

[jira] [Updated] (FLINK-24846) AsyncWaitOperator fails during stop-with-savepoint

2021-11-12 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-24846: - Component/s: Runtime / Checkpointing > AsyncWaitOperator fails during stop-with-savepoint >

[jira] [Commented] (FLINK-24852) Cleanup of Orphaned Incremental State Artifacts

2021-11-12 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17442845#comment-17442845 ] Yun Tang commented on FLINK-24852: -- I think the suggestion to use the "previous+1" checkpoint id

[jira] [Updated] (FLINK-24841) ChainOrderTest.testMigrationAndRestore fails on AZP

2021-11-12 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-24841: - Component/s: Runtime / Checkpointing (was: Runtime / State Backends) >

[jira] [Commented] (FLINK-24046) Refactor the relationship bwtween PredefinedOptions and RocksDBConfigurableOptions

2021-11-10 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441720#comment-17441720 ] Yun Tang commented on FLINK-24046: -- As discussed offline, I think we should still keep the

[jira] [Resolved] (FLINK-24818) Incorrect comment of ttlConfig field in StateDescriptor

2021-11-10 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-24818. -- Resolution: Fixed merged in master: f8f84da44cdb833f54789c20414c354d3a00efa6 > Incorrect comment of

[jira] [Commented] (FLINK-24852) Cleanup of Orphaned Incremental State Artifacts

2021-11-10 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17441597#comment-17441597 ] Yun Tang commented on FLINK-24852: -- [~sewen] Thanks for bring up this topic. First of all, the kernel

[jira] [Commented] (FLINK-24818) Incorrect comment of ttlConfig field in StateDescriptor

2021-11-09 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440984#comment-17440984 ] Yun Tang commented on FLINK-24818: -- [~jianzhang.yjz] Thanks for pointing out this documentation erro,

[jira] [Assigned] (FLINK-24818) Incorrect comment of ttlConfig field in StateDescriptor

2021-11-09 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang reassigned FLINK-24818: Assignee: jianzhang.yjz > Incorrect comment of ttlConfig field in StateDescriptor >

[jira] [Comment Edited] (FLINK-24783) Improve monitoring experience and usability of state backend

2021-11-07 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440160#comment-17440160 ] Yun Tang edited comment on FLINK-24783 at 11/8/21, 3:13 AM: [~sjwiesman]

[jira] [Commented] (FLINK-24783) Improve monitoring experience and usability of state backend

2021-11-07 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17440160#comment-17440160 ] Yun Tang commented on FLINK-24783: -- [~sjwiesman][~nkruber], I think it would be helpful to add such

[jira] [Resolved] (FLINK-24475) Remove no longer used NestedMap* classes

2021-11-07 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang resolved FLINK-24475. -- Resolution: Fixed Merged in master: fc4f255644a64bb556b0dcefb165a9c772164c5b > Remove no longer used

[jira] [Updated] (FLINK-24783) Improve monitoring experience and usability of state backend

2021-11-05 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-24783: - Summary: Improve monitoring experience and usability of state backend (was: Improve state backend

[jira] [Updated] (FLINK-24784) Enable state.backend.latency-track.state-name-as-variable by default

2021-11-05 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Tang updated FLINK-24784: - Description: This could help improve the usablility of state access latency. > Enable

<    3   4   5   6   7   8   9   10   11   12   >