[jira] [Commented] (FLINK-13808) Checkpoints expired by timeout may leak RocksDB files

2019-08-28 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16918254#comment-16918254 ] Congxian Qiu(klion26) commented on FLINK-13808: --- Thanks for the ping [~car

[jira] [Commented] (FLINK-13148) Expose WindowedStream.sideOutputLateData() from CoGroupedStreams

2019-08-30 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16919543#comment-16919543 ] Congxian Qiu(klion26) commented on FLINK-13148: --- Kindly ping [~kkl0u], wha

[jira] [Commented] (FLINK-13148) Expose WindowedStream.sideOutputLateData() from CoGroupedStreams

2019-09-01 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920614#comment-16920614 ] Congxian Qiu(klion26) commented on FLINK-13148: --- [~kkl0u] thanks for your

[jira] [Commented] (FLINK-13612) StateDescriptor Loading Error NPE at FlinkKafkaProducer011 with High Concurrency Initialization

2019-09-02 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16920844#comment-16920844 ] Congxian Qiu(klion26) commented on FLINK-13612: --- [~Vow] Does this problem

[jira] [Commented] (FLINK-13612) StateDescriptor Loading Error NPE at FlinkKafkaProducer011 with High Concurrency Initialization

2019-09-02 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921133#comment-16921133 ] Congxian Qiu(klion26) commented on FLINK-13612: --- [~Vow] could you please s

[jira] [Commented] (FLINK-13612) StateDescriptor Loading Error NPE at FlinkKafkaProducer011 with High Concurrency Initialization

2019-09-03 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921384#comment-16921384 ] Congxian Qiu(klion26) commented on FLINK-13612: --- [~Vow] The line 264 of {{

[jira] [Commented] (FLINK-13612) StateDescriptor Loading Error NPE at FlinkKafkaProducer011 with High Concurrency Initialization

2019-09-03 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16921400#comment-16921400 ] Congxian Qiu(klion26) commented on FLINK-13612: --- [~Vow] As this has been f

[jira] [Updated] (FLINK-13612) StateDescriptor Loading Error NPE at FlinkKafkaProducer011 with High Concurrency Initialization

2019-09-03 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Congxian Qiu(klion26) updated FLINK-13612: -- Fix Version/s: (was: 1.9.1) 1.9.0 > StateDescriptor Loa

[jira] [Commented] (FLINK-13808) Checkpoints expired by timeout may leak RocksDB files

2019-09-05 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16923874#comment-16923874 ] Congxian Qiu(klion26) commented on FLINK-13808: --- After analysis with [~Cae

[jira] [Created] (FLINK-14035) Introduce/Change some log for snapshot to better analysis checkpoint problem

2019-09-09 Thread Congxian Qiu(klion26) (Jira)
Congxian Qiu(klion26) created FLINK-14035: - Summary: Introduce/Change some log for snapshot to better analysis checkpoint problem Key: FLINK-14035 URL: https://issues.apache.org/jira/browse/FLINK-14035

[jira] [Commented] (FLINK-14110) Deleting state.backend.rocksdb.localdir causes silent failure

2019-09-18 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16932165#comment-16932165 ] Congxian Qiu(klion26) commented on FLINK-14110: --- [~aaronlevin] thank you f

[jira] [Comment Edited] (FLINK-14110) Deleting state.backend.rocksdb.localdir causes silent failure

2019-09-18 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16932165#comment-16932165 ] Congxian Qiu(klion26) edited comment on FLINK-14110 at 9/18/19 7:44 AM: --

[jira] [Commented] (FLINK-14035) Introduce/Change some log for snapshot to better analysis checkpoint problem

2019-09-18 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16932201#comment-16932201 ] Congxian Qiu(klion26) commented on FLINK-14035: --- [~StephanEwen] Thanks for

[jira] [Closed] (FLINK-14035) Introduce/Change some log for snapshot to better analysis checkpoint problem

2019-09-18 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Congxian Qiu(klion26) closed FLINK-14035. - Resolution: Won't Fix > Introduce/Change some log for snapshot to better analysi

[jira] [Commented] (FLINK-14110) Deleting state.backend.rocksdb.localdir causes silent failure

2019-09-19 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16933940#comment-16933940 ] Congxian Qiu(klion26) commented on FLINK-14110: --- [~aaronlevin] thanks for

[jira] [Commented] (FLINK-13148) Expose WindowedStream.sideOutputLateData() from CoGroupedStreams

2019-09-22 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935323#comment-16935323 ] Congxian Qiu(klion26) commented on FLINK-13148: --- Hi, [~kkl0u] do you think

[jira] [Commented] (FLINK-14159) flink rocksdb StreamCompressionDecorator not right

2019-09-23 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935785#comment-16935785 ] Congxian Qiu(klion26) commented on FLINK-14159: --- hi, [~jackylau] Do you wa

[jira] [Commented] (FLINK-14159) flink rocksdb StreamCompressionDecorator not right

2019-09-24 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16936536#comment-16936536 ] Congxian Qiu(klion26) commented on FLINK-14159: --- [~jackylau] ah, I've misu

[jira] [Commented] (FLINK-2491) Checkpointing only works if all operators/tasks are still running

2019-09-24 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-2491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16937329#comment-16937329 ] Congxian Qiu(klion26) commented on FLINK-2491: -- [~tomas.witzany] Currently,

[jira] [Commented] (FLINK-14159) flink rocksdb StreamCompressionDecorator not right

2019-09-24 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16937332#comment-16937332 ] Congxian Qiu(klion26) commented on FLINK-14159: --- [~jackylau] Yes, When we

[jira] [Created] (FLINK-14264) Expose CheckpointBackend in checkpoint config RestAPI

2019-09-27 Thread Congxian Qiu(klion26) (Jira)
Congxian Qiu(klion26) created FLINK-14264: - Summary: Expose CheckpointBackend in checkpoint config RestAPI Key: FLINK-14264 URL: https://issues.apache.org/jira/browse/FLINK-14264 Project: Flink

[jira] [Commented] (FLINK-14264) Expose CheckpointBackend in checkpoint config RestAPI

2019-09-27 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16939837#comment-16939837 ] Congxian Qiu(klion26) commented on FLINK-14264: --- [~Zentol] What do you thi

[jira] [Updated] (FLINK-14264) Expose CheckpointBackend in checkpoint config RestAPI

2019-09-27 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Congxian Qiu(klion26) updated FLINK-14264: -- Fix Version/s: 1.10.0 Affects Version/s: (was: 1.9.0) > Expose Che

[jira] [Commented] (FLINK-14336) Exceptions in AsyncCheckpointRunnable#run are never logged

2019-10-07 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946404#comment-16946404 ] Congxian Qiu(klion26) commented on FLINK-14336: --- For now, we only have com

[jira] [Commented] (FLINK-13808) Checkpoints expired by timeout may leak RocksDB files

2019-10-07 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946458#comment-16946458 ] Congxian Qiu(klion26) commented on FLINK-13808: --- Thanks for the reply [~se

[jira] [Created] (FLINK-14340) Specify an unique DFSClient name for Hadoop FileSystem

2019-10-07 Thread Congxian Qiu(klion26) (Jira)
Congxian Qiu(klion26) created FLINK-14340: - Summary: Specify an unique DFSClient name for Hadoop FileSystem Key: FLINK-14340 URL: https://issues.apache.org/jira/browse/FLINK-14340 Project: Flin

[jira] [Updated] (FLINK-14340) Specify an unique DFSClient name for Hadoop FileSystem

2019-10-07 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Congxian Qiu(klion26) updated FLINK-14340: -- Description: Currently, when Flink read/write to HDFS, we do not set the DFSCl

[jira] [Commented] (FLINK-14340) Specify an unique DFSClient name for Hadoop FileSystem

2019-10-07 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16946472#comment-16946472 ] Congxian Qiu(klion26) commented on FLINK-14340: --- [~sewen] as you introduce

[jira] [Commented] (FLINK-14339) The checkpoint ID count wrong on restore savepoint log

2019-10-08 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16947311#comment-16947311 ] Congxian Qiu(klion26) commented on FLINK-14339: --- This logs the next checkp

[jira] [Commented] (FLINK-14264) Expose CheckpointBackend in checkpoint config RestAPI

2019-10-11 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949354#comment-16949354 ] Congxian Qiu(klion26) commented on FLINK-14264: --- [~aljoscha] what do you t

[jira] [Comment Edited] (FLINK-14264) Expose CheckpointBackend in checkpoint config RestAPI

2019-10-11 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16949354#comment-16949354 ] Congxian Qiu(klion26) edited comment on FLINK-14264 at 10/11/19 10:35 AM:

[jira] [Commented] (FLINK-11637) Translate "Checkpoints" page into Chinese

2019-05-21 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16844658#comment-16844658 ] Congxian Qiu(klion26) commented on FLINK-11637: --- [~guanghui] If there is n

[jira] [Commented] (FLINK-11560) Translate "Flink Applications" page into Chinese

2019-05-21 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16845437#comment-16845437 ] Congxian Qiu(klion26) commented on FLINK-11560: --- thanks for your contribut

[jira] [Commented] (FLINK-11634) Translate "State Backends" page into Chinese

2019-05-22 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16845702#comment-16845702 ] Congxian Qiu(klion26) commented on FLINK-11634: --- [~zxhe] I can't find your

[jira] [Assigned] (FLINK-12536) Make BufferOrEventSequence#getNext() non-blocking

2019-05-22 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Congxian Qiu(klion26) reassigned FLINK-12536: - Assignee: Congxian Qiu(klion26) > Make BufferOrEventSequence#getNext()

[jira] [Commented] (FLINK-12296) Data loss silently in RocksDBStateBackend when more than one operator(has states) chained in a single task

2019-05-22 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16846382#comment-16846382 ] Congxian Qiu(klion26) commented on FLINK-12296: --- merged * master        

[jira] [Commented] (FLINK-12607) Introduce a REST API that returns the maxParallelism of a job

2019-05-23 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16847179#comment-16847179 ] Congxian Qiu(klion26) commented on FLINK-12607: --- Thanks for filing the iss

[jira] [Created] (FLINK-12619) Support TERMINATE/SUSPEND Job with Checkpoint

2019-05-24 Thread Congxian Qiu(klion26) (JIRA)
Congxian Qiu(klion26) created FLINK-12619: - Summary: Support TERMINATE/SUSPEND Job with Checkpoint Key: FLINK-12619 URL: https://issues.apache.org/jira/browse/FLINK-12619 Project: Flink

[jira] [Commented] (FLINK-12619) Support TERMINATE/SUSPEND Job with Checkpoint

2019-05-28 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16849589#comment-16849589 ] Congxian Qiu(klion26) commented on FLINK-12619: --- [~aljoscha] thanks for yo

[jira] [Comment Edited] (FLINK-12296) Data loss silently in RocksDBStateBackend when more than one operator(has states) chained in a single task

2019-05-28 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16850320#comment-16850320 ] Congxian Qiu(klion26) edited comment on FLINK-12296 at 5/29/19 2:42 AM: --

[jira] [Resolved] (FLINK-12296) Data loss silently in RocksDBStateBackend when more than one operator(has states) chained in a single task

2019-05-28 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Congxian Qiu(klion26) resolved FLINK-12296. --- Resolution: Fixed Since the commits have been merged in master, release-1.8,

[jira] [Commented] (FLINK-12296) Data loss silently in RocksDBStateBackend when more than one operator(has states) chained in a single task

2019-05-28 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16850490#comment-16850490 ] Congxian Qiu(klion26) commented on FLINK-12296: --- Thanks for the reminder [

[jira] [Commented] (FLINK-11947) Support MapState key / value schema evolution for RocksDB

2019-05-28 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16850497#comment-16850497 ] Congxian Qiu(klion26) commented on FLINK-11947: --- [~cresny] I'm interested

[jira] [Commented] (FLINK-11947) Support MapState value schema evolution for RocksDB

2019-05-29 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851503#comment-16851503 ] Congxian Qiu(klion26) commented on FLINK-11947: --- hi, [~cre...@gmail.com] 

[jira] [Commented] (FLINK-12683) Provide task manager's location information for checkpoint acknowledge message to improve the checkpoint log message

2019-05-30 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16851694#comment-16851694 ] Congxian Qiu(klion26) commented on FLINK-12683: --- I think we can find the h

[jira] [Comment Edited] (FLINK-12683) Provide task manager's location information for checkpoint acknowledge message to improve the checkpoint log message

2019-05-30 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16852572#comment-16852572 ] Congxian Qiu(klion26) edited comment on FLINK-12683 at 5/31/19 2:03 AM: --

[jira] [Commented] (FLINK-12683) Provide task manager's location information for checkpoint acknowledge message to improve the checkpoint log message

2019-05-30 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16852572#comment-16852572 ] Congxian Qiu(klion26) commented on FLINK-12683: --- Please have a look at FLI

[jira] [Commented] (FLINK-12683) Provide task manager's location information for checkpoint coordinator specific log messages

2019-05-30 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16852658#comment-16852658 ] Congxian Qiu(klion26) commented on FLINK-12683: --- In my opinion, the jm log

[jira] [Commented] (FLINK-11947) Support MapState value schema evolution for RocksDB

2019-06-02 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16854170#comment-16854170 ] Congxian Qiu(klion26) commented on FLINK-11947: --- Hi, [~cre...@gmail.com] H

[jira] [Created] (FLINK-12733) Expose Rest API for TERMINATE/SUSPEND Job with Checkpoint

2019-06-04 Thread Congxian Qiu(klion26) (JIRA)
Congxian Qiu(klion26) created FLINK-12733: - Summary: Expose Rest API for TERMINATE/SUSPEND Job with Checkpoint Key: FLINK-12733 URL: https://issues.apache.org/jira/browse/FLINK-12733 Project: F

[jira] [Commented] (FLINK-6755) Allow triggering Checkpoints through command line client

2019-06-05 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16856860#comment-16856860 ] Congxian Qiu(klion26) commented on FLINK-6755: -- The two issues are indeed re

[jira] [Commented] (FLINK-12619) Support TERMINATE/SUSPEND Job with Checkpoint

2019-06-06 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16857800#comment-16857800 ] Congxian Qiu(klion26) commented on FLINK-12619: --- In my opinion, the checkp

[jira] [Commented] (FLINK-12785) RocksDB savepoint recovery can use a lot of unmanaged memory

2019-06-09 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16859657#comment-16859657 ] Congxian Qiu(klion26) commented on FLINK-12785: --- Thanks for filing the iss

[jira] [Commented] (FLINK-12785) RocksDB savepoint recovery can use a lot of unmanaged memory

2019-06-10 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16860481#comment-16860481 ] Congxian Qiu(klion26) commented on FLINK-12785: --- I think your analysis is

[jira] [Comment Edited] (FLINK-12785) RocksDB savepoint recovery can use a lot of unmanaged memory

2019-06-10 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16860481#comment-16860481 ] Congxian Qiu(klion26) edited comment on FLINK-12785 at 6/11/19 2:34 AM: --

[jira] [Commented] (FLINK-11947) Support MapState value schema evolution for RocksDB

2019-06-10 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-11947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16860524#comment-16860524 ] Congxian Qiu(klion26) commented on FLINK-11947: --- [~cre...@gmail.com] thank

[jira] [Assigned] (FLINK-12785) RocksDB savepoint recovery can use a lot of unmanaged memory

2019-06-11 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Congxian Qiu(klion26) reassigned FLINK-12785: - Assignee: Congxian Qiu(klion26) > RocksDB savepoint recovery can use a

[jira] [Commented] (FLINK-12785) RocksDB savepoint recovery can use a lot of unmanaged memory

2019-06-11 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16861675#comment-16861675 ] Congxian Qiu(klion26) commented on FLINK-12785: --- [~mikekap] thanks for the

[jira] [Commented] (FLINK-12836) Allow retained checkpoints to be persisted on success

2019-06-13 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16863613#comment-16863613 ] Congxian Qiu(klion26) commented on FLINK-12836: --- Hi [~andreweduffy], Could

[jira] [Commented] (FLINK-12829) jobmaster log taskmanger address when task transition state to failed with error

2019-06-13 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16863623#comment-16863623 ] Congxian Qiu(klion26) commented on FLINK-12829: --- Hi, do you think FLINK-11

[jira] [Commented] (FLINK-12619) Support TERMINATE/SUSPEND Job with Checkpoint

2019-06-14 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16864111#comment-16864111 ] Congxian Qiu(klion26) commented on FLINK-12619: --- Thanks for the doc [~carp

[jira] [Created] (FLINK-12880) Support triggering checkpoint automatically when cancel a job

2019-06-18 Thread Congxian Qiu(klion26) (JIRA)
Congxian Qiu(klion26) created FLINK-12880: - Summary: Support triggering checkpoint automatically when cancel a job Key: FLINK-12880 URL: https://issues.apache.org/jira/browse/FLINK-12880 Proje

[jira] [Updated] (FLINK-12880) Support triggering checkpoint automatically when cancel a job

2019-06-18 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Congxian Qiu(klion26) updated FLINK-12880: -- Component/s: Runtime / State Backends > Support triggering checkpoint automati

[jira] [Created] (FLINK-12994) Improve the buffer processing performance in SpilledBufferOrEventSequence#getNext

2019-06-26 Thread Congxian Qiu(klion26) (JIRA)
Congxian Qiu(klion26) created FLINK-12994: - Summary: Improve the buffer processing performance in SpilledBufferOrEventSequence#getNext Key: FLINK-12994 URL: https://issues.apache.org/jira/browse/FLINK-1299

[jira] [Commented] (FLINK-12536) Make BufferOrEventSequence#getNext() non-blocking

2019-06-26 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-12536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16873088#comment-16873088 ] Congxian Qiu(klion26) commented on FLINK-12536: --- As discussed with [~pnowo

[jira] [Created] (FLINK-13009) YARNSessionCapacitySchedulerITCase#testVCoresAreSetCorrectlyAndJobManagerHostnameAreShownInWebInterfaceAndDynamicPropertiesAndYarnApplicationNameAndTaskManagerSlots

2019-06-26 Thread Congxian Qiu(klion26) (JIRA)
Congxian Qiu(klion26) created FLINK-13009: - Summary: YARNSessionCapacitySchedulerITCase#testVCoresAreSetCorrectlyAndJobManagerHostnameAreShownInWebInterfaceAndDynamicPropertiesAndYarnApplicationNameAndTaskManagerSlots Key:

[jira] [Updated] (FLINK-13009) YARNSessionCapacitySchedulerITCase#testVCoresAreSetCorrectlyAndJobManagerHostnameAreShownInWebInterfaceAndDynamicPropertiesAndYarnApplicationNameAndTaskManagerSlots thro

2019-06-26 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-13009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Congxian Qiu(klion26) updated FLINK-13009: -- Summary: YARNSessionCapacitySchedulerITCase#testVCoresAreSetCorrectlyAndJobMan

[jira] [Updated] (FLINK-13009) YARNSessionCapacitySchedulerITCase#testVCoresAreSetCorrectlyAndJobManagerHostnameAreShownInWebInterfaceAndDynamicPropertiesAndYarnApplicationNameAndTaskManagerSlots thro

2019-06-26 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-13009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Congxian Qiu(klion26) updated FLINK-13009: -- Description: The test {{YARNSessionCapacitySchedulerITCase#testVCoresAreSetCo

[jira] [Updated] (FLINK-13009) YARNSessionCapacitySchedulerITCase#testVCoresAreSetCorrectlyAndJobManagerHostnameAreShownInWebInterfaceAndDynamicPropertiesAndYarnApplicationNameAndTaskManagerSlots thro

2019-06-26 Thread Congxian Qiu(klion26) (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-13009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Congxian Qiu(klion26) updated FLINK-13009: -- Description: The test {{YARNSessionCapacitySchedulerITCase#testVCoresAreSetCo

[jira] [Commented] (FLINK-16576) State inconsistency on restore with memory state backends

2020-03-28 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17069428#comment-17069428 ] Congxian Qiu(klion26) commented on FLINK-16576: --- The reason why the restor

[jira] [Created] (FLINK-16916) The logic of NullableSerializer#copy is wrong

2020-04-01 Thread Congxian Qiu(klion26) (Jira)
Congxian Qiu(klion26) created FLINK-16916: - Summary: The logic of NullableSerializer#copy is wrong Key: FLINK-16916 URL: https://issues.apache.org/jira/browse/FLINK-16916 Project: Flink

[jira] [Commented] (FLINK-16916) The logic of NullableSerializer#copy is wrong

2020-04-01 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17072593#comment-17072593 ] Congxian Qiu(klion26) commented on FLINK-16916: --- [~aljoscha] , what do you

[jira] [Commented] (FLINK-16724) ListSerializer cannot serialize list which containers null

2020-04-01 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17072596#comment-17072596 ] Congxian Qiu(klion26) commented on FLINK-16724: --- [~nppoly] thanks for repo

[jira] [Updated] (FLINK-16916) The logic of NullableSerializer#copy is wrong

2020-04-01 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Congxian Qiu(klion26) updated FLINK-16916: -- Fix Version/s: 1.10.2 1.9.3 1.8.4 > The

[jira] [Commented] (FLINK-16908) FlinkKafkaProducerITCase testScaleUpAfterScalingDown Timeout expired while initializing transactional state in 60000ms.

2020-04-02 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17074174#comment-17074174 ] Congxian Qiu(klion26) commented on FLINK-16908: --- another instance  [https:

[jira] [Commented] (FLINK-16724) ListSerializer cannot serialize list which containers null

2020-04-03 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17074991#comment-17074991 ] Congxian Qiu(klion26) commented on FLINK-16724: --- [~nppoly] What do you thi

[jira] [Created] (FLINK-17007) Add section "How to handle application parameters" in DataStream documentation

2020-04-06 Thread Congxian Qiu(klion26) (Jira)
Congxian Qiu(klion26) created FLINK-17007: - Summary: Add section "How to handle application parameters" in DataStream documentation Key: FLINK-17007 URL: https://issues.apache.org/jira/browse/FLINK-17007

[jira] [Created] (FLINK-17043) Putting more information into accounting when failing a job in FailureManager

2020-04-07 Thread Congxian Qiu(klion26) (Jira)
Congxian Qiu(klion26) created FLINK-17043: - Summary: Putting more information into accounting when failing a job in FailureManager Key: FLINK-17043 URL: https://issues.apache.org/jira/browse/FLINK-17043

[jira] [Created] (FLINK-19249) Job would wait sometime(~10 min) before failover if some connection broken

2020-09-15 Thread Congxian Qiu(klion26) (Jira)
Congxian Qiu(klion26) created FLINK-19249: - Summary: Job would wait sometime(~10 min) before failover if some connection broken Key: FLINK-19249 URL: https://issues.apache.org/jira/browse/FLINK-19249

[jira] [Commented] (FLINK-19249) Job would wait sometime(~10 min) before failover if some connection broken

2020-09-20 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17199167#comment-17199167 ] Congxian Qiu(klion26) commented on FLINK-19249: --- [~sewen] thanks for the r

[jira] [Created] (FLINK-19325) Optimize the consumed time for checkpoint completion

2020-09-21 Thread Congxian Qiu(klion26) (Jira)
Congxian Qiu(klion26) created FLINK-19325: - Summary: Optimize the consumed time for checkpoint completion Key: FLINK-19325 URL: https://issues.apache.org/jira/browse/FLINK-19325 Project: Flink

[jira] [Commented] (FLINK-19300) Timer loss after restoring from savepoint

2020-09-21 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17199331#comment-17199331 ] Congxian Qiu(klion26) commented on FLINK-19300: --- [~xianggao] thanks for re

[jira] [Commented] (FLINK-19249) Job would wait sometime(~10 min) before failover if some connection broken

2020-09-22 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17200033#comment-17200033 ] Congxian Qiu(klion26) commented on FLINK-19249: --- For the client side, we c

[jira] [Commented] (FLINK-19359) Restore from Checkpoint fails if checkpoint folders is corrupt/partial

2020-09-22 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17200040#comment-17200040 ] Congxian Qiu(klion26) commented on FLINK-19359: --- There is not {{_metadata}

[jira] [Commented] (FLINK-19381) Fix docs about relocatable savepoints

2020-09-24 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17201481#comment-17201481 ] Congxian Qiu(klion26) commented on FLINK-19381: --- Ah, the doc wasn't update

[jira] [Commented] (FLINK-15280) Checkpoint end-to-end test failed

2019-12-16 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16997279#comment-16997279 ] Congxian Qiu(klion26) commented on FLINK-15280: --- FYI FLINK-15105 wants to

[jira] [Closed] (FLINK-13553) KvStateServerHandlerTest.readInboundBlocking unstable on Travis

2019-12-19 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Congxian Qiu(klion26) closed FLINK-13553. - Resolution: Cannot Reproduce > KvStateServerHandlerTest.readInboundBlocking unst

[jira] [Commented] (FLINK-13553) KvStateServerHandlerTest.readInboundBlocking unstable on Travis

2019-12-19 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16999881#comment-16999881 ] Congxian Qiu(klion26) commented on FLINK-13553: --- Currently, can't reproduc

[jira] [Commented] (FLINK-15152) Job running without periodic checkpoint for stop failed at the beginning

2019-12-25 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17003193#comment-17003193 ] Congxian Qiu(klion26) commented on FLINK-15152: --- Thanks for reporting the

[jira] [Commented] (FLINK-15152) Job running without periodic checkpoint for stop failed at the beginning

2019-12-25 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17003427#comment-17003427 ] Congxian Qiu(klion26) commented on FLINK-15152: ---  After having a look at t

[jira] [Comment Edited] (FLINK-15152) Job running without periodic checkpoint for stop failed at the beginning

2019-12-25 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17003427#comment-17003427 ] Congxian Qiu(klion26) edited comment on FLINK-15152 at 12/26/19 2:27 AM: -

[jira] [Commented] (FLINK-15406) The savepoint is writted by "State Processor API" can't be restore by map or flatmap

2019-12-26 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17003837#comment-17003837 ] Congxian Qiu(klion26) commented on FLINK-15406: --- Hi, [~lintingbin]  From t

[jira] [Commented] (FLINK-15403) 'State Migration end-to-end test from 1.6' is unstable on travis.

2019-12-26 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17003840#comment-17003840 ] Congxian Qiu(klion26) commented on FLINK-15403: --- The exception in the desc

[jira] [Updated] (FLINK-15424) Make all AppendingState#add respect the java doc

2019-12-27 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Congxian Qiu(klion26) updated FLINK-15424: -- Component/s: Runtime / State Backends > Make all AppendingState#add respect th

[jira] [Created] (FLINK-15424) Make all AppendingState#add respect the java doc

2019-12-27 Thread Congxian Qiu(klion26) (Jira)
Congxian Qiu(klion26) created FLINK-15424: - Summary: Make all AppendingState#add respect the java doc Key: FLINK-15424 URL: https://issues.apache.org/jira/browse/FLINK-15424 Project: Flink

[jira] [Commented] (FLINK-15427) State TTL RocksDb backend end-to-end test stalls on travis

2019-12-27 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17004128#comment-17004128 ] Congxian Qiu(klion26) commented on FLINK-15427: --- I'll  take a look at this

[jira] [Commented] (FLINK-15427) State TTL RocksDb backend end-to-end test stalls on travis

2019-12-28 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17004461#comment-17004461 ] Congxian Qiu(klion26) commented on FLINK-15427: --- This test itself passed,

[jira] [Commented] (FLINK-15247) Closing (Testing)MiniCluster may cause ConcurrentModificationException

2019-12-30 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17005943#comment-17005943 ] Congxian Qiu(klion26) commented on FLINK-15247: --- another instance [https:/

[jira] [Updated] (FLINK-15451) TaskManagerProcessFailureBatchRecoveryITCase.testTaskManagerProcessFailure failed on azure

2019-12-31 Thread Congxian Qiu(klion26) (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Congxian Qiu(klion26) updated FLINK-15451: -- Summary: TaskManagerProcessFailureBatchRecoveryITCase.testTaskManagerProcessFa

[jira] [Created] (FLINK-15451) TaskManagerProcessFailureBatchRecoveryITCase.testTaskManagerProcessFailure

2019-12-31 Thread Congxian Qiu(klion26) (Jira)
Congxian Qiu(klion26) created FLINK-15451: - Summary: TaskManagerProcessFailureBatchRecoveryITCase.testTaskManagerProcessFailure Key: FLINK-15451 URL: https://issues.apache.org/jira/browse/FLINK-15451

  1   2   3   4   >