[jira] [Commented] (FLINK-4391) Provide support for asynchronous operations over streams

2016-08-14 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15420638#comment-15420638 ] Gyula Fora commented on FLINK-4391: --- We have also done something similar at King for han

[jira] [Created] (FLINK-4413) Improve savepoint restore error messages

2016-08-17 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-4413: - Summary: Improve savepoint restore error messages Key: FLINK-4413 URL: https://issues.apache.org/jira/browse/FLINK-4413 Project: Flink Issue Type: Improvement

[jira] [Updated] (FLINK-4413) Improve savepoint restore error messages

2016-08-17 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora updated FLINK-4413: -- Description: Currently when savepoint restore fails due to some problems with parallelism or the assign

[jira] [Created] (FLINK-4441) RocksDB statebackend makes all operators appear stateful

2016-08-21 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-4441: - Summary: RocksDB statebackend makes all operators appear stateful Key: FLINK-4441 URL: https://issues.apache.org/jira/browse/FLINK-4441 Project: Flink Issue Type:

[jira] [Commented] (FLINK-4445) Ignore unmatched state when restoring from savepoint

2016-08-22 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15430336#comment-15430336 ] Gyula Fora commented on FLINK-4445: --- Hi Ufuk, My personal experience is that it's very

[jira] [Resolved] (FLINK-4441) RocksDB statebackend makes all operators appear stateful

2016-08-24 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora resolved FLINK-4441. --- Resolution: Fixed > RocksDB statebackend makes all operators appear stateful > ---

[jira] [Created] (FLINK-4471) Rocks backend fully async snapshot restore fails with custom serializers

2016-08-24 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-4471: - Summary: Rocks backend fully async snapshot restore fails with custom serializers Key: FLINK-4471 URL: https://issues.apache.org/jira/browse/FLINK-4471 Project: Flink

[jira] [Assigned] (FLINK-4471) Rocks backend fully async snapshot restore fails with custom serializers

2016-08-24 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora reassigned FLINK-4471: - Assignee: Gyula Fora > Rocks backend fully async snapshot restore fails with custom serializers >

[jira] [Closed] (FLINK-4471) Rocks backend fully async snapshot restore fails with custom serializers

2016-08-25 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora closed FLINK-4471. - Resolution: Won't Fix > Rocks backend fully async snapshot restore fails with custom serializers > ---

[jira] [Commented] (FLINK-6006) Kafka Consumer can lose state if queried partition list is incomplete on restore

2017-03-23 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15938170#comment-15938170 ] Gyula Fora commented on FLINK-6006: --- I have a slight feeling that this didnt completely

[jira] [Commented] (FLINK-6006) Kafka Consumer can lose state if queried partition list is incomplete on restore

2017-03-23 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15938297#comment-15938297 ] Gyula Fora commented on FLINK-6006: --- I tried restarting the consumer when I was sure tha

[jira] [Commented] (FLINK-6006) Kafka Consumer can lose state if queried partition list is incomplete on restore

2017-03-23 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15938567#comment-15938567 ] Gyula Fora commented on FLINK-6006: --- Unfortunately I only have the JM log and that doesn

[jira] [Commented] (FLINK-6006) Kafka Consumer can lose state if queried partition list is incomplete on restore

2017-03-24 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15940010#comment-15940010 ] Gyula Fora commented on FLINK-6006: --- Don't be sorry, there is a high probability that I

[jira] [Created] (FLINK-6262) UnknownTopicOrPartitionException Kafka consumer error on broker restart/failure

2017-04-04 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-6262: - Summary: UnknownTopicOrPartitionException Kafka consumer error on broker restart/failure Key: FLINK-6262 URL: https://issues.apache.org/jira/browse/FLINK-6262 Project: Flin

[jira] [Created] (FLINK-6263) Leader error in Kafka producer on leader change (broker restart/failrue)

2017-04-04 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-6263: - Summary: Leader error in Kafka producer on leader change (broker restart/failrue) Key: FLINK-6263 URL: https://issues.apache.org/jira/browse/FLINK-6263 Project: Flink

[jira] [Created] (FLINK-6264) Kafka consumer fails if can't find leader for partition

2017-04-04 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-6264: - Summary: Kafka consumer fails if can't find leader for partition Key: FLINK-6264 URL: https://issues.apache.org/jira/browse/FLINK-6264 Project: Flink Issue Type: B

[jira] [Created] (FLINK-5068) YARN HA: Job scheduled before TM is up leading to "Not enough free slots" error

2016-11-15 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-5068: - Summary: YARN HA: Job scheduled before TM is up leading to "Not enough free slots" error Key: FLINK-5068 URL: https://issues.apache.org/jira/browse/FLINK-5068 Project: Flin

[jira] [Created] (FLINK-5071) YARN: yarn.containers.vcores config not respected when checking for vcores

2016-11-15 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-5071: - Summary: YARN: yarn.containers.vcores config not respected when checking for vcores Key: FLINK-5071 URL: https://issues.apache.org/jira/browse/FLINK-5071 Project: Flink

[jira] [Commented] (FLINK-4182) HA recovery not working properly under ApplicationMaster failures.

2016-11-15 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667283#comment-15667283 ] Gyula Fora commented on FLINK-4182: --- Ah sorry those jobs were 1.1.3 (I am not sure if th

[jira] [Commented] (FLINK-4182) HA recovery not working properly under ApplicationMaster failures.

2016-11-15 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15667277#comment-15667277 ] Gyula Fora commented on FLINK-4182: --- Hi, I have observed the same scenario in many of

[jira] [Commented] (FLINK-5071) YARN: yarn.containers.vcores config not respected when checking for vcores

2016-11-21 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15683135#comment-15683135 ] Gyula Fora commented on FLINK-5071: --- Both actually. The problem is here: https://github

[jira] [Commented] (FLINK-3397) Failed streaming jobs should fall back to the most recent checkpoint/savepoint

2016-06-23 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3397?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15346080#comment-15346080 ] Gyula Fora commented on FLINK-3397: --- You are always free to give it a shot, to be honest

[jira] [Commented] (FLINK-4120) Lightweight fault tolerance through recomputing lost state

2016-06-27 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15350565#comment-15350565 ] Gyula Fora commented on FLINK-4120: --- Hi, Thanks for the interesting proposal. I have se

[jira] [Updated] (FLINK-4120) Lightweight fault tolerance through recomputing lost state

2016-06-27 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora updated FLINK-4120: -- Priority: Minor (was: Major) > Lightweight fault tolerance through recomputing lost state > ---

[jira] [Updated] (FLINK-4120) Lightweight fault tolerance through recomputing lost state

2016-06-27 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora updated FLINK-4120: -- Component/s: (was: Core) State Backends, Checkpointing > Lightweight fault toleranc

[jira] [Created] (FLINK-4155) Get Kafka producer partition info in open method instead of constructor

2016-07-05 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-4155: - Summary: Get Kafka producer partition info in open method instead of constructor Key: FLINK-4155 URL: https://issues.apache.org/jira/browse/FLINK-4155 Project: Flink

[jira] [Created] (FLINK-4193) Task manager JVM crashes while deploying cancelling jobs

2016-07-11 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-4193: - Summary: Task manager JVM crashes while deploying cancelling jobs Key: FLINK-4193 URL: https://issues.apache.org/jira/browse/FLINK-4193 Project: Flink Issue Type:

[jira] [Commented] (FLINK-4193) Task manager JVM crashes while deploying cancelling jobs

2016-07-11 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371139#comment-15371139 ] Gyula Fora commented on FLINK-4193: --- I know that rocks is bundled within the application

[jira] [Commented] (FLINK-4193) Task manager JVM crashes while deploying cancelling jobs

2016-07-11 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371134#comment-15371134 ] Gyula Fora commented on FLINK-4193: --- We are using a pretty recent version, just a couple

[jira] [Commented] (FLINK-4193) Task manager JVM crashes while deploying cancelling jobs

2016-07-11 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15371524#comment-15371524 ] Gyula Fora commented on FLINK-4193: --- It happened multiple times in a row on the same clu

[jira] [Commented] (FLINK-4193) Task manager JVM crashes while deploying cancelling jobs

2016-07-12 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15372638#comment-15372638 ] Gyula Fora commented on FLINK-4193: --- I can probably try a different GC later but I have

[jira] [Commented] (FLINK-3006) TypeExtractor fails on custom type

2016-07-27 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15395198#comment-15395198 ] Gyula Fora commented on FLINK-3006: --- I agree, Stephan, closing it. > TypeExtractor fail

[jira] [Closed] (FLINK-3006) TypeExtractor fails on custom type

2016-07-27 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora closed FLINK-3006. - Resolution: Not A Problem > TypeExtractor fails on custom type > -- > >

[jira] [Created] (FLINK-4275) Generic Folding, Reducing and List states behave differently from other state backends

2016-07-28 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-4275: - Summary: Generic Folding, Reducing and List states behave differently from other state backends Key: FLINK-4275 URL: https://issues.apache.org/jira/browse/FLINK-4275 Projec

[jira] [Commented] (FLINK-4275) Generic Folding, Reducing and List states behave differently from other state backends

2016-07-29 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15399143#comment-15399143 ] Gyula Fora commented on FLINK-4275: --- I would not remove them in any case. They provide a

[jira] [Created] (FLINK-6291) Internal Timer service cannot be "removed"

2017-04-11 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-6291: - Summary: Internal Timer service cannot be "removed" Key: FLINK-6291 URL: https://issues.apache.org/jira/browse/FLINK-6291 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-6291) Internal Timer service cannot be "removed"

2017-04-18 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15972650#comment-15972650 ] Gyula Fora commented on FLINK-6291: --- Sounds good :) > Internal Timer service cannot be

[jira] [Commented] (FLINK-6264) Kafka consumer fails if can't find leader for partition

2017-04-20 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15976253#comment-15976253 ] Gyula Fora commented on FLINK-6264: --- I am not sure what causes the exception, probably [

[jira] [Commented] (FLINK-6390) Add Trigger Hooks to the Checkpoint Coordinator

2017-04-26 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985119#comment-15985119 ] Gyula Fora commented on FLINK-6390: --- Hi Stephan, This looks pretty useful. One thing th

[jira] [Commented] (FLINK-6390) Add Trigger Hooks to the Checkpoint Coordinator

2017-04-26 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15985122#comment-15985122 ] Gyula Fora commented on FLINK-6390: --- we could call it completeCheckpoint for example >

[jira] [Commented] (FLINK-6390) Add Trigger Hooks to the Checkpoint Coordinator

2017-04-26 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15986084#comment-15986084 ] Gyula Fora commented on FLINK-6390: --- Not a big deal but Stephan I think you missed my co

[jira] [Created] (FLINK-4873) Add config option to specify "home directory" for YARN client resource sharing

2016-10-20 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-4873: - Summary: Add config option to specify "home directory" for YARN client resource sharing Key: FLINK-4873 URL: https://issues.apache.org/jira/browse/FLINK-4873 Project: Flink

[jira] [Commented] (FLINK-4948) Consider using checksums or similar to detect bad checkpoints

2016-10-27 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15612892#comment-15612892 ] Gyula Fora commented on FLINK-4948: --- I think in general this would be very nice but what

[jira] [Commented] (FLINK-4193) Task manager JVM crashes while deploying cancelling jobs

2016-10-31 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15622787#comment-15622787 ] Gyula Fora commented on FLINK-4193: --- Yes, still an issue that we could not figure out. W

[jira] [Commented] (FLINK-4193) Task manager JVM crashes while deploying cancelling jobs

2016-11-01 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15624754#comment-15624754 ] Gyula Fora commented on FLINK-4193: --- These issues usually happened inside the RocksDB.op

[jira] [Commented] (FLINK-3659) Add ConnectWithBroadcast Operation

2016-11-01 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15625086#comment-15625086 ] Gyula Fora commented on FLINK-3659: --- Hi, Would this work in a way as connected streams w

[jira] [Commented] (FLINK-3659) Add ConnectWithBroadcast Operation

2016-11-01 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15625089#comment-15625089 ] Gyula Fora commented on FLINK-3659: --- (I have a workshop after lunch so might be slow to

[jira] [Commented] (FLINK-3659) Add ConnectWithBroadcast Operation

2016-11-02 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15628205#comment-15628205 ] Gyula Fora commented on FLINK-3659: --- I agree that we should try to keep the API as it is

[jira] [Created] (FLINK-4992) Expose String parameter for timers in Timely functions and TimerService

2016-11-02 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-4992: - Summary: Expose String parameter for timers in Timely functions and TimerService Key: FLINK-4992 URL: https://issues.apache.org/jira/browse/FLINK-4992 Project: Flink

[jira] [Commented] (FLINK-4992) Expose String parameter for timers in Timely functions and TimerService

2016-11-02 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15630678#comment-15630678 ] Gyula Fora commented on FLINK-4992: --- Well, it doesn't have to be Strings but there shoul

[jira] [Created] (FLINK-5985) Flink treats every task as stateful (making topology changes impossible)

2017-03-07 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-5985: - Summary: Flink treats every task as stateful (making topology changes impossible) Key: FLINK-5985 URL: https://issues.apache.org/jira/browse/FLINK-5985 Project: Flink

[jira] [Commented] (FLINK-5985) Flink treats every task as stateful (making topology changes impossible)

2017-03-08 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15900980#comment-15900980 ] Gyula Fora commented on FLINK-5985: --- It should be possible to set it for *only* the stat

[jira] [Commented] (FLINK-5985) Flink treats every task as stateful (making topology changes impossible)

2017-03-08 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15900995#comment-15900995 ] Gyula Fora commented on FLINK-5985: --- even something as simple as stream.filter(event ->

[jira] [Created] (FLINK-5996) Jobmanager HA should not crash on lost ZK node

2017-03-08 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-5996: - Summary: Jobmanager HA should not crash on lost ZK node Key: FLINK-5996 URL: https://issues.apache.org/jira/browse/FLINK-5996 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-5985) Flink treats every task as stateful (making topology changes impossible)

2017-03-08 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15901105#comment-15901105 ] Gyula Fora commented on FLINK-5985: --- Hi Ufuk, I did exactly this yesterday: First got

[jira] [Commented] (FLINK-5996) Jobmanager HA should not crash on lost ZK node

2017-03-08 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15901108#comment-15901108 ] Gyula Fora commented on FLINK-5996: --- That is correct. The jobmanager fails and recovers

[jira] [Commented] (FLINK-5985) Flink treats every task as stateful (making topology changes impossible)

2017-03-08 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15901424#comment-15901424 ] Gyula Fora commented on FLINK-5985: --- I was somehow assuming that this affects all jobs.

[jira] [Commented] (FLINK-6006) Kafka Consumer can lose state if queried partition list is incomplete on restore

2017-03-09 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15902973#comment-15902973 ] Gyula Fora commented on FLINK-6006: --- Thank you for looking into this! > Kafka Consumer

[jira] [Commented] (FLINK-5985) Flink treats every task as stateful (making topology changes impossible)

2017-03-09 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15903110#comment-15903110 ] Gyula Fora commented on FLINK-5985: --- You can easily reproduce the bug locally by running

[jira] [Commented] (FLINK-6537) Umbrella issue for fixes to incremental snapshots

2017-05-15 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16010393#comment-16010393 ] Gyula Fora commented on FLINK-6537: --- Hi Stefan! Thank you for all the work :) I have t

[jira] [Commented] (FLINK-6633) Register with shared state registry before adding to CompletedCheckpointStore

2017-05-19 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16017374#comment-16017374 ] Gyula Fora commented on FLINK-6633: --- I have tried you fix, restore now works for increme

[jira] [Commented] (FLINK-6537) Umbrella issue for fixes to incremental snapshots

2017-05-22 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16019611#comment-16019611 ] Gyula Fora commented on FLINK-6537: --- Hi Stefan! I can confirm that the incremental check

[jira] [Commented] (FLINK-6537) Umbrella issue for fixes to incremental snapshots

2017-05-22 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1601#comment-1601 ] Gyula Fora commented on FLINK-6537: --- You can look at all the logs I have posted. For exa

[jira] [Commented] (FLINK-6537) Umbrella issue for fixes to incremental snapshots

2017-05-23 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1602#comment-1602 ] Gyula Fora commented on FLINK-6537: --- Thanks a lot for looking into this. I wont be able

[jira] [Commented] (FLINK-6685) SafetyNetCloseableRegistry is closed prematurely in Task::triggerCheckpointBarrier

2017-05-24 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16023140#comment-16023140 ] Gyula Fora commented on FLINK-6685: --- Thanks Stefan, awesome job! I can confirm that this

[jira] [Created] (FLINK-6742) Savepoint conversion might fail if task ids change

2017-05-27 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-6742: - Summary: Savepoint conversion might fail if task ids change Key: FLINK-6742 URL: https://issues.apache.org/jira/browse/FLINK-6742 Project: Flink Issue Type: Bug

[jira] [Updated] (FLINK-6742) Savepoint conversion might fail if operators change

2017-05-27 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora updated FLINK-6742: -- Summary: Savepoint conversion might fail if operators change (was: Savepoint conversion might fail if t

[jira] [Commented] (FLINK-6742) Savepoint conversion might fail if operators change

2017-05-27 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16027477#comment-16027477 ] Gyula Fora commented on FLINK-6742: --- what's the reason for not allowing the removal / ne

[jira] [Commented] (FLINK-6742) Savepoint conversion might fail if operators change

2017-05-27 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16027495#comment-16027495 ] Gyula Fora commented on FLINK-6742: --- In my case I would like to remove 2 operators while

[jira] [Commented] (FLINK-6742) Savepoint conversion might fail if operators change

2017-05-27 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16027498#comment-16027498 ] Gyula Fora commented on FLINK-6742: --- They are incompatible due to some custom state back

[jira] [Updated] (FLINK-6742) Savepoint conversion might fail if operators change

2017-05-27 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora updated FLINK-6742: -- Priority: Minor (was: Critical) > Savepoint conversion might fail if operators change > ---

[jira] [Commented] (FLINK-6742) Savepoint conversion might fail if operators change

2017-05-27 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16027499#comment-16027499 ] Gyula Fora commented on FLINK-6742: --- Thank you for the help Chesnay! Should we close thi

[jira] [Created] (FLINK-6754) Savepoints don't respect client timeout config

2017-05-29 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-6754: - Summary: Savepoints don't respect client timeout config Key: FLINK-6754 URL: https://issues.apache.org/jira/browse/FLINK-6754 Project: Flink Issue Type: Bug

[jira] [Closed] (FLINK-1313) Add support for out-of-place aggregations for streaming

2017-05-29 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora closed FLINK-1313. - Resolution: Won't Fix > Add support for out-of-place aggregations for streaming >

[jira] [Created] (FLINK-6755) Allow triggering Checkpoints through command line client

2017-05-29 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-6755: - Summary: Allow triggering Checkpoints through command line client Key: FLINK-6755 URL: https://issues.apache.org/jira/browse/FLINK-6755 Project: Flink Issue Type:

[jira] [Updated] (FLINK-6754) Savepoints don't respect client timeout config

2017-05-29 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora updated FLINK-6754: -- Affects Version/s: 1.3.0 1.2.1 > Savepoints don't respect client timeout config >

[jira] [Created] (FLINK-6762) Cannot rescale externalized incremental checkpoints

2017-05-29 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-6762: - Summary: Cannot rescale externalized incremental checkpoints Key: FLINK-6762 URL: https://issues.apache.org/jira/browse/FLINK-6762 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-10387) StateBackend create methods should return interface not abstract KeyedStateBackend classes

2018-09-21 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-10387: -- Summary: StateBackend create methods should return interface not abstract KeyedStateBackend classes Key: FLINK-10387 URL: https://issues.apache.org/jira/browse/FLINK-10387

[jira] [Closed] (FLINK-1003) Spread out scheduling strategy

2018-10-02 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora closed FLINK-1003. - Resolution: Won't Fix > Spread out scheduling strategy > -- > >

[jira] [Commented] (FLINK-9635) Local recovery scheduling can cause spread out of tasks

2018-10-02 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-9635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16635168#comment-16635168 ] Gyula Fora commented on FLINK-9635: --- Should we consider this issue a blocker? I know th

[jira] [Commented] (FLINK-13874) StreamingFileSink fails to recover (truncate) properly

2019-08-28 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16917819#comment-16917819 ] Gyula Fora commented on FLINK-13874: I added some extra logging to figure out what t

[jira] [Commented] (FLINK-13874) StreamingFileSink fails to recover (truncate) properly

2019-08-28 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16917833#comment-16917833 ] Gyula Fora commented on FLINK-13874: And while the lease revoking process seem to ti

[jira] [Commented] (FLINK-13874) StreamingFileSink fails to recover (truncate) properly

2019-08-28 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16918043#comment-16918043 ] Gyula Fora commented on FLINK-13874: I increased the lease timeout to 5 minutes, it

[jira] [Commented] (FLINK-13874) StreamingFileSink fails to recover (truncate) properly

2019-08-29 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16918526#comment-16918526 ] Gyula Fora commented on FLINK-13874: This seems like an issue with HDFS as the lease

[jira] [Commented] (FLINK-13874) StreamingFileSink fails to recover (truncate) properly

2019-08-29 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16918528#comment-16918528 ] Gyula Fora commented on FLINK-13874: We will investigate this further in the future

[jira] [Resolved] (FLINK-13874) StreamingFileSink fails to recover (truncate) properly

2019-08-29 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora resolved FLINK-13874. Resolution: Won't Fix This seems to be an issue with HDFS or HDFS configuration, I will close this

[jira] [Commented] (FLINK-13566) Support checkpoint configuration through flink-conf.yaml

2019-09-05 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16923145#comment-16923145 ] Gyula Fora commented on FLINK-13566: Let's wait until the discussion of FLIP-59  [ht

[jira] [Created] (FLINK-13979) Translate new streamfilesink docs to chinese

2019-09-05 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-13979: -- Summary: Translate new streamfilesink docs to chinese Key: FLINK-13979 URL: https://issues.apache.org/jira/browse/FLINK-13979 Project: Flink Issue Type: New Feat

[jira] [Closed] (FLINK-13842) Improve Javadocs and web documentation of the StreamingFileSink

2019-09-05 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora closed FLINK-13842. -- Resolution: Fixed > Improve Javadocs and web documentation of the StreamingFileSink >

[jira] [Created] (FLINK-14002) FlinkKafkaProducer constructor that takes KafkaSerializationSchema shouldnt take default topic

2019-09-07 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-14002: -- Summary: FlinkKafkaProducer constructor that takes KafkaSerializationSchema shouldnt take default topic Key: FLINK-14002 URL: https://issues.apache.org/jira/browse/FLINK-14002

[jira] [Commented] (FLINK-14002) FlinkKafkaProducer constructor that takes KafkaSerializationSchema shouldnt take default topic

2019-09-08 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16925398#comment-16925398 ] Gyula Fora commented on FLINK-14002: Actually the default topic is used in case of K

[jira] [Commented] (FLINK-4873) Add config option to specify "home directory" for YARN client resource sharing

2019-09-10 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-4873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16926473#comment-16926473 ] Gyula Fora commented on FLINK-4873: --- Hm, looks like I had the change commit on my maste

[jira] [Assigned] (FLINK-4873) Add config option to specify "home directory" for YARN client resource sharing

2019-09-10 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-4873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora reassigned FLINK-4873: - Assignee: Matyas Orhidi > Add config option to specify "home directory" for YARN client resource

[jira] [Created] (FLINK-14048) Flink client hangs after trying to kill Yarn Job during deployment

2019-09-10 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-14048: -- Summary: Flink client hangs after trying to kill Yarn Job during deployment Key: FLINK-14048 URL: https://issues.apache.org/jira/browse/FLINK-14048 Project: Flink

[jira] [Commented] (FLINK-14048) Flink client hangs after trying to kill Yarn Job during deployment

2019-09-11 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16927313#comment-16927313 ] Gyula Fora commented on FLINK-14048: yes it was in per-job mode > Flink client hang

[jira] [Commented] (FLINK-14002) FlinkKafkaProducer constructor that takes KafkaSerializationSchema shouldnt take default topic

2019-09-12 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16928513#comment-16928513 ] Gyula Fora commented on FLINK-14002: I am bit busy in the next few days but I can de

[jira] [Assigned] (FLINK-14145) getLatestCheckpoint(true) returns wrong checkpoint

2019-09-20 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora reassigned FLINK-14145: -- Assignee: Gyula Fora > getLatestCheckpoint(true) returns wrong checkpoint > -

[jira] [Commented] (FLINK-14145) getLatestCheckpoint(true) returns wrong checkpoint

2019-09-20 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16934222#comment-16934222 ] Gyula Fora commented on FLINK-14145: Thanks [~uce] for catching this, I should have

[jira] [Resolved] (FLINK-14145) getLatestCheckpoint(true) returns wrong checkpoint

2019-09-24 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora resolved FLINK-14145. Resolution: Fixed > getLatestCheckpoint(true) returns wrong checkpoint > -

[jira] [Commented] (FLINK-6755) Allow triggering Checkpoints through command line client

2019-05-15 Thread Gyula Fora (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16840198#comment-16840198 ] Gyula Fora commented on FLINK-6755: --- I agree with the leaked abstraction, I dont see th

  1   2   3   4   5   6   7   8   9   10   >