[jira] [Created] (FLINK-4577) Re-enable transparent reshard handling in Kinesis Consumer

2016-09-04 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-4577: -- Summary: Re-enable transparent reshard handling in Kinesis Consumer Key: FLINK-4577 URL: https://issues.apache.org/jira/browse/FLINK-4577 Project: Flink

[jira] [Created] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-09-04 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-4576: -- Summary: Low Watermark Service in JobManager for Streaming Sources Key: FLINK-4576 URL: https://issues.apache.org/jira/browse/FLINK-4576 Project: Flink

[jira] [Updated] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-09-04 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4576: --- Description: As per discussion in FLINK-4341 by [~aljoscha] and [~StephanEwen], we

[jira] [Updated] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-09-04 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4576: --- Priority: Blocker (was: Major) > Low Watermark Service in JobManager for Streaming

[jira] [Updated] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-09-04 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4576: --- Description: As per discussion in FLINK-4341 by [~aljoscha] and [~StephanEwen], we

[jira] [Updated] (FLINK-4574) Strengthen fetch interval implementation in Kinesis consumer

2016-09-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4574: --- Description: As pointed out by [~rmetzger], right now the fetch interval

[jira] [Updated] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-09-04 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4576: --- Description: As per discussion in FLINK-4341 by [~aljoscha] and [~StephanEwen], we

[jira] [Resolved] (FLINK-4514) ExpiredIteratorException in Kinesis Consumer on long catch-ups to head of stream

2016-08-30 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai resolved FLINK-4514. Resolution: Resolved > ExpiredIteratorException in Kinesis Consumer on long

[jira] [Commented] (FLINK-4514) ExpiredIteratorException in Kinesis Consumer on long catch-ups to head of stream

2016-08-30 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449397#comment-15449397 ] Tzu-Li (Gordon) Tai commented on FLINK-4514: Resolved for master in

[jira] [Updated] (FLINK-4559) Kinesis Producer not setting credentials provider properly when AWS_CREDENTIALS_PROVIDER is "AUTO"

2016-09-01 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4559: --- Fix Version/s: 1.1.3 > Kinesis Producer not setting credentials provider properly

[jira] [Updated] (FLINK-4559) Kinesis Producer not setting credentials provider properly when AWS_CREDENTIALS_PROVIDER is "AUTO"

2016-09-01 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4559: --- Affects Version/s: 1.1.1 1.1.0 > Kinesis Producer not setting

[jira] [Updated] (FLINK-4559) Kinesis Producer not setting credentials provider properly when AWS_CREDENTIALS_PROVIDER is "AUTO"

2016-09-01 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4559: --- Affects Version/s: 1.1.2 > Kinesis Producer not setting credentials provider properly

[jira] [Created] (FLINK-4559) Kinesis Producer not setting credentials provider properly when AWS_CREDENTIALS_PROVIDER is "AUTO"

2016-09-01 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-4559: -- Summary: Kinesis Producer not setting credentials provider properly when AWS_CREDENTIALS_PROVIDER is "AUTO" Key: FLINK-4559 URL:

[jira] [Commented] (FLINK-4536) Possible thread leak in Task Manager

2016-08-30 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15451227#comment-15451227 ] Tzu-Li (Gordon) Tai commented on FLINK-4536: Thanks for reporting this. Just to confirm, Could

[jira] [Updated] (FLINK-4619) JobManager does not answer to client when restore from savepoint fails

2016-09-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4619: --- Fix Version/s: 1.1.3 1.2.0 > JobManager does not answer to client

[jira] [Commented] (FLINK-4618) Last kafka message gets consumed twice when restarting job

2016-09-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15490153#comment-15490153 ] Tzu-Li (Gordon) Tai commented on FLINK-4618: I'm answering your questions in SO, so that we

[jira] [Commented] (FLINK-4619) JobManager does not answer to client when restore from savepoint fails

2016-09-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15490308#comment-15490308 ] Tzu-Li (Gordon) Tai commented on FLINK-4619: +1 to fix. Encountered this also. From the

[jira] [Updated] (FLINK-4619) JobManager does not answer to client when restore from savepoint fails

2016-09-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4619: --- Affects Version/s: 1.1.0 1.1.2 > JobManager does not answer to

[jira] [Commented] (FLINK-4619) JobManager does not answer to client when restore from savepoint fails

2016-09-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15490344#comment-15490344 ] Tzu-Li (Gordon) Tai commented on FLINK-4619: I think

[jira] [Created] (FLINK-4611) Make "AUTO" credential provider as default for Kinesis Connector

2016-09-10 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-4611: -- Summary: Make "AUTO" credential provider as default for Kinesis Connector Key: FLINK-4611 URL: https://issues.apache.org/jira/browse/FLINK-4611 Project:

[jira] [Commented] (FLINK-4602) Move RocksDB backed to proper package

2016-09-10 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15481024#comment-15481024 ] Tzu-Li (Gordon) Tai commented on FLINK-4602: Does this also mean we will be moving the rocksdb

[jira] [Updated] (FLINK-4611) Make "AUTO" credential provider as default for Kinesis Connector

2016-09-10 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4611: --- Priority: Major (was: Minor) > Make "AUTO" credential provider as default for

[jira] [Comment Edited] (FLINK-4618) Last kafka message gets consumed twice when restarting job

2016-09-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489901#comment-15489901 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4618 at 9/14/16 9:43 AM: -

[jira] [Comment Edited] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-09-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489818#comment-15489818 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4576 at 9/14/16 10:13 AM: --

[jira] [Comment Edited] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-09-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489818#comment-15489818 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4576 at 9/14/16 10:14 AM: --

[jira] [Comment Edited] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-09-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489818#comment-15489818 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4576 at 9/14/16 8:37 AM: -

[jira] [Comment Edited] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-09-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489818#comment-15489818 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4576 at 9/14/16 8:36 AM: -

[jira] [Commented] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-09-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489818#comment-15489818 ] Tzu-Li (Gordon) Tai commented on FLINK-4576: Hi [~aljoscha], thanks for the help! I've

[jira] [Commented] (FLINK-4618) Last kafka message gets consumed twice when restarting job

2016-09-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489901#comment-15489901 ] Tzu-Li (Gordon) Tai commented on FLINK-4618: Hi [~melmoth], Flink achieves exactly-once

[jira] [Comment Edited] (FLINK-4618) Last kafka message gets consumed twice when restarting job

2016-09-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489901#comment-15489901 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4618 at 9/14/16 9:16 AM: -

[jira] [Comment Edited] (FLINK-4618) Last kafka message gets consumed twice when restarting job

2016-09-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489901#comment-15489901 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4618 at 9/14/16 9:17 AM: -

[jira] [Commented] (FLINK-4617) Kafka & Flink duplicate messages on restart

2016-09-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489944#comment-15489944 ] Tzu-Li (Gordon) Tai commented on FLINK-4617: Hi Matthew, >From your description, I'm assuming

[jira] [Comment Edited] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-09-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489818#comment-15489818 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4576 at 9/14/16 8:37 AM: -

[jira] [Comment Edited] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-09-14 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15489818#comment-15489818 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4576 at 9/14/16 8:36 AM: -

[jira] [Commented] (FLINK-4618) Last kafka message gets consumed twice when restarting job

2016-09-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15493845#comment-15493845 ] Tzu-Li (Gordon) Tai commented on FLINK-4618: Hi [~melmoth], I've revisited this issue, and I

[jira] [Reopened] (FLINK-4618) Last kafka message gets consumed twice when restarting job

2016-09-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai reopened FLINK-4618: > Last kafka message gets consumed twice when restarting job >

[jira] [Updated] (FLINK-4618) Kafka Consumer 0.9 should start from the next record on startup from offsets in Kafka

2016-09-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4618: --- Summary: Kafka Consumer 0.9 should start from the next record on startup from offsets

[jira] [Updated] (FLINK-4618) FlinkKafkaConsumer09 should start from the next record on startup from offsets in Kafka

2016-09-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4618: --- Fix Version/s: 1.1.3 1.2.0 > FlinkKafkaConsumer09 should start

[jira] [Commented] (FLINK-4617) Kafka & Flink duplicate messages on restart

2016-09-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15493950#comment-15493950 ] Tzu-Li (Gordon) Tai commented on FLINK-4617: Revisited and reconfirmed that this is actually a

[jira] [Updated] (FLINK-4618) Kafka Consumer 0.9 should start from the next record when startup from Kafka offsets

2016-09-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4618: --- Summary: Kafka Consumer 0.9 should start from the next record when startup from Kafka

[jira] [Updated] (FLINK-4618) Kafka Consumer 0.9 should start from the next record when startup from Kafka offsets

2016-09-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4618: --- Description: **Original reported ticket title: Last kafka message gets consumed twice

[jira] [Updated] (FLINK-4618) Kafka Consumer 0.9 should start from the next record on startup from Kafka offsets

2016-09-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4618: --- Summary: Kafka Consumer 0.9 should start from the next record on startup from Kafka

[jira] [Updated] (FLINK-4618) FlinkKafkaConsumer09 should start from the next record on startup from offsets in Kafka

2016-09-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4618: --- Summary: FlinkKafkaConsumer09 should start from the next record on startup from

[jira] [Commented] (FLINK-4618) FlinkKafkaConsumer09 should start from the next record on startup from offsets in Kafka

2016-09-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15493927#comment-15493927 ] Tzu-Li (Gordon) Tai commented on FLINK-4618: I've confirmed that the problem only exists in

[jira] [Comment Edited] (FLINK-4618) FlinkKafkaConsumer09 should start from the next record on startup from offsets in Kafka

2016-09-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15493927#comment-15493927 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4618 at 9/15/16 5:04 PM: -

[jira] [Created] (FLINK-4627) Use Flink's PropertiesUtil in Kinesis connector to extract typed values from config properties

2016-09-15 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-4627: -- Summary: Use Flink's PropertiesUtil in Kinesis connector to extract typed values from config properties Key: FLINK-4627 URL:

[jira] [Updated] (FLINK-4627) Use Flink's PropertiesUtil in Kinesis connector to extract typed values from config properties

2016-09-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4627: --- Description: Right now value extraction from config properties in the Kinesis

[jira] [Commented] (FLINK-4618) FlinkKafkaConsumer09 should start from the next record on startup from offsets in Kafka

2016-09-30 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535151#comment-15535151 ] Tzu-Li (Gordon) Tai commented on FLINK-4618: Hi [~melmoth], I'd like to make sure this bug is

[jira] [Commented] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-09-30 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535824#comment-15535824 ] Tzu-Li (Gordon) Tai commented on FLINK-4576: Hi [~aljoscha], I'm struggling a bit on

[jira] [Comment Edited] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-09-30 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535824#comment-15535824 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4576 at 9/30/16 12:12 PM: --

[jira] [Created] (FLINK-4753) Kafka 0.8 connector's Periodic Offset Committer should synchronize on checkpoint lock

2016-10-06 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-4753: -- Summary: Kafka 0.8 connector's Periodic Offset Committer should synchronize on checkpoint lock Key: FLINK-4753 URL: https://issues.apache.org/jira/browse/FLINK-4753

[jira] [Comment Edited] (FLINK-4722) Consumer group concept not working properly with FlinkKafkaConsumer09

2016-10-04 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15544170#comment-15544170 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4722 at 10/4/16 7:41 AM: -

[jira] [Updated] (FLINK-4514) ExpiredIteratorException in Kinesis Consumer on long catch-ups to head of stream

2016-10-04 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4514: --- Fix Version/s: (was: 1.1.2) 1.1.3 > ExpiredIteratorException

[jira] [Closed] (FLINK-4617) Kafka & Flink duplicate messages on restart

2016-09-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai closed FLINK-4617. -- > Kafka & Flink duplicate messages on restart > ---

[jira] [Resolved] (FLINK-4617) Kafka & Flink duplicate messages on restart

2016-09-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai resolved FLINK-4617. Resolution: Not A Bug > Kafka & Flink duplicate messages on restart >

[jira] [Commented] (FLINK-4617) Kafka & Flink duplicate messages on restart

2016-09-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15492513#comment-15492513 ] Tzu-Li (Gordon) Tai commented on FLINK-4617: Hi [~mbarlocker], now that this is sorted out (on

[jira] [Commented] (FLINK-4629) Kafka v 0.10 Support

2016-09-19 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15502547#comment-15502547 ] Tzu-Li (Gordon) Tai commented on FLINK-4629: Closing this as a duplicate issue. Please follow

[jira] [Closed] (FLINK-4629) Kafka v 0.10 Support

2016-09-19 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai closed FLINK-4629. -- > Kafka v 0.10 Support > > > Key: FLINK-4629 >

[jira] [Resolved] (FLINK-4629) Kafka v 0.10 Support

2016-09-19 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai resolved FLINK-4629. Resolution: Duplicate > Kafka v 0.10 Support > > >

[jira] [Commented] (FLINK-4618) FlinkKafkaConsumer09 should start from the next record on startup from offsets in Kafka

2016-09-19 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15503822#comment-15503822 ] Tzu-Li (Gordon) Tai commented on FLINK-4618: {{partition.isOffsetDefined()}} in this part of

[jira] [Commented] (FLINK-4618) FlinkKafkaConsumer09 should start from the next record on startup from offsets in Kafka

2016-09-19 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15503837#comment-15503837 ] Tzu-Li (Gordon) Tai commented on FLINK-4618: I'm not entirely sure of whether the

[jira] [Commented] (FLINK-4618) FlinkKafkaConsumer09 should start from the next record on startup from offsets in Kafka

2016-09-19 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15503766#comment-15503766 ] Tzu-Li (Gordon) Tai commented on FLINK-4618: [~melmoth] Great to hear, thanks for picking up

[jira] [Comment Edited] (FLINK-4618) FlinkKafkaConsumer09 should start from the next record on startup from offsets in Kafka

2016-09-19 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15503837#comment-15503837 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4618 at 9/19/16 3:55 PM: -

[jira] [Commented] (FLINK-4629) Kafka v 0.10 Support

2016-09-20 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508374#comment-15508374 ] Tzu-Li (Gordon) Tai commented on FLINK-4629: I just recalled that I have actually replied to

[jira] [Commented] (FLINK-4341) Kinesis connector does not emit maximum watermark properly

2016-08-18 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426232#comment-15426232 ] Tzu-Li (Gordon) Tai commented on FLINK-4341: I can take a look at fixing this after I get back

[jira] [Comment Edited] (FLINK-4341) Kinesis connector does not emit maximum watermark properly

2016-08-18 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15426232#comment-15426232 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4341 at 8/18/16 10:28 AM: --

[jira] [Updated] (FLINK-4514) ExpiredIteratorException in Kinesis Consumer on long catch-ups to head of stream

2016-08-26 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4514: --- Affects Version/s: 1.1.1 1.1.0 > ExpiredIteratorException in

[jira] [Created] (FLINK-4514) ExpiredIteratorException in Kinesis Consumer on long catch-ups to head of stream

2016-08-26 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-4514: -- Summary: ExpiredIteratorException in Kinesis Consumer on long catch-ups to head of stream Key: FLINK-4514 URL: https://issues.apache.org/jira/browse/FLINK-4514

[jira] [Updated] (FLINK-4514) ExpiredIteratorException in Kinesis Consumer on long catch-ups to head of stream

2016-08-26 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4514: --- Description: Original mailing thread for the reported issue:

[jira] [Commented] (FLINK-4341) Kinesis connector does not emit maximum watermark properly

2016-08-23 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433850#comment-15433850 ] Tzu-Li (Gordon) Tai commented on FLINK-4341: I agree. I've been trying around for the past few

[jira] [Updated] (FLINK-4194) Implement isEndOfStream() for KinesisDeserializationSchema

2016-08-28 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4194: --- Affects Version/s: (was: 1.1.0) > Implement isEndOfStream() for

[jira] [Updated] (FLINK-4194) Implement isEndOfStream() for KinesisDeserializationSchema

2016-08-28 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4194: --- Fix Version/s: 1.2.0 > Implement isEndOfStream() for KinesisDeserializationSchema >

[jira] [Comment Edited] (FLINK-4194) Implement isEndOfStream() for KinesisDeserializationSchema

2016-08-28 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15443628#comment-15443628 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4194 at 8/28/16 3:39 PM: -

[jira] [Created] (FLINK-4523) Allow Kinesis Consumer to start from specific timestamp

2016-08-28 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-4523: -- Summary: Allow Kinesis Consumer to start from specific timestamp Key: FLINK-4523 URL: https://issues.apache.org/jira/browse/FLINK-4523 Project: Flink

[jira] [Updated] (FLINK-4523) Allow Kinesis Consumer to start from specific timestamp

2016-08-28 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4523: --- Description: We had a Kinesis user requesting this feature on an offline chat. To be

[jira] [Updated] (FLINK-4523) Allow Kinesis Consumer to start from specific timestamp / Date

2016-08-28 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4523: --- Summary: Allow Kinesis Consumer to start from specific timestamp / Date (was: Allow

[jira] [Commented] (FLINK-4194) Implement isEndOfStream() for KinesisDeserializationSchema

2016-08-28 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15443628#comment-15443628 ] Tzu-Li (Gordon) Tai commented on FLINK-4194: I'll implement {{isEndOfShard()}} as an initial

[jira] [Commented] (FLINK-4618) FlinkKafkaConsumer09 should start from the next record on startup from offsets in Kafka

2016-09-28 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529466#comment-15529466 ] Tzu-Li (Gordon) Tai commented on FLINK-4618: Hi [~melmoth], I just had a look at the Kafka

[jira] [Comment Edited] (FLINK-4618) FlinkKafkaConsumer09 should start from the next record on startup from offsets in Kafka

2016-09-28 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529466#comment-15529466 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4618 at 9/28/16 12:43 PM: --

[jira] [Comment Edited] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-09-30 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535824#comment-15535824 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4576 at 9/30/16 4:16 PM: -

[jira] [Comment Edited] (FLINK-4722) Consumer group concept not working properly with FlinkKafkaConsumer09

2016-10-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15542796#comment-15542796 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4722 at 10/3/16 4:30 PM: -

[jira] [Commented] (FLINK-4722) Consumer group concept not working properly with FlinkKafkaConsumer09

2016-10-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15542796#comment-15542796 ] Tzu-Li (Gordon) Tai commented on FLINK-4722: Is there any reason / use case why you need to

[jira] [Comment Edited] (FLINK-4722) Consumer group concept not working properly with FlinkKafkaConsumer09

2016-10-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15542855#comment-15542855 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4722 at 10/3/16 4:55 PM: -

[jira] [Commented] (FLINK-4722) Consumer group concept not working properly with FlinkKafkaConsumer09

2016-10-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15542855#comment-15542855 ] Tzu-Li (Gordon) Tai commented on FLINK-4722: I'm not sure if I fully understand your use case,

[jira] [Comment Edited] (FLINK-4722) Consumer group concept not working properly with FlinkKafkaConsumer09

2016-10-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15542855#comment-15542855 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4722 at 10/3/16 4:58 PM: -

[jira] [Comment Edited] (FLINK-4722) Consumer group concept not working properly with FlinkKafkaConsumer09

2016-10-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15542855#comment-15542855 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4722 at 10/3/16 4:58 PM: -

[jira] [Comment Edited] (FLINK-4722) Consumer group concept not working properly with FlinkKafkaConsumer09

2016-10-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15542796#comment-15542796 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4722 at 10/3/16 4:35 PM: -

[jira] [Created] (FLINK-4727) Kafka 0.9 Consumer should also checkpoint auto retrieved offsets even when no data is read

2016-10-03 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-4727: -- Summary: Kafka 0.9 Consumer should also checkpoint auto retrieved offsets even when no data is read Key: FLINK-4727 URL:

[jira] [Updated] (FLINK-4727) Kafka 0.9 Consumer should also checkpoint auto retrieved offsets even when no data is read

2016-10-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4727: --- Description: This is basically the 0.9 version counterpart for FLINK-3440. When the

[jira] [Comment Edited] (FLINK-4722) Consumer group concept not working properly with FlinkKafkaConsumer09

2016-10-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15542145#comment-15542145 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4722 at 10/3/16 11:00 AM: --

[jira] [Commented] (FLINK-4722) Consumer group concept not working properly with FlinkKafkaConsumer09

2016-10-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15542145#comment-15542145 ] Tzu-Li (Gordon) Tai commented on FLINK-4722: Hi [~sudhanshulenka], I think this is expected

[jira] [Created] (FLINK-4723) Unify definition of committed offsets to Kafka / ZK for Kafka 0.8 and 0.9 consumer

2016-10-01 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-4723: -- Summary: Unify definition of committed offsets to Kafka / ZK for Kafka 0.8 and 0.9 consumer Key: FLINK-4723 URL: https://issues.apache.org/jira/browse/FLINK-4723

[jira] [Updated] (FLINK-4723) Unify definition of committed offsets to Kafka / ZK for Kafka 0.8 and 0.9 consumer

2016-10-01 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4723: --- Description: The proper "definition" of the offsets committed back to Kafka / ZK

[jira] [Resolved] (FLINK-4618) FlinkKafkaConsumer09 should start from the next record on startup from offsets in Kafka

2016-10-01 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai resolved FLINK-4618. Resolution: Fixed > FlinkKafkaConsumer09 should start from the next record on

[jira] [Commented] (FLINK-4618) FlinkKafkaConsumer09 should start from the next record on startup from offsets in Kafka

2016-10-01 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15538306#comment-15538306 ] Tzu-Li (Gordon) Tai commented on FLINK-4618: Resolved for master via

[jira] [Updated] (FLINK-4723) Unify definition of committed offsets to Kafka / ZK for Kafka 0.8 and 0.9 consumer

2016-10-01 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4723: --- Description: The proper "definition" of the offsets committed back to Kafka / ZK

[jira] [Updated] (FLINK-4723) Unify definition of committed offsets to Kafka / ZK for Kafka 0.8 and 0.9 consumer

2016-10-01 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4723: --- Description: The proper "definition" of the offsets committed back to Kafka / ZK

[jira] [Updated] (FLINK-4723) Unify behaviour of committed offsets to Kafka / ZK for Kafka 0.8 and 0.9 consumer

2016-10-01 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4723: --- Summary: Unify behaviour of committed offsets to Kafka / ZK for Kafka 0.8 and 0.9

[jira] [Updated] (FLINK-4723) Unify behaviour of committed offsets to Kafka / ZK for Kafka 0.8 and 0.9 consumer

2016-10-01 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4723: --- Description: The proper "behaviour" of the offsets committed back to Kafka / ZK

[jira] [Comment Edited] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-09-30 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535824#comment-15535824 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4576 at 9/30/16 2:35 PM: -

<    1   2   3   4   5   6   7   8   9   10   >