[jira] [Comment Edited] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-09-30 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535824#comment-15535824 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4576 at 9/30/16 2:57 PM: -

[jira] [Comment Edited] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-09-30 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15535824#comment-15535824 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4576 at 9/30/16 3:06 PM: -

[jira] [Comment Edited] (FLINK-4722) Consumer group concept not working properly with FlinkKafkaConsumer09

2016-10-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15544170#comment-15544170 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4722 at 10/4/16 3:04 AM: -

[jira] [Commented] (FLINK-4722) Consumer group concept not working properly with FlinkKafkaConsumer09

2016-10-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15544170#comment-15544170 ] Tzu-Li (Gordon) Tai commented on FLINK-4722: One last comment: Iterating over all data

[jira] [Comment Edited] (FLINK-4722) Consumer group concept not working properly with FlinkKafkaConsumer09

2016-10-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15544170#comment-15544170 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4722 at 10/4/16 3:17 AM: -

[jira] [Comment Edited] (FLINK-4722) Consumer group concept not working properly with FlinkKafkaConsumer09

2016-10-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15544170#comment-15544170 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4722 at 10/4/16 3:01 AM: -

[jira] [Comment Edited] (FLINK-4905) Kafka test instability IllegalStateException: Client is not started

2016-10-25 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607498#comment-15607498 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4905 at 10/26/16 5:39 AM: --

[jira] [Comment Edited] (FLINK-4905) Kafka test instability IllegalStateException: Client is not started

2016-10-25 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607498#comment-15607498 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4905 at 10/26/16 5:37 AM: --

[jira] [Commented] (FLINK-4905) Kafka test instability IllegalStateException: Client is not started

2016-10-25 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607498#comment-15607498 ] Tzu-Li (Gordon) Tai commented on FLINK-4905: Had a quick look at this. The only place we're

[jira] [Comment Edited] (FLINK-4905) Kafka test instability IllegalStateException: Client is not started

2016-10-25 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607498#comment-15607498 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4905 at 10/26/16 5:37 AM: --

[jira] [Comment Edited] (FLINK-4905) Kafka test instability IllegalStateException: Client is not started

2016-10-25 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15607498#comment-15607498 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4905 at 10/26/16 5:35 AM: --

[jira] [Comment Edited] (FLINK-5017) Introduce WatermarkStatus stream element to allow for temporarily idle streaming sources

2016-11-07 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15644949#comment-15644949 ] Tzu-Li (Gordon) Tai edited comment on FLINK-5017 at 11/7/16 6:25 PM: -

[jira] [Commented] (FLINK-5017) Introduce WatermarkStatus stream element to allow for temporarily idle streaming sources

2016-11-07 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15644993#comment-15644993 ] Tzu-Li (Gordon) Tai commented on FLINK-5017: I think the main difference in my thinking is

[jira] [Commented] (FLINK-5017) Introduce WatermarkStatus stream element to allow for temporarily idle streaming sources

2016-11-07 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15644949#comment-15644949 ] Tzu-Li (Gordon) Tai commented on FLINK-5017: Hi [~aljoscha], To ease discussion a bit, I've

[jira] [Comment Edited] (FLINK-5017) Introduce WatermarkStatus stream element to allow for temporarily idle streaming sources

2016-11-07 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15644949#comment-15644949 ] Tzu-Li (Gordon) Tai edited comment on FLINK-5017 at 11/7/16 6:27 PM: -

[jira] [Comment Edited] (FLINK-5017) Introduce WatermarkStatus stream element to allow for temporarily idle streaming sources

2016-11-07 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15644949#comment-15644949 ] Tzu-Li (Gordon) Tai edited comment on FLINK-5017 at 11/7/16 6:29 PM: -

[jira] [Commented] (FLINK-5017) Introduce WatermarkStatus stream element to allow for temporarily idle streaming sources

2016-11-08 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15649511#comment-15649511 ] Tzu-Li (Gordon) Tai commented on FLINK-5017: Ah, I see. I actually didn't realize it is

[jira] [Commented] (FLINK-5017) Introduce WatermarkStatus stream element to allow for temporarily idle streaming sources

2016-11-09 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15653044#comment-15653044 ] Tzu-Li (Gordon) Tai commented on FLINK-5017: Yes I think that's better than

[jira] [Comment Edited] (FLINK-5017) Introduce WatermarkStatus stream element to allow for temporarily idle streaming sources

2016-11-07 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15644993#comment-15644993 ] Tzu-Li (Gordon) Tai edited comment on FLINK-5017 at 11/7/16 6:57 PM: -

[jira] [Commented] (FLINK-5013) Flink Kinesis connector doesn't work on old EMR versions

2016-11-10 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655925#comment-15655925 ] Tzu-Li (Gordon) Tai commented on FLINK-5013: This seems a bit odd to me, because I also

[jira] [Assigned] (FLINK-5013) Flink Kinesis connector doesn't work on old EMR versions

2016-11-10 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai reassigned FLINK-5013: -- Assignee: Tzu-Li (Gordon) Tai > Flink Kinesis connector doesn't work on old

[jira] [Commented] (FLINK-5013) Flink Kinesis connector doesn't work on old EMR versions

2016-11-10 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15655931#comment-15655931 ] Tzu-Li (Gordon) Tai commented on FLINK-5013: Adding the testing for different external service

[jira] [Comment Edited] (FLINK-5013) Flink Kinesis connector doesn't work on old EMR versions

2016-11-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656541#comment-15656541 ] Tzu-Li (Gordon) Tai edited comment on FLINK-5013 at 11/11/16 8:59 AM: --

[jira] [Commented] (FLINK-5013) Flink Kinesis connector doesn't work on old EMR versions

2016-11-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15656541#comment-15656541 ] Tzu-Li (Gordon) Tai commented on FLINK-5013: Results of my tests: Shading {{com.amazonaws.*}}

[jira] [Comment Edited] (FLINK-5013) Flink Kinesis connector doesn't work on old EMR versions

2016-11-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657042#comment-15657042 ] Tzu-Li (Gordon) Tai edited comment on FLINK-5013 at 11/11/16 1:15 PM: --

[jira] [Commented] (FLINK-5013) Flink Kinesis connector doesn't work on old EMR versions

2016-11-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657042#comment-15657042 ] Tzu-Li (Gordon) Tai commented on FLINK-5013: Update: I've found the problem with the

[jira] [Commented] (FLINK-5017) Introduce WatermarkStatus stream element to allow for temporarily idle streaming sources

2016-11-04 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15638540#comment-15638540 ] Tzu-Li (Gordon) Tai commented on FLINK-5017: If we want to extend {{Watermark}}, to aid with

[jira] [Comment Edited] (FLINK-5017) Introduce WatermarkStatus stream element to allow for temporarily idle streaming sources

2016-11-04 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15638540#comment-15638540 ] Tzu-Li (Gordon) Tai edited comment on FLINK-5017 at 11/5/16 4:09 AM: -

[jira] [Comment Edited] (FLINK-5018) User configurable source idle timeout to work with WatermarkStatus emitting

2016-11-07 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15643615#comment-15643615 ] Tzu-Li (Gordon) Tai edited comment on FLINK-5018 at 11/7/16 9:28 AM: -

[jira] [Comment Edited] (FLINK-5018) User configurable source idle timeout to work with WatermarkStatus emitting

2016-11-07 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15643743#comment-15643743 ] Tzu-Li (Gordon) Tai edited comment on FLINK-5018 at 11/7/16 10:20 AM: --

[jira] [Comment Edited] (FLINK-5017) Introduce WatermarkStatus stream element to allow for temporarily idle streaming sources

2016-11-07 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15644993#comment-15644993 ] Tzu-Li (Gordon) Tai edited comment on FLINK-5017 at 11/7/16 6:49 PM: -

[jira] [Commented] (FLINK-5018) User configurable source idle timeout to work with WatermarkStatus emitting

2016-11-07 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15643615#comment-15643615 ] Tzu-Li (Gordon) Tai commented on FLINK-5018: Some updates after thinking about this: I'm not

[jira] [Resolved] (FLINK-4723) Unify behaviour of committed offsets to Kafka / ZK for Kafka 0.8 and 0.9 consumer

2016-10-17 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai resolved FLINK-4723. Resolution: Fixed > Unify behaviour of committed offsets to Kafka / ZK for Kafka

[jira] [Commented] (FLINK-4723) Unify behaviour of committed offsets to Kafka / ZK for Kafka 0.8 and 0.9 consumer

2016-10-17 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584364#comment-15584364 ] Tzu-Li (Gordon) Tai commented on FLINK-4723: [~rmetzger] Should this fix go into release-1.1

[jira] [Commented] (FLINK-4723) Unify behaviour of committed offsets to Kafka / ZK for Kafka 0.8 and 0.9 consumer

2016-10-17 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584361#comment-15584361 ] Tzu-Li (Gordon) Tai commented on FLINK-4723: Resolved for master via

[jira] [Comment Edited] (FLINK-4723) Unify behaviour of committed offsets to Kafka / ZK for Kafka 0.8 and 0.9 consumer

2016-10-17 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15584364#comment-15584364 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4723 at 10/18/16 3:58 AM: --

[jira] [Assigned] (FLINK-3123) Allow setting custom start-offsets for the Kafka consumer

2016-10-24 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai reassigned FLINK-3123: -- Assignee: Tzu-Li (Gordon) Tai > Allow setting custom start-offsets for the

[jira] [Updated] (FLINK-3123) Allow setting custom start-offsets for the Kafka consumer

2016-10-24 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-3123: --- Fix Version/s: 1.2.0 > Allow setting custom start-offsets for the Kafka consumer >

[jira] [Commented] (FLINK-4727) Kafka 0.9 Consumer should also checkpoint auto retrieved offsets even when no data is read

2016-10-18 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15587389#comment-15587389 ] Tzu-Li (Gordon) Tai commented on FLINK-4727: Resolved for master via

[jira] [Comment Edited] (FLINK-3123) Allow setting custom start-offsets for the Kafka consumer

2016-11-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657704#comment-15657704 ] Tzu-Li (Gordon) Tai edited comment on FLINK-3123 at 11/11/16 6:18 PM: --

[jira] [Comment Edited] (FLINK-4905) Kafka test instability IllegalStateException: Client is not started

2016-11-22 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15686881#comment-15686881 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4905 at 11/22/16 2:28 PM: --

[jira] [Commented] (FLINK-4905) Kafka test instability IllegalStateException: Client is not started

2016-11-22 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15686881#comment-15686881 ] Tzu-Li (Gordon) Tai commented on FLINK-4905: Hi [~Andrew Efimov], Thanks for looking at this.

[jira] [Resolved] (FLINK-4155) Get Kafka producer partition info in open method instead of constructor

2016-11-22 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai resolved FLINK-4155. Resolution: Fixed > Get Kafka producer partition info in open method instead of

[jira] [Created] (FLINK-5128) Get Kafka partitions in FlinkKafkaProducer only if a partitioner is set

2016-11-22 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-5128: -- Summary: Get Kafka partitions in FlinkKafkaProducer only if a partitioner is set Key: FLINK-5128 URL: https://issues.apache.org/jira/browse/FLINK-5128

[jira] [Commented] (FLINK-4155) Get Kafka producer partition info in open method instead of constructor

2016-11-22 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687157#comment-15687157 ] Tzu-Li (Gordon) Tai commented on FLINK-4155: Resolved for master with

[jira] [Commented] (FLINK-5075) Kinesis consumer incorrectly determines shards as newly discovered when tested against Kinesalite

2016-11-24 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15692971#comment-15692971 ] Tzu-Li (Gordon) Tai commented on FLINK-5075: Resolved for {{master}} via

[jira] [Updated] (FLINK-5075) Kinesis consumer incorrectly determines shards as newly discovered when tested against Kinesalite

2016-11-24 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-5075: --- Fix Version/s: 1.2.0 > Kinesis consumer incorrectly determines shards as newly

[jira] [Updated] (FLINK-5075) Kinesis consumer incorrectly determines shards as newly discovered when tested against Kinesalite

2016-11-24 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-5075: --- Fix Version/s: 1.1.4 > Kinesis consumer incorrectly determines shards as newly

[jira] [Resolved] (FLINK-5075) Kinesis consumer incorrectly determines shards as newly discovered when tested against Kinesalite

2016-11-24 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai resolved FLINK-5075. Resolution: Fixed > Kinesis consumer incorrectly determines shards as newly

[jira] [Commented] (FLINK-5013) Flink Kinesis connector doesn't work on old EMR versions

2016-11-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669628#comment-15669628 ] Tzu-Li (Gordon) Tai commented on FLINK-5013: Resolved for master with

[jira] [Created] (FLINK-5075) Kinesis consumer incorrectly determines shards as newly discovered when tested against Kinesalite

2016-11-15 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-5075: -- Summary: Kinesis consumer incorrectly determines shards as newly discovered when tested against Kinesalite Key: FLINK-5075 URL:

[jira] [Comment Edited] (FLINK-5013) Flink Kinesis connector doesn't work on old EMR versions

2016-11-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669628#comment-15669628 ] Tzu-Li (Gordon) Tai edited comment on FLINK-5013 at 11/16/16 6:53 AM: --

[jira] [Updated] (FLINK-5013) Flink Kinesis connector doesn't work on old EMR versions

2016-11-16 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-5013: --- Fix Version/s: 1.1.4 > Flink Kinesis connector doesn't work on old EMR versions >

[jira] [Closed] (FLINK-4727) Kafka 0.9 Consumer should also checkpoint auto retrieved offsets even when no data is read

2016-11-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai closed FLINK-4727. -- Resolution: Resolved > Kafka 0.9 Consumer should also checkpoint auto retrieved offsets

[jira] [Comment Edited] (FLINK-5013) Flink Kinesis connector doesn't work on old EMR versions

2016-11-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15669628#comment-15669628 ] Tzu-Li (Gordon) Tai edited comment on FLINK-5013 at 11/16/16 6:55 AM: --

[jira] [Updated] (FLINK-5075) Kinesis consumer incorrectly determines shards as newly discovered when tested against Kinesalite

2016-11-16 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-5075: --- Assignee: (was: Tzu-Li (Gordon) Tai) > Kinesis consumer incorrectly determines

[jira] [Assigned] (FLINK-5075) Kinesis consumer incorrectly determines shards as newly discovered when tested against Kinesalite

2016-11-16 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai reassigned FLINK-5075: -- Assignee: Tzu-Li (Gordon) Tai > Kinesis consumer incorrectly determines shards

[jira] [Comment Edited] (FLINK-3123) Allow setting custom start-offsets for the Kafka consumer

2016-11-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657704#comment-15657704 ] Tzu-Li (Gordon) Tai edited comment on FLINK-3123 at 11/11/16 6:18 PM: --

[jira] [Commented] (FLINK-3123) Allow setting custom start-offsets for the Kafka consumer

2016-11-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15657704#comment-15657704 ] Tzu-Li (Gordon) Tai commented on FLINK-3123: Hi [~juho.autio.r], {quote} My use case is

[jira] [Comment Edited] (FLINK-4022) Partition discovery / regex topic subscription for the Kafka consumer

2016-11-02 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15629801#comment-15629801 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4022 at 11/2/16 5:48 PM: -

[jira] [Comment Edited] (FLINK-4022) Partition discovery / regex topic subscription for the Kafka consumer

2016-11-02 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15629801#comment-15629801 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4022 at 11/2/16 5:47 PM: -

[jira] [Commented] (FLINK-4022) Partition discovery / regex topic subscription for the Kafka consumer

2016-11-02 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15629801#comment-15629801 ] Tzu-Li (Gordon) Tai commented on FLINK-4022: Hi [~StephanEwen], Right now, for subtasks that

[jira] [Comment Edited] (FLINK-4022) Partition discovery / regex topic subscription for the Kafka consumer

2016-11-02 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15629801#comment-15629801 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4022 at 11/2/16 5:48 PM: -

[jira] [Commented] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-11-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631848#comment-15631848 ] Tzu-Li (Gordon) Tai commented on FLINK-4576: Back to analysis of the original problem: I

[jira] [Comment Edited] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-11-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631848#comment-15631848 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4576 at 11/3/16 7:11 AM: -

[jira] [Comment Edited] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-11-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631848#comment-15631848 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4576 at 11/3/16 7:10 AM: -

[jira] [Comment Edited] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-11-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631848#comment-15631848 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4576 at 11/3/16 7:11 AM: -

[jira] [Comment Edited] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-11-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631848#comment-15631848 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4576 at 11/3/16 7:12 AM: -

[jira] [Comment Edited] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-11-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631848#comment-15631848 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4576 at 11/3/16 7:27 AM: -

[jira] [Commented] (FLINK-4022) Partition discovery / regex topic subscription for the Kafka consumer

2016-11-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15632388#comment-15632388 ] Tzu-Li (Gordon) Tai commented on FLINK-4022: Hi [~jgrier], I actually was thinking about a

[jira] [Comment Edited] (FLINK-4022) Partition discovery / regex topic subscription for the Kafka consumer

2016-11-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15632388#comment-15632388 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4022 at 11/3/16 11:06 AM: --

[jira] [Comment Edited] (FLINK-4022) Partition discovery / regex topic subscription for the Kafka consumer

2016-11-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15632388#comment-15632388 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4022 at 11/3/16 11:06 AM: --

[jira] [Comment Edited] (FLINK-4022) Partition discovery / regex topic subscription for the Kafka consumer

2016-11-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15632388#comment-15632388 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4022 at 11/3/16 11:08 AM: --

[jira] [Comment Edited] (FLINK-4022) Partition discovery / regex topic subscription for the Kafka consumer

2016-11-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15632388#comment-15632388 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4022 at 11/3/16 11:09 AM: --

[jira] [Comment Edited] (FLINK-4022) Partition discovery / regex topic subscription for the Kafka consumer

2016-11-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15632388#comment-15632388 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4022 at 11/3/16 11:10 AM: --

[jira] [Commented] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-11-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631789#comment-15631789 ] Tzu-Li (Gordon) Tai commented on FLINK-4576: Hi [~aljoscha], I think there's another problem

[jira] [Commented] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-11-02 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631405#comment-15631405 ] Tzu-Li (Gordon) Tai commented on FLINK-4576: Ah, right. Got lost on this part mid-discussion.

[jira] [Comment Edited] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-11-04 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15635719#comment-15635719 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4576 at 11/4/16 8:58 AM: -

[jira] [Commented] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-11-04 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15635719#comment-15635719 ] Tzu-Li (Gordon) Tai commented on FLINK-4576: Yes, that's true. In general, if all input

[jira] [Comment Edited] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-11-04 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15635727#comment-15635727 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4576 at 11/4/16 9:38 AM: -

[jira] [Comment Edited] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-11-04 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15635719#comment-15635719 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4576 at 11/4/16 9:40 AM: -

[jira] [Comment Edited] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-11-04 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15635719#comment-15635719 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4576 at 11/4/16 8:59 AM: -

[jira] [Commented] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-11-04 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15635727#comment-15635727 ] Tzu-Li (Gordon) Tai commented on FLINK-4576: If we let sources emit "watermark idle" and

[jira] [Comment Edited] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-11-04 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15635719#comment-15635719 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4576 at 11/4/16 9:08 AM: -

[jira] [Commented] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-11-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15635107#comment-15635107 ] Tzu-Li (Gordon) Tai commented on FLINK-4576: I think the general problem with a central

[jira] [Comment Edited] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-11-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15635107#comment-15635107 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4576 at 11/4/16 3:52 AM: -

[jira] [Comment Edited] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-11-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15635107#comment-15635107 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4576 at 11/4/16 4:01 AM: -

[jira] [Comment Edited] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-11-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15635107#comment-15635107 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4576 at 11/4/16 3:57 AM: -

[jira] [Created] (FLINK-5018) User configurable source idle timeout to work with WatermarkStatus emitting

2016-11-04 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-5018: -- Summary: User configurable source idle timeout to work with WatermarkStatus emitting Key: FLINK-5018 URL: https://issues.apache.org/jira/browse/FLINK-5018

[jira] [Commented] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-11-04 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15636003#comment-15636003 ] Tzu-Li (Gordon) Tai commented on FLINK-4576: Oh, I see what you mean by timeout now. Yes, I

[jira] [Comment Edited] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-11-04 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15636003#comment-15636003 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4576 at 11/4/16 11:00 AM: --

[jira] [Closed] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-11-04 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai closed FLINK-4576. -- Resolution: Won't Fix > Low Watermark Service in JobManager for Streaming Sources >

[jira] [Commented] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-11-04 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15636021#comment-15636021 ] Tzu-Li (Gordon) Tai commented on FLINK-4576: Thanks for all the input, [~aljoscha] and

[jira] [Created] (FLINK-5017) Introduce WatermarkStatus stream element to allow for temporarily idle streaming sources

2016-11-04 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-5017: -- Summary: Introduce WatermarkStatus stream element to allow for temporarily idle streaming sources Key: FLINK-5017 URL:

[jira] [Commented] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-11-04 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15636243#comment-15636243 ] Tzu-Li (Gordon) Tai commented on FLINK-4576: The re-opened tickets, split as separate tasks:

[jira] [Commented] (FLINK-5017) Introduce WatermarkStatus stream element to allow for temporarily idle streaming sources

2016-11-04 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15636743#comment-15636743 ] Tzu-Li (Gordon) Tai commented on FLINK-5017: I had considered this, by defining values "-1"

[jira] [Comment Edited] (FLINK-5017) Introduce WatermarkStatus stream element to allow for temporarily idle streaming sources

2016-11-04 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15636743#comment-15636743 ] Tzu-Li (Gordon) Tai edited comment on FLINK-5017 at 11/4/16 3:48 PM: -

[jira] [Commented] (FLINK-4022) Partition discovery / regex topic subscription for the Kafka consumer

2016-11-02 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15629178#comment-15629178 ] Tzu-Li (Gordon) Tai commented on FLINK-4022: This is currently blocked by FLINK-4576, which

[jira] [Commented] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-10-29 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15617827#comment-15617827 ] Tzu-Li (Gordon) Tai commented on FLINK-4576: Hi [~aljoscha], Thanks a lot for the pointers,

[jira] [Comment Edited] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-10-29 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15617827#comment-15617827 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4576 at 10/29/16 9:46 AM: --

<    1   2   3   4   5   6   7   8   9   10   >