[jira] [Updated] (FLINK-3211) Add AWS Kinesis streaming connector

2016-01-09 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-3211: --- Fix Version/s: (was: 1.0.0) > Add AWS Kinesis streaming connector >

[jira] [Updated] (FLINK-3211) Add AWS Kinesis streaming connector

2016-01-09 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-3211: --- Description: AWS Kinesis is a widely adopted message queue used by AWS users, much

[jira] [Updated] (FLINK-3211) Add AWS Kinesis streaming connector

2016-01-09 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-3211: --- Description: AWS Kinesis is a widely adopted message queue used by AWS users, much

[jira] [Updated] (FLINK-3211) Add AWS Kinesis streaming connector

2016-01-09 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-3211: --- Description: AWS Kinesis is a widely adopted message queue used by AWS users, much

[jira] [Updated] (FLINK-3211) Add AWS Kinesis streaming connector

2016-01-09 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-3211: --- Affects Version/s: 1.0.0 > Add AWS Kinesis streaming connector >

[jira] [Updated] (FLINK-3211) Add AWS Kinesis streaming connector

2016-01-09 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-3211: --- Description: AWS Kinesis is a widely adopted message queue used by AWS users, much

[jira] [Updated] (FLINK-3211) Add AWS Kinesis streaming connector

2016-01-09 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-3211: --- Description: AWS Kinesis is a widely adopted message queue used by AWS users, much

[jira] [Updated] (FLINK-3211) Add AWS Kinesis streaming connector

2016-01-09 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-3211: --- Description: AWS Kinesis is a widely adopted message queue used by AWS users, much

[jira] [Commented] (FLINK-3211) Add AWS Kinesis streaming connector

2016-01-09 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090928#comment-15090928 ] Tzu-Li (Gordon) Tai commented on FLINK-3211: A follow-up regarding whether or not the Kinesis

[jira] [Comment Edited] (FLINK-3211) Add AWS Kinesis streaming connector

2016-01-09 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090928#comment-15090928 ] Tzu-Li (Gordon) Tai edited comment on FLINK-3211 at 1/10/16 6:40 AM: -

[jira] [Created] (FLINK-3211) Add AWS Kinesis streaming connector

2016-01-08 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-3211: -- Summary: Add AWS Kinesis streaming connector Key: FLINK-3211 URL: https://issues.apache.org/jira/browse/FLINK-3211 Project: Flink Issue Type:

[jira] [Updated] (FLINK-3211) Add AWS Kinesis streaming connector

2016-01-09 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-3211: --- Description: AWS Kinesis is a widely adopted message queue used by AWS users, much

[jira] [Commented] (FLINK-3211) Add AWS Kinesis streaming connector

2016-01-12 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15095775#comment-15095775 ] Tzu-Li (Gordon) Tai commented on FLINK-3211: Some issues on the originally planned

[jira] [Created] (FLINK-3231) Handle Kinesis-side resharding in Kinesis streaming consumer

2016-01-13 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-3231: -- Summary: Handle Kinesis-side resharding in Kinesis streaming consumer Key: FLINK-3231 URL: https://issues.apache.org/jira/browse/FLINK-3231 Project:

[jira] [Commented] (FLINK-3211) Add AWS Kinesis streaming connector

2016-01-13 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15095796#comment-15095796 ] Tzu-Li (Gordon) Tai commented on FLINK-3211: Very happy to help out and contribute :) > Add

[jira] [Commented] (FLINK-3211) Add AWS Kinesis streaming connector

2016-01-13 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15095795#comment-15095795 ] Tzu-Li (Gordon) Tai commented on FLINK-3211: Opening separate sub-tasks for source consumer /

[jira] [Created] (FLINK-3229) Kinesis consumer with integration of Flink's checkpointing mechanics

2016-01-13 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-3229: -- Summary: Kinesis consumer with integration of Flink's checkpointing mechanics Key: FLINK-3229 URL: https://issues.apache.org/jira/browse/FLINK-3229

[jira] [Updated] (FLINK-3229) Kinesis streaming consumer with integration of Flink's checkpointing mechanics

2016-01-13 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-3229: --- Summary: Kinesis streaming consumer with integration of Flink's checkpointing

[jira] [Created] (FLINK-3230) Kinesis streaming producer

2016-01-13 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-3230: -- Summary: Kinesis streaming producer Key: FLINK-3230 URL: https://issues.apache.org/jira/browse/FLINK-3230 Project: Flink Issue Type: Sub-task

[jira] [Comment Edited] (FLINK-3211) Add AWS Kinesis streaming connector

2016-01-13 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15095796#comment-15095796 ] Tzu-Li (Gordon) Tai edited comment on FLINK-3211 at 1/13/16 8:11 AM: -

[jira] [Comment Edited] (FLINK-3211) Add AWS Kinesis streaming connector

2016-01-13 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15095795#comment-15095795 ] Tzu-Li (Gordon) Tai edited comment on FLINK-3211 at 1/13/16 9:50 AM: -

[jira] [Comment Edited] (FLINK-3211) Add AWS Kinesis streaming connector

2016-01-13 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15095795#comment-15095795 ] Tzu-Li (Gordon) Tai edited comment on FLINK-3211 at 1/13/16 9:49 AM: -

[jira] [Updated] (FLINK-3231) Handle Kinesis-side resharding in Kinesis streaming consumer

2016-01-13 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-3231: --- Description: A big difference between Kinesis shards and Kafka partitions is that

[jira] [Updated] (FLINK-3231) Handle Kinesis-side resharding in Kinesis streaming consumer

2016-01-13 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-3231: --- Description: A big difference between Kinesis shards and Kafka partitions is that

[jira] [Commented] (FLINK-3211) Add AWS Kinesis streaming connector

2016-01-10 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15091408#comment-15091408 ] Tzu-Li (Gordon) Tai commented on FLINK-3211: Thanks [~StephanEwen] for the response and help

[jira] [Assigned] (FLINK-3211) Add AWS Kinesis streaming connector

2016-01-10 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai reassigned FLINK-3211: -- Assignee: Tzu-Li (Gordon) Tai > Add AWS Kinesis streaming connector >

[jira] [Updated] (FLINK-4022) Partition discovery / regex topic subscription for the Kafka consumer

2016-06-05 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4022: --- Description: Example: allow users to subscribe to "topic-n*", so that the consumer

[jira] [Created] (FLINK-4022) Partition discovery / regex topic subscription for the Kafka consumer

2016-06-05 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-4022: -- Summary: Partition discovery / regex topic subscription for the Kafka consumer Key: FLINK-4022 URL: https://issues.apache.org/jira/browse/FLINK-4022

[jira] [Commented] (FLINK-4022) Partition discovery / regex topic subscription for the Kafka consumer

2016-06-05 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315787#comment-15315787 ] Tzu-Li (Gordon) Tai commented on FLINK-4022: I'd like to start working on this feature if it's

[jira] [Updated] (FLINK-4020) Remove shard list querying from Kinesis consumer constructor

2016-06-05 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4020: --- Description: Currently FlinkKinesisConsumer is querying for the whole list of shards

[jira] [Assigned] (FLINK-4020) Remove shard list querying from Kinesis consumer constructor

2016-06-05 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai reassigned FLINK-4020: -- Assignee: Tzu-Li (Gordon) Tai > Remove shard list querying from Kinesis

[jira] [Created] (FLINK-4033) Missing Scala example snippets for the Kinesis Connector documentation

2016-06-08 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-4033: -- Summary: Missing Scala example snippets for the Kinesis Connector documentation Key: FLINK-4033 URL: https://issues.apache.org/jira/browse/FLINK-4033

[jira] [Commented] (FLINK-3923) Unify configuration conventions of the Kinesis producer to the same as the consumer

2016-06-06 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15317860#comment-15317860 ] Tzu-Li (Gordon) Tai commented on FLINK-3923: I'm wondering whether or not it might be a better

[jira] [Commented] (FLINK-3231) Handle Kinesis-side resharding in Kinesis streaming consumer

2016-06-09 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322524#comment-15322524 ] Tzu-Li (Gordon) Tai commented on FLINK-3231: Update for this: Had a talk with [~rmetzger]

[jira] [Assigned] (FLINK-3231) Handle Kinesis-side resharding in Kinesis streaming consumer

2016-06-09 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai reassigned FLINK-3231: -- Assignee: Tzu-Li (Gordon) Tai > Handle Kinesis-side resharding in Kinesis

[jira] [Commented] (FLINK-3923) Unify configuration conventions of the Kinesis producer to the same as the consumer

2016-06-07 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15318272#comment-15318272 ] Tzu-Li (Gordon) Tai commented on FLINK-3923: The consumer isn't using the KCL at the moment,

[jira] [Commented] (FLINK-4008) Hello,I am not able to create jar of flink-streaming-connectors ...I am able to create jar of others like twitter,kafka,flume but I am not able to create jar of flink-s

2016-06-07 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15320019#comment-15320019 ] Tzu-Li (Gordon) Tai commented on FLINK-4008: Don't build under the kinesis connector only.

[jira] [Commented] (FLINK-4018) Configurable idle time between getRecords requests to Kinesis shards

2016-06-03 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315290#comment-15315290 ] Tzu-Li (Gordon) Tai commented on FLINK-4018: We have a user who has tried out the connector

[jira] [Created] (FLINK-4018) Configurable idle time between getRecords requests to Kinesis shards

2016-06-03 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-4018: -- Summary: Configurable idle time between getRecords requests to Kinesis shards Key: FLINK-4018 URL: https://issues.apache.org/jira/browse/FLINK-4018

[jira] [Created] (FLINK-4019) Expose approximateArrivalTimestamp through the KinesisDeserializationSchema interface

2016-06-04 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-4019: -- Summary: Expose approximateArrivalTimestamp through the KinesisDeserializationSchema interface Key: FLINK-4019 URL: https://issues.apache.org/jira/browse/FLINK-4019

[jira] [Created] (FLINK-4020) Remove shard list querying from Kinesis consumer constructor

2016-06-04 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-4020: -- Summary: Remove shard list querying from Kinesis consumer constructor Key: FLINK-4020 URL: https://issues.apache.org/jira/browse/FLINK-4020 Project:

[jira] [Created] (FLINK-4080) Kinesis consumer not exactly-once if stopped in the middle of processing aggregated records

2016-06-15 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-4080: -- Summary: Kinesis consumer not exactly-once if stopped in the middle of processing aggregated records Key: FLINK-4080 URL:

[jira] [Updated] (FLINK-4080) Kinesis consumer not exactly-once if stopped in the middle of processing aggregated records

2016-06-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4080: --- Description: I've occasionally experienced unsuccessful ManualExactlyOnceTest after

[jira] [Updated] (FLINK-4080) Kinesis consumer not exactly-once if stopped in the middle of processing aggregated records

2016-06-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4080: --- Description: I've occasionally experienced unsuccessful ManualExactlyOnceTest after

[jira] [Commented] (FLINK-4023) Move Kafka consumer partition discovery from constructor to open()

2016-06-13 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328831#comment-15328831 ] Tzu-Li (Gordon) Tai commented on FLINK-4023: https://issues.apache.org/jira/browse/FLINK-4069

[jira] [Commented] (FLINK-4069) Kafka Consumer should not initialize on construction

2016-06-13 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328840#comment-15328840 ] Tzu-Li (Gordon) Tai commented on FLINK-4069: Thanks for creating this JIRA Shannon. However,

[jira] [Comment Edited] (FLINK-4069) Kafka Consumer should not initialize on construction

2016-06-13 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328840#comment-15328840 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4069 at 6/14/16 2:50 AM: -

[jira] [Comment Edited] (FLINK-4069) Kafka Consumer should not initialize on construction

2016-06-13 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15328840#comment-15328840 ] Tzu-Li (Gordon) Tai edited comment on FLINK-4069 at 6/14/16 2:50 AM: -

[jira] [Updated] (FLINK-4022) Partition discovery / regex topic subscription for the Kafka consumer

2016-06-05 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4022: --- Description: Allow users to subscribe to "topic-n*", so that the consumer

[jira] [Updated] (FLINK-4020) Remove shard list querying from Kinesis consumer constructor

2016-06-04 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4020: --- Description: Currently FlinkKinesisConsumer is querying for the whole list of shards

[jira] [Updated] (FLINK-3231) Handle Kinesis-side resharding in Kinesis streaming consumer

2016-06-04 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-3231: --- Affects Version/s: (was: 1.0.0) 1.1.0 > Handle

[jira] [Commented] (FLINK-3231) Handle Kinesis-side resharding in Kinesis streaming consumer

2016-06-04 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315494#comment-15315494 ] Tzu-Li (Gordon) Tai commented on FLINK-3231: Hi Stephan, Finally reached the point where we

[jira] [Comment Edited] (FLINK-3231) Handle Kinesis-side resharding in Kinesis streaming consumer

2016-06-04 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315494#comment-15315494 ] Tzu-Li (Gordon) Tai edited comment on FLINK-3231 at 6/4/16 1:04 PM: Hi

[jira] [Commented] (FLINK-4019) Expose approximateArrivalTimestamp through the KinesisDeserializationSchema interface

2016-06-05 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316225#comment-15316225 ] Tzu-Li (Gordon) Tai commented on FLINK-4019: Good suggestion! For now, the connector doesn't

[jira] [Created] (FLINK-3989) Add guide to write a custom streaming source / sink in DataStream API documentation

2016-05-28 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-3989: -- Summary: Add guide to write a custom streaming source / sink in DataStream API documentation Key: FLINK-3989 URL: https://issues.apache.org/jira/browse/FLINK-3989

[jira] [Commented] (FLINK-3211) Add AWS Kinesis streaming connector

2016-05-28 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305760#comment-15305760 ] Tzu-Li (Gordon) Tai commented on FLINK-3211: [~rmetzger] Hi Robert, I'm back and ready to

[jira] [Commented] (FLINK-3229) Kinesis streaming consumer with integration of Flink's checkpointing mechanics

2016-05-28 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305762#comment-15305762 ] Tzu-Li (Gordon) Tai commented on FLINK-3229: Great working with the community :) Thanks for

[jira] [Updated] (FLINK-3989) Add guide to write a custom streaming connector in DataStream API documentation

2016-05-28 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-3989: --- Summary: Add guide to write a custom streaming connector in DataStream API

[jira] [Commented] (FLINK-3211) Add AWS Kinesis streaming connector

2016-05-28 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15305768#comment-15305768 ] Tzu-Li (Gordon) Tai commented on FLINK-3211: I just noticed the conversation on PR #2016.

[jira] [Updated] (FLINK-3989) Add guide to write a custom streaming connector in DataStream API documentation

2016-05-31 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-3989: --- Assignee: Tzu-Li (Gordon) Tai > Add guide to write a custom streaming connector in

[jira] [Commented] (FLINK-3989) Add guide to write a custom streaming connector in DataStream API documentation

2016-05-31 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15307359#comment-15307359 ] Tzu-Li (Gordon) Tai commented on FLINK-3989: I'll be getting a first draft out for the next

[jira] [Commented] (FLINK-3954) Installing Flink on EMR using EMR bootstrap action

2016-05-31 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15307388#comment-15307388 ] Tzu-Li (Gordon) Tai commented on FLINK-3954: https://issues.apache.org/jira/browse/FLINK-1337

[jira] [Commented] (FLINK-4008) Hello,I am not able to create jar of flink-streaming-connectors ...I am able to create jar of others like twitter,kafka,flume but I am not able to create jar of flink-s

2016-06-02 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15311890#comment-15311890 ] Tzu-Li (Gordon) Tai commented on FLINK-4008: Hi Akshnay, flink-streaming-connectors wasn't

[jira] [Commented] (FLINK-3989) Add guide to write a custom streaming connector in DataStream API documentation

2016-05-31 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15307552#comment-15307552 ] Tzu-Li (Gordon) Tai commented on FLINK-3989: Just realized that the javadocs in the Java

[jira] [Updated] (FLINK-4018) Configurable idle time between getRecords requests to Kinesis shards

2016-06-16 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4018: --- Fix Version/s: 1.1.0 > Configurable idle time between getRecords requests to Kinesis

[jira] [Updated] (FLINK-4020) Remove shard list querying from Kinesis consumer constructor

2016-06-16 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4020: --- Fix Version/s: 1.1.0 > Remove shard list querying from Kinesis consumer constructor >

[jira] [Updated] (FLINK-3231) Handle Kinesis-side resharding in Kinesis streaming consumer

2016-06-16 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-3231: --- Fix Version/s: 1.1.0 > Handle Kinesis-side resharding in Kinesis streaming consumer >

[jira] [Updated] (FLINK-3924) Remove protobuf shading from Kinesis connector

2016-06-17 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-3924: --- Fix Version/s: 1.1.0 > Remove protobuf shading from Kinesis connector >

[jira] [Assigned] (FLINK-4019) Expose approximateArrivalTimestamp through the KinesisDeserializationSchema interface

2016-06-16 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai reassigned FLINK-4019: -- Assignee: Tzu-Li (Gordon) Tai > Expose approximateArrivalTimestamp through the

[jira] [Commented] (FLINK-4019) Expose approximateArrivalTimestamp through the KinesisDeserializationSchema interface

2016-06-16 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15333858#comment-15333858 ] Tzu-Li (Gordon) Tai commented on FLINK-4019: Ok. I'll add this then along with the upcoming PR

[jira] [Updated] (FLINK-4019) Expose approximateArrivalTimestamp through the KinesisDeserializationSchema interface

2016-06-16 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4019: --- Fix Version/s: 1.1.0 > Expose approximateArrivalTimestamp through the

[jira] [Updated] (FLINK-3211) Add AWS Kinesis streaming connector with deep integration with Flink's checkpointing mechanics

2016-01-10 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-3211: --- Summary: Add AWS Kinesis streaming connector with deep integration with Flink's

[jira] [Comment Edited] (FLINK-3211) Add AWS Kinesis streaming connector with deep integration with Flink's checkpointing mechanics

2016-01-10 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090974#comment-15090974 ] Tzu-Li (Gordon) Tai edited comment on FLINK-3211 at 1/10/16 1:30 PM: -

[jira] [Updated] (FLINK-3211) Add AWS Kinesis streaming connector

2016-01-10 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-3211: --- Summary: Add AWS Kinesis streaming connector (was: Add AWS Kinesis streaming

[jira] [Commented] (FLINK-3211) Add AWS Kinesis streaming connector with deep integration with Flink's checkpointing mechanics

2016-01-10 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090974#comment-15090974 ] Tzu-Li (Gordon) Tai commented on FLINK-3211: Re-clarification of why using the KCL is not

[jira] [Comment Edited] (FLINK-3211) Add AWS Kinesis streaming connector with deep integration with Flink's checkpointing mechanics

2016-01-10 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090974#comment-15090974 ] Tzu-Li (Gordon) Tai edited comment on FLINK-3211 at 1/10/16 12:03 PM: --

[jira] [Comment Edited] (FLINK-3211) Add AWS Kinesis streaming connector with deep integration with Flink's checkpointing mechanics

2016-01-10 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15091050#comment-15091050 ] Tzu-Li (Gordon) Tai edited comment on FLINK-3211 at 1/10/16 1:56 PM: -

[jira] [Comment Edited] (FLINK-3211) Add AWS Kinesis streaming connector with deep integration with Flink's checkpointing mechanics

2016-01-10 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15091050#comment-15091050 ] Tzu-Li (Gordon) Tai edited comment on FLINK-3211 at 1/10/16 1:56 PM: -

[jira] [Commented] (FLINK-3211) Add AWS Kinesis streaming connector with deep integration with Flink's checkpointing mechanics

2016-01-10 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15091050#comment-15091050 ] Tzu-Li (Gordon) Tai commented on FLINK-3211: I'm currently in-progress of the work, will

[jira] [Comment Edited] (FLINK-3211) Add AWS Kinesis streaming connector with deep integration with Flink's checkpointing mechanics

2016-01-10 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15090974#comment-15090974 ] Tzu-Li (Gordon) Tai edited comment on FLINK-3211 at 1/10/16 10:42 AM: --

[jira] [Updated] (FLINK-3231) Handle Kinesis-side resharding in Kinesis streaming consumer

2016-06-17 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-3231: --- Component/s: Kinesis Connector > Handle Kinesis-side resharding in Kinesis streaming

[jira] [Updated] (FLINK-3983) Allow users to set any (relevant) configuration parameter of the KinesisProducerConfiguration

2016-06-17 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-3983: --- Component/s: Streaming Connectors > Allow users to set any (relevant) configuration

[jira] [Updated] (FLINK-4018) Configurable idle time between getRecords requests to Kinesis shards

2016-06-17 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4018: --- Component/s: Kinesis Connector > Configurable idle time between getRecords requests

[jira] [Updated] (FLINK-4020) Remove shard list querying from Kinesis consumer constructor

2016-06-17 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4020: --- Component/s: Kinesis Connector > Remove shard list querying from Kinesis consumer

[jira] [Assigned] (FLINK-4033) Missing Scala example snippets for the Kinesis Connector documentation

2016-06-29 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai reassigned FLINK-4033: -- Assignee: Tzu-Li (Gordon) Tai > Missing Scala example snippets for the Kinesis

[jira] [Comment Edited] (FLINK-3211) Add AWS Kinesis streaming connector

2016-03-22 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15206770#comment-15206770 ] Tzu-Li (Gordon) Tai edited comment on FLINK-3211 at 3/22/16 4:52 PM: -

[jira] [Commented] (FLINK-3211) Add AWS Kinesis streaming connector

2016-03-22 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15206770#comment-15206770 ] Tzu-Li (Gordon) Tai commented on FLINK-3211: No problem :) > Add AWS Kinesis streaming

[jira] [Commented] (FLINK-3211) Add AWS Kinesis streaming connector

2016-03-22 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15206709#comment-15206709 ] Tzu-Li (Gordon) Tai commented on FLINK-3211: Hi Roy & Robert Apologies for the late reply. I

[jira] [Commented] (FLINK-3211) Add AWS Kinesis streaming connector

2016-03-22 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15206739#comment-15206739 ] Tzu-Li (Gordon) Tai commented on FLINK-3211: Hi, thanks Roy. I don't think using the actual

[jira] [Commented] (FLINK-3852) Use a StreamExecutionEnvironment in the quickstart job skeleton

2016-05-10 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279399#comment-15279399 ] Tzu-Li (Gordon) Tai commented on FLINK-3852: Hi Mark, I think replacing the StreamingJob

[jira] [Issue Comment Deleted] (FLINK-3852) Use a StreamExecutionEnvironment in the quickstart job skeleton

2016-05-10 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-3852: --- Comment: was deleted (was: Hi Mark, I think replacing the StreamingJob skeleton as

[jira] [Commented] (FLINK-3852) Use a StreamExecutionEnvironment in the quickstart job skeleton

2016-05-10 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279400#comment-15279400 ] Tzu-Li (Gordon) Tai commented on FLINK-3852: Hi Mark, I think replacing the StreamingJob

[jira] [Commented] (FLINK-3211) Add AWS Kinesis streaming connector

2016-05-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15280969#comment-15280969 ] Tzu-Li (Gordon) Tai commented on FLINK-3211: [~rmetzger] Hi Robert, Can you tell me how you

[jira] [Commented] (FLINK-3211) Add AWS Kinesis streaming connector

2016-05-11 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15279737#comment-15279737 ] Tzu-Li (Gordon) Tai commented on FLINK-3211:

[jira] [Updated] (FLINK-3229) Kinesis streaming consumer with integration of Flink's checkpointing mechanics

2016-04-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-3229: --- Description: Opening a sub-task to implement data source consumer for Kinesis

[jira] [Updated] (FLINK-3229) Kinesis streaming consumer with integration of Flink's checkpointing mechanics

2016-04-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-3229: --- Description: Opening a sub-task to implement data source consumer for Kinesis

[jira] [Commented] (FLINK-3211) Add AWS Kinesis streaming connector

2016-04-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15243988#comment-15243988 ] Tzu-Li (Gordon) Tai commented on FLINK-3211:

[jira] [Updated] (FLINK-3211) Add AWS Kinesis streaming connector

2016-04-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-3211: --- Affects Version/s: (was: 1.0.0) 1.1.0 > Add AWS Kinesis

[jira] [Comment Edited] (FLINK-3211) Add AWS Kinesis streaming connector

2016-04-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15243988#comment-15243988 ] Tzu-Li (Gordon) Tai edited comment on FLINK-3211 at 4/16/16 3:53 AM: -

[jira] [Commented] (FLINK-3229) Kinesis streaming consumer with integration of Flink's checkpointing mechanics

2016-04-15 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15243991#comment-15243991 ] Tzu-Li (Gordon) Tai commented on FLINK-3229: (Duplicate comment from FLINK-3211. Posting it

  1   2   3   4   5   6   7   8   9   10   >