[jira] [Updated] (FLINK-4022) Partition discovery / regex topic subscription for the Kafka consumer

2016-06-05 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4022: --- Description: Example: allow users to subscribe to "topic-n*", so that the consumer

[jira] [Commented] (FLINK-4002) [py] Improve testing infraestructure

2016-06-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315849#comment-15315849 ] ASF GitHub Bot commented on FLINK-4002: --- Github user zentol commented on the issue:

[GitHub] flink issue #2063: [FLINK-4002] [py] Improve testing infraestructure

2016-06-05 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/2063 test files are never copied to the tmp folder regardless of whether HDFS is used or not. This is not a bug, but intended behaviour. You can easily add the utils.py to the test invokation by

[jira] [Created] (FLINK-4022) Partition discovery / regex topic subscription for the Kafka consumer

2016-06-05 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-4022: -- Summary: Partition discovery / regex topic subscription for the Kafka consumer Key: FLINK-4022 URL: https://issues.apache.org/jira/browse/FLINK-4022

[jira] [Commented] (FLINK-4022) Partition discovery / regex topic subscription for the Kafka consumer

2016-06-05 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315787#comment-15315787 ] Tzu-Li (Gordon) Tai commented on FLINK-4022: I'd like to start working on this feature if it's

[jira] [Updated] (FLINK-4020) Remove shard list querying from Kinesis consumer constructor

2016-06-05 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4020: --- Description: Currently FlinkKinesisConsumer is querying for the whole list of shards

[jira] [Assigned] (FLINK-4020) Remove shard list querying from Kinesis consumer constructor

2016-06-05 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai reassigned FLINK-4020: -- Assignee: Tzu-Li (Gordon) Tai > Remove shard list querying from Kinesis

[jira] [Updated] (FLINK-4023) Move Kafka consumer partition discovery from constructor to open()

2016-06-05 Thread Michal Harish (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michal Harish updated FLINK-4023: - Description: Currently, Flink queries Kafka for partition information when creating the Kafka

[jira] [Created] (FLINK-4023) Move Kafka consumer partition discovery from constructor to open()

2016-06-05 Thread Michal Harish (JIRA)
Michal Harish created FLINK-4023: Summary: Move Kafka consumer partition discovery from constructor to open() Key: FLINK-4023 URL: https://issues.apache.org/jira/browse/FLINK-4023 Project: Flink

[jira] [Commented] (FLINK-4002) [py] Improve testing infraestructure

2016-06-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15315835#comment-15315835 ] ASF GitHub Bot commented on FLINK-4002: --- Github user omaralvarez commented on the issue:

[GitHub] flink issue #2063: [FLINK-4002] [py] Improve testing infraestructure

2016-06-05 Thread omaralvarez
Github user omaralvarez commented on the issue: https://github.com/apache/flink/pull/2063 I have fixed the last errors in the test functions. But, while trying to refactor the utility code, that now is repeated in both test files, I think I found another bug. The thing is

[GitHub] flink issue #2072: [FLINK-3948] Protect RocksDB cleanup by cleanup lock

2016-06-05 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/2072 Looks great, +1 to merge --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[jira] [Commented] (FLINK-3948) EventTimeWindowCheckpointingITCase Fails with Core Dump

2016-06-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316023#comment-15316023 ] ASF GitHub Bot commented on FLINK-3948: --- Github user StephanEwen commented on the issue:

[jira] [Created] (FLINK-4024) FileSourceFunction not adjusted to new IF lifecycle

2016-06-05 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-4024: --- Summary: FileSourceFunction not adjusted to new IF lifecycle Key: FLINK-4024 URL: https://issues.apache.org/jira/browse/FLINK-4024 Project: Flink

[jira] [Updated] (FLINK-4023) Move Kafka consumer partition discovery from constructor to open()

2016-06-05 Thread Michal Harish (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michal Harish updated FLINK-4023: - Description: Currently, Flink queries Kafka for partition information when creating the Kafka

[jira] [Updated] (FLINK-4023) Move Kafka consumer partition discovery from constructor to open()

2016-06-05 Thread Michal Harish (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michal Harish updated FLINK-4023: - Description: Currently, Flink queries Kafka for partition information when creating the Kafka

[jira] [Updated] (FLINK-4024) FileSourceFunction not adjusted to new IF lifecycle

2016-06-05 Thread Chesnay Schepler (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-4024: Assignee: (was: Chesnay Schepler) > FileSourceFunction not adjusted to new IF lifecycle

[GitHub] flink issue #2065: [FLINK-4011] Keep UserCodeClassLoader in archived Executi...

2016-06-05 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/2065 You already outlined one of the drawbacks (holding on to the classes). There are probably other parts in the execution graph that currently hold onto user defined classes as well. A

[jira] [Commented] (FLINK-4011) Unable to access completed job in web frontend

2016-06-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316024#comment-15316024 ] ASF GitHub Bot commented on FLINK-4011: --- Github user StephanEwen commented on the issue:

[GitHub] flink pull request #2066: Updated ssh configuration in base Dockerfile

2016-06-05 Thread StephanEwen
Github user StephanEwen commented on a diff in the pull request: https://github.com/apache/flink/pull/2066#discussion_r65825673 --- Diff: flink-contrib/docker-flink/base/Dockerfile --- @@ -38,12 +38,12 @@ ENV JAVA_HOME /usr/java/default/ RUN echo 'root:secret' | chpasswd

[jira] [Commented] (FLINK-3980) Remove ExecutionConfig.PARALLELISM_UNKNOWN

2016-06-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316036#comment-15316036 ] ASF GitHub Bot commented on FLINK-3980: --- Github user StephanEwen commented on the issue:

[jira] [Commented] (FLINK-4025) Add possiblity for the RMQ Streaming Source to customize the queue

2016-06-05 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316028#comment-15316028 ] ASF GitHub Bot commented on FLINK-4025: --- GitHub user theomega opened a pull request:

[GitHub] flink issue #2064: [FLINK-3980] [core] Remove ExecutionConfig.PARALLELISM_UN...

2016-06-05 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/2064 Thanks, Greg, this looks good! +1 to merge --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[jira] [Created] (FLINK-4025) Add possiblity for the RMQ Streaming Source to customize the queue

2016-06-05 Thread Dominik Bruhn (JIRA)
Dominik Bruhn created FLINK-4025: Summary: Add possiblity for the RMQ Streaming Source to customize the queue Key: FLINK-4025 URL: https://issues.apache.org/jira/browse/FLINK-4025 Project: Flink

[GitHub] flink pull request #2073: [FLINK-4025] Add possiblity for the RMQ Streaming ...

2016-06-05 Thread theomega
GitHub user theomega opened a pull request: https://github.com/apache/flink/pull/2073 [FLINK-4025] Add possiblity for the RMQ Streaming Source to customize the queue This patch adds the possibilty for the user of the RabbitMQ Streaming Connector to customize the queue which is

[jira] [Commented] (FLINK-3777) Add open and close methods to manage IF lifecycle

2016-06-05 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316032#comment-15316032 ] Stephan Ewen commented on FLINK-3777: - Can I revive this thread quickly? This is one more of these

[jira] [Commented] (FLINK-4019) Expose approximateArrivalTimestamp through the KinesisDeserializationSchema interface

2016-06-05 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316048#comment-15316048 ] Stephan Ewen commented on FLINK-4019: - That would also be great to attach as a default time stamp. So,

[GitHub] flink pull request #2068: [hotfix] [core] Fix scope format keys

2016-06-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/2068 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Updated] (FLINK-4022) Partition discovery / regex topic subscription for the Kafka consumer

2016-06-05 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-4022: --- Description: Allow users to subscribe to "topic-n*", so that the consumer

[jira] [Commented] (FLINK-4014) Jobs hang. Maybe NetworkBufferPool and LocalBufferPool has some problem

2016-06-05 Thread ZhengBowen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316110#comment-15316110 ] ZhengBowen commented on FLINK-4014: --- Hi,Ufuk,thank you for your help.Any good news these days? > Jobs

[jira] [Commented] (FLINK-4019) Expose approximateArrivalTimestamp through the KinesisDeserializationSchema interface

2016-06-05 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15316225#comment-15316225 ] Tzu-Li (Gordon) Tai commented on FLINK-4019: Good suggestion! For now, the connector doesn't