[jira] [Created] (FLINK-4821) Implement rescalable non-partitioned state for Kinesis Connector

2016-10-13 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-4821: -- Summary: Implement rescalable non-partitioned state for Kinesis Connector Key: FLINK-4821 URL: https://issues.apache.org/jira/browse/FLINK-4821 Project: F

[GitHub] flink issue #2627: Kafka 0.10 follow-up fixes

2016-10-13 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2627 I'm merging the PR. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[jira] [Commented] (FLINK-4280) New Flink-specific option to set starting position of Kafka consumer without respecting external offsets in ZK / Broker

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571243#comment-15571243 ] ASF GitHub Bot commented on FLINK-4280: --- Github user tzulitai commented on the issue

[GitHub] flink issue #2509: [FLINK-4280][kafka-connector] Explicit start position con...

2016-10-13 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2509 @rmetzger @gyfora @koeninger Rebased this on the Kafka 0.10 connector and some other recent changes. This is ready for review now ;) I'd like to add tests for this after #2580, because #2580 adds a

[GitHub] flink pull request #2627: Kafka 0.10 follow-up fixes

2016-10-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/2627 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (FLINK-4280) New Flink-specific option to set starting position of Kafka consumer without respecting external offsets in ZK / Broker

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571253#comment-15571253 ] ASF GitHub Bot commented on FLINK-4280: --- Github user tzulitai commented on a diff in

[GitHub] flink pull request #2509: [FLINK-4280][kafka-connector] Explicit start posit...

2016-10-13 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2509#discussion_r83165323 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.9/src/main/java/org/apache/flink/streaming/connectors/kafka/internal/Kafka09Fetcher.java --- @@

[GitHub] flink pull request #2509: [FLINK-4280][kafka-connector] Explicit start posit...

2016-10-13 Thread tzulitai
Github user tzulitai commented on a diff in the pull request: https://github.com/apache/flink/pull/2509#discussion_r83165620 --- Diff: flink-streaming-connectors/flink-connector-kafka-0.9/src/main/java/org/apache/flink/streaming/connectors/kafka/internal/Kafka09Fetcher.java --- @@

[jira] [Commented] (FLINK-4280) New Flink-specific option to set starting position of Kafka consumer without respecting external offsets in ZK / Broker

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571255#comment-15571255 ] ASF GitHub Bot commented on FLINK-4280: --- Github user tzulitai commented on a diff in

[jira] [Closed] (FLINK-4140) CheckpointCoordinator fails to discard completed checkpoint

2016-10-13 Thread Ufuk Celebi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ufuk Celebi closed FLINK-4140. -- Resolution: Fixed Assignee: (was: Ufuk Celebi) Fix Version/s: 1.2.0 Fixed as part of

[GitHub] flink issue #2604: [FLINK-4753] [kafka] PeriodicOffsetCommitter should synch...

2016-10-13 Thread tzulitai
Github user tzulitai commented on the issue: https://github.com/apache/flink/pull/2604 @rmetzger I think I just wanted to make sure that the `KafkaTopicPartitionState[]` state in the fetcher wasn't concurrently accessed, but actually on a second look there shouldn't be any problems wi

[jira] [Commented] (FLINK-4753) Kafka 0.8 connector's Periodic Offset Committer should synchronize on checkpoint lock

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571319#comment-15571319 ] ASF GitHub Bot commented on FLINK-4753: --- Github user tzulitai commented on the issue

[jira] [Commented] (FLINK-4815) Automatic fallback to earlier checkpoints when checkpoint restore fails

2016-10-13 Thread Ovidiu Marcu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571398#comment-15571398 ] Ovidiu Marcu commented on FLINK-4815: - hi I am currently working on a very similar pro

[jira] [Commented] (FLINK-2821) Change Akka configuration to allow accessing actors from different URLs

2016-10-13 Thread Philipp von dem Bussche (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571405#comment-15571405 ] Philipp von dem Bussche commented on FLINK-2821: +1 for this feature. I am

[GitHub] flink issue #2608: [FLINK-4512] [FLIP-10] Add option to persist periodic che...

2016-10-13 Thread uce
Github user uce commented on the issue: https://github.com/apache/flink/pull/2608 Local Travis passed except for an independent Cassandra test failure (https://travis-ci.org/uce/flink/builds/167107635). Going to merge this. --- If your project is set up for it, you can reply to this

[jira] [Commented] (FLINK-4512) Add option for persistent checkpoints

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571422#comment-15571422 ] ASF GitHub Bot commented on FLINK-4512: --- Github user uce commented on the issue:

[jira] [Commented] (FLINK-4717) Naive version of atomic stop signal with savepoint

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571423#comment-15571423 ] ASF GitHub Bot commented on FLINK-4717: --- Github user uce commented on the issue:

[GitHub] flink issue #2609: [FLINK-4717] Add CancelJobWithSavepoint

2016-10-13 Thread uce
Github user uce commented on the issue: https://github.com/apache/flink/pull/2609 Local Travis build passed (https://travis-ci.org/uce/flink/builds/167108720). I'm going to rebase and merge this later. --- If your project is set up for it, you can reply to this email and have your r

[GitHub] flink issue #2518: [FLINK-3931] Implement Transport Encryption (SSL/TLS)

2016-10-13 Thread mxm
Github user mxm commented on the issue: https://github.com/apache/flink/pull/2518 @skrishnappa I would like to merge this. Could you add the test case to ensure encryption is turned on and rebase the PR? --- If your project is set up for it, you can reply to this email and have your

[jira] [Commented] (FLINK-3931) Implement Transport Encryption (SSL/TLS)

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571428#comment-15571428 ] ASF GitHub Bot commented on FLINK-3931: --- Github user mxm commented on the issue:

[GitHub] flink pull request #2618: Refactoring the Continuous File Monitoring Functio...

2016-10-13 Thread kl0u
Github user kl0u commented on a diff in the pull request: https://github.com/apache/flink/pull/2618#discussion_r83183505 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/source/ContinuousFileMonitoringFunction.java --- @@ -60,26 +63,27 @@

[jira] [Commented] (FLINK-4604) Add support for standard deviation/variance

2016-10-13 Thread Anton Mushin (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571502#comment-15571502 ] Anton Mushin commented on FLINK-4604: - I tried use code like as your code and I got ex

[GitHub] flink pull request #2618: Refactoring the Continuous File Monitoring Functio...

2016-10-13 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/2618#discussion_r83184745 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/source/ContinuousFileMonitoringFunction.java --- @@ -60,26 +63,27 @@

[jira] [Updated] (FLINK-4779) Restoring from savepoint fails when BucketingSink has not yet created folder

2016-10-13 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-4779: Priority: Blocker (was: Major) > Restoring from savepoint fails when BucketingSink has not

[jira] [Updated] (FLINK-4725) BucketingSink throws NPE while restoring state if basePath does not exist

2016-10-13 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-4725: Priority: Blocker (was: Major) > BucketingSink throws NPE while restoring state if basePath

[jira] [Updated] (FLINK-4725) BucketingSink throws NPE while restoring state if basePath does not exist

2016-10-13 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-4725: Affects Version/s: 1.2.0 > BucketingSink throws NPE while restoring state if basePath does n

[jira] [Updated] (FLINK-4725) BucketingSink throws NPE while restoring state if basePath does not exist

2016-10-13 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-4725: Description: BucketingSink throws a NullPointerException when attempting to clean up pending

[jira] [Closed] (FLINK-4779) Restoring from savepoint fails when BucketingSink has not yet created folder

2016-10-13 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-4779. --- Resolution: Duplicate > Restoring from savepoint fails when BucketingSink has not yet created

[jira] [Created] (FLINK-4822) Ensure that the Kafka 0.8 connector is compatible with kafka-consumer-groups.sh

2016-10-13 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-4822: - Summary: Ensure that the Kafka 0.8 connector is compatible with kafka-consumer-groups.sh Key: FLINK-4822 URL: https://issues.apache.org/jira/browse/FLINK-4822 Proje

[jira] [Updated] (FLINK-4822) Ensure that the Kafka 0.8 connector is compatible with kafka-consumer-groups.sh

2016-10-13 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger updated FLINK-4822: -- Description: The Kafka 0.8 connector is not properly creating all datastructures in Zookeeper f

[GitHub] flink pull request #2629: [FLINK-4391] Provide support for asynchronous oper...

2016-10-13 Thread bjlovegithub
GitHub user bjlovegithub opened a pull request: https://github.com/apache/flink/pull/2629 [FLINK-4391] Provide support for asynchronous operations over streams PR for [FLIP 12](https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=65870673) - Implementation for Async I/O

[jira] [Commented] (FLINK-4391) Provide support for asynchronous operations over streams

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571577#comment-15571577 ] ASF GitHub Bot commented on FLINK-4391: --- GitHub user bjlovegithub opened a pull requ

[jira] [Created] (FLINK-4823) org.apache.flink.types.NullFieldException: Field 0 is null, but expected to hold a value

2016-10-13 Thread Sajeev Ramakrishnan (JIRA)
Sajeev Ramakrishnan created FLINK-4823: -- Summary: org.apache.flink.types.NullFieldException: Field 0 is null, but expected to hold a value Key: FLINK-4823 URL: https://issues.apache.org/jira/browse/FLINK-4823

[jira] [Commented] (FLINK-4823) org.apache.flink.types.NullFieldException: Field 0 is null, but expected to hold a value

2016-10-13 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571691#comment-15571691 ] Greg Hogan commented on FLINK-4823: --- Thanks for reporting this. Is there code you could

[GitHub] flink pull request #2386: [FLINK-3660] Measure latency and exposes them via ...

2016-10-13 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2386#discussion_r83201419 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/OperatorChain.java --- @@ -273,7 +276,7 @@ public void releaseOutputs(

[jira] [Commented] (FLINK-3660) Measure latency of elements and expose it through web interface

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571741#comment-15571741 ] ASF GitHub Bot commented on FLINK-3660: --- Github user rmetzger commented on a diff in

[jira] [Commented] (FLINK-4823) org.apache.flink.types.NullFieldException: Field 0 is null, but expected to hold a value

2016-10-13 Thread Sajeev Ramakrishnan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571746#comment-15571746 ] Sajeev Ramakrishnan commented on FLINK-4823: DataSet> vertices

[jira] [Commented] (FLINK-3660) Measure latency of elements and expose it through web interface

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571752#comment-15571752 ] ASF GitHub Bot commented on FLINK-3660: --- Github user rmetzger commented on the issue

[GitHub] flink issue #2386: [FLINK-3660] Measure latency and exposes them via a metri...

2016-10-13 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2386 Thank you for the review @zentol and @aljoscha. I addressed your comments and rebased the code to the current master. I'm currently testing the change again locally. Once that is completed succe

[jira] [Commented] (FLINK-2221) Checkpoints to "file://" are not cleaned up

2016-10-13 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571757#comment-15571757 ] Aljoscha Krettek commented on FLINK-2221: - +1 for "won't fix" ([~StephanEwen]) >

[jira] [Closed] (FLINK-2221) Checkpoints to "file://" are not cleaned up

2016-10-13 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-2221. --- Resolution: Won't Fix This is the expected behaviour. As mentioned in the discussion. > Check

[jira] [Created] (FLINK-4824) CliFrontend shows misleading error message when main() method returns before env.execute()

2016-10-13 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-4824: - Summary: CliFrontend shows misleading error message when main() method returns before env.execute() Key: FLINK-4824 URL: https://issues.apache.org/jira/browse/FLINK-4824

[GitHub] flink pull request #2386: [FLINK-3660] Measure latency and exposes them via ...

2016-10-13 Thread aljoscha
Github user aljoscha commented on a diff in the pull request: https://github.com/apache/flink/pull/2386#discussion_r83203023 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/OperatorChain.java --- @@ -273,7 +276,7 @@ public void releaseOutputs(

[jira] [Commented] (FLINK-3660) Measure latency of elements and expose it through web interface

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571767#comment-15571767 ] ASF GitHub Bot commented on FLINK-3660: --- Github user aljoscha commented on a diff in

[jira] [Commented] (FLINK-3660) Measure latency of elements and expose it through web interface

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571815#comment-15571815 ] ASF GitHub Bot commented on FLINK-3660: --- Github user rmetzger commented on a diff in

[GitHub] flink pull request #2386: [FLINK-3660] Measure latency and exposes them via ...

2016-10-13 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2386#discussion_r83207030 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/OperatorChain.java --- @@ -273,7 +276,7 @@ public void releaseOutputs(

[jira] [Commented] (FLINK-2821) Change Akka configuration to allow accessing actors from different URLs

2016-10-13 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571823#comment-15571823 ] Stephan Ewen commented on FLINK-2821: - I agree, it would be good to resolve that. It s

[jira] [Commented] (FLINK-4824) CliFrontend shows misleading error message when main() method returns before env.execute()

2016-10-13 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571879#comment-15571879 ] Maximilian Michels commented on FLINK-4824: --- That was recently changed (before w

[jira] [Commented] (FLINK-4735) Migrate some job execution related akka messages to rpc calls

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571902#comment-15571902 ] ASF GitHub Bot commented on FLINK-4735: --- Github user KurtYoung commented on the issu

[GitHub] flink issue #2588: [FLINK-4735] [cluster management] Migrate some job execut...

2016-10-13 Thread KurtYoung
Github user KurtYoung commented on the issue: https://github.com/apache/flink/pull/2588 This PR now contains some work from master branch picked by Stephan. Rebased to the latest flip-6 --- If your project is set up for it, you can reply to this email and have your reply appear on

[jira] [Commented] (FLINK-4410) Report more information about operator checkpoints

2016-10-13 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571931#comment-15571931 ] Robert Metzger commented on FLINK-4410: --- I'll add the CheckpointMetrics to the coord

[jira] [Assigned] (FLINK-4410) Report more information about operator checkpoints

2016-10-13 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger reassigned FLINK-4410: - Assignee: Robert Metzger > Report more information about operator checkpoints > -

[jira] [Assigned] (FLINK-4698) Visualize additional checkpoint information

2016-10-13 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger reassigned FLINK-4698: - Assignee: Robert Metzger > Visualize additional checkpoint information >

[jira] [Assigned] (FLINK-4697) Gather more detailed checkpoint stats in CheckpointStatsTracker

2016-10-13 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger reassigned FLINK-4697: - Assignee: Robert Metzger > Gather more detailed checkpoint stats in CheckpointStatsTracke

[GitHub] flink issue #2497: [FLINK-4339][cluster management] Implement Slot Pool core...

2016-10-13 Thread KurtYoung
Github user KurtYoung commented on the issue: https://github.com/apache/flink/pull/2497 This PR now bases on #2588 , only the last commit is related. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does no

[jira] [Commented] (FLINK-4339) Implement Slot Pool Core

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571922#comment-15571922 ] ASF GitHub Bot commented on FLINK-4339: --- Github user KurtYoung commented on the issu

[jira] [Commented] (FLINK-4727) Kafka 0.9 Consumer should also checkpoint auto retrieved offsets even when no data is read

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572005#comment-15572005 ] ASF GitHub Bot commented on FLINK-4727: --- Github user rmetzger commented on the issue

[GitHub] flink issue #2585: [FLINK-4727] [kafka-connector] Set missing initial offset...

2016-10-13 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2585 +1 to merge --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if th

[GitHub] flink issue #2604: [FLINK-4753] [kafka] PeriodicOffsetCommitter should synch...

2016-10-13 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2604 Okay. I'm sorry that I didn't respond to the JIRA when you opened it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project

[jira] [Commented] (FLINK-4753) Kafka 0.8 connector's Periodic Offset Committer should synchronize on checkpoint lock

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572008#comment-15572008 ] ASF GitHub Bot commented on FLINK-4753: --- Github user rmetzger commented on the issue

[jira] [Commented] (FLINK-4723) Unify behaviour of committed offsets to Kafka / ZK for Kafka 0.8 and 0.9 consumer

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572013#comment-15572013 ] ASF GitHub Bot commented on FLINK-4723: --- Github user rmetzger commented on a diff in

[GitHub] flink pull request #2580: [FLINK-4723] [kafka-connector] Unify committed off...

2016-10-13 Thread rmetzger
Github user rmetzger commented on a diff in the pull request: https://github.com/apache/flink/pull/2580#discussion_r83222904 --- Diff: flink-streaming-connectors/flink-connector-kafka-base/src/test/java/org/apache/flink/streaming/connectors/kafka/KafkaConsumerTestBase.java --- @@

[jira] [Comment Edited] (FLINK-4604) Add support for standard deviation/variance

2016-10-13 Thread Anton Mushin (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571502#comment-15571502 ] Anton Mushin edited comment on FLINK-4604 at 10/13/16 2:10 PM: -

[jira] [Comment Edited] (FLINK-4604) Add support for standard deviation/variance

2016-10-13 Thread Anton Mushin (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15571502#comment-15571502 ] Anton Mushin edited comment on FLINK-4604 at 10/13/16 2:10 PM: -

[jira] [Commented] (FLINK-4194) Implement isEndOfStream() for KinesisDeserializationSchema

2016-10-13 Thread Robert Metzger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572052#comment-15572052 ] Robert Metzger commented on FLINK-4194: --- The method {{KinesisDeserializationSchema.i

[jira] [Created] (FLINK-4825) Implement a RexExecutor that uses Flink's code generation

2016-10-13 Thread Timo Walther (JIRA)
Timo Walther created FLINK-4825: --- Summary: Implement a RexExecutor that uses Flink's code generation Key: FLINK-4825 URL: https://issues.apache.org/jira/browse/FLINK-4825 Project: Flink Issue T

[jira] [Updated] (FLINK-4825) Implement a RexExecutor that uses Flink's code generation

2016-10-13 Thread Timo Walther (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timo Walther updated FLINK-4825: Description: The added {{ReduceExpressionRule}} leads to inconsistent behavior. Because some parts

[GitHub] flink issue #2624: [FLINK-4516] update leadership information in ResourceMan...

2016-10-13 Thread mxm
Github user mxm commented on the issue: https://github.com/apache/flink/pull/2624 Merged to `flip-6`. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] flink pull request #2624: [FLINK-4516] update leadership information in Reso...

2016-10-13 Thread mxm
Github user mxm closed the pull request at: https://github.com/apache/flink/pull/2624 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled

[jira] [Commented] (FLINK-4516) ResourceManager leadership election

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572068#comment-15572068 ] ASF GitHub Bot commented on FLINK-4516: --- Github user mxm commented on the issue:

[jira] [Commented] (FLINK-4516) ResourceManager leadership election

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572067#comment-15572067 ] ASF GitHub Bot commented on FLINK-4516: --- Github user mxm closed the pull request at:

[jira] [Resolved] (FLINK-4791) Fix issues caused by expression reduction

2016-10-13 Thread Timo Walther (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timo Walther resolved FLINK-4791. - Resolution: Fixed Fix Version/s: 1.2.0 Temporarily fixed by disabling the rule in c7d1a3b8

[jira] [Commented] (FLINK-4604) Add support for standard deviation/variance

2016-10-13 Thread Anton Mushin (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572115#comment-15572115 ] Anton Mushin commented on FLINK-4604: - Sorry, I will try explain my problem. I have tw

[jira] [Commented] (FLINK-3037) Make the behavior of the Kafka consumer configurable if the offsets to restore from are not available

2016-10-13 Thread Cody Koeninger (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572133#comment-15572133 ] Cody Koeninger commented on FLINK-3037: --- As a user, I want to be able to start low-v

[jira] [Commented] (FLINK-4576) Low Watermark Service in JobManager for Streaming Sources

2016-10-13 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572142#comment-15572142 ] Aljoscha Krettek commented on FLINK-4576: - Hi, first off, sorry for the late respo

[jira] [Commented] (FLINK-4824) CliFrontend shows misleading error message when main() method returns before env.execute()

2016-10-13 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572151#comment-15572151 ] Greg Hogan commented on FLINK-4824: --- {{WordCount}} should be able to convey to {{Cluster

[jira] [Commented] (FLINK-4823) org.apache.flink.types.NullFieldException: Field 0 is null, but expected to hold a value

2016-10-13 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572160#comment-15572160 ] Greg Hogan commented on FLINK-4823: --- Adding \{code\} before and after this code block wi

[jira] [Commented] (FLINK-2821) Change Akka configuration to allow accessing actors from different URLs

2016-10-13 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572174#comment-15572174 ] Maximilian Michels commented on FLINK-2821: --- Just to add another option: - Appl

[jira] [Commented] (FLINK-4824) CliFrontend shows misleading error message when main() method returns before env.execute()

2016-10-13 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572274#comment-15572274 ] Maximilian Michels commented on FLINK-4824: --- I agree that we should differentiat

[GitHub] flink issue #2386: [FLINK-3660] Measure latency and exposes them via a metri...

2016-10-13 Thread rmetzger
Github user rmetzger commented on the issue: https://github.com/apache/flink/pull/2386 I had an offline discussion with @aljoscha about this PR, and we decided to remove the `isSink` flag from the `AbstractStreamOperator`. I updated the PR. --- If your project is set up for it, y

[jira] [Commented] (FLINK-3660) Measure latency of elements and expose it through web interface

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3660?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572276#comment-15572276 ] ASF GitHub Bot commented on FLINK-3660: --- Github user rmetzger commented on the issue

[GitHub] flink issue #2588: [FLINK-4735] [cluster management] Migrate some job execut...

2016-10-13 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/2588 Merged to the `flip-6` feature branch in 34fef4752e94b3d0c7afe7a9525799bb651a07b4 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[jira] [Commented] (FLINK-4735) Migrate some job execution related akka messages to rpc calls

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572286#comment-15572286 ] ASF GitHub Bot commented on FLINK-4735: --- Github user StephanEwen commented on the is

[GitHub] flink issue #2497: [FLINK-4339][cluster management] Implement Slot Pool core...

2016-10-13 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/2497 Merged into the `flip-6` feature branch in 48c936eeda7b265f32bbf9f14d15f78eae15c06f --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well

[jira] [Commented] (FLINK-4339) Implement Slot Pool Core

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572293#comment-15572293 ] ASF GitHub Bot commented on FLINK-4339: --- Github user StephanEwen commented on the is

[jira] [Assigned] (FLINK-4824) CliFrontend shows misleading error message when main() method returns before env.execute()

2016-10-13 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Hogan reassigned FLINK-4824: - Assignee: Greg Hogan > CliFrontend shows misleading error message when main() method returns befo

[jira] [Commented] (FLINK-4691) Add group-windows for streaming tables

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572347#comment-15572347 ] ASF GitHub Bot commented on FLINK-4691: --- Github user twalthr commented on the issue:

[GitHub] flink issue #2562: [FLINK-4691] [table] Add group-windows for streaming tabl...

2016-10-13 Thread twalthr
Github user twalthr commented on the issue: https://github.com/apache/flink/pull/2562 @fhueske I updated the PR. The only thing that is missing now are tests for the `DataStreamAggregate` class. I will add unit tests tomorrow. --- If your project is set up for it, you can reply to th

[jira] [Commented] (FLINK-2821) Change Akka configuration to allow accessing actors from different URLs

2016-10-13 Thread Maximilian Michels (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572364#comment-15572364 ] Maximilian Michels commented on FLINK-2821: --- Just out of fun, I actually tried t

[jira] [Resolved] (FLINK-2603) Flink hangs before starting execution

2016-10-13 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Hogan resolved FLINK-2603. --- Resolution: Not A Problem I believe this is due to a configured limit in the size of Akka messages as

[jira] [Commented] (FLINK-4129) HITSAlgorithm should test for element-wise convergence

2016-10-13 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572513#comment-15572513 ] Greg Hogan commented on FLINK-4129: --- [~vkalavri] what do you think we should do with thi

[jira] [Updated] (FLINK-4117) Wait for CuratorFramework connection to be established

2016-10-13 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Hogan updated FLINK-4117: -- Description: Received the following error when locally running {{mvn verify}}. Searching on the error i

[jira] [Updated] (FLINK-4117) Wait for CuratorFramework connection to be established

2016-10-13 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Hogan updated FLINK-4117: -- Description: Received the following error when locally running {{mvn verify}}. Searching on the error i

[jira] [Resolved] (FLINK-4117) Wait for CuratorFramework connection to be established

2016-10-13 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Hogan resolved FLINK-4117. --- Resolution: Cannot Reproduce > Wait for CuratorFramework connection to be established > --

[jira] [Commented] (FLINK-1890) Add note to docs that ReadFields annotations are currently not evaluated

2016-10-13 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572633#comment-15572633 ] Greg Hogan commented on FLINK-1890: --- Do we still want this documented or can we close th

[jira] [Commented] (FLINK-2821) Change Akka configuration to allow accessing actors from different URLs

2016-10-13 Thread Philipp von dem Bussche (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572639#comment-15572639 ] Philipp von dem Bussche commented on FLINK-2821: [~mxm] thats awesome ! Th

[jira] [Commented] (FLINK-720) Forbid catching exceptions only with "e.printStackTrace()" using Checkstyle

2016-10-13 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572652#comment-15572652 ] Greg Hogan commented on FLINK-720: -- Are we still looking to add this check? > Forbid catc

[jira] [Resolved] (FLINK-787) Custom termination criterion in delta iteration

2016-10-13 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Hogan resolved FLINK-787. -- Resolution: Duplicate > Custom termination criterion in delta iteration > ---

[jira] [Commented] (FLINK-2821) Change Akka configuration to allow accessing actors from different URLs

2016-10-13 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15572671#comment-15572671 ] Stephan Ewen commented on FLINK-2821: - That's pretty amazing. [~philipp.bussche] do y

[jira] [Resolved] (FLINK-1936) Normalize keys and default values in ConfigConstants.java

2016-10-13 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-1936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Hogan resolved FLINK-1936. --- Resolution: Fixed > Normalize keys and default values in ConfigConstants.java > --

  1   2   >