[GitHub] flink pull request #5074: [FLINK-7873] [runtime] Introduce local recovery

2018-02-27 Thread sihuazhou
Github user sihuazhou closed the pull request at: https://github.com/apache/flink/pull/5074 ---

[jira] [Commented] (FLINK-7873) Introduce CheckpointCacheManager for reading checkpoint data locally when performing failover

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379918#comment-16379918 ] ASF GitHub Bot commented on FLINK-7873: --- Github user sihuazhou closed the pull request at:

[jira] [Closed] (FLINK-7873) Introduce CheckpointCacheManager for reading checkpoint data locally when performing failover

2018-02-27 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sihua Zhou closed FLINK-7873. - Resolution: Duplicate Release Note: fixed by stefan. > Introduce CheckpointCacheManager for reading

[jira] [Assigned] (FLINK-8160) Extend OperatorHarness to expose metrics

2018-02-27 Thread Tuo Wang (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tuo Wang reassigned FLINK-8160: --- Assignee: Tuo Wang > Extend OperatorHarness to expose metrics >

[jira] [Updated] (FLINK-8794) When using BucketingSink, it happens that one of the files is always in the [.in-progress] state

2018-02-27 Thread yanxiaobin (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yanxiaobin updated FLINK-8794: -- Description: When using BucketingSink, it happens that one of the files is always in the

[jira] [Updated] (FLINK-8794) When using BucketingSink, it happens that one of the files is always in the [.in-progress] state

2018-02-27 Thread yanxiaobin (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yanxiaobin updated FLINK-8794: -- Description: When using BucketingSink, it happens that one of the files is always in the

[jira] [Comment Edited] (FLINK-5697) Add per-shard watermarks for FlinkKinesisConsumer

2018-02-27 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379815#comment-16379815 ] Thomas Weise edited comment on FLINK-5697 at 2/28/18 5:52 AM: -- We have

[jira] [Commented] (FLINK-5697) Add per-shard watermarks for FlinkKinesisConsumer

2018-02-27 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379815#comment-16379815 ] Thomas Weise commented on FLINK-5697: - We have implemented periodic watermark support in a

[GitHub] flink issue #5578: [FLINK-8777][state]Improve resource release for local rec...

2018-02-27 Thread sihuazhou
Github user sihuazhou commented on the issue: https://github.com/apache/flink/pull/5578 @StefanRRichter I have addressed your suggestions, except the one that to make the `if` a bit complex, instead I introduced a `Predicate` for the `pruneCheckpoints()`. I not sure whether it is ok

[jira] [Commented] (FLINK-8777) improve resource release when recovery from failover

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379806#comment-16379806 ] ASF GitHub Bot commented on FLINK-8777: --- Github user sihuazhou commented on the issue:

[jira] [Commented] (FLINK-7836) specifying node label for flink job to run on yarn

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379780#comment-16379780 ] ASF GitHub Bot commented on FLINK-7836: --- Github user yanghua commented on the issue:

[jira] [Commented] (FLINK-8792) bad semantic of method name MessageQueryParameter.convertStringToValue

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379779#comment-16379779 ] ASF GitHub Bot commented on FLINK-8792: --- Github user yanghua commented on the issue:

[GitHub] flink issue #5593: [FLINK-7836][Client] specifying node label for flink job ...

2018-02-27 Thread yanghua
Github user yanghua commented on the issue: https://github.com/apache/flink/pull/5593 @tillrohrmann could you review this PR? Thanks! ---

[GitHub] flink issue #5587: [FLINK-8792][REST] bad semantic of method name MessageQue...

2018-02-27 Thread yanghua
Github user yanghua commented on the issue: https://github.com/apache/flink/pull/5587 @tillrohrmann could you review this PR? Thanks! ---

[jira] [Commented] (FLINK-6847) Add TIMESTAMPDIFF supported in TableAPI

2018-02-27 Thread Wind (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379777#comment-16379777 ] Wind commented on FLINK-6847: - can you assign it to me if possible ? > Add TIMESTAMPDIFF supported in

[jira] [Issue Comment Deleted] (FLINK-6847) Add TIMESTAMPDIFF supported in TableAPI

2018-02-27 Thread Wind (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wind updated FLINK-6847: Comment: was deleted (was: can you assign it to me if possible ?) > Add TIMESTAMPDIFF supported in TableAPI >

[jira] [Commented] (FLINK-7470) Acquire RM leadership before registering with Mesos

2018-02-27 Thread Bertrand Bossy (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379756#comment-16379756 ] Bertrand Bossy commented on FLINK-7470: --- Is there any update on this? FLIP-6 mode for Mesos seems to

[jira] [Commented] (FLINK-7836) specifying node label for flink job to run on yarn

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379722#comment-16379722 ] ASF GitHub Bot commented on FLINK-7836: --- GitHub user yanghua opened a pull request:

[GitHub] flink pull request #5593: [FLINK-7836][Client] specifying node label for fli...

2018-02-27 Thread yanghua
GitHub user yanghua opened a pull request: https://github.com/apache/flink/pull/5593 [FLINK-7836][Client] specifying node label for flink job to run on yarn ## What is the purpose of the change *This pull request support flink on yarn to specify yarn node label for yarn

[jira] [Commented] (FLINK-8777) improve resource release when recovery from failover

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379717#comment-16379717 ] ASF GitHub Bot commented on FLINK-8777: --- Github user sihuazhou commented on a diff in the pull

[GitHub] flink pull request #5578: [FLINK-8777][state]Improve resource release for lo...

2018-02-27 Thread sihuazhou
Github user sihuazhou commented on a diff in the pull request: https://github.com/apache/flink/pull/5578#discussion_r171133066 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/TaskLocalStateStoreImpl.java --- @@ -300,6 +291,32 @@ private void

[GitHub] flink pull request #5592: [hotfix] fix javadoc link of ClusterClient#trigger...

2018-02-27 Thread Matrix42
GitHub user Matrix42 opened a pull request: https://github.com/apache/flink/pull/5592 [hotfix] fix javadoc link of ClusterClient#triggerSavepoint ## What is the purpose of the change fix javadoc link of ClusterClient#triggerSavepoint You can merge this pull request into a

[jira] [Commented] (FLINK-8777) improve resource release when recovery from failover

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379697#comment-16379697 ] ASF GitHub Bot commented on FLINK-8777: --- Github user sihuazhou commented on a diff in the pull

[jira] [Commented] (FLINK-8777) improve resource release when recovery from failover

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379696#comment-16379696 ] ASF GitHub Bot commented on FLINK-8777: --- Github user sihuazhou commented on a diff in the pull

[GitHub] flink pull request #5578: [FLINK-8777][state]Improve resource release for lo...

2018-02-27 Thread sihuazhou
Github user sihuazhou commented on a diff in the pull request: https://github.com/apache/flink/pull/5578#discussion_r171130767 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/TaskLocalStateStoreImpl.java --- @@ -159,6 +166,11 @@ public TaskStateSnapshot

[GitHub] flink pull request #5578: [FLINK-8777][state]Improve resource release for lo...

2018-02-27 Thread sihuazhou
Github user sihuazhou commented on a diff in the pull request: https://github.com/apache/flink/pull/5578#discussion_r171130750 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/TaskLocalStateStoreImpl.java --- @@ -300,6 +291,32 @@ private void

[jira] [Commented] (FLINK-8777) improve resource release when recovery from failover

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379698#comment-16379698 ] ASF GitHub Bot commented on FLINK-8777: --- Github user sihuazhou commented on a diff in the pull

[GitHub] flink pull request #5578: [FLINK-8777][state]Improve resource release for lo...

2018-02-27 Thread sihuazhou
Github user sihuazhou commented on a diff in the pull request: https://github.com/apache/flink/pull/5578#discussion_r171130718 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/TaskLocalStateStoreImpl.java --- @@ -90,6 +92,9 @@ @GuardedBy("lock")

[jira] [Commented] (FLINK-8620) Enable shipping custom artifacts to BlobStore and accessing them through DistributedCache

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379673#comment-16379673 ] ASF GitHub Bot commented on FLINK-8620: --- Github user ifndef-SleePy commented on the issue:

[GitHub] flink issue #5580: [FLINK-8620] Enable shipping custom files to BlobStore an...

2018-02-27 Thread ifndef-SleePy
Github user ifndef-SleePy commented on the issue: https://github.com/apache/flink/pull/5580 @zentol All right, got your point. That's a problem indeed. ---

[jira] [Updated] (FLINK-8708) Unintended integer division in StandaloneThreadedGenerator

2018-02-27 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated FLINK-8708: -- Description: In

[jira] [Commented] (FLINK-8720) Logging exception with S3 connector and BucketingSink

2018-02-27 Thread dejan miljkovic (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379167#comment-16379167 ] dejan miljkovic commented on FLINK-8720: I see from FLINK-8798 that solution is going to be

[jira] [Resolved] (FLINK-8538) Add a Kafka table source factory with JSON format support

2018-02-27 Thread Timo Walther (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timo Walther resolved FLINK-8538. - Resolution: Fixed Fix Version/s: 1.6.0 1.5.0 Fixed in 1.6.0:

[jira] [Commented] (FLINK-8538) Add a Kafka table source factory with JSON format support

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379148#comment-16379148 ] ASF GitHub Bot commented on FLINK-8538: --- Github user asfgit closed the pull request at:

[GitHub] flink pull request #5564: [FLINK-8538] [table] Add a Kafka table source fact...

2018-02-27 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5564 ---

[jira] [Commented] (FLINK-8667) expose key in KeyedBroadcastProcessFunction#onTimer()

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379074#comment-16379074 ] ASF GitHub Bot commented on FLINK-8667: --- Github user bowenli86 commented on the issue:

[GitHub] flink issue #5500: [FLINK-8667] expose key in KeyedBroadcastProcessFunction#...

2018-02-27 Thread bowenli86
Github user bowenli86 commented on the issue: https://github.com/apache/flink/pull/5500 @tillrohrmann @kl0u Thanks for reviewing, guys As @pnowojski mentioned, we three decided to expose timer keys in `ProcessFunction` in

[jira] [Commented] (FLINK-8689) Add runtime support of distinct filter using MapView

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379063#comment-16379063 ] ASF GitHub Bot commented on FLINK-8689: --- Github user walterddr commented on the issue:

[GitHub] flink issue #5555: [FLINK-8689][table]Add runtime support of distinct filter...

2018-02-27 Thread walterddr
Github user walterddr commented on the issue: https://github.com/apache/flink/pull/ I agree this design is much cleaner and easier to maintain later. I was hesitating to change the function signature of `generateAggregations()`. I will try to introduce some common

[jira] [Commented] (FLINK-8538) Add a Kafka table source factory with JSON format support

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379044#comment-16379044 ] ASF GitHub Bot commented on FLINK-8538: --- Github user twalthr commented on the issue:

[GitHub] flink issue #5564: [FLINK-8538] [table] Add a Kafka table source factory wit...

2018-02-27 Thread twalthr
Github user twalthr commented on the issue: https://github.com/apache/flink/pull/5564 Thank you @fhueske. Will merge... ---

[jira] [Commented] (FLINK-8538) Add a Kafka table source factory with JSON format support

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16379026#comment-16379026 ] ASF GitHub Bot commented on FLINK-8538: --- Github user fhueske commented on the issue:

[GitHub] flink issue #5564: [FLINK-8538] [table] Add a Kafka table source factory wit...

2018-02-27 Thread fhueske
Github user fhueske commented on the issue: https://github.com/apache/flink/pull/5564 Thanks for the update. I think this is good to merge. ---

[jira] [Commented] (FLINK-8750) InputGate may contain data after an EndOfPartitionEvent

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378993#comment-16378993 ] ASF GitHub Bot commented on FLINK-8750: --- Github user NicoK commented on a diff in the pull request:

[jira] [Commented] (FLINK-8750) InputGate may contain data after an EndOfPartitionEvent

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378989#comment-16378989 ] ASF GitHub Bot commented on FLINK-8750: --- Github user NicoK commented on a diff in the pull request:

[jira] [Commented] (FLINK-8750) InputGate may contain data after an EndOfPartitionEvent

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378992#comment-16378992 ] ASF GitHub Bot commented on FLINK-8750: --- Github user NicoK commented on a diff in the pull request:

[jira] [Commented] (FLINK-8750) InputGate may contain data after an EndOfPartitionEvent

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378994#comment-16378994 ] ASF GitHub Bot commented on FLINK-8750: --- Github user NicoK commented on a diff in the pull request:

[GitHub] flink pull request #5588: [FLINK-8750][runtime] Improve detection of no rema...

2018-02-27 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/5588#discussion_r171004092 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/io/network/api/serialization/EventSerializerTest.java --- @@ -117,49 +116,55 @@ public void

[jira] [Commented] (FLINK-8750) InputGate may contain data after an EndOfPartitionEvent

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378991#comment-16378991 ] ASF GitHub Bot commented on FLINK-8750: --- Github user NicoK commented on a diff in the pull request:

[jira] [Commented] (FLINK-8750) InputGate may contain data after an EndOfPartitionEvent

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378990#comment-16378990 ] ASF GitHub Bot commented on FLINK-8750: --- Github user NicoK commented on a diff in the pull request:

[GitHub] flink pull request #5588: [FLINK-8750][runtime] Improve detection of no rema...

2018-02-27 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/5588#discussion_r171001535 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/io/network/api/serialization/EventSerializer.java --- @@ -107,10 +107,9 @@ else if (eventClass

[GitHub] flink pull request #5588: [FLINK-8750][runtime] Improve detection of no rema...

2018-02-27 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/5588#discussion_r171001862 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/io/network/api/serialization/EventSerializer.java --- @@ -318,13 +295,9 @@ public static

[GitHub] flink pull request #5588: [FLINK-8750][runtime] Improve detection of no rema...

2018-02-27 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/5588#discussion_r171002283 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/io/network/api/serialization/EventSerializerTest.java --- @@ -117,49 +116,55 @@ public void

[GitHub] flink pull request #5588: [FLINK-8750][runtime] Improve detection of no rema...

2018-02-27 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/5588#discussion_r171001301 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/io/network/api/serialization/EventSerializer.java --- @@ -122,38 +121,16 @@ private static

[GitHub] flink pull request #5588: [FLINK-8750][runtime] Improve detection of no rema...

2018-02-27 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/5588#discussion_r171000868 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/io/network/api/serialization/EventSerializer.java --- @@ -107,10 +107,9 @@ else if (eventClass

[jira] [Commented] (FLINK-8755) SpilledSubpartitionView wrongly relys on the backlog for determining whether more data is available

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378965#comment-16378965 ] ASF GitHub Bot commented on FLINK-8755: --- Github user NicoK commented on the issue:

[GitHub] flink issue #5581: [FLINK-8755][FLINK-8786][network] fix two bugs in spilled...

2018-02-27 Thread NicoK
Github user NicoK commented on the issue: https://github.com/apache/flink/pull/5581 rebased (not including newest FLINK-8694 changes!) and addressed the comments ---

[jira] [Commented] (FLINK-8755) SpilledSubpartitionView wrongly relys on the backlog for determining whether more data is available

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378940#comment-16378940 ] ASF GitHub Bot commented on FLINK-8755: --- Github user NicoK commented on a diff in the pull request:

[GitHub] flink pull request #5581: [FLINK-8755][FLINK-8786][network] fix two bugs in ...

2018-02-27 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/5581#discussion_r170993496 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition/SpillableSubpartitionTest.java --- @@ -222,59 +219,24 @@ public void

[jira] [Commented] (FLINK-8755) SpilledSubpartitionView wrongly relys on the backlog for determining whether more data is available

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378926#comment-16378926 ] ASF GitHub Bot commented on FLINK-8755: --- Github user NicoK commented on a diff in the pull request:

[GitHub] flink pull request #5581: [FLINK-8755][FLINK-8786][network] fix two bugs in ...

2018-02-27 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/5581#discussion_r170990471 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition/SubpartitionTestBase.java --- @@ -138,11 +145,68 @@ static void

[jira] [Commented] (FLINK-8737) Creating a union of UnionGate instances will fail with UnsupportedOperationException when retrieving buffers

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378912#comment-16378912 ] ASF GitHub Bot commented on FLINK-8737: --- Github user NicoK commented on a diff in the pull request:

[GitHub] flink pull request #5583: [FLINK-8737][network] disallow creating a union of...

2018-02-27 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/5583#discussion_r170988543 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/consumer/UnionInputGate.java --- @@ -61,7 +61,7 @@ *

[jira] [Commented] (FLINK-8756) Support ClusterClient.getAccumulators() in RestClusterClient

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378910#comment-16378910 ] ASF GitHub Bot commented on FLINK-8756: --- Github user GJL commented on the issue:

[GitHub] flink issue #5573: [FLINK-8756][Client] Support ClusterClient.getAccumulator...

2018-02-27 Thread GJL
Github user GJL commented on the issue: https://github.com/apache/flink/pull/5573 @yanghua I will take a look this week. ---

[jira] [Commented] (FLINK-8737) Creating a union of UnionGate instances will fail with UnsupportedOperationException when retrieving buffers

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8737?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378907#comment-16378907 ] ASF GitHub Bot commented on FLINK-8737: --- Github user NicoK commented on a diff in the pull request:

[GitHub] flink pull request #5583: [FLINK-8737][network] disallow creating a union of...

2018-02-27 Thread NicoK
Github user NicoK commented on a diff in the pull request: https://github.com/apache/flink/pull/5583#discussion_r170987211 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/consumer/UnionInputGate.java --- @@ -189,11 +189,11 @@ public void

[jira] [Assigned] (FLINK-8336) YarnFileStageTestS3ITCase.testRecursiveUploadForYarnS3 test instability

2018-02-27 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber reassigned FLINK-8336: -- Assignee: Nico Kruber > YarnFileStageTestS3ITCase.testRecursiveUploadForYarnS3 test

[jira] [Commented] (FLINK-8777) improve resource release when recovery from failover

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378890#comment-16378890 ] ASF GitHub Bot commented on FLINK-8777: --- Github user StefanRRichter commented on a diff in the pull

[jira] [Commented] (FLINK-8777) improve resource release when recovery from failover

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378891#comment-16378891 ] ASF GitHub Bot commented on FLINK-8777: --- Github user StefanRRichter commented on a diff in the pull

[jira] [Commented] (FLINK-8777) improve resource release when recovery from failover

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1637#comment-1637 ] ASF GitHub Bot commented on FLINK-8777: --- Github user StefanRRichter commented on a diff in the pull

[GitHub] flink pull request #5578: [FLINK-8777][state]Improve resource release for lo...

2018-02-27 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5578#discussion_r170975679 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/TaskLocalStateStoreImpl.java --- @@ -159,6 +166,11 @@ public TaskStateSnapshot

[jira] [Assigned] (FLINK-8408) YarnFileStageTestS3ITCase.testRecursiveUploadForYarnS3n unstable on Travis

2018-02-27 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber reassigned FLINK-8408: -- Assignee: Nico Kruber > YarnFileStageTestS3ITCase.testRecursiveUploadForYarnS3n unstable on

[jira] [Commented] (FLINK-8777) improve resource release when recovery from failover

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378889#comment-16378889 ] ASF GitHub Bot commented on FLINK-8777: --- Github user StefanRRichter commented on a diff in the pull

[GitHub] flink pull request #5578: [FLINK-8777][state]Improve resource release for lo...

2018-02-27 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5578#discussion_r170975600 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/TaskLocalStateStoreImpl.java --- @@ -300,6 +291,32 @@ private void

[GitHub] flink pull request #5578: [FLINK-8777][state]Improve resource release for lo...

2018-02-27 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5578#discussion_r170975985 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/TaskLocalStateStoreImpl.java --- @@ -90,6 +92,9 @@ @GuardedBy("lock")

[GitHub] flink pull request #5578: [FLINK-8777][state]Improve resource release for lo...

2018-02-27 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5578#discussion_r170982734 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/TaskLocalStateStoreImpl.java --- @@ -300,6 +291,32 @@ private void

[jira] [Updated] (FLINK-8801) S3's eventual consistent read-after-write may fail yarn deployment of resources to S3

2018-02-27 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-8801: --- Fix Version/s: 1.4.3 > S3's eventual consistent read-after-write may fail yarn deployment of >

[jira] [Created] (FLINK-8801) S3's eventual consistent read-after-write may fail yarn deployment of resources to S3

2018-02-27 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-8801: -- Summary: S3's eventual consistent read-after-write may fail yarn deployment of resources to S3 Key: FLINK-8801 URL: https://issues.apache.org/jira/browse/FLINK-8801

[jira] [Closed] (FLINK-8798) Make commons-logging a parent-first pattern

2018-02-27 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen closed FLINK-8798. --- > Make commons-logging a parent-first pattern > --- > >

[jira] [Resolved] (FLINK-8798) Make commons-logging a parent-first pattern

2018-02-27 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-8798. - Resolution: Fixed Fixed in - 1.4.2 via 392cfaaed9380c5ea38b8593d23023925638cbe3 - 1.5.0 via

[jira] [Commented] (FLINK-8787) Deploying FLIP-6 YARN session with HA fails

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378868#comment-16378868 ] ASF GitHub Bot commented on FLINK-8787: --- GitHub user GJL opened a pull request:

[jira] [Created] (FLINK-8800) Set Logging to TRACE for org.apache.flink.runtime.rest.handler.job.metrics.JobVertexMetricsHandler

2018-02-27 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-8800: --- Summary: Set Logging to TRACE for org.apache.flink.runtime.rest.handler.job.metrics.JobVertexMetricsHandler Key: FLINK-8800 URL: https://issues.apache.org/jira/browse/FLINK-8800

[GitHub] flink pull request #5591: [FLINK-8787][flip6] Deploying FLIP-6 YARN session ...

2018-02-27 Thread GJL
GitHub user GJL opened a pull request: https://github.com/apache/flink/pull/5591 [FLINK-8787][flip6] Deploying FLIP-6 YARN session with HA fails ## What is the purpose of the change *Do not copy `flinkConfiguration` in `AbstractYarnClusterDescriptor`. There is code that

[jira] [Resolved] (FLINK-8798) Make commons-logging a parent-first pattern

2018-02-27 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen resolved FLINK-8798. - Resolution: Fixed Fixed in - 1.4.2 via 392cfaaed9380c5ea38b8593d23023925638cbe3 > Make

[jira] [Created] (FLINK-8799) Make AbstractYarnClusterDescriptor immutable

2018-02-27 Thread Gary Yao (JIRA)
Gary Yao created FLINK-8799: --- Summary: Make AbstractYarnClusterDescriptor immutable Key: FLINK-8799 URL: https://issues.apache.org/jira/browse/FLINK-8799 Project: Flink Issue Type: Bug

[jira] [Reopened] (FLINK-8798) Make commons-logging a parent-first pattern

2018-02-27 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephan Ewen reopened FLINK-8798: - prematurely closed > Make commons-logging a parent-first pattern >

[GitHub] flink issue #5582: [FLINK-8790][State] Improve performance for recovery from...

2018-02-27 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/5582 Thanks for the contribution! We are currently busy with the 1.5 release. I will have a closer look at this PR and your other pending JIRAs after the release is out. ---

[jira] [Commented] (FLINK-8790) Improve performance for recovery from incremental checkpoint

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378850#comment-16378850 ] ASF GitHub Bot commented on FLINK-8790: --- Github user StefanRRichter commented on the issue:

[jira] [Commented] (FLINK-8720) Logging exception with S3 connector and BucketingSink

2018-02-27 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378844#comment-16378844 ] Stephan Ewen commented on FLINK-8720: - The proper fix is coming, tracked in FLINK-8798 > Logging

[jira] [Created] (FLINK-8798) Make commons-logging a parent-first pattern

2018-02-27 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-8798: --- Summary: Make commons-logging a parent-first pattern Key: FLINK-8798 URL: https://issues.apache.org/jira/browse/FLINK-8798 Project: Flink Issue Type: Bug

[GitHub] flink issue #5500: [FLINK-8667] expose key in KeyedBroadcastProcessFunction#...

2018-02-27 Thread pnowojski
Github user pnowojski commented on the issue: https://github.com/apache/flink/pull/5500 If this security concern is an issue, maybe in that case `getCurrentKey()` should take `object-reuse` into account, and if `object-reuse` is set to false, make a defensive copy of the key on

[jira] [Commented] (FLINK-8667) expose key in KeyedBroadcastProcessFunction#onTimer()

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378819#comment-16378819 ] ASF GitHub Bot commented on FLINK-8667: --- Github user pnowojski commented on the issue:

[jira] [Commented] (FLINK-8667) expose key in KeyedBroadcastProcessFunction#onTimer()

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378818#comment-16378818 ] ASF GitHub Bot commented on FLINK-8667: --- Github user kl0u commented on the issue:

[jira] [Closed] (FLINK-8360) Implement task-local state recovery

2018-02-27 Thread Stefan Richter (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-8360. - Resolution: Fixed > Implement task-local state recovery > --- > >

[GitHub] flink issue #5500: [FLINK-8667] expose key in KeyedBroadcastProcessFunction#...

2018-02-27 Thread kl0u
Github user kl0u commented on the issue: https://github.com/apache/flink/pull/5500 If also @aljoscha is ok, I can review this PR and merge it. ---

[jira] [Commented] (FLINK-7756) RocksDB state backend Checkpointing (Async and Incremental) is not working with CEP.

2018-02-27 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-7756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378805#comment-16378805 ] Aljoscha Krettek commented on FLINK-7756: - [~shashank734] Not right now. But thanks for providing

[jira] [Commented] (FLINK-6352) FlinkKafkaConsumer should support to use timestamp to set up start offset

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-6352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378802#comment-16378802 ] ASF GitHub Bot commented on FLINK-6352: --- Github user aljoscha commented on a diff in the pull

[GitHub] flink pull request #5282: [FLINK-6352] [kafka] Timestamp-based offset config...

2018-02-27 Thread aljoscha
Github user aljoscha commented on a diff in the pull request: https://github.com/apache/flink/pull/5282#discussion_r170966200 --- Diff: flink-connectors/flink-connector-kafka-base/src/test/java/org/apache/flink/streaming/connectors/kafka/KafkaConsumerTestBase.java --- @@ -621,12

[jira] [Commented] (FLINK-8777) improve resource release when recovery from failover

2018-02-27 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16378796#comment-16378796 ] ASF GitHub Bot commented on FLINK-8777: --- Github user sihuazhou commented on a diff in the pull

  1   2   3   4   >