[jira] [Updated] (FLINK-4760) Kafka 09 Consumer failed to initialize state because of corrupted operator state and not able to recover

2016-10-06 Thread Zhenzhong Xu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenzhong Xu updated FLINK-4760: Summary: Kafka 09 Consumer failed to initialize state because of corrupted operator state and not

[jira] [Created] (FLINK-4760) Kafka 09 Consumer failed to initialize state causing job to restart

2016-10-06 Thread Zhenzhong Xu (JIRA)
Zhenzhong Xu created FLINK-4760: --- Summary: Kafka 09 Consumer failed to initialize state causing job to restart Key: FLINK-4760 URL: https://issues.apache.org/jira/browse/FLINK-4760 Project: Flink

[jira] [Closed] (FLINK-4736) Don't duplicate fields in Ordering

2016-10-06 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Hogan closed FLINK-4736. - Resolution: Implemented Implemented in 6efb7c2666d6b75b686e30a44f0acec8f69d1ed0 > Don't duplicate fields

[jira] [Commented] (FLINK-4736) Don't duplicate fields in Ordering

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553183#comment-15553183 ] ASF GitHub Bot commented on FLINK-4736: --- Github user asfgit closed the pull request at:

[GitHub] flink pull request #2601: [FLINK-4736] [core] Don't duplicate fields in Orde...

2016-10-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/2601 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (FLINK-3801) Upgrade Joda-Time library to 2.9.3

2016-10-06 Thread Greg Hogan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15553058#comment-15553058 ] Greg Hogan commented on FLINK-3801: --- Why the roughly-every-week formatting change on this ticket's

[GitHub] flink issue #2605: [DISCUSS] Introduce config options

2016-10-06 Thread greghogan
Github user greghogan commented on the issue: https://github.com/apache/flink/pull/2605 +1. My only suggestion would be to move the deprecated keys out of the constructor into a separate method like `public Option withDeprecatedKeys(String... deprecatedKeys) {`. And the same

[jira] [Commented] (FLINK-3932) Implement State Backend Security

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552873#comment-15552873 ] ASF GitHub Bot commented on FLINK-3932: --- Github user vijikarthi commented on the issue:

[GitHub] flink issue #2589: FLINK-3932 State Backend Security

2016-10-06 Thread vijikarthi
Github user vijikarthi commented on the issue: https://github.com/apache/flink/pull/2589 Thanks @mxm . I have just rebased it against the master. Could you please merge the code. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub

[GitHub] flink pull request #2605: [DISCUSS] Introduce config options

2016-10-06 Thread StephanEwen
GitHub user StephanEwen opened a pull request: https://github.com/apache/flink/pull/2605 [DISCUSS] Introduce config options It is a bit unorthodox to start a discussion via a pull request, but this suggestion is best motivated via some code. I suggest to move away from the

[jira] [Commented] (FLINK-4637) Address Yarn proxy incompatibility with Flink Web UI when service level authorization is enabled

2016-10-06 Thread Vijay Srinivasaraghavan (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552657#comment-15552657 ] Vijay Srinivasaraghavan commented on FLINK-4637: Yarn WebAppProxyServlet code passes only

[jira] [Created] (FLINK-4759) Unclosed DataOutputViewStream in JavaSerializer

2016-10-06 Thread Ted Yu (JIRA)
Ted Yu created FLINK-4759: - Summary: Unclosed DataOutputViewStream in JavaSerializer Key: FLINK-4759 URL: https://issues.apache.org/jira/browse/FLINK-4759 Project: Flink Issue Type: Bug

[jira] [Updated] (FLINK-3801) Upgrade Joda-Time library to 2.9.3

2016-10-06 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated FLINK-3801: -- Description: Currently yoda-time 2.5 is used which was very old. We should upgrade to 2.9.3 was: Currently

[jira] [Commented] (FLINK-3931) Implement Transport Encryption (SSL/TLS)

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552481#comment-15552481 ] ASF GitHub Bot commented on FLINK-3931: --- Github user mxm commented on a diff in the pull request:

[jira] [Assigned] (FLINK-3888) Custom Aggregator with Convergence can't be registered directly with DeltaIteration

2016-10-06 Thread Vasia Kalavri (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vasia Kalavri reassigned FLINK-3888: Assignee: Vasia Kalavri > Custom Aggregator with Convergence can't be registered directly

[jira] [Commented] (FLINK-3931) Implement Transport Encryption (SSL/TLS)

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552477#comment-15552477 ] ASF GitHub Bot commented on FLINK-3931: --- Github user mxm commented on a diff in the pull request:

[jira] [Commented] (FLINK-3931) Implement Transport Encryption (SSL/TLS)

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552470#comment-15552470 ] ASF GitHub Bot commented on FLINK-3931: --- Github user mxm commented on a diff in the pull request:

[jira] [Commented] (FLINK-3931) Implement Transport Encryption (SSL/TLS)

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552475#comment-15552475 ] ASF GitHub Bot commented on FLINK-3931: --- Github user mxm commented on a diff in the pull request:

[jira] [Commented] (FLINK-3931) Implement Transport Encryption (SSL/TLS)

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552480#comment-15552480 ] ASF GitHub Bot commented on FLINK-3931: --- Github user mxm commented on a diff in the pull request:

[jira] [Commented] (FLINK-3931) Implement Transport Encryption (SSL/TLS)

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552473#comment-15552473 ] ASF GitHub Bot commented on FLINK-3931: --- Github user mxm commented on a diff in the pull request:

[jira] [Commented] (FLINK-3931) Implement Transport Encryption (SSL/TLS)

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552472#comment-15552472 ] ASF GitHub Bot commented on FLINK-3931: --- Github user mxm commented on a diff in the pull request:

[jira] [Commented] (FLINK-3931) Implement Transport Encryption (SSL/TLS)

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552478#comment-15552478 ] ASF GitHub Bot commented on FLINK-3931: --- Github user mxm commented on a diff in the pull request:

[jira] [Commented] (FLINK-3931) Implement Transport Encryption (SSL/TLS)

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552474#comment-15552474 ] ASF GitHub Bot commented on FLINK-3931: --- Github user mxm commented on a diff in the pull request:

[jira] [Commented] (FLINK-3931) Implement Transport Encryption (SSL/TLS)

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552471#comment-15552471 ] ASF GitHub Bot commented on FLINK-3931: --- Github user mxm commented on a diff in the pull request:

[jira] [Commented] (FLINK-3931) Implement Transport Encryption (SSL/TLS)

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552476#comment-15552476 ] ASF GitHub Bot commented on FLINK-3931: --- Github user mxm commented on a diff in the pull request:

[jira] [Commented] (FLINK-3931) Implement Transport Encryption (SSL/TLS)

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552479#comment-15552479 ] ASF GitHub Bot commented on FLINK-3931: --- Github user mxm commented on a diff in the pull request:

[jira] [Commented] (FLINK-3931) Implement Transport Encryption (SSL/TLS)

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-3931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552469#comment-15552469 ] ASF GitHub Bot commented on FLINK-3931: --- Github user mxm commented on a diff in the pull request:

[GitHub] flink pull request #2518: [FLINK-3931] Implement Transport Encryption (SSL/T...

2016-10-06 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/2518#discussion_r82214217 --- Diff: flink-core/src/main/java/org/apache/flink/configuration/ConfigConstants.java --- @@ -628,6 +641,11 @@ public static final String

[GitHub] flink pull request #2518: [FLINK-3931] Implement Transport Encryption (SSL/T...

2016-10-06 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/2518#discussion_r82214165 --- Diff: flink-core/src/main/java/org/apache/flink/configuration/ConfigConstants.java --- @@ -157,6 +157,9 @@ */ public static final String

[GitHub] flink pull request #2518: [FLINK-3931] Implement Transport Encryption (SSL/T...

2016-10-06 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/2518#discussion_r82216311 --- Diff: flink-runtime-web/src/main/java/org/apache/flink/runtime/webmonitor/handlers/JobManagerConfigHandler.java --- @@ -45,7 +45,18 @@ public String

[GitHub] flink pull request #2518: [FLINK-3931] Implement Transport Encryption (SSL/T...

2016-10-06 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/2518#discussion_r82215957 --- Diff: flink-runtime-web/src/main/java/org/apache/flink/runtime/webmonitor/files/StaticFileServerHandler.java --- @@ -304,8 +314,15 @@ private void

[GitHub] flink pull request #2518: [FLINK-3931] Implement Transport Encryption (SSL/T...

2016-10-06 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/2518#discussion_r82214189 --- Diff: flink-core/src/main/java/org/apache/flink/configuration/ConfigConstants.java --- @@ -544,6 +552,11 @@ public static final String

[GitHub] flink pull request #2518: [FLINK-3931] Implement Transport Encryption (SSL/T...

2016-10-06 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/2518#discussion_r8650 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/blob/BlobClientSslTest.java --- @@ -0,0 +1,284 @@ +/* + * Licensed to the Apache Software

[GitHub] flink pull request #2518: [FLINK-3931] Implement Transport Encryption (SSL/T...

2016-10-06 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/2518#discussion_r82214177 --- Diff: flink-core/src/main/java/org/apache/flink/configuration/ConfigConstants.java --- @@ -178,6 +181,11 @@ public static final String

[GitHub] flink pull request #2518: [FLINK-3931] Implement Transport Encryption (SSL/T...

2016-10-06 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/2518#discussion_r82213335 --- Diff: docs/setup/security-ssl.md --- @@ -0,0 +1,139 @@ +--- +title: "SSL Setup" +nav-parent_id: setup +nav-pos: 8 +--- + +

[GitHub] flink pull request #2518: [FLINK-3931] Implement Transport Encryption (SSL/T...

2016-10-06 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/2518#discussion_r82211062 --- Diff: docs/setup/config.md --- @@ -181,6 +183,7 @@ The following parameters configure Flink's JobManager and TaskManagers. - `taskmanager.hostname`: The

[GitHub] flink pull request #2518: [FLINK-3931] Implement Transport Encryption (SSL/T...

2016-10-06 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/2518#discussion_r82211083 --- Diff: docs/setup/config.md --- @@ -211,6 +214,19 @@ The following parameters configure Flink's JobManager and TaskManagers. - `akka.throughput`: Number

[GitHub] flink pull request #2518: [FLINK-3931] Implement Transport Encryption (SSL/T...

2016-10-06 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/2518#discussion_r82230310 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/blob/BlobClientSslTest.java --- @@ -0,0 +1,284 @@ +/* + * Licensed to the Apache Software

[GitHub] flink pull request #2518: [FLINK-3931] Implement Transport Encryption (SSL/T...

2016-10-06 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/2518#discussion_r82211018 --- Diff: docs/setup/config.md --- @@ -140,6 +140,8 @@ will be used under the directory specified by jobmanager.web.tmpdir. - `blob.server.port`: Port

[GitHub] flink pull request #2518: [FLINK-3931] Implement Transport Encryption (SSL/T...

2016-10-06 Thread mxm
Github user mxm commented on a diff in the pull request: https://github.com/apache/flink/pull/2518#discussion_r82211248 --- Diff: docs/setup/config.md --- @@ -222,6 +238,7 @@ The following parameters configure Flink's JobManager and TaskManagers. -

[jira] [Created] (FLINK-4758) Remove IOReadableWritable from classes where not needed

2016-10-06 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-4758: --- Summary: Remove IOReadableWritable from classes where not needed Key: FLINK-4758 URL: https://issues.apache.org/jira/browse/FLINK-4758 Project: Flink Issue

[jira] [Created] (FLINK-4757) Unify "GlobalJobParameters" and "Configuration"

2016-10-06 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-4757: --- Summary: Unify "GlobalJobParameters" and "Configuration" Key: FLINK-4757 URL: https://issues.apache.org/jira/browse/FLINK-4757 Project: Flink Issue Type:

[jira] [Commented] (FLINK-4731) HeapKeyedStateBackend restoring broken for scale-in

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552347#comment-15552347 ] ASF GitHub Bot commented on FLINK-4731: --- Github user StefanRRichter commented on the issue:

[jira] [Commented] (FLINK-4735) Migrate some job execution related akka messages to rpc calls

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552354#comment-15552354 ] ASF GitHub Bot commented on FLINK-4735: --- Github user KurtYoung commented on the issue:

[GitHub] flink issue #2588: [FLINK-4735] [cluster management] Migrate some job execut...

2016-10-06 Thread KurtYoung
Github user KurtYoung commented on the issue: https://github.com/apache/flink/pull/2588 @StephanEwen Sounds reasonable. This PR has some overlayer with #2594, will address your comment after that one merged and rebase to the latest flip-6 branch --- If your project is set up for

[GitHub] flink issue #2584: [FLINK-4731] Bugfix for HeapKeyedStateBackend scale-in an...

2016-10-06 Thread StefanRRichter
Github user StefanRRichter commented on the issue: https://github.com/apache/flink/pull/2584 Thanks a lot for the review Ufuk! I addressed your comments (see my responses also). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as

[jira] [Commented] (FLINK-4731) HeapKeyedStateBackend restoring broken for scale-in

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552325#comment-15552325 ] ASF GitHub Bot commented on FLINK-4731: --- Github user StefanRRichter commented on a diff in the pull

[GitHub] flink pull request #2584: [FLINK-4731] Bugfix for HeapKeyedStateBackend scal...

2016-10-06 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/2584#discussion_r8653 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/memory/ByteStreamStateHandle.java --- @@ -20,62 +20,49 @@ import

[GitHub] flink pull request #2584: [FLINK-4731] Bugfix for HeapKeyedStateBackend scal...

2016-10-06 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/2584#discussion_r82221594 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/savepoint/SavepointV1Serializer.java --- @@ -290,6 +290,7 @@ public static

[jira] [Commented] (FLINK-4731) HeapKeyedStateBackend restoring broken for scale-in

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552313#comment-15552313 ] ASF GitHub Bot commented on FLINK-4731: --- Github user StefanRRichter commented on a diff in the pull

[jira] [Commented] (FLINK-4731) HeapKeyedStateBackend restoring broken for scale-in

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552302#comment-15552302 ] ASF GitHub Bot commented on FLINK-4731: --- Github user StefanRRichter commented on a diff in the pull

[GitHub] flink pull request #2584: [FLINK-4731] Bugfix for HeapKeyedStateBackend scal...

2016-10-06 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/2584#discussion_r82221108 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/filesystem/FsCheckpointStreamFactory.java --- @@ -219,7 +218,7 @@ public void

[jira] [Commented] (FLINK-4731) HeapKeyedStateBackend restoring broken for scale-in

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552273#comment-15552273 ] ASF GitHub Bot commented on FLINK-4731: --- Github user uce commented on a diff in the pull request:

[jira] [Commented] (FLINK-4731) HeapKeyedStateBackend restoring broken for scale-in

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552275#comment-15552275 ] ASF GitHub Bot commented on FLINK-4731: --- Github user uce commented on a diff in the pull request:

[jira] [Commented] (FLINK-4731) HeapKeyedStateBackend restoring broken for scale-in

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552276#comment-15552276 ] ASF GitHub Bot commented on FLINK-4731: --- Github user uce commented on a diff in the pull request:

[jira] [Commented] (FLINK-4731) HeapKeyedStateBackend restoring broken for scale-in

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552274#comment-15552274 ] ASF GitHub Bot commented on FLINK-4731: --- Github user uce commented on a diff in the pull request:

[GitHub] flink pull request #2584: [FLINK-4731] Bugfix for HeapKeyedStateBackend scal...

2016-10-06 Thread uce
Github user uce commented on a diff in the pull request: https://github.com/apache/flink/pull/2584#discussion_r82216509 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/heap/HeapKeyedStateBackend.java --- @@ -259,28 +263,29 @@ public void

[jira] [Commented] (FLINK-4731) HeapKeyedStateBackend restoring broken for scale-in

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552272#comment-15552272 ] ASF GitHub Bot commented on FLINK-4731: --- Github user uce commented on a diff in the pull request:

[jira] [Commented] (FLINK-4731) HeapKeyedStateBackend restoring broken for scale-in

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552271#comment-15552271 ] ASF GitHub Bot commented on FLINK-4731: --- Github user uce commented on a diff in the pull request:

[GitHub] flink pull request #2584: [FLINK-4731] Bugfix for HeapKeyedStateBackend scal...

2016-10-06 Thread uce
Github user uce commented on a diff in the pull request: https://github.com/apache/flink/pull/2584#discussion_r82213262 --- Diff: flink-tests/src/test/java/org/apache/flink/test/checkpointing/RescalingITCase.java --- @@ -663,28 +826,42 @@ public Integer snapshotState(long

[GitHub] flink pull request #2584: [FLINK-4731] Bugfix for HeapKeyedStateBackend scal...

2016-10-06 Thread uce
Github user uce commented on a diff in the pull request: https://github.com/apache/flink/pull/2584#discussion_r82217757 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/memory/ByteStreamStateHandle.java --- @@ -20,62 +20,49 @@ import

[GitHub] flink pull request #2584: [FLINK-4731] Bugfix for HeapKeyedStateBackend scal...

2016-10-06 Thread uce
Github user uce commented on a diff in the pull request: https://github.com/apache/flink/pull/2584#discussion_r82211635 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/filesystem/FsCheckpointStreamFactory.java --- @@ -219,7 +218,7 @@ public void write(byte[]

[GitHub] flink pull request #2584: [FLINK-4731] Bugfix for HeapKeyedStateBackend scal...

2016-10-06 Thread uce
Github user uce commented on a diff in the pull request: https://github.com/apache/flink/pull/2584#discussion_r82211023 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/filesystem/FsCheckpointStreamFactory.java --- @@ -297,7 +296,7 @@ public StreamStateHandle

[GitHub] flink pull request #2584: [FLINK-4731] Bugfix for HeapKeyedStateBackend scal...

2016-10-06 Thread uce
Github user uce commented on a diff in the pull request: https://github.com/apache/flink/pull/2584#discussion_r82211497 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/savepoint/SavepointV1Serializer.java --- @@ -290,6 +290,7 @@ public static void

[jira] [Commented] (FLINK-4755) Create ContainerID; Rename ResourceID into ProcessID and InstanceID into RegistrationID

2016-10-06 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552184#comment-15552184 ] Stephan Ewen commented on FLINK-4755: - I order to keep {{flip-6}} close to master, we should rename it

[jira] [Closed] (FLINK-4730) Introduce CheckpointMetaData

2016-10-06 Thread Ufuk Celebi (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ufuk Celebi closed FLINK-4730. -- Resolution: Implemented Fix Version/s: 1.2.0 Implemented in 0dac7ad (master). > Introduce

[jira] [Comment Edited] (FLINK-4604) Add support for standard deviation/variance

2016-10-06 Thread Timo Walther (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15551943#comment-15551943 ] Timo Walther edited comment on FLINK-4604 at 10/6/16 2:28 PM: -- Ok, it seems

[jira] [Commented] (FLINK-4730) Introduce CheckpointMetaData

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552157#comment-15552157 ] ASF GitHub Bot commented on FLINK-4730: --- Github user asfgit closed the pull request at:

[GitHub] flink pull request #2583: [FLINK-4730] Introduce checkpoint meta data

2016-10-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/2583 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] flink issue #2550: [FLINK-4657] Implement HighAvailabilityServices based on ...

2016-10-06 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/2550 @KurtYoung Yes, the `cluster-id` should lake the role of `availability.zookeeper.path.namespace` - in some sense it is a renaming. I would also suggest we use existing IDs where possible

[jira] [Commented] (FLINK-4657) Implement HighAvailabilityServices based on zookeeper

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552151#comment-15552151 ] ASF GitHub Bot commented on FLINK-4657: --- Github user StephanEwen commented on the issue:

[jira] [Commented] (FLINK-4735) Migrate some job execution related akka messages to rpc calls

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552140#comment-15552140 ] ASF GitHub Bot commented on FLINK-4735: --- Github user StephanEwen commented on the issue:

[GitHub] flink issue #2588: [FLINK-4735] [cluster management] Migrate some job execut...

2016-10-06 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/2588 Looks good, thanks, will merge this. I would suggest two followups: - We can remove the "dispose savepoint" method, because that is functionality disappearing right now. Savepoints

[GitHub] flink issue #2602: [hotfix] Re-register restored processing time timers.

2016-10-06 Thread StephanEwen
Github user StephanEwen commented on the issue: https://github.com/apache/flink/pull/2602 Looks good, merging this... --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[jira] [Created] (FLINK-4755) Create ContainerID; Rename ResourceID into ProcessID and InstanceID into RegistrationID

2016-10-06 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-4755: Summary: Create ContainerID; Rename ResourceID into ProcessID and InstanceID into RegistrationID Key: FLINK-4755 URL: https://issues.apache.org/jira/browse/FLINK-4755

[jira] [Commented] (FLINK-4604) Add support for standard deviation/variance

2016-10-06 Thread Timo Walther (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552086#comment-15552086 ] Timo Walther commented on FLINK-4604: - Maybe the cost function of {{DataSetAggregate}} is faulty.

[jira] [Created] (FLINK-4756) NullPointerException on submiting a job with StreamExecutionEnvironment.createRemoteEnvironment to a flink cluster

2016-10-06 Thread Ruwen Moos (JIRA)
Ruwen Moos created FLINK-4756: - Summary: NullPointerException on submiting a job with StreamExecutionEnvironment.createRemoteEnvironment to a flink cluster Key: FLINK-4756 URL:

[jira] [Comment Edited] (FLINK-4604) Add support for standard deviation/variance

2016-10-06 Thread Anton Mushin (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15552063#comment-15552063 ] Anton Mushin edited comment on FLINK-4604 at 10/6/16 2:24 PM: -- bq. Can you

[jira] [Updated] (FLINK-4604) Add support for standard deviation/variance

2016-10-06 Thread Anton Mushin (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Mushin updated FLINK-4604: Attachment: 1.jpg bq. Can you check if AggregateReduceFunctionsRule.matches is called? yes it is

[jira] [Commented] (FLINK-2254) Add Bipartite Graph Support for Gelly

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-2254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15551941#comment-15551941 ] ASF GitHub Bot commented on FLINK-2254: --- Github user vasia commented on the issue:

[jira] [Commented] (FLINK-4753) Kafka 0.8 connector's Periodic Offset Committer should synchronize on checkpoint lock

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15551952#comment-15551952 ] ASF GitHub Bot commented on FLINK-4753: --- GitHub user tzulitai opened a pull request:

[GitHub] flink pull request #2604: [FLINK-4753] [kafka] PeriodicOffsetCommitter shoul...

2016-10-06 Thread tzulitai
GitHub user tzulitai opened a pull request: https://github.com/apache/flink/pull/2604 [FLINK-4753] [kafka] PeriodicOffsetCommitter should synchronize on checkpoint lock The `PeriodicOffsetCommitter` in Kafka 0.8 currently doesn't synchronize on the checkpoint lock when creating a

[jira] [Comment Edited] (FLINK-4604) Add support for standard deviation/variance

2016-10-06 Thread Timo Walther (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15551943#comment-15551943 ] Timo Walther edited comment on FLINK-4604 at 10/6/16 1:36 PM: -- Ok, it seems

[jira] [Commented] (FLINK-4604) Add support for standard deviation/variance

2016-10-06 Thread Timo Walther (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15551943#comment-15551943 ] Timo Walther commented on FLINK-4604: - Ok, it seems that the {{AggregateReduceFunctionsRule}} does

[GitHub] flink issue #2564: [FLINK-2254] Add BipartiateGraph class

2016-10-06 Thread vasia
Github user vasia commented on the issue: https://github.com/apache/flink/pull/2564 Thanks for the update @mushketyk and for the review @greghogan. I agree with your suggestions. For the type parameters I would go for ``. Let me know if there's any other issue

[jira] [Assigned] (FLINK-4492) Cleanup files from canceled snapshots

2016-10-06 Thread Nikolay Vasilishin (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nikolay Vasilishin reassigned FLINK-4492: - Assignee: Nikolay Vasilishin > Cleanup files from canceled snapshots >

[GitHub] flink issue #2571: [FLINK-4348] Simplify logic of SlotManager

2016-10-06 Thread mxm
Github user mxm commented on the issue: https://github.com/apache/flink/pull/2571 Rebased to latest `flip-6`. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[jira] [Commented] (FLINK-4691) Add group-windows for streaming tables

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15551920#comment-15551920 ] ASF GitHub Bot commented on FLINK-4691: --- Github user twalthr commented on a diff in the pull

[GitHub] flink pull request #2562: [FLINK-4691] [table] Add group-windows for streami...

2016-10-06 Thread twalthr
Github user twalthr commented on a diff in the pull request: https://github.com/apache/flink/pull/2562#discussion_r82186936 --- Diff: flink-libraries/flink-table/src/main/scala/org/apache/flink/api/scala/table/expressionDsl.scala --- @@ -325,33 +337,42 @@ trait

[jira] [Commented] (FLINK-4348) Implement slot allocation protocol with TaskExecutor

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15551911#comment-15551911 ] ASF GitHub Bot commented on FLINK-4348: --- Github user mxm commented on the issue:

[jira] [Commented] (FLINK-4691) Add group-windows for streaming tables

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15551824#comment-15551824 ] ASF GitHub Bot commented on FLINK-4691: --- Github user twalthr commented on a diff in the pull

[jira] [Commented] (FLINK-4691) Add group-windows for streaming tables

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15551825#comment-15551825 ] ASF GitHub Bot commented on FLINK-4691: --- Github user twalthr commented on a diff in the pull

[GitHub] flink pull request #2562: [FLINK-4691] [table] Add group-windows for streami...

2016-10-06 Thread twalthr
Github user twalthr commented on a diff in the pull request: https://github.com/apache/flink/pull/2562#discussion_r82177134 --- Diff: flink-libraries/flink-table/src/main/scala/org/apache/flink/api/table/runtime/aggregate/AggregateReduceCombineFunction.scala --- @@ -0,0 +1,132 @@

[GitHub] flink pull request #2562: [FLINK-4691] [table] Add group-windows for streami...

2016-10-06 Thread twalthr
Github user twalthr commented on a diff in the pull request: https://github.com/apache/flink/pull/2562#discussion_r82177163 --- Diff: flink-libraries/flink-table/src/main/scala/org/apache/flink/api/table/runtime/aggregate/AggregateReduceCombineFunction.scala --- @@ -0,0 +1,132 @@

[jira] [Commented] (FLINK-4691) Add group-windows for streaming tables

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15551819#comment-15551819 ] ASF GitHub Bot commented on FLINK-4691: --- Github user twalthr commented on a diff in the pull

[GitHub] flink pull request #2562: [FLINK-4691] [table] Add group-windows for streami...

2016-10-06 Thread twalthr
Github user twalthr commented on a diff in the pull request: https://github.com/apache/flink/pull/2562#discussion_r82176556 --- Diff: flink-libraries/flink-table/src/main/scala/org/apache/flink/api/table/plan/nodes/datastream/DataStreamAggregate.scala --- @@ -0,0 +1,261 @@

[jira] [Comment Edited] (FLINK-4604) Add support for standard deviation/variance

2016-10-06 Thread Anton Mushin (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15551768#comment-15551768 ] Anton Mushin edited comment on FLINK-4604 at 10/6/16 12:22 PM: --- I used

[jira] [Commented] (FLINK-4730) Introduce CheckpointMetaData

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15551782#comment-15551782 ] ASF GitHub Bot commented on FLINK-4730: --- Github user StefanRRichter commented on a diff in the pull

[GitHub] flink pull request #2583: [FLINK-4730] Introduce checkpoint meta data

2016-10-06 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/2583#discussion_r82174054 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/CheckpointMetaData.java --- @@ -0,0 +1,113 @@ +/* + * Licensed to

[jira] [Commented] (FLINK-4730) Introduce CheckpointMetaData

2016-10-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-4730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15551770#comment-15551770 ] ASF GitHub Bot commented on FLINK-4730: --- Github user StefanRRichter commented on a diff in the pull

  1   2   >