[jira] [Commented] (FLINK-8648) Allow for customization of emitRecordAndUpdateState in Kinesis connector

2018-02-23 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374254#comment-16374254 ] Tzu-Li (Gordon) Tai commented on FLINK-8648: Merged via e75481cc6c5240e976f7eb

[jira] [Resolved] (FLINK-8648) Allow for customization of emitRecordAndUpdateState in Kinesis connector

2018-02-23 Thread Tzu-Li (Gordon) Tai (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai resolved FLINK-8648. Resolution: Fixed Fix Version/s: 1.5.0 > Allow for customization of emitRecor

[jira] [Commented] (FLINK-8648) Allow for customization of emitRecordAndUpdateState in Kinesis connector

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374253#comment-16374253 ] ASF GitHub Bot commented on FLINK-8648: --- Github user asfgit closed the pull request

[jira] [Commented] (FLINK-5728) FlinkKafkaProducer should flush on checkpoint by default

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374256#comment-16374256 ] ASF GitHub Bot commented on FLINK-5728: --- Github user tzulitai closed the pull reques

[GitHub] flink pull request #5492: [FLINK-5728] [kafka] Let FlinkKafkaProducers flush...

2018-02-23 Thread tzulitai
Github user tzulitai closed the pull request at: https://github.com/apache/flink/pull/5492 ---

[jira] [Commented] (FLINK-8752) ClassNotFoundException when using the user code class loader

2018-02-23 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374269#comment-16374269 ] Stephan Ewen commented on FLINK-8752: - This was a regression introduced by a patch bet

[jira] [Comment Edited] (FLINK-8752) ClassNotFoundException when using the user code class loader

2018-02-23 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374269#comment-16374269 ] Stephan Ewen edited comment on FLINK-8752 at 2/23/18 12:03 PM: -

[jira] [Commented] (FLINK-8751) Canceling a job results in a InterruptedException in the JM

2018-02-23 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374278#comment-16374278 ] Stephan Ewen commented on FLINK-8751: - Can you confirm that this is reported by the *J

[jira] [Comment Edited] (FLINK-8751) Canceling a job results in a InterruptedException in the JM

2018-02-23 Thread Stephan Ewen (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8751?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374278#comment-16374278 ] Stephan Ewen edited comment on FLINK-8751 at 2/23/18 12:09 PM: -

[jira] [Created] (FLINK-8761) Various improvements to the Quickstarts

2018-02-23 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-8761: --- Summary: Various improvements to the Quickstarts Key: FLINK-8761 URL: https://issues.apache.org/jira/browse/FLINK-8761 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-8763) Remove obsolete Dummy.java classes from quickstart projects.

2018-02-23 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-8763: --- Summary: Remove obsolete Dummy.java classes from quickstart projects. Key: FLINK-8763 URL: https://issues.apache.org/jira/browse/FLINK-8763 Project: Flink Iss

[jira] [Created] (FLINK-8762) Remove unnecessary examples and make "StreamingJob" the default

2018-02-23 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-8762: --- Summary: Remove unnecessary examples and make "StreamingJob" the default Key: FLINK-8762 URL: https://issues.apache.org/jira/browse/FLINK-8762 Project: Flink

[jira] [Created] (FLINK-8764) Make quickstarts work out of the box for IDE and JAR packaging

2018-02-23 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-8764: --- Summary: Make quickstarts work out of the box for IDE and JAR packaging Key: FLINK-8764 URL: https://issues.apache.org/jira/browse/FLINK-8764 Project: Flink I

[jira] [Created] (FLINK-8766) Pin scala runtime version for Java Quickstart

2018-02-23 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-8766: --- Summary: Pin scala runtime version for Java Quickstart Key: FLINK-8766 URL: https://issues.apache.org/jira/browse/FLINK-8766 Project: Flink Issue Type: Sub-tas

[jira] [Created] (FLINK-8765) Simplify quickstart properties

2018-02-23 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-8765: --- Summary: Simplify quickstart properties Key: FLINK-8765 URL: https://issues.apache.org/jira/browse/FLINK-8765 Project: Flink Issue Type: Sub-task Com

[jira] [Created] (FLINK-8767) Set the maven.compiler.source and .target properties for Java Quickstart

2018-02-23 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-8767: --- Summary: Set the maven.compiler.source and .target properties for Java Quickstart Key: FLINK-8767 URL: https://issues.apache.org/jira/browse/FLINK-8767 Project: Flink

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-23 Thread sihuazhou
Github user sihuazhou commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r170238910 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/DuplicatingCheckpointOutputStream.java --- @@ -0,0 +1,287 @@ +/* + * Licensed

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-23 Thread sihuazhou
Github user sihuazhou commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r170239200 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/DuplicatingCheckpointOutputStream.java --- @@ -0,0 +1,287 @@ +/* + * Licensed

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374288#comment-16374288 ] ASF GitHub Bot commented on FLINK-8360: --- Github user sihuazhou commented on a diff i

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374287#comment-16374287 ] ASF GitHub Bot commented on FLINK-8360: --- Github user sihuazhou commented on a diff i

[jira] [Commented] (FLINK-8761) Various improvements to the Quickstarts

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374299#comment-16374299 ] ASF GitHub Bot commented on FLINK-8761: --- GitHub user StephanEwen opened a pull reque

[GitHub] flink pull request #5569: [FLINK-8761] [quickstarts] Big improvements to the...

2018-02-23 Thread StephanEwen
GitHub user StephanEwen opened a pull request: https://github.com/apache/flink/pull/5569 [FLINK-8761] [quickstarts] Big improvements to the quickstart experience ## What is the purpose of the change Various improvements to the quickstarts, each in one commit. The ma

[jira] [Created] (FLINK-8768) Change {{NettyMessageDecoder}} to inherit from {{LengthFieldBasedFrameDecoder}}

2018-02-23 Thread Nico Kruber (JIRA)
Nico Kruber created FLINK-8768: -- Summary: Change {{NettyMessageDecoder}} to inherit from {{LengthFieldBasedFrameDecoder}} Key: FLINK-8768 URL: https://issues.apache.org/jira/browse/FLINK-8768 Project: Fl

[GitHub] flink pull request #5569: [FLINK-8761] [quickstarts] Big improvements to the...

2018-02-23 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/5569#discussion_r170245593 --- Diff: flink-quickstart/flink-quickstart-java/src/main/resources/archetype-resources/pom.xml --- @@ -50,181 +51,113 @@ under the License.

[jira] [Commented] (FLINK-8761) Various improvements to the Quickstarts

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374313#comment-16374313 ] ASF GitHub Bot commented on FLINK-8761: --- Github user zentol commented on a diff in t

[GitHub] flink issue #5569: [FLINK-8761] [quickstarts] Big improvements to the quicks...

2018-02-23 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/5569 The [quickstart docs|https://ci.apache.org/projects/flink/flink-docs-master/quickstart/java_api_quickstart.html] must be updated as they still list now deleted classes. ---

[jira] [Commented] (FLINK-8761) Various improvements to the Quickstarts

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374314#comment-16374314 ] ASF GitHub Bot commented on FLINK-8761: --- Github user zentol commented on the issue:

[GitHub] flink pull request #5567: [FLINK-8451] [serializers] Make Scala tuple serial...

2018-02-23 Thread twalthr
Github user twalthr commented on a diff in the pull request: https://github.com/apache/flink/pull/5567#discussion_r170247807 --- Diff: flink-core/src/main/java/org/apache/flink/util/InstantiationUtil.java --- @@ -121,10 +121,53 @@ public ClassLoaderObjectInputStream(InputStream in,

[GitHub] flink pull request #5566: [FLINK-8754][flip6] Make TaskManagerInfo implement...

2018-02-23 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/flink/pull/5566 ---

[jira] [Resolved] (FLINK-8754) TaskManagerInfo is not serializable

2018-02-23 Thread Till Rohrmann (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann resolved FLINK-8754. -- Resolution: Fixed Fixed via 461d66eb44307afe22464fbbb2f22dacd8aa96d8 > TaskManagerInfo is not s

[jira] [Commented] (FLINK-8754) TaskManagerInfo is not serializable

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374320#comment-16374320 ] ASF GitHub Bot commented on FLINK-8754: --- Github user asfgit closed the pull request

[jira] [Commented] (FLINK-8451) CaseClassSerializer is not backwards compatible in 1.4

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374321#comment-16374321 ] ASF GitHub Bot commented on FLINK-8451: --- Github user twalthr commented on a diff in

[jira] [Commented] (FLINK-8761) Various improvements to the Quickstarts

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374324#comment-16374324 ] ASF GitHub Bot commented on FLINK-8761: --- Github user zentol commented on a diff in t

[GitHub] flink pull request #5569: [FLINK-8761] [quickstarts] Big improvements to the...

2018-02-23 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/5569#discussion_r170248573 --- Diff: flink-quickstart/flink-quickstart-java/src/main/resources/archetype-resources/pom.xml --- @@ -50,181 +51,113 @@ under the License.

[GitHub] flink issue #5567: [FLINK-8451] [serializers] Make Scala tuple serializer de...

2018-02-23 Thread twalthr
Github user twalthr commented on the issue: https://github.com/apache/flink/pull/5567 @tzulitai I think just writing out the arity is not enough. It really depends on the type of tuple. Maybe it would have been better to write out only the name of the class. But since we support tuple

[jira] [Commented] (FLINK-8451) CaseClassSerializer is not backwards compatible in 1.4

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374326#comment-16374326 ] ASF GitHub Bot commented on FLINK-8451: --- Github user twalthr commented on the issue:

[jira] [Created] (FLINK-8769) Quickstart job submission logs contain several exceptions

2018-02-23 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-8769: --- Summary: Quickstart job submission logs contain several exceptions Key: FLINK-8769 URL: https://issues.apache.org/jira/browse/FLINK-8769 Project: Flink

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-23 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r170249880 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/TaskExecutorLocalStateStoresManager.java --- @@ -186,6 +210,34 @@ private void doR

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-23 Thread sihuazhou
Github user sihuazhou commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r170242003 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/filesystem/FileBasedStateOutputStream.java --- @@ -0,0 +1,155 @@ +/* + * Lice

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-23 Thread sihuazhou
Github user sihuazhou commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r170243957 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/taskexecutor/TaskManagerServices.java --- @@ -141,7 +147,7 @@ public JobLeaderService getJo

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374334#comment-16374334 ] ASF GitHub Bot commented on FLINK-8360: --- Github user sihuazhou commented on a diff i

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374333#comment-16374333 ] ASF GitHub Bot commented on FLINK-8360: --- Github user sihuazhou commented on a diff i

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374336#comment-16374336 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-23 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r170250183 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/TaskLocalStateStoreImpl.java --- @@ -0,0 +1,298 @@ +/* + * Licensed to the

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374337#comment-16374337 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-8761) Various improvements to the Quickstarts

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374339#comment-16374339 ] ASF GitHub Bot commented on FLINK-8761: --- Github user zentol commented on a diff in t

[GitHub] flink pull request #5569: [FLINK-8761] [quickstarts] Big improvements to the...

2018-02-23 Thread zentol
Github user zentol commented on a diff in the pull request: https://github.com/apache/flink/pull/5569#discussion_r170250532 --- Diff: flink-quickstart/flink-quickstart-java/src/main/resources/archetype-resources/pom.xml --- @@ -50,181 +51,113 @@ under the License.

[jira] [Updated] (FLINK-8714) Suggest new users to use env.readTextFile method with 2 arguments (using the charset), not to rely on system charset (which varies across environments)

2018-02-23 Thread Michal Klempa (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michal Klempa updated FLINK-8714: - Labels: easyfix newbie patch-available (was: easyfix newbie) > Suggest new users to use env.readT

[GitHub] flink issue #5536: [FLINK-8714][Documentation] Added either charsetName) or ...

2018-02-23 Thread michalklempa
Github user michalklempa commented on the issue: https://github.com/apache/flink/pull/5536 @zentol Thanks, done. ---

[jira] [Commented] (FLINK-8714) Suggest new users to use env.readTextFile method with 2 arguments (using the charset), not to rely on system charset (which varies across environments)

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374341#comment-16374341 ] ASF GitHub Bot commented on FLINK-8714: --- Github user michalklempa commented on the i

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-23 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r170251605 --- Diff: flink-contrib/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend.java --- @@ -270,6 +

[jira] [Commented] (FLINK-8741) KafkaFetcher09/010/011 uses wrong user code classloader

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374344#comment-16374344 ] ASF GitHub Bot commented on FLINK-8741: --- Github user aljoscha commented on the issue

[GitHub] flink issue #5568: [FLINK-8741] [kafka] Fix incorrect user code classloader ...

2018-02-23 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/5568 The changes look good! Did you try running the end-to-end test without the fix? If yes and they were failing before the fix I'd say this is good to go. ---

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374347#comment-16374347 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[GitHub] flink issue #5543: [FLINK-8596][CLI] Also catch NoClassDefFoundErrors

2018-02-23 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/5543 There's also a `ClassNotFoundException` in the logs, which is not ignored. ---

[GitHub] flink issue #5569: [FLINK-8761] [quickstarts] Big improvements to the quicks...

2018-02-23 Thread zentol
Github user zentol commented on the issue: https://github.com/apache/flink/pull/5569 Building the quickstart project with the `Execute maven goal` in IntelliJ `Maven Projects` window causes `flink-dist` to be included in the jar. This also happened when disabling the IntelliJ profile.

[jira] [Commented] (FLINK-8761) Various improvements to the Quickstarts

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374349#comment-16374349 ] ASF GitHub Bot commented on FLINK-8761: --- Github user zentol commented on the issue:

[jira] [Commented] (FLINK-8596) Custom command line code does not correctly catch errors

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374348#comment-16374348 ] ASF GitHub Bot commented on FLINK-8596: --- Github user aljoscha commented on the issue

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374353#comment-16374353 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-23 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r170253088 --- Diff: flink-contrib/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend.java --- @@ -1629,

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-23 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r170253246 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/TaskExecutorLocalStateStoresManagerTest.java --- @@ -46,9 +48,15 @@ public void

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374354#comment-16374354 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-23 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r170253853 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/TaskLocalStateStoreImplTest.java --- @@ -59,12 +59,18 @@ public void before() th

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374356#comment-16374356 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[jira] [Commented] (FLINK-8599) Improve the failure behavior of the FileInputFormat for bad files

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374359#comment-16374359 ] ASF GitHub Bot commented on FLINK-8599: --- Github user ChengzhiZhao commented on the i

[GitHub] flink issue #5521: [FLINK-8599] Improve the failure behavior of the FileInpu...

2018-02-23 Thread ChengzhiZhao
Github user ChengzhiZhao commented on the issue: https://github.com/apache/flink/pull/5521 @steveloughran Updated. ---

[jira] [Commented] (FLINK-8753) Introduce Incremental savepoint

2018-02-23 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374374#comment-16374374 ] Aljoscha Krettek commented on FLINK-8753: - I don't think we can do this currently.

[jira] [Closed] (FLINK-8752) ClassNotFoundException when using the user code class loader

2018-02-23 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed FLINK-8752. --- Resolution: Duplicate > ClassNotFoundException when using the user code class loader > ---

[jira] [Updated] (FLINK-8750) InputGate may contain data after an EndOfPartitionEvent

2018-02-23 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated FLINK-8750: Priority: Blocker (was: Major) > InputGate may contain data after an EndOfPartitionEvent >

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-23 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r170260996 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/LocalRecoveryConfig.java --- @@ -0,0 +1,120 @@ +/* + * Licensed to the A

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374395#comment-16374395 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-23 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r170261966 --- Diff: flink-contrib/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBKeyedStateBackend.java --- @@ -270,6

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374399#comment-16374399 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-23 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r170263293 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/TaskExecutorLocalStateStoresManager.java --- @@ -186,6 +210,34 @@ private void d

[jira] [Commented] (FLINK-8759) Bump Netty to 4.0.56

2018-02-23 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374405#comment-16374405 ] Nico Kruber commented on FLINK-8759: yes, we still need to bump the version in flink t

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374404#comment-16374404 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-23 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r170264017 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/DuplicatingCheckpointOutputStream.java --- @@ -0,0 +1,287 @@ +/* + * Lic

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374408#comment-16374408 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[GitHub] flink pull request #5403: [WIP] Reschedule failed tasks to previous allocati...

2018-02-23 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5403#discussion_r170261991 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/jobmaster/slotpool/SlotSharingManager.java --- @@ -175,105 +176,17 @@ MultiTaskSlot crea

[GitHub] flink pull request #5403: [WIP] Reschedule failed tasks to previous allocati...

2018-02-23 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5403#discussion_r170260048 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/jobmaster/slotpool/SlotPool.java --- @@ -1518,11 +1469,27 @@ void clear() {

[GitHub] flink pull request #5403: [WIP] Reschedule failed tasks to previous allocati...

2018-02-23 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5403#discussion_r170252510 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/clusterframework/types/SlotProfile.java --- @@ -0,0 +1,275 @@ +/* + * Licensed t

[GitHub] flink pull request #5403: [WIP] Reschedule failed tasks to previous allocati...

2018-02-23 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5403#discussion_r170252422 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/clusterframework/types/SlotProfile.java --- @@ -0,0 +1,275 @@ +/* + * Licensed t

[GitHub] flink pull request #5403: [WIP] Reschedule failed tasks to previous allocati...

2018-02-23 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5403#discussion_r170260506 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/jobmaster/slotpool/SlotPool.java --- @@ -824,11 +814,8 @@ private void failPendingReques

[GitHub] flink pull request #5403: [WIP] Reschedule failed tasks to previous allocati...

2018-02-23 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5403#discussion_r170253767 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/clusterframework/types/SlotProfile.java --- @@ -0,0 +1,275 @@ +/* + * Licensed t

[GitHub] flink pull request #5403: [WIP] Reschedule failed tasks to previous allocati...

2018-02-23 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5403#discussion_r170259983 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/jobmaster/slotpool/SlotSharingManager.java --- @@ -175,105 +176,17 @@ MultiTaskSlot crea

[GitHub] flink pull request #5403: [WIP] Reschedule failed tasks to previous allocati...

2018-02-23 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5403#discussion_r170262113 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/jobmaster/slotpool/SlotPool.java --- @@ -1343,63 +1330,27 @@ boolean contains(Allocation

[GitHub] flink pull request #5403: [WIP] Reschedule failed tasks to previous allocati...

2018-02-23 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5403#discussion_r170261587 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/jobmaster/slotpool/SlotPool.java --- @@ -1343,63 +1330,27 @@ boolean contains(Allocation

[GitHub] flink pull request #5403: [WIP] Reschedule failed tasks to previous allocati...

2018-02-23 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5403#discussion_r170253550 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/clusterframework/types/SlotProfile.java --- @@ -0,0 +1,275 @@ +/* + * Licensed t

[GitHub] flink pull request #5403: [WIP] Reschedule failed tasks to previous allocati...

2018-02-23 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5403#discussion_r170260253 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/clusterframework/types/SlotProfile.java --- @@ -0,0 +1,275 @@ +/* + * Licensed t

[jira] [Commented] (FLINK-8753) Introduce Incremental savepoint

2018-02-23 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374414#comment-16374414 ] Sihua Zhou commented on FLINK-8753: --- [~aljoscha] Thanks for your reply. I agree that if

[jira] [Created] (FLINK-8770) CompletedCheckPoints stored on ZooKeeper is not up-to-date, when JobManager is restarted it fails to recover the job due to "checkpoint FileNotFound exception"

2018-02-23 Thread Xinyang Gao (JIRA)
Xinyang Gao created FLINK-8770: -- Summary: CompletedCheckPoints stored on ZooKeeper is not up-to-date, when JobManager is restarted it fails to recover the job due to "checkpoint FileNotFound exception" Key: FLINK-8770

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-23 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r170266486 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/filesystem/FileBasedStateOutputStream.java --- @@ -0,0 +1,155 @@ +/* + *

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374417#comment-16374417 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-23 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r170266913 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/DuplicatingCheckpointOutputStream.java --- @@ -0,0 +1,287 @@ +/* + * Lic

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374420#comment-16374420 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[jira] [Commented] (FLINK-8753) Introduce Incremental savepoint

2018-02-23 Thread Sihua Zhou (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374425#comment-16374425 ] Sihua Zhou commented on FLINK-8753: --- [~gyfora] For your proposal, I think there is a pro

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-23 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r170268121 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/taskexecutor/TaskManagerServices.java --- @@ -141,7 +147,7 @@ public JobLeaderService

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16374427#comment-16374427 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[jira] [Updated] (FLINK-8768) Change NettyMessageDecoder to inherit from LengthFieldBasedFrameDecoder

2018-02-23 Thread Nico Kruber (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nico Kruber updated FLINK-8768: --- Summary: Change NettyMessageDecoder to inherit from LengthFieldBasedFrameDecoder (was: Change {{Netty

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-23 Thread sihuazhou
Github user sihuazhou commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r170269557 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/filesystem/FileBasedStateOutputStream.java --- @@ -0,0 +1,155 @@ +/* + * Lice

<    1   2   3   4   >