[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365772#comment-16365772 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168514624 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/TaskExecutorLocalStateStoresManager.java --- @@ -20,35 +20,47 @@ impo

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365744#comment-16365744 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365742#comment-16365742 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365753#comment-16365753 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365751#comment-16365751 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365752#comment-16365752 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365750#comment-16365750 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365746#comment-16365746 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365756#comment-16365756 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365745#comment-16365745 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365747#comment-16365747 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365755#comment-16365755 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365748#comment-16365748 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365749#comment-16365749 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365743#comment-16365743 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168507141 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/TestTaskStateManager.java --- @@ -118,12 +121,38 @@ public void reportTaskStateSna

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168510181 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/operators/BackendRestorerProcedure.java --- @@ -0,0 +1,143 @@ +/* +

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168510973 --- Diff: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/operators/StreamTaskStateInitializerImpl.java --- @@ -223,155 +223,110 @@ p

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168506302 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/TaskStateManagerImplTest.java --- @@ -109,10 +111,10 @@ public void testStateRepor

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168506899 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/TestTaskStateManager.java --- @@ -118,12 +121,38 @@ public void reportTaskStateSna

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168507106 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/TestTaskStateManager.java --- @@ -118,12 +121,38 @@ public void reportTaskStateSna

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168501126 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/TaskExecutorLocalStateStoresManager.java --- @@ -20,35 +20,47 @@ import

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168501599 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/TaskLocalStateStore.java --- @@ -19,92 +19,224 @@ package org.apache.flink.ru

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168501441 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/TaskLocalStateStore.java --- @@ -19,92 +19,224 @@ package org.apache.flink.ru

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168500772 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/TaskExecutorLocalStateStoresManager.java --- @@ -59,58 +71,55 @@ public TaskExecut

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168502352 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/TaskLocalStateStore.java --- @@ -19,92 +19,224 @@ package org.apache.flink.ru

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168498608 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/TaskExecutorLocalStateStoresManager.java --- @@ -20,35 +20,47 @@ import

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168498124 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/TaskStateSnapshot.java --- @@ -75,7 +79,10 @@ public OperatorSubtaskState ge

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168502943 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/TaskLocalStateStore.java --- @@ -19,92 +19,224 @@ package org.apache.flink.ru

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365733#comment-16365733 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365732#comment-16365732 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168509527 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/CheckpointStreamWithResultProvider.java --- @@ -0,0 +1,175 @@ +/* + * Li

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168509418 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/CheckpointStreamWithResultProvider.java --- @@ -0,0 +1,175 @@ +/* + * Li

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365684#comment-16365684 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168501090 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/taskmanager/TaskManager.scala --- @@ -1195,22 +1202,15 @@ class TaskManager(

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168500911 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/taskmanager/TaskManager.scala --- @@ -120,15 +120,16 @@ import scala.language.postfix

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365683#comment-16365683 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365678#comment-16365678 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168499407 --- Diff: flink-contrib/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBStateBackend.java --- @@ -727,19 +72

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365677#comment-16365677 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168499252 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/TaskExecutorLocalStateStoresManagerTest.java --- @@ -100,21 +109,27 @@ public vo

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168498267 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/LocalRecoveryDirectoryProviderTest.java --- @@ -0,0 +1,95 @@ +/* + * Lic

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365674#comment-16365674 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365671#comment-16365671 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168497863 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/LocalRecoveryDirectoryProviderTest.java --- @@ -0,0 +1,95 @@ +/* + * Lic

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365667#comment-16365667 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365663#comment-16365663 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168497612 --- Diff: flink-runtime/src/test/java/org/apache/flink/runtime/state/DuplicatingCheckpointOutputStreamTest.java --- @@ -0,0 +1,242 @@ +/* + *

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168497476 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/TaskLocalStateStore.java --- @@ -55,25 +54,24 @@ /** */ private

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168495596 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/LocalRecoveryConfigBase.java --- @@ -0,0 +1,37 @@ +/* + * Licensed to th

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365662#comment-16365662 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168497075 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/TaskLocalStateStore.java --- @@ -55,25 +54,24 @@ /** */ private

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365657#comment-16365657 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168496761 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/TaskExecutorLocalStateStoresManager.java --- @@ -44,11 +44,21 @@ private

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365653#comment-16365653 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365652#comment-16365652 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168495783 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/LocalRecoveryDirectoryProvider.java --- @@ -0,0 +1,112 @@ +/* + * Licens

[GitHub] flink issue #5491: [FLINK-8630] [table] To support JSON schema to TypeInform...

2018-02-15 Thread twalthr
Github user twalthr commented on the issue: https://github.com/apache/flink/pull/5491 Thanks for the review @xccui. I agree that a pure string-based format would be helpful as well. For this we can simply use a string serialization schema later. In a long-term view we will need to imp

[jira] [Commented] (FLINK-8630) To support JSON schema to TypeInformation conversion

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365649#comment-16365649 ] ASF GitHub Bot commented on FLINK-8630: --- Github user twalthr commented on the issue:

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365647#comment-16365647 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168495158 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/DuplicatingCheckpointOutputStream.java --- @@ -0,0 +1,281 @@ +/* + * Lic

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365645#comment-16365645 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168495056 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/CheckpointStreamWithResultProvider.java --- @@ -0,0 +1,175 @@ +/* + * Li

[jira] [Commented] (FLINK-5728) FlinkKafkaProducer should flush on checkpoint by default

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-5728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365644#comment-16365644 ] ASF GitHub Bot commented on FLINK-5728: --- Github user aljoscha commented on the issue

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365643#comment-16365643 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[GitHub] flink issue #5492: [FLINK-5728] [kafka] Let FlinkKafkaProducers flush on che...

2018-02-15 Thread aljoscha
Github user aljoscha commented on the issue: https://github.com/apache/flink/pull/5492 Had to change this line to use `StreamingRuntimeContext.class` because the Producer would now actually call this: https://github.com/apache/flink/blob/96e898f2923f6b68bc845facf9c2d7ce1a951bbb/flink-

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168494570 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/CheckpointStreamWithResultProvider.java --- @@ -0,0 +1,175 @@ +/* + * Li

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168494204 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/heap/HeapKeyedStateBackend.java --- @@ -553,27 +616,36 @@ public boolean support

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365640#comment-16365640 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365638#comment-16365638 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168494158 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/CheckpointStreamWithResultProvider.java --- @@ -0,0 +1,175 @@ +/* + * Li

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365637#comment-16365637 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168493674 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/state/CheckpointStreamWithResultProvider.java --- @@ -0,0 +1,175 @@ +/* + * Li

[jira] [Commented] (FLINK-8630) To support JSON schema to TypeInformation conversion

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365635#comment-16365635 ] ASF GitHub Bot commented on FLINK-8630: --- Github user twalthr commented on a diff in

[GitHub] flink pull request #5491: [FLINK-8630] [table] To support JSON schema to Typ...

2018-02-15 Thread twalthr
Github user twalthr commented on a diff in the pull request: https://github.com/apache/flink/pull/5491#discussion_r168493184 --- Diff: flink-formats/flink-json/src/main/java/org/apache/flink/formats/json/JsonRowSerializationSchema.java --- @@ -0,0 +1,208 @@ +/* + * License

[jira] [Commented] (FLINK-8630) To support JSON schema to TypeInformation conversion

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365631#comment-16365631 ] ASF GitHub Bot commented on FLINK-8630: --- Github user twalthr commented on a diff in

[GitHub] flink pull request #5491: [FLINK-8630] [table] To support JSON schema to Typ...

2018-02-15 Thread twalthr
Github user twalthr commented on a diff in the pull request: https://github.com/apache/flink/pull/5491#discussion_r168492861 --- Diff: flink-formats/flink-json/src/main/java/org/apache/flink/formats/json/JsonSchemaConverter.java --- @@ -0,0 +1,358 @@ +/* + * Licensed to th

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365622#comment-16365622 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168490613 --- Diff: flink-core/src/main/java/org/apache/flink/util/ThrowingSupplier.java --- @@ -0,0 +1,38 @@ +/* + * Licensed to the Apache Software Fo

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread StefanRRichter
Github user StefanRRichter commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168490322 --- Diff: flink-contrib/flink-statebackend-rocksdb/src/test/java/org/apache/flink/contrib/streaming/state/RocksDBStateBackendTest.java --- @@ -482,40

[jira] [Commented] (FLINK-8581) Improve performance for low latency network

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365619#comment-16365619 ] ASF GitHub Bot commented on FLINK-8581: --- Github user pnowojski commented on a diff i

[GitHub] flink pull request #5423: [FLINK-8581] Improve performance for low latency n...

2018-02-15 Thread pnowojski
Github user pnowojski commented on a diff in the pull request: https://github.com/apache/flink/pull/5423#discussion_r168490355 --- Diff: flink-runtime/src/main/java/org/apache/flink/runtime/io/network/netty/PartitionRequestQueue.java --- @@ -151,64 +213,55 @@ private void writeAnd

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365618#comment-16365618 ] ASF GitHub Bot commented on FLINK-8360: --- Github user StefanRRichter commented on a d

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365611#comment-16365611 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168489132 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/taskmanager/TaskManager.scala --- @@ -1195,22 +1202,15 @@ class TaskManager(

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365605#comment-16365605 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[GitHub] flink pull request #5239: [FLINK-8360] Implement task-local state recovery

2018-02-15 Thread tillrohrmann
Github user tillrohrmann commented on a diff in the pull request: https://github.com/apache/flink/pull/5239#discussion_r168488712 --- Diff: flink-runtime/src/main/scala/org/apache/flink/runtime/taskmanager/TaskManager.scala --- @@ -120,15 +120,16 @@ import scala.language.postfixOp

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365576#comment-16365576 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365594#comment-16365594 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365597#comment-16365597 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365579#comment-16365579 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365577#comment-16365577 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365593#comment-16365593 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365575#comment-16365575 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365583#comment-16365583 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365598#comment-16365598 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365588#comment-16365588 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365590#comment-16365590 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

[jira] [Commented] (FLINK-8360) Implement task-local state recovery

2018-02-15 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/FLINK-8360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16365589#comment-16365589 ] ASF GitHub Bot commented on FLINK-8360: --- Github user tillrohrmann commented on a dif

<    1   2   3   4   >