[GitHub] [flink-benchmarks] zhuzhurk merged pull request #7: [FLINK-20612][runtime] Add benchmarks for scheduler

2021-02-08 Thread GitBox
zhuzhurk merged pull request #7: URL: https://github.com/apache/flink-benchmarks/pull/7 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [flink] flinkbot edited a comment on pull request #14900: (1.12) [FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavуpoint properly

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14900: URL: https://github.com/apache/flink/pull/14900#issuecomment-775088580 ## CI report: * 18ad713d9f142ea56a521284d26c95746ee862e3 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14837: [FLINK-20417][k8s] Create a new watcher when the old one is closed with HTTP_GONE

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14837: URL: https://github.com/apache/flink/pull/14837#issuecomment-771773023 ## CI report: * 3b8c1e0ff92ce707e8294a0660015984aee24dda Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14881: [hotfix][state] Improve logging in AbstractKeyedStateBackend

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14881: URL: https://github.com/apache/flink/pull/14881#issuecomment-774272115 ## CI report: * 86d913f12aa1f2c57166457922b0e42ccf06c8bf Azure:

[GitHub] [flink] rmetzger commented on pull request #14879: [FLINK-21256][FLINK-21257] Add Restarting and Executing state for declarative scheduler

2021-02-08 Thread GitBox
rmetzger commented on pull request #14879: URL: https://github.com/apache/flink/pull/14879#issuecomment-775248264 Thanks a lot for this thorough review and the good comments! I believe I addressed all of your comments! I did not move this one class to the correct commit, because

[GitHub] [flink] flinkbot edited a comment on pull request #14898: [FLINK-20957][task][tests] Make sure we enter the measured sleep after the Task thread started measuring backPressure/idle time

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14898: URL: https://github.com/apache/flink/pull/14898#issuecomment-775061724 ## CI report: * 003899ca86fb157e6cfc57ecadcebcdeac7a3b40 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14900: (1.12) [FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavуpoint properly

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14900: URL: https://github.com/apache/flink/pull/14900#issuecomment-775088580 ## CI report: * 874b9911ce11714ffcfef6a80c2c45d6211a483d Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14895: [FLINK-21295][table] Support 'useModules' and 'listFullModules' in ModuleManager and TableEnvironment

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14895: URL: https://github.com/apache/flink/pull/14895#issuecomment-774905526 ## CI report: * 9e93e16b88ed43e6d467ff6373b87211abe3a2ba Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14899: (1.11) [FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavуpoint properly

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14899: URL: https://github.com/apache/flink/pull/14899#issuecomment-775088427 ## CI report: * 220751f1633882095b95872d04468a29c3305d33 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14892: [FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavуpoint properly

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14892: URL: https://github.com/apache/flink/pull/14892#issuecomment-774773480 ## CI report: * 5e8633852b9a4cc92ef1b75e264e60f3054563ab Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14881: [hotfix][state] Improve logging in AbstractKeyedStateBackend

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14881: URL: https://github.com/apache/flink/pull/14881#issuecomment-774272115 ## CI report: * 86d913f12aa1f2c57166457922b0e42ccf06c8bf Azure:

[jira] [Updated] (FLINK-21322) Factor out common ExecutionGraph logic

2021-02-08 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-21322: - Summary: Factor out common ExecutionGraph logic (was: Add ExecutionGraphHandler) >

[jira] [Updated] (FLINK-21322) Factor out common ExecutionGraph logic

2021-02-08 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-21322: - Description: Add a re-usable scheduler component containing common execution graph

[GitHub] [flink] rkhachatryan commented on a change in pull request #14881: [hotfix][state] Improve logging in AbstractKeyedStateBackend

2021-02-08 Thread GitBox
rkhachatryan commented on a change in pull request #14881: URL: https://github.com/apache/flink/pull/14881#discussion_r572133766 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/state/AbstractKeyedStateBackend.java ## @@ -127,7 +127,9 @@ public

[GitHub] [flink] flinkbot edited a comment on pull request #14900: (1.12) [FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavуpoint properly

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14900: URL: https://github.com/apache/flink/pull/14900#issuecomment-775088580 ## CI report: * 874b9911ce11714ffcfef6a80c2c45d6211a483d Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14899: (1.11) [FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavуpoint properly

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14899: URL: https://github.com/apache/flink/pull/14899#issuecomment-775088427 ## CI report: * 220751f1633882095b95872d04468a29c3305d33 Azure:

[jira] [Created] (FLINK-21322) Add ExecutionGraphHandler

2021-02-08 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-21322: Summary: Add ExecutionGraphHandler Key: FLINK-21322 URL: https://issues.apache.org/jira/browse/FLINK-21322 Project: Flink Issue Type: Improvement

[GitHub] [flink] rmetzger commented on a change in pull request #14879: [FLINK-21256][FLINK-21257] Add Restarting and Executing state for declarative scheduler

2021-02-08 Thread GitBox
rmetzger commented on a change in pull request #14879: URL: https://github.com/apache/flink/pull/14879#discussion_r572122385 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/scheduler/declarative/StateWithExecutionGraph.java ## @@ -0,0 +1,415 @@ +/* + *

[GitHub] [flink] flinkbot edited a comment on pull request #14895: [FLINK-21295][table] Support 'useModules' and 'listFullModules' in ModuleManager and TableEnvironment

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14895: URL: https://github.com/apache/flink/pull/14895#issuecomment-774905526 ## CI report: * 9e93e16b88ed43e6d467ff6373b87211abe3a2ba Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14892: [FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavуpoint properly

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14892: URL: https://github.com/apache/flink/pull/14892#issuecomment-774773480 ## CI report: * 4df9e2e15a04d4dc2c0c9b3ed29713bb2ac428f3 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14897: [FLINK-21221][runtime] Deduplication for multiple ResourceCounters

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14897: URL: https://github.com/apache/flink/pull/14897#issuecomment-775050448 ## CI report: * 6f75cd909db04a110e7696ed1cf89f56df0ae32f Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14895: [FLINK-21295][table] Support 'useModules' and 'listFullModules' in ModuleManager and TableEnvironment

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14895: URL: https://github.com/apache/flink/pull/14895#issuecomment-774905526 ## CI report: * 9e93e16b88ed43e6d467ff6373b87211abe3a2ba Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14891: [FLINK-21289][deployment] FIX missing load pipeline.classpaths in app…

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14891: URL: https://github.com/apache/flink/pull/14891#issuecomment-774628149 ## CI report: * 29ddfd1a206cb8d33e1c5a0f0ca7c1097c77d327 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14834: [FLINK-21234][build system] Adding timeout to all tasks

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14834: URL: https://github.com/apache/flink/pull/14834#issuecomment-771607546 ## CI report: * 3c55d1b87076148f095c08a55319f1b898dc932d UNKNOWN * 5c8ac11faf9d6fbcad7550bec8abf6a6343347c3 UNKNOWN *

[GitHub] [flink] rkhachatryan commented on pull request #14754: [FLINK-21127][runtime][checkpoint] Stores finished status for fully finished operators in checkpoint

2021-02-08 Thread GitBox
rkhachatryan commented on pull request #14754: URL: https://github.com/apache/flink/pull/14754#issuecomment-775200104 Hi @gaoyunhaii , thanks for clarifying and updating the PR. It LGTM in general, I'd make a final pass after all conflicts resolved.

[GitHub] [flink] rkhachatryan commented on a change in pull request #14754: [FLINK-21127][runtime][checkpoint] Stores finished status for fully finished operators in checkpoint

2021-02-08 Thread GitBox
rkhachatryan commented on a change in pull request #14754: URL: https://github.com/apache/flink/pull/14754#discussion_r572102215 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/OperatorState.java ## @@ -81,10 +93,22 @@ public OperatorID

[GitHub] [flink] LadyForest commented on pull request #14895: [FLINK-21295][table] Support 'useModules' and 'listFullModules' in ModuleManager and TableEnvironment

2021-02-08 Thread GitBox
LadyForest commented on pull request #14895: URL: https://github.com/apache/flink/pull/14895#issuecomment-775197009 @flinkbot run azure This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [flink] flinkbot edited a comment on pull request #14900: (1.12) [FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavуpoint properly

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14900: URL: https://github.com/apache/flink/pull/14900#issuecomment-775088580 ## CI report: * e7e876554dc4dc19ec22cc0cdddc60671213c40d Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14899: (1.11) [FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavуpoint properly

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14899: URL: https://github.com/apache/flink/pull/14899#issuecomment-775088427 ## CI report: * 1f9b2fa2aff9a084e0c51778b47e9fc916fb7d9d Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14893: [FLINK-21321][Runtime/StateBackends] improve RocksDB incremental rescale performance by using deleteRange operator

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14893: URL: https://github.com/apache/flink/pull/14893#issuecomment-774815157 ## CI report: * ee31b03b7bfced8fdd46a67513c4c11408c4b28c Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14892: [FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavуpoint properly

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14892: URL: https://github.com/apache/flink/pull/14892#issuecomment-774773480 ## CI report: * 4df9e2e15a04d4dc2c0c9b3ed29713bb2ac428f3 Azure:

[GitHub] [flink] rmetzger commented on a change in pull request #14879: [FLINK-21256][FLINK-21257] Add Restarting and Executing state for declarative scheduler

2021-02-08 Thread GitBox
rmetzger commented on a change in pull request #14879: URL: https://github.com/apache/flink/pull/14879#discussion_r572086187 ## File path: flink-runtime/src/test/java/org/apache/flink/runtime/scheduler/declarative/ExecutingTest.java ## @@ -0,0 +1,451 @@ +/* + * Licensed to

[jira] [Updated] (FLINK-21321) Change RocksDB incremental checkpoint re-scaling to use deleteRange

2021-02-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-21321: --- Labels: pull-request-available (was: ) > Change RocksDB incremental checkpoint re-scaling

[GitHub] [flink] flinkbot edited a comment on pull request #14900: (1.12) [FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavуpoint properly

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14900: URL: https://github.com/apache/flink/pull/14900#issuecomment-775088580 ## CI report: * e7e876554dc4dc19ec22cc0cdddc60671213c40d Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14899: (1.11) [FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavуpoint properly

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14899: URL: https://github.com/apache/flink/pull/14899#issuecomment-775088427 ## CI report: * 1f9b2fa2aff9a084e0c51778b47e9fc916fb7d9d Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14893: [FLINK-21321][Runtime/StateBackends] improve RocksDB incremental rescale performance by using deleteRange operator

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14893: URL: https://github.com/apache/flink/pull/14893#issuecomment-774815157 ## CI report: * ee31b03b7bfced8fdd46a67513c4c11408c4b28c Azure:

[jira] [Commented] (FLINK-21321) Change RocksDB incremental checkpoint re-scaling to use deleteRange

2021-02-08 Thread Jiayi Liao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281075#comment-17281075 ] Jiayi Liao commented on FLINK-21321: [~legojoey17] We've met the same problem recently. The

[GitHub] [flink] flinkbot edited a comment on pull request #14892: [FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavуpoint properly

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14892: URL: https://github.com/apache/flink/pull/14892#issuecomment-774773480 ## CI report: * 4df9e2e15a04d4dc2c0c9b3ed29713bb2ac428f3 Azure:

[GitHub] [flink] lgo commented on pull request #12345: draft: [FLINK-17971] [Runtime/StateBackends] Add RocksDB SST ingestion for batch writes

2021-02-08 Thread GitBox
lgo commented on pull request #12345: URL: https://github.com/apache/flink/pull/12345#issuecomment-775169629 It passes all of the tests in `flink-statebackend-rocksdb` module. I have not done any other testing, like setitng up an app and experimenting. I added all the code behind a

[jira] [Updated] (FLINK-21321) Change RocksDB incremental checkpoint re-scaling to use deleteRange

2021-02-08 Thread Joey Pereira (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joey Pereira updated FLINK-21321: - Description: In FLINK-8790, it was suggested to use RocksDB's {{deleteRange}} API to more

[jira] [Created] (FLINK-21321) Change RocksDB incremental checkpoint re-scaling to use deleteRange

2021-02-08 Thread Joey Pereira (Jira)
Joey Pereira created FLINK-21321: Summary: Change RocksDB incremental checkpoint re-scaling to use deleteRange Key: FLINK-21321 URL: https://issues.apache.org/jira/browse/FLINK-21321 Project: Flink

[jira] [Commented] (FLINK-21309) Metrics of JobManager and TaskManager overwrite each other in pushgateway

2021-02-08 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281058#comment-17281058 ] Chesnay Schepler commented on FLINK-21309: -- Imagine a Flink session cluster where continuously

[GitHub] [flink] rkhachatryan commented on a change in pull request #14892: [FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavуpoint properly

2021-02-08 Thread GitBox
rkhachatryan commented on a change in pull request #14892: URL: https://github.com/apache/flink/pull/14892#discussion_r572051109 ## File path: flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/OperatorChain.java ## @@ -120,7 +120,7 @@ private

[GitHub] [flink] rmetzger commented on a change in pull request #14879: [FLINK-21256][FLINK-21257] Add Restarting and Executing state for declarative scheduler

2021-02-08 Thread GitBox
rmetzger commented on a change in pull request #14879: URL: https://github.com/apache/flink/pull/14879#discussion_r572048718 ## File path: flink-runtime/src/test/java/org/apache/flink/runtime/scheduler/declarative/MockStateWithExecutionGraphContext.java ## @@ -0,0 +1,80 @@

[GitHub] [flink] flinkbot edited a comment on pull request #14900: (1.12) [FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavуpoint properly

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14900: URL: https://github.com/apache/flink/pull/14900#issuecomment-775088580 ## CI report: * e7e876554dc4dc19ec22cc0cdddc60671213c40d Azure:

[jira] [Commented] (FLINK-21028) Streaming application didn't stop properly

2021-02-08 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281047#comment-17281047 ] Till Rohrmann commented on FLINK-21028: --- Stephan suggested that this might be race condition

[jira] [Commented] (FLINK-21309) Metrics of JobManager and TaskManager overwrite each other in pushgateway

2021-02-08 Thread jiguodai (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281043#comment-17281043 ] jiguodai commented on FLINK-21309: -- [~chesnay] It does't matter that "randomSuffix" is enabled by

[GitHub] [flink] flinkbot edited a comment on pull request #14899: (1.11) [FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavуpoint properly

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14899: URL: https://github.com/apache/flink/pull/14899#issuecomment-775088427 ## CI report: * 1f9b2fa2aff9a084e0c51778b47e9fc916fb7d9d Azure:

[GitHub] [flink] tillrohrmann commented on a change in pull request #14897: [FLINK-21221][runtime] Deduplication for multiple ResourceCounters

2021-02-08 Thread GitBox
tillrohrmann commented on a change in pull request #14897: URL: https://github.com/apache/flink/pull/14897#discussion_r572027972 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/util/ResourceCounter.java ## @@ -35,11 +37,12 @@ * associated counts. The

[GitHub] [flink] flinkbot edited a comment on pull request #14892: [FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavуpoint properly

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14892: URL: https://github.com/apache/flink/pull/14892#issuecomment-774773480 ## CI report: * 4df9e2e15a04d4dc2c0c9b3ed29713bb2ac428f3 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14834: [FLINK-21234][build system] Adding timeout to all tasks

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14834: URL: https://github.com/apache/flink/pull/14834#issuecomment-771607546 ## CI report: * 3c55d1b87076148f095c08a55319f1b898dc932d UNKNOWN * 5c8ac11faf9d6fbcad7550bec8abf6a6343347c3 UNKNOWN *

[GitHub] [flink] flinkbot edited a comment on pull request #14790: [FLINK-21134] Introduce 'scheduler-mode' config option

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14790: URL: https://github.com/apache/flink/pull/14790#issuecomment-768914005 ## CI report: * 2091ecc59adf36056b22d2779716c556d7ef6721 Azure:

[jira] [Commented] (FLINK-20663) Managed memory may not be released in time when operators use managed memory frequently

2021-02-08 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281026#comment-17281026 ] Till Rohrmann commented on FLINK-20663: --- Sounds as the next best option here. > Managed memory

[jira] [Commented] (FLINK-21309) Metrics of JobManager and TaskManager overwrite each other in pushgateway

2021-02-08 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281023#comment-17281023 ] Chesnay Schepler commented on FLINK-21309: -- I would be against it because it is one of those

[jira] [Commented] (FLINK-21309) Metrics of JobManager and TaskManager overwrite each other in pushgateway

2021-02-08 Thread jiguodai (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281014#comment-17281014 ] jiguodai commented on FLINK-21309: -- [~chesnay] Got it, What about adding a configuration in

[GitHub] [flink] flinkbot edited a comment on pull request #14834: [FLINK-21234][build system] Adding timeout to all tasks

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14834: URL: https://github.com/apache/flink/pull/14834#issuecomment-771607546 ## CI report: * 3c55d1b87076148f095c08a55319f1b898dc932d UNKNOWN * 5c8ac11faf9d6fbcad7550bec8abf6a6343347c3 UNKNOWN *

[GitHub] [flink] flinkbot edited a comment on pull request #14754: [FLINK-21127][runtime][checkpoint] Stores finished status for fully finished operators in checkpoint

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14754: URL: https://github.com/apache/flink/pull/14754#issuecomment-766965862 ## CI report: * 0f8924698701b1d6768f8757414d69836b83fa3a Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14740: [FLINK-21067][runtime][checkpoint] Modify the logic of computing which tasks to trigger/ack/commit to support finished tasks

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14740: URL: https://github.com/apache/flink/pull/14740#issuecomment-766340750 ## CI report: * c7e6b28b249f85cf52740d5201a769e0982a60aa UNKNOWN * bebd298009b12a9d5ac6518902f5534f8e00ff32 UNKNOWN *

[GitHub] [flink] flinkbot edited a comment on pull request #14899: (1.11) [FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavуpoint properly

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14899: URL: https://github.com/apache/flink/pull/14899#issuecomment-775088427 ## CI report: * 1f9b2fa2aff9a084e0c51778b47e9fc916fb7d9d Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14900: (1.12) [FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavуpoint properly

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14900: URL: https://github.com/apache/flink/pull/14900#issuecomment-775088580 ## CI report: * e7e876554dc4dc19ec22cc0cdddc60671213c40d Azure:

[jira] [Comment Edited] (FLINK-21201) Creating BoundedBlockingSubpartition blocks TaskManager’s main thread

2021-02-08 Thread Zhilong Hong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280903#comment-17280903 ] Zhilong Hong edited comment on FLINK-21201 at 2/8/21, 12:22 PM: Sorry

[GitHub] [flink] flinkbot edited a comment on pull request #14834: [FLINK-21234][build system] Adding timeout to all tasks

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14834: URL: https://github.com/apache/flink/pull/14834#issuecomment-771607546 ## CI report: * 3c55d1b87076148f095c08a55319f1b898dc932d UNKNOWN * 5c8ac11faf9d6fbcad7550bec8abf6a6343347c3 UNKNOWN *

[GitHub] [flink] flinkbot edited a comment on pull request #14837: [FLINK-20417][k8s] Create a new watcher when the old one is closed with HTTP_GONE

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14837: URL: https://github.com/apache/flink/pull/14837#issuecomment-771773023 ## CI report: * 006090b8d1c6326366fb1c4bbae71c5714b761d8 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14740: [FLINK-21067][runtime][checkpoint] Modify the logic of computing which tasks to trigger/ack/commit to support finished tasks

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14740: URL: https://github.com/apache/flink/pull/14740#issuecomment-766340750 ## CI report: * c7e6b28b249f85cf52740d5201a769e0982a60aa UNKNOWN * bebd298009b12a9d5ac6518902f5534f8e00ff32 UNKNOWN *

[jira] [Commented] (FLINK-21309) Metrics of JobManager and TaskManager overwrite each other in pushgateway

2021-02-08 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280981#comment-17280981 ] Chesnay Schepler commented on FLINK-21309: -- The random suffix option is not enabled by default

[jira] [Commented] (FLINK-21309) Metrics of JobManager and TaskManager overwrite each other in pushgateway

2021-02-08 Thread jiguodai (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280979#comment-17280979 ] jiguodai commented on FLINK-21309: -- [~chesnay]If so, "randomJobNameSuffix" will be a must-option

[GitHub] [flink] pnowojski commented on a change in pull request #14892: [FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavуpoint properly

2021-02-08 Thread GitBox
pnowojski commented on a change in pull request #14892: URL: https://github.com/apache/flink/pull/14892#discussion_r571985243 ## File path: flink-streaming-java/src/main/java/org/apache/flink/streaming/runtime/tasks/OperatorChain.java ## @@ -120,7 +120,7 @@ private

[GitHub] [flink] flinkbot commented on pull request #14900: (1.12) [FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavуpoint properly

2021-02-08 Thread GitBox
flinkbot commented on pull request #14900: URL: https://github.com/apache/flink/pull/14900#issuecomment-775088580 ## CI report: * e7e876554dc4dc19ec22cc0cdddc60671213c40d UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot

[jira] [Issue Comment Deleted] (FLINK-21309) Metrics of JobManager and TaskManager overwrite each other in pushgateway

2021-02-08 Thread jiguodai (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jiguodai updated FLINK-21309: - Comment: was deleted (was: [~chesnay]If so, "randomJobNameSuffix" will be a must-option instead of be

[GitHub] [flink] flinkbot commented on pull request #14899: (1.11) [FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavуpoint properly

2021-02-08 Thread GitBox
flinkbot commented on pull request #14899: URL: https://github.com/apache/flink/pull/14899#issuecomment-775088427 ## CI report: * 1f9b2fa2aff9a084e0c51778b47e9fc916fb7d9d UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot

[GitHub] [flink] flinkbot edited a comment on pull request #14892: [FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavуpoint properly

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14892: URL: https://github.com/apache/flink/pull/14892#issuecomment-774773480 ## CI report: * c2b1848fbbb9a93eba822697792f60a47ba86531 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14837: [FLINK-20417][k8s] Create a new watcher when the old one is closed with HTTP_GONE

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14837: URL: https://github.com/apache/flink/pull/14837#issuecomment-771773023 ## CI report: * 006090b8d1c6326366fb1c4bbae71c5714b761d8 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14834: [FLINK-21234][build system] Adding timeout to all tasks

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14834: URL: https://github.com/apache/flink/pull/14834#issuecomment-771607546 ## CI report: * 3c55d1b87076148f095c08a55319f1b898dc932d UNKNOWN * 5c8ac11faf9d6fbcad7550bec8abf6a6343347c3 UNKNOWN *

[GitHub] [flink] flinkbot edited a comment on pull request #14740: [FLINK-21067][runtime][checkpoint] Modify the logic of computing which tasks to trigger/ack/commit to support finished tasks

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14740: URL: https://github.com/apache/flink/pull/14740#issuecomment-766340750 ## CI report: * c7e6b28b249f85cf52740d5201a769e0982a60aa UNKNOWN * bebd298009b12a9d5ac6518902f5534f8e00ff32 UNKNOWN *

[jira] [Commented] (FLINK-21309) Metrics of JobManager and TaskManager overwrite each other in pushgateway

2021-02-08 Thread jiguodai (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280971#comment-17280971 ] jiguodai commented on FLINK-21309: -- [~chesnay]If so, "randomJobNameSuffix" will be a must-option

[GitHub] [flink] wangyang0918 commented on pull request #14837: [FLINK-20417][k8s] Create a new watcher when the old one is closed with HTTP_GONE

2021-02-08 Thread GitBox
wangyang0918 commented on pull request #14837: URL: https://github.com/apache/flink/pull/14837#issuecomment-775081233 @tillrohrmann I have pushed a `fixup` for the new added tests, which verify the old watch is closed and the new watch creation if a

[GitHub] [flink] flinkbot edited a comment on pull request #14898: [FLINK-20957][task][tests] Make sure we enter the measured sleep after the Task thread started measuring backPressure/idle time

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14898: URL: https://github.com/apache/flink/pull/14898#issuecomment-775061724 ## CI report: * 003899ca86fb157e6cfc57ecadcebcdeac7a3b40 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14892: [FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavуpoint properly

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14892: URL: https://github.com/apache/flink/pull/14892#issuecomment-774773480 ## CI report: * c2b1848fbbb9a93eba822697792f60a47ba86531 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14834: [FLINK-21234][build system] Adding timeout to all tasks

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14834: URL: https://github.com/apache/flink/pull/14834#issuecomment-771607546 ## CI report: * 3c55d1b87076148f095c08a55319f1b898dc932d UNKNOWN * 5c8ac11faf9d6fbcad7550bec8abf6a6343347c3 UNKNOWN *

[GitHub] [flink] flinkbot commented on pull request #14900: (1.12) [FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavуpoint properly

2021-02-08 Thread GitBox
flinkbot commented on pull request #14900: URL: https://github.com/apache/flink/pull/14900#issuecomment-775076123 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the

[GitHub] [flink] flinkbot commented on pull request #14899: (1.11) [FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavуpoint properly

2021-02-08 Thread GitBox
flinkbot commented on pull request #14899: URL: https://github.com/apache/flink/pull/14899#issuecomment-775076145 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the

[GitHub] [flink] rkhachatryan opened a new pull request #14899: (1.11) [FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavуpoint properly

2021-02-08 Thread GitBox
rkhachatryan opened a new pull request #14899: URL: https://github.com/apache/flink/pull/14899 **(backport of #14892 to 1.11)** ## What is the purpose of the change ``` 1. Reset OperatorChain.isStoppingBySyncSavepoint from LegacySourceFunctionThread so that StreamTask

[GitHub] [flink] rkhachatryan opened a new pull request #14900: (1.12) [FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavуpoint properly

2021-02-08 Thread GitBox
rkhachatryan opened a new pull request #14900: URL: https://github.com/apache/flink/pull/14900 **(backport of #14892 to 1.12)** ## What is the purpose of the change ``` 1. Reset OperatorChain.isStoppingBySyncSavepoint from LegacySourceFunctionThread so that StreamTask

[GitHub] [flink] flinkbot commented on pull request #14898: [FLINK-20957][task][tests] Make sure we enter the measured sleep after the Task thread started measuring backPressure/idle time

2021-02-08 Thread GitBox
flinkbot commented on pull request #14898: URL: https://github.com/apache/flink/pull/14898#issuecomment-775061724 ## CI report: * 003899ca86fb157e6cfc57ecadcebcdeac7a3b40 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot

[GitHub] [flink] flinkbot edited a comment on pull request #14897: [FLINK-21221][runtime] Deduplication for multiple ResourceCounters

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14897: URL: https://github.com/apache/flink/pull/14897#issuecomment-775050448 ## CI report: * 6f75cd909db04a110e7696ed1cf89f56df0ae32f Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14820: [FLINK-21085][runtime][checkpoint] Allows triggering checkpoint barrier handler for non-source tasks

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14820: URL: https://github.com/apache/flink/pull/14820#issuecomment-770327711 ## CI report: * d83bee7799051ef32e0f9ec9e26339b23b7dc057 UNKNOWN * 274dceea68cb81e8a2c20118fcc2ccf44fcb936b Azure:

[GitHub] [flink] flinkbot commented on pull request #14898: [FLINK-20957][task][tests] Make sure we enter the measured sleep after the Task thread started measuring backPressure/idle time

2021-02-08 Thread GitBox
flinkbot commented on pull request #14898: URL: https://github.com/apache/flink/pull/14898#issuecomment-775053160 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the

[jira] [Updated] (FLINK-20957) StreamTaskTest.testProcessWithUnAvailableOutput unstable

2021-02-08 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-20957: --- Labels: pull-request-available test-stability (was: test-stability) >

[GitHub] [flink] pnowojski opened a new pull request #14898: [FLINK-20957][task][tests] Make sure we enter the measured sleep after the Task thread started measuring backPressure/idle time

2021-02-08 Thread GitBox
pnowojski opened a new pull request #14898: URL: https://github.com/apache/flink/pull/14898 Make sure that the Task thread actually starts measuring the backpressure before we start the measured sleep. The WaitingThread is started from within the mailbox so we should first wait

[jira] [Assigned] (FLINK-20957) StreamTaskTest.testProcessWithUnAvailableOutput unstable

2021-02-08 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski reassigned FLINK-20957: -- Assignee: Piotr Nowojski > StreamTaskTest.testProcessWithUnAvailableOutput unstable

[GitHub] [flink] flinkbot commented on pull request #14897: [FLINK-21221][runtime] Deduplication for multiple ResourceCounters

2021-02-08 Thread GitBox
flinkbot commented on pull request #14897: URL: https://github.com/apache/flink/pull/14897#issuecomment-775050448 ## CI report: * 6f75cd909db04a110e7696ed1cf89f56df0ae32f UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot

[jira] [Closed] (FLINK-21155) FileSourceTextLinesITCase.testBoundedTextFileSourceWithTaskManagerFailover does not pass

2021-02-08 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann closed FLINK-21155. - Resolution: Fixed Fixed via 1.13.0: 920be99cfdbba7b884b41134c9188e0804a1482d 1.12.2:

[GitHub] [flink] flinkbot edited a comment on pull request #14891: [FLINK-21289][deployment] FIX missing load pipeline.classpaths in app…

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14891: URL: https://github.com/apache/flink/pull/14891#issuecomment-774628149 ## CI report: * 9c2009b345b3c138b83d25d2ca929a33f5918ab8 Azure:

[GitHub] [flink] tillrohrmann closed pull request #14856: [BP-1.12][FLINK-21155][tests] Fix FileSourceTextLinesITCase

2021-02-08 Thread GitBox
tillrohrmann closed pull request #14856: URL: https://github.com/apache/flink/pull/14856 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [flink] tillrohrmann commented on pull request #14856: [BP-1.12][FLINK-21155][tests] Fix FileSourceTextLinesITCase

2021-02-08 Thread GitBox
tillrohrmann commented on pull request #14856: URL: https://github.com/apache/flink/pull/14856#issuecomment-775050135 Merged via cbcb7c17459b57c614ecc81bef6b574f7611c61d This is an automated message from the Apache Git

[GitHub] [flink] flinkbot edited a comment on pull request #14820: [FLINK-21085][runtime][checkpoint] Allows triggering checkpoint barrier handler for non-source tasks

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14820: URL: https://github.com/apache/flink/pull/14820#issuecomment-770327711 ## CI report: * d83bee7799051ef32e0f9ec9e26339b23b7dc057 UNKNOWN * 42cdc662ef4b6416b30017a5c3cb090ee66f7d07 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14834: [FLINK-21234][build system] Adding timeout to all tasks

2021-02-08 Thread GitBox
flinkbot edited a comment on pull request #14834: URL: https://github.com/apache/flink/pull/14834#issuecomment-771607546 ## CI report: * 3c55d1b87076148f095c08a55319f1b898dc932d UNKNOWN * 5c8ac11faf9d6fbcad7550bec8abf6a6343347c3 UNKNOWN *

[GitHub] [flink] zentol commented on pull request #14826: [FLINK-12358][docs] Add IT case to verify REST docs corresponding to the code

2021-02-08 Thread GitBox
zentol commented on pull request #14826: URL: https://github.com/apache/flink/pull/14826#issuecomment-775049515 hmmdo we even need the snapshot for this? Couldn't we retrieve the current handlers from an entrypoint? Then we wouldn't have to change anything about the snapshot or parse

[jira] [Updated] (FLINK-21303) Remove LogicalSlot#getPhysicalSlotNumber

2021-02-08 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-21303: - Summary: Remove LogicalSlot#getPhysicalSlotNumber (was: Maybe remove

[jira] [Closed] (FLINK-21303) Maybe remove LogicalSlot#getPhysicalSlotNumber

2021-02-08 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-21303. Resolution: Fixed master: 7ea786ac6af7286eb147449729316418b38cdafe > Maybe remove

<    1   2   3   4   >