[GitHub] [flink] flinkbot edited a comment on pull request #14834: [FLINK-21346][build system] Adding timeout to all tasks

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14834: URL: https://github.com/apache/flink/pull/14834#issuecomment-771607546 ## CI report: * 3c55d1b87076148f095c08a55319f1b898dc932d UNKNOWN * 5c8ac11faf9d6fbcad7550bec8abf6a6343347c3 UNKNOWN *

[GitHub] [flink] flinkbot edited a comment on pull request #14744: [FLINK-17511][tests] Rerun RocksDB memory control tests if necessary

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14744: URL: https://github.com/apache/flink/pull/14744#issuecomment-766515087 ## CI report: * 0a3a317f89be84c50608d6bd9514dde8367e3d5d Azure:

[jira] [Commented] (FLINK-20376) Error in restoring checkpoint/savepoint when Flink is upgraded from 1.9 to 1.11.2

2021-02-10 Thread Partha Pradeep Mishra (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282900#comment-17282900 ] Partha Pradeep Mishra commented on FLINK-20376: --- [~pnowojski] # We are using

[GitHub] [flink] Myasuka commented on pull request #14826: [FLINK-12358][docs] Add IT case to verify REST docs corresponding to the code

2021-02-10 Thread GitBox
Myasuka commented on pull request #14826: URL: https://github.com/apache/flink/pull/14826#issuecomment-777256998 @zentol , I also concerned the necessity to leave snapshot files during submitting this PR. However, if we really have `v2` REST API in the future, should the snapshot of rest

[jira] [Created] (FLINK-21360) Add resourceTimeout configuration

2021-02-10 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-21360: -- Summary: Add resourceTimeout configuration Key: FLINK-21360 URL: https://issues.apache.org/jira/browse/FLINK-21360 Project: Flink Issue Type: Sub-task

[GitHub] [flink] Myasuka commented on pull request #14744: [FLINK-17511][tests] Rerun RocksDB memory control tests if necessary

2021-02-10 Thread GitBox
Myasuka commented on pull request #14744: URL: https://github.com/apache/flink/pull/14744#issuecomment-777255056 @StephanEwen , yes I agree with your concern. Current memory control mechanism of RocksDB cannot handle any malloced memory not inserted into block cache or write buffer, those

[GitHub] [flink] flinkbot edited a comment on pull request #14744: [FLINK-17511][tests] Rerun RocksDB memory control tests if necessary

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14744: URL: https://github.com/apache/flink/pull/14744#issuecomment-766515087 ## CI report: * 0a3a317f89be84c50608d6bd9514dde8367e3d5d Azure:

[jira] [Closed] (FLINK-21349) 'Quickstarts Scala nightly end-to-end test' fails with errors in logs

2021-02-10 Thread Dawid Wysakowicz (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dawid Wysakowicz closed FLINK-21349. Resolution: Duplicate > 'Quickstarts Scala nightly end-to-end test' fails with errors in

[jira] [Commented] (FLINK-21349) 'Quickstarts Scala nightly end-to-end test' fails with errors in logs

2021-02-10 Thread Dawid Wysakowicz (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282895#comment-17282895 ] Dawid Wysakowicz commented on FLINK-21349: -- Thanks [~AHeise]. Seems likely. I will mark it as a

[GitHub] [flink] Myasuka commented on pull request #14744: [FLINK-17511][tests] Rerun RocksDB memory control tests if necessary

2021-02-10 Thread GitBox
Myasuka commented on pull request #14744: URL: https://github.com/apache/flink/pull/14744#issuecomment-777247888 @flinkbot run azure This is an automated message from the Apache Git Service. To respond to the message, please

[jira] [Commented] (FLINK-21349) 'Quickstarts Scala nightly end-to-end test' fails with errors in logs

2021-02-10 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282893#comment-17282893 ] Arvid Heise commented on FLINK-21349: - Probably a duplicate of

[jira] [Comment Edited] (FLINK-21349) 'Quickstarts Scala nightly end-to-end test' fails with errors in logs

2021-02-10 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282893#comment-17282893 ] Arvid Heise edited comment on FLINK-21349 at 2/11/21, 7:20 AM: --- Probably a

[jira] [Commented] (FLINK-16947) ArtifactResolutionException: Could not transfer artifact. Entry [...] has not been leased from this pool

2021-02-10 Thread Robert Metzger (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282891#comment-17282891 ] Robert Metzger commented on FLINK-16947: My best bet at this point would be using the latest

[jira] [Commented] (FLINK-20461) YARNFileReplicationITCase.testPerJobModeWithDefaultFileReplication

2021-02-10 Thread Dawid Wysakowicz (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282888#comment-17282888 ] Dawid Wysakowicz commented on FLINK-20461: -- New instance:

[jira] [Commented] (FLINK-21318) ExecutionContextTest.testCatalogs fail

2021-02-10 Thread Dawid Wysakowicz (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282887#comment-17282887 ] Dawid Wysakowicz commented on FLINK-21318: -- Yes, it happens with JDK 11. Could you prepare a

[jira] [Commented] (FLINK-21318) ExecutionContextTest.testCatalogs fail

2021-02-10 Thread Dawid Wysakowicz (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282885#comment-17282885 ] Dawid Wysakowicz commented on FLINK-21318: --

[jira] [Commented] (FLINK-16947) ArtifactResolutionException: Could not transfer artifact. Entry [...] has not been leased from this pool

2021-02-10 Thread Dawid Wysakowicz (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282884#comment-17282884 ] Dawid Wysakowicz commented on FLINK-16947: --

[jira] [Commented] (FLINK-21349) 'Quickstarts Scala nightly end-to-end test' fails with errors in logs

2021-02-10 Thread Dawid Wysakowicz (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282882#comment-17282882 ] Dawid Wysakowicz commented on FLINK-21349: -- Another instance:

[GitHub] [flink] flinkbot edited a comment on pull request #14921: [FLINK-21100][coordination] Add DeclarativeScheduler

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14921: URL: https://github.com/apache/flink/pull/14921#issuecomment-777147472 ## CI report: * e96b358d1ab6bc698b02756b1273d0475025ce85 Azure:

[jira] [Comment Edited] (FLINK-21351) Incremental checkpoint data would be lost once a non-stop savepoint completed

2021-02-10 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282867#comment-17282867 ] Yun Tang edited comment on FLINK-21351 at 2/11/21, 5:56 AM: [~dwysakowicz]

[jira] [Commented] (FLINK-21351) Incremental checkpoint data would be lost once a non-stop savepoint completed

2021-02-10 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282867#comment-17282867 ] Yun Tang commented on FLINK-21351: -- [~dwysakowicz] yes, once a savepoint completed, the previous added

[GitHub] [flink] gaoyunhaii commented on a change in pull request #14740: [FLINK-21067][runtime][checkpoint] Modify the logic of computing which tasks to trigger/ack/commit to support finished tasks

2021-02-10 Thread GitBox
gaoyunhaii commented on a change in pull request #14740: URL: https://github.com/apache/flink/pull/14740#discussion_r574247927 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/CheckpointPlanCalculator.java ## @@ -18,109 +18,498 @@ package

[jira] [Commented] (FLINK-21318) ExecutionContextTest.testCatalogs fail

2021-02-10 Thread Rui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282839#comment-17282839 ] Rui Li commented on FLINK-21318: Does this failure happen in the JDK11 test? Hive in general doesn't run

[GitHub] [flink] flinkbot edited a comment on pull request #14921: [FLINK-21100][coordination] Add DeclarativeScheduler

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14921: URL: https://github.com/apache/flink/pull/14921#issuecomment-777147472 ## CI report: * e96b358d1ab6bc698b02756b1273d0475025ce85 Azure:

[GitHub] [flink] flinkbot commented on pull request #14921: [FLINK-21100][coordination] Add DeclarativeScheduler

2021-02-10 Thread GitBox
flinkbot commented on pull request #14921: URL: https://github.com/apache/flink/pull/14921#issuecomment-777147472 ## CI report: * e96b358d1ab6bc698b02756b1273d0475025ce85 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot

[jira] [Updated] (FLINK-21100) Add DeclarativeScheduler skeleton

2021-02-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-21100: --- Labels: pull-request-available (was: ) > Add DeclarativeScheduler skeleton >

[GitHub] [flink] flinkbot commented on pull request #14921: [FLINK-21100][coordination] Add DeclarativeScheduler

2021-02-10 Thread GitBox
flinkbot commented on pull request #14921: URL: https://github.com/apache/flink/pull/14921#issuecomment-777143367 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the

[GitHub] [flink] zentol opened a new pull request #14921: [FLINK-21100][coordination] Add DeclarativeScheduler

2021-02-10 Thread GitBox
zentol opened a new pull request #14921: URL: https://github.com/apache/flink/pull/14921 Based on #14909 and #14910. Implements the `DeclarativeScheduler`. It primarily connects the various `State` classes, the `SlotAllocator` and `ScaleUpController` to create a new streaming-only

[GitHub] [flink] flinkbot edited a comment on pull request #14839: [FLINK-21353][state] Add DFS-based StateChangelog

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14839: URL: https://github.com/apache/flink/pull/14839#issuecomment-772060196 ## CI report: * 813a44dd88fc0357316be02c53119c7def6f3eac Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14908: [FLINK-21312][checkpointing] Don't endInput() if stopped externally

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14908: URL: https://github.com/apache/flink/pull/14908#issuecomment-775883728 ## CI report: * 1d86e16e8a391683db0ab043d8316585caf79146 Azure:

[jira] [Closed] (FLINK-21342) Various classes extending TestBases cannot be instantiated

2021-02-10 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-21342. Resolution: Fixed master: 09b8e4e3881a70fd8f3fad103b5d60ff24991178 > Various classes

[GitHub] [flink] zentol merged pull request #14918: [FLINK-21342][tests] Add '@Ignore' to *TestInstance classes

2021-02-10 Thread GitBox
zentol merged pull request #14918: URL: https://github.com/apache/flink/pull/14918 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [flink] LinyuYao1021 commented on a change in pull request #14737: [FLINK-19667] Add AWS Glue Schema Registry integration

2021-02-10 Thread GitBox
LinyuYao1021 commented on a change in pull request #14737: URL: https://github.com/apache/flink/pull/14737#discussion_r574177985 ## File path: flink-formats/flink-avro-glue-schema-registry/pom.xml ## @@ -0,0 +1,99 @@ + + +http://maven.apache.org/POM/4.0.0; +

[GitHub] [flink] flinkbot edited a comment on pull request #14909: [FLINK-21258] Add Canceling state for DeclarativeScheduler

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14909: URL: https://github.com/apache/flink/pull/14909#issuecomment-775883834 ## CI report: * 41d226e0a1b6e53dc7f65273e1148a02564a24ef Azure:

[GitHub] [flink] LinyuYao1021 commented on a change in pull request #14737: [FLINK-19667] Add AWS Glue Schema Registry integration

2021-02-10 Thread GitBox
LinyuYao1021 commented on a change in pull request #14737: URL: https://github.com/apache/flink/pull/14737#discussion_r574171820 ## File path:

[GitHub] [flink] flinkbot edited a comment on pull request #14910: [FLINK-21259] Add Failing state for DeclarativeScheduler

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14910: URL: https://github.com/apache/flink/pull/14910#issuecomment-775986669 ## CI report: * e711078acde12b997d01ac2282840d3cd958d7bd Azure:

[jira] [Comment Edited] (FLINK-14034) In FlinkKafkaProducer, KafkaTransactionState should be made public or invoke should be made final

2021-02-10 Thread Andrew Roberts (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282743#comment-17282743 ] Andrew Roberts edited comment on FLINK-14034 at 2/10/21, 10:16 PM: ---

[jira] [Commented] (FLINK-21359) CompatibilityResult issues with Flink 1.9.0

2021-02-10 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282746#comment-17282746 ] Chesnay Schepler commented on FLINK-21359: -- Do you use a custom serializer? If so, please have

[GitHub] [flink] LinyuYao1021 commented on a change in pull request #14737: [FLINK-19667] Add AWS Glue Schema Registry integration

2021-02-10 Thread GitBox
LinyuYao1021 commented on a change in pull request #14737: URL: https://github.com/apache/flink/pull/14737#discussion_r574115398 ## File path:

[jira] [Commented] (FLINK-14034) In FlinkKafkaProducer, KafkaTransactionState should be made public or invoke should be made final

2021-02-10 Thread Andrew Roberts (Jira)
[ https://issues.apache.org/jira/browse/FLINK-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282743#comment-17282743 ] Andrew Roberts commented on FLINK-14034: Just to add another use case here: It is possible for

[jira] [Created] (FLINK-21359) CompatibilityResult issues with Flink 1.9.0

2021-02-10 Thread Siva (Jira)
Siva created FLINK-21359: Summary: CompatibilityResult issues with Flink 1.9.0 Key: FLINK-21359 URL: https://issues.apache.org/jira/browse/FLINK-21359 Project: Flink Issue Type: Bug

[GitHub] [flink] LinyuYao1021 commented on a change in pull request #14737: [FLINK-19667] Add AWS Glue Schema Registry integration

2021-02-10 Thread GitBox
LinyuYao1021 commented on a change in pull request #14737: URL: https://github.com/apache/flink/pull/14737#discussion_r574088029 ## File path: flink-formats/flink-avro-glue-schema-registry/pom.xml ## @@ -0,0 +1,99 @@ + + +http://maven.apache.org/POM/4.0.0; +

[GitHub] [flink] sjwiesman commented on a change in pull request #13912: [FLINK-19466][FLINK-19467][runtime / state backends] Add Flip-142 public interfaces and methods

2021-02-10 Thread GitBox
sjwiesman commented on a change in pull request #13912: URL: https://github.com/apache/flink/pull/13912#discussion_r574067926 ## File path: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/environment/StreamExecutionEnvironment.java ## @@ -562,27 +566,30 @@

[GitHub] [flink] sjwiesman commented on a change in pull request #13912: [FLINK-19466][FLINK-19467][runtime / state backends] Add Flip-142 public interfaces and methods

2021-02-10 Thread GitBox
sjwiesman commented on a change in pull request #13912: URL: https://github.com/apache/flink/pull/13912#discussion_r574067140 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/state/storage/AbstractFileCheckpointStorage.java ## @@ -0,0 +1,215 @@ +/* + *

[GitHub] [flink] sjwiesman commented on a change in pull request #13912: [FLINK-19466][FLINK-19467][runtime / state backends] Add Flip-142 public interfaces and methods

2021-02-10 Thread GitBox
sjwiesman commented on a change in pull request #13912: URL: https://github.com/apache/flink/pull/13912#discussion_r574065708 ## File path: flink-core/src/main/java/org/apache/flink/configuration/CheckpointingOptions.java ## @@ -27,22 +29,70 @@ // general checkpoint and

[GitHub] [flink] sjwiesman commented on a change in pull request #13912: [FLINK-19466][FLINK-19467][runtime / state backends] Add Flip-142 public interfaces and methods

2021-02-10 Thread GitBox
sjwiesman commented on a change in pull request #13912: URL: https://github.com/apache/flink/pull/13912#discussion_r574064508 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/state/StateBackendLoader.java ## @@ -131,7 +144,7 @@ public static StateBackend

[GitHub] [flink] flinkbot edited a comment on pull request #14908: [FLINK-21312][checkpointing] Don't endInput() if stopped externally

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14908: URL: https://github.com/apache/flink/pull/14908#issuecomment-775883728 ## CI report: * 3269f981a58236969430a57e583ca5bdaa694c5a Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14899: [BP-1.11][FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavepoint properly

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14899: URL: https://github.com/apache/flink/pull/14899#issuecomment-775088427 ## CI report: * ea262e0d3ed21c3ee3b815782ab2d12d2e6a6300 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14839: [FLINK-21353][state] Add DFS-based StateChangelog

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14839: URL: https://github.com/apache/flink/pull/14839#issuecomment-772060196 ## CI report: * a0d75a1671f3537cf3cf8ef72d08cbffc3d71295 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14919: [FLINK-21338][test] Relax ITCase naming constraints

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14919: URL: https://github.com/apache/flink/pull/14919#issuecomment-776686704 ## CI report: * 65a33645d217d8756e40a5c630680e30058f64cb Azure:

[GitHub] [flink] rkhachatryan commented on a change in pull request #14740: [FLINK-21067][runtime][checkpoint] Modify the logic of computing which tasks to trigger/ack/commit to support finished tasks

2021-02-10 Thread GitBox
rkhachatryan commented on a change in pull request #14740: URL: https://github.com/apache/flink/pull/14740#discussion_r573992537 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/CheckpointPlanCalculator.java ## @@ -18,109 +18,498 @@ package

[GitHub] [flink] flinkbot edited a comment on pull request #14908: [FLINK-21312][checkpointing] Don't endInput() if stopped externally

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14908: URL: https://github.com/apache/flink/pull/14908#issuecomment-775883728 ## CI report: * 3269f981a58236969430a57e583ca5bdaa694c5a Azure:

[jira] [Updated] (FLINK-21353) Add FS-based StateChangelog implementation

2021-02-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-21353: --- Labels: pull-request-available (was: ) > Add FS-based StateChangelog implementation >

[GitHub] [flink] flinkbot edited a comment on pull request #14839: [FLINK-21353][state] Add DFS-based StateChangelog

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14839: URL: https://github.com/apache/flink/pull/14839#issuecomment-772060196 ## CI report: * a0d75a1671f3537cf3cf8ef72d08cbffc3d71295 Azure:

[GitHub] [flink] LinyuYao1021 commented on a change in pull request #14737: [FLINK-19667] Add AWS Glue Schema Registry integration

2021-02-10 Thread GitBox
LinyuYao1021 commented on a change in pull request #14737: URL: https://github.com/apache/flink/pull/14737#discussion_r574033549 ## File path: flink-formats/flink-avro-glue-schema-registry/pom.xml ## @@ -0,0 +1,99 @@ + + +http://maven.apache.org/POM/4.0.0; +

[GitHub] [flink] flinkbot edited a comment on pull request #14910: [FLINK-21259] Add Failing state for DeclarativeScheduler

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14910: URL: https://github.com/apache/flink/pull/14910#issuecomment-775986669 ## CI report: * b4ba3c37230a6f471b340a9426a270c29f812fec Azure:

[GitHub] [flink] rkhachatryan commented on a change in pull request #14740: [FLINK-21067][runtime][checkpoint] Modify the logic of computing which tasks to trigger/ack/commit to support finished tasks

2021-02-10 Thread GitBox
rkhachatryan commented on a change in pull request #14740: URL: https://github.com/apache/flink/pull/14740#discussion_r573983605 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/CheckpointPlanCalculator.java ## @@ -18,109 +18,498 @@ package

[GitHub] [flink] flinkbot edited a comment on pull request #14918: [FLINK-21342][tests] Add '@Ignore' to *TestInstance classes

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14918: URL: https://github.com/apache/flink/pull/14918#issuecomment-776686622 ## CI report: * ce71a30f35e944cab2e6307431911935e50c05d4 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14910: [FLINK-21259] Add Failing state for DeclarativeScheduler

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14910: URL: https://github.com/apache/flink/pull/14910#issuecomment-775986669 ## CI report: * b4ba3c37230a6f471b340a9426a270c29f812fec Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14909: [FLINK-21258] Add Canceling state for DeclarativeScheduler

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14909: URL: https://github.com/apache/flink/pull/14909#issuecomment-775883834 ## CI report: * b1053bef9b535540da2d20f57fd61d7a0d28eb1c Azure:

[GitHub] [flink] rmetzger commented on pull request #14910: [FLINK-21259] Add Failing state for DeclarativeScheduler

2021-02-10 Thread GitBox
rmetzger commented on pull request #14910: URL: https://github.com/apache/flink/pull/14910#issuecomment-776936981 Rebased to latest master, will address the comments tomorrow (ideally after the Canceling PR is merged, so that I can share the MockExecutionGraph).

[GitHub] [flink] rkhachatryan commented on a change in pull request #14740: [FLINK-21067][runtime][checkpoint] Modify the logic of computing which tasks to trigger/ack/commit to support finished tasks

2021-02-10 Thread GitBox
rkhachatryan commented on a change in pull request #14740: URL: https://github.com/apache/flink/pull/14740#discussion_r573983605 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/CheckpointPlanCalculator.java ## @@ -18,109 +18,498 @@ package

[GitHub] [flink] flinkbot edited a comment on pull request #14919: [FLINK-21338][test] Relax ITCase naming constraints

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14919: URL: https://github.com/apache/flink/pull/14919#issuecomment-776686704 ## CI report: * 12ef0b44ac73fe945b51118a9cda3ebc27d9c411 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14909: [FLINK-21258] Add Canceling state for DeclarativeScheduler

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14909: URL: https://github.com/apache/flink/pull/14909#issuecomment-775883834 ## CI report: * b1053bef9b535540da2d20f57fd61d7a0d28eb1c Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14900: [BP-1.12][FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavepoint properly

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14900: URL: https://github.com/apache/flink/pull/14900#issuecomment-775088580 ## CI report: * 4e8341f6a43cfa5e209873f8a19ce8c492809916 Azure:

[jira] [Closed] (FLINK-21260) Add DeclarativeScheduler / Finished state

2021-02-10 Thread Robert Metzger (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Metzger closed FLINK-21260. -- Resolution: Fixed Impl:

[GitHub] [flink] rmetzger closed pull request #14912: [FLINK-21260] Add Finished state for DeclarativeScheduler

2021-02-10 Thread GitBox
rmetzger closed pull request #14912: URL: https://github.com/apache/flink/pull/14912 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [flink] rmetzger commented on pull request #14912: [FLINK-21260] Add Finished state for DeclarativeScheduler

2021-02-10 Thread GitBox
rmetzger commented on pull request #14912: URL: https://github.com/apache/flink/pull/14912#issuecomment-776929737 Thank you for your feedback! I addressed the comments and will merge the change now! This is an automated

[GitHub] [flink] rmetzger commented on pull request #14909: [FLINK-21258] Add Canceling state for DeclarativeScheduler

2021-02-10 Thread GitBox
rmetzger commented on pull request #14909: URL: https://github.com/apache/flink/pull/14909#issuecomment-776925910 I rebased this change to the latest master (thus fewer commits are included), and addressed all comments Once you confirm that the `testTaskFailuresAreIgnored()` doesn't

[GitHub] [flink] rmetzger commented on a change in pull request #14909: [FLINK-21258] Add Canceling state for DeclarativeScheduler

2021-02-10 Thread GitBox
rmetzger commented on a change in pull request #14909: URL: https://github.com/apache/flink/pull/14909#discussion_r573978651 ## File path: flink-runtime/src/test/java/org/apache/flink/runtime/scheduler/declarative/CancelingTest.java ## @@ -0,0 +1,171 @@ +/* + * Licensed to

[GitHub] [flink] flinkbot edited a comment on pull request #14920: [FLINK-21358][docs] Adds savepoint 1.12.x to savepoint compatibility diagram

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14920: URL: https://github.com/apache/flink/pull/14920#issuecomment-776908223 ## CI report: * 70a9959f76e9eaf8a7063a1fc3edcfe270f09ea4 Azure:

[GitHub] [flink] flinkbot commented on pull request #14920: [FLINK-21358][docs] Adds savepoint 1.12.x to savepoint compatibility diagram

2021-02-10 Thread GitBox
flinkbot commented on pull request #14920: URL: https://github.com/apache/flink/pull/14920#issuecomment-776908223 ## CI report: * 70a9959f76e9eaf8a7063a1fc3edcfe270f09ea4 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot

[GitHub] [flink] LinyuYao1021 commented on a change in pull request #14737: [FLINK-19667] Add AWS Glue Schema Registry integration

2021-02-10 Thread GitBox
LinyuYao1021 commented on a change in pull request #14737: URL: https://github.com/apache/flink/pull/14737#discussion_r573954198 ## File path:

[GitHub] [flink] flinkbot commented on pull request #14920: [FLINK-21358][docs] Adds savepoint 1.12.x to savepoint compatibility diagram

2021-02-10 Thread GitBox
flinkbot commented on pull request #14920: URL: https://github.com/apache/flink/pull/14920#issuecomment-776901940 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the

[jira] [Updated] (FLINK-21358) Missing snapshot version compatibility for 1.12

2021-02-10 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-21358: --- Labels: pull-request-available (was: ) > Missing snapshot version compatibility for 1.12 >

[GitHub] [flink] XComp opened a new pull request #14920: [FLINK-21358][docs] Adds savepoint 1.12.x to savepoint compatibility diagram

2021-02-10 Thread GitBox
XComp opened a new pull request #14920: URL: https://github.com/apache/flink/pull/14920 ## What is the purpose of the change I assumed that there are no changes that would be break the compatibility for `1.12.x` ## Brief change log * added new row and column for

[GitHub] [flink] flinkbot edited a comment on pull request #14908: [FLINK-21312][checkpointing] Don't endInput() if stopped externally

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14908: URL: https://github.com/apache/flink/pull/14908#issuecomment-775883728 ## CI report: * 3269f981a58236969430a57e583ca5bdaa694c5a Azure:

[jira] [Assigned] (FLINK-21358) Missing snapshot version compatibility for 1.12

2021-02-10 Thread Matthias (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias reassigned FLINK-21358: Assignee: Matthias > Missing snapshot version compatibility for 1.12 >

[jira] [Created] (FLINK-21358) Missing snapshot version compatibility for 1.12

2021-02-10 Thread Matthias (Jira)
Matthias created FLINK-21358: Summary: Missing snapshot version compatibility for 1.12 Key: FLINK-21358 URL: https://issues.apache.org/jira/browse/FLINK-21358 Project: Flink Issue Type: Task

[GitHub] [flink] flinkbot edited a comment on pull request #14919: [FLINK-21338][test] Relax ITCase naming constraints

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14919: URL: https://github.com/apache/flink/pull/14919#issuecomment-776686704 ## CI report: * 360f2b77255636af978380228b96c7f6bc2a4b77 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14918: [FLINK-21342][tests] Add '@Ignore' to *TestInstance classes

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14918: URL: https://github.com/apache/flink/pull/14918#issuecomment-776686622 ## CI report: * 6cd3b9e24933db6c3113f864c6640b5d7e06a091 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14899: [BP-1.11][FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavepoint properly

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14899: URL: https://github.com/apache/flink/pull/14899#issuecomment-775088427 ## CI report: * ea262e0d3ed21c3ee3b815782ab2d12d2e6a6300 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14834: [FLINK-21346][build system] Adding timeout to all tasks

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14834: URL: https://github.com/apache/flink/pull/14834#issuecomment-771607546 ## CI report: * 3c55d1b87076148f095c08a55319f1b898dc932d UNKNOWN * 5c8ac11faf9d6fbcad7550bec8abf6a6343347c3 UNKNOWN *

[GitHub] [flink] aljoscha commented on a change in pull request #14913: [FLINK-21344] Support switching from/to rocks db with heap timers

2021-02-10 Thread GitBox
aljoscha commented on a change in pull request #14913: URL: https://github.com/apache/flink/pull/14913#discussion_r573919950 ## File path: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/restore/RocksDBHandle.java ## @@

[jira] [Created] (FLINK-21357) Add periodic materialization

2021-02-10 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-21357: - Summary: Add periodic materialization Key: FLINK-21357 URL: https://issues.apache.org/jira/browse/FLINK-21357 Project: Flink Issue Type: Sub-task

[jira] [Updated] (FLINK-21356) Implement incremental checkpointing and recovery using state changelog

2021-02-10 Thread Roman Khachatryan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Khachatryan updated FLINK-21356: -- Description: * Including state handles serialization (MetadataV2V3SerializerBase) *

[jira] [Created] (FLINK-21356) Implement incremental checkpointing and recovery using state changelog

2021-02-10 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-21356: - Summary: Implement incremental checkpointing and recovery using state changelog Key: FLINK-21356 URL: https://issues.apache.org/jira/browse/FLINK-21356

[jira] [Created] (FLINK-21355) Send changes to the state changelog (still proxy everything)

2021-02-10 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-21355: - Summary: Send changes to the state changelog (still proxy everything) Key: FLINK-21355 URL: https://issues.apache.org/jira/browse/FLINK-21355 Project:

[GitHub] [flink] flinkbot edited a comment on pull request #14899: [BP-1.11][FLINK-21312][checkpointing] Reset OperatorChain.isStoppingBySyncSavepoint properly

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14899: URL: https://github.com/apache/flink/pull/14899#issuecomment-775088427 ## CI report: * ea262e0d3ed21c3ee3b815782ab2d12d2e6a6300 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14895: [FLINK-21295][table] Support 'useModules' and 'listFullModules' in ModuleManager and TableEnvironment

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14895: URL: https://github.com/apache/flink/pull/14895#issuecomment-774905526 ## CI report: * 0f00bd24f7fc90e353eaf3d90a3f220b7dc222a2 Azure:

[jira] [Updated] (FLINK-21354) Add ChangelogStateBackend (proxy-everything)

2021-02-10 Thread Roman Khachatryan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Khachatryan updated FLINK-21354: -- Component/s: Runtime / State Backends > Add ChangelogStateBackend (proxy-everything)

[jira] [Created] (FLINK-21354) Add ChangelogStateBackend (proxy-everything)

2021-02-10 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-21354: - Summary: Add ChangelogStateBackend (proxy-everything) Key: FLINK-21354 URL: https://issues.apache.org/jira/browse/FLINK-21354 Project: Flink Issue

[jira] [Updated] (FLINK-21354) Add ChangelogStateBackend (proxy-everything)

2021-02-10 Thread Roman Khachatryan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Khachatryan updated FLINK-21354: -- Fix Version/s: 1.13.0 > Add ChangelogStateBackend (proxy-everything) >

[jira] [Created] (FLINK-21353) Add FS-based StateChangelog implementation

2021-02-10 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-21353: - Summary: Add FS-based StateChangelog implementation Key: FLINK-21353 URL: https://issues.apache.org/jira/browse/FLINK-21353 Project: Flink Issue

[jira] [Updated] (FLINK-19503) Add StateChangelog interface and its in-memory implementation

2021-02-10 Thread Roman Khachatryan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Khachatryan updated FLINK-19503: -- Parent: FLINK-21352 Issue Type: Sub-task (was: New Feature) > Add

[jira] [Created] (FLINK-21352) FLIP-158: Generalized incremental checkpoints

2021-02-10 Thread Roman Khachatryan (Jira)
Roman Khachatryan created FLINK-21352: - Summary: FLIP-158: Generalized incremental checkpoints Key: FLINK-21352 URL: https://issues.apache.org/jira/browse/FLINK-21352 Project: Flink

[jira] [Commented] (FLINK-21133) FLIP-27 Source does not work with synchronous savepoint

2021-02-10 Thread Kezhu Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17282564#comment-17282564 ] Kezhu Wang commented on FLINK-21133: {quote}I think what stop-with-savepoint should really do is

[GitHub] [flink] rkhachatryan merged pull request #14881: [hotfix][state] Improve logging in AbstractKeyedStateBackend

2021-02-10 Thread GitBox
rkhachatryan merged pull request #14881: URL: https://github.com/apache/flink/pull/14881 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [flink] flinkbot edited a comment on pull request #14847: [FLINK-21030][runtime] Add global failover in case of a stop-with-savepoint failure

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14847: URL: https://github.com/apache/flink/pull/14847#issuecomment-772387941 ## CI report: * 5d63d3f4786b9b5580e73c501d0c2081ff843804 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14834: [FLINK-21346][build system] Adding timeout to all tasks

2021-02-10 Thread GitBox
flinkbot edited a comment on pull request #14834: URL: https://github.com/apache/flink/pull/14834#issuecomment-771607546 ## CI report: * 3c55d1b87076148f095c08a55319f1b898dc932d UNKNOWN * 5c8ac11faf9d6fbcad7550bec8abf6a6343347c3 UNKNOWN *

  1   2   3   >