[jira] [Updated] (FLINK-21094) Support StreamExecSink json serialization/deserialization

2021-01-22 Thread godfrey he (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] godfrey he updated FLINK-21094: --- Description: Similar to StreamExecTableSourceScan, if a sink table's ddl is {code:sql} CREATE

[GitHub] [flink] flinkbot edited a comment on pull request #14732: Release 1.12 The Flink task was committed to YARN, but the prompt(NoSuchMethod:Lorg/apache/hadoop/security/UserGroupInformation) fail

2021-01-22 Thread GitBox
flinkbot edited a comment on pull request #14732: URL: https://github.com/apache/flink/pull/14732#issuecomment-765882051 ## CI report: * b866f88656da7ca5f6b962c234f7c2a07d58fe99 Azure:

[jira] [Updated] (FLINK-21093) Support StreamExecTableSource json serialization/deserialization

2021-01-22 Thread godfrey he (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] godfrey he updated FLINK-21093: --- Description: If a source table's ddl is {code:sql} CREATE TABLE MyTable ( a bigint, b int, c

[GitHub] [flink] flinkbot edited a comment on pull request #14729: [FLINK-21092][FLINK-21093][FLINK-21094][FLINK-21096][table-planner-blink] Support ExecNode plan serialization/deserialization for `IN

2021-01-22 Thread GitBox
flinkbot edited a comment on pull request #14729: URL: https://github.com/apache/flink/pull/14729#issuecomment-765399004 ## CI report: * ef724e57e7676c154c8f0d6da93a811e9d411051 Azure:

[jira] [Updated] (FLINK-21094) Support StreamExecSink json serialization/deserialization

2021-01-22 Thread godfrey he (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] godfrey he updated FLINK-21094: --- Description: Similar to StreamExecTableSourceScan, if a sink table's ddl is {code:sql} CREATE

[jira] [Updated] (FLINK-21094) Support StreamExecSink json serialization/deserialization

2021-01-22 Thread godfrey he (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] godfrey he updated FLINK-21094: --- Description: Similar to StreamExecTableSourceScan, if a sink table's ddl is {code:sql} CREATE

[jira] [Updated] (FLINK-21093) Support StreamExecTableSource json serialization/deserialization

2021-01-22 Thread godfrey he (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] godfrey he updated FLINK-21093: --- Description: If a table's ddl is {code:sql} CREATE TABLE MyTable ( a bigint, b int, c

[jira] [Updated] (FLINK-21093) Support StreamExecTableSource json serialization/deserialization

2021-01-22 Thread godfrey he (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] godfrey he updated FLINK-21093: --- Description: If a table's ddl is {code:sql} CREATE TABLE MyTable ( a bigint, b int, c

[jira] [Updated] (FLINK-21093) Support StreamExecTableSource json serialization/deserialization

2021-01-22 Thread godfrey he (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] godfrey he updated FLINK-21093: --- Description: An StreamExecTableSource can be serialized to json, and the json The json for

[jira] [Updated] (FLINK-21093) Support StreamExecTableSource json serialization/deserialization

2021-01-22 Thread godfrey he (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] godfrey he updated FLINK-21093: --- Fix Version/s: 1.13.0 > Support StreamExecTableSource json serialization/deserialization >

[jira] [Updated] (FLINK-21093) Support StreamExecTableSource json serialization/deserialization

2021-01-22 Thread godfrey he (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] godfrey he updated FLINK-21093: --- Description: StreamExecTableSource w (was: Stream ) > Support StreamExecTableSource json

[jira] [Updated] (FLINK-21093) Support StreamExecTableSource json serialization/deserialization

2021-01-22 Thread godfrey he (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] godfrey he updated FLINK-21093: --- Description: Stream > Support StreamExecTableSource json serialization/deserialization >

[jira] [Updated] (FLINK-21092) Introduce getJsonPlan, explainJsonPlan and executeJsonPlan in TableEnvironmentInternal

2021-01-22 Thread godfrey he (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] godfrey he updated FLINK-21092: --- Description: We will introduce the following methods to support json plan operations in

[GitHub] [flink] flinkbot commented on pull request #14732: Release 1.12 The Flink task was committed to YARN, but the prompt(NoSuchMethod:Lorg/apache/hadoop/security/UserGroupInformation) failed

2021-01-22 Thread GitBox
flinkbot commented on pull request #14732: URL: https://github.com/apache/flink/pull/14732#issuecomment-765882051 ## CI report: * b866f88656da7ca5f6b962c234f7c2a07d58fe99 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot

[GitHub] [flink] flinkbot commented on pull request #14732: Release 1.12 The Flink task was committed to YARN, but the prompt(NoSuchMethod:Lorg/apache/hadoop/security/UserGroupInformation) failed

2021-01-22 Thread GitBox
flinkbot commented on pull request #14732: URL: https://github.com/apache/flink/pull/14732#issuecomment-765881797 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the

[GitHub] [flink] bingfeng2004 opened a new pull request #14732: Release 1.12 The Flink task was committed to YARN, but the prompt(NoSuchMethod:Lorg/apache/hadoop/security/UserGroupInformation) failed

2021-01-22 Thread GitBox
bingfeng2004 opened a new pull request #14732: URL: https://github.com/apache/flink/pull/14732 **Runtime env:** flink on yarn my job is mysql to hive Hadoop3.0.0 on CDH6.3.2 **Log Details:** 2021-01-21 20:01:46,051 INFO

[jira] [Updated] (FLINK-19687) Support to get execution plan in `StatementSet`

2021-01-22 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-19687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-19687: Fix Version/s: 1.13.0 > Support to get execution plan in `StatementSet` >

[GitHub] [flink] flinkbot edited a comment on pull request #14678: [FLINK-20833][runtime] Add pluggable failure listener in job manager

2021-01-22 Thread GitBox
flinkbot edited a comment on pull request #14678: URL: https://github.com/apache/flink/pull/14678#issuecomment-761905721 ## CI report: * cade20e85b29ca63c51383dca04976c1d9801042 UNKNOWN * 1a6bd7aa98b649bd119479247d34ea029b8ba636 Azure:

[jira] [Updated] (FLINK-21104) UnalignedCheckpointITCase.execute failed with "IllegalStateException"

2021-01-22 Thread Dian Fu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu updated FLINK-21104: Affects Version/s: (was: 1.12.0) 1.12.2 > UnalignedCheckpointITCase.execute

[jira] [Updated] (FLINK-21104) UnalignedCheckpointITCase.execute failed with "IllegalStateException"

2021-01-22 Thread Dian Fu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu updated FLINK-21104: Fix Version/s: 1.12.2 1.13.0 > UnalignedCheckpointITCase.execute failed with

[jira] [Comment Edited] (FLINK-21104) UnalignedCheckpointITCase.execute failed with "IllegalStateException"

2021-01-22 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270555#comment-17270555 ] Leonard Xu edited comment on FLINK-21104 at 1/23/21, 5:20 AM: -- I think

[GitHub] [flink] flinkbot edited a comment on pull request #13797: [FLINK-19465][runtime / statebackends] Add CheckpointStorage interface and wire through runtime

2021-01-22 Thread GitBox
flinkbot edited a comment on pull request #13797: URL: https://github.com/apache/flink/pull/13797#issuecomment-716854695 ## CI report: * c06b3dcd4eb4045f66352c8b65c14a7b60163ecd UNKNOWN * 185e46fd046c5f39a87ac3583ad559b065a275e1 UNKNOWN *

[jira] [Commented] (FLINK-21104) UnalignedCheckpointITCase.execute failed with "IllegalStateException"

2021-01-22 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270555#comment-17270555 ] Leonard Xu commented on FLINK-21104: I think these fail cases are caused by FLINK-29654 and commit

[GitHub] [flink] flinkbot edited a comment on pull request #14729: [FLINK-21092][FLINK-21093][FLINK-21094][FLINK-21096][table-planner-blink] Support ExecNode plan serialization/deserialization for `IN

2021-01-22 Thread GitBox
flinkbot edited a comment on pull request #14729: URL: https://github.com/apache/flink/pull/14729#issuecomment-765399004 ## CI report: * 6357401af97f8c268fccb433c81c8a80cfe270d3 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14729: [FLINK-21092][FLINK-21093][FLINK-21094][FLINK-21096][table-planner-blink] Support ExecNode plan serialization/deserialization for `IN

2021-01-22 Thread GitBox
flinkbot edited a comment on pull request #14729: URL: https://github.com/apache/flink/pull/14729#issuecomment-765399004 ## CI report: * 6357401af97f8c268fccb433c81c8a80cfe270d3 Azure:

[jira] [Commented] (FLINK-21104) UnalignedCheckpointITCase.execute failed with "IllegalStateException"

2021-01-22 Thread Huang Xingbo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270540#comment-17270540 ] Huang Xingbo commented on FLINK-21104: --

[jira] [Commented] (FLINK-21104) UnalignedCheckpointITCase.execute failed with "IllegalStateException"

2021-01-22 Thread Huang Xingbo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270538#comment-17270538 ] Huang Xingbo commented on FLINK-21104: -- cc [~AHeise] [~roman_khachatryan] Could you help take a

[jira] [Commented] (FLINK-21104) UnalignedCheckpointITCase.execute failed with "IllegalStateException"

2021-01-22 Thread Huang Xingbo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270537#comment-17270537 ] Huang Xingbo commented on FLINK-21104: --

[jira] [Updated] (FLINK-21104) UnalignedCheckpointITCase.execute failed with "IllegalStateException"

2021-01-22 Thread Huang Xingbo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huang Xingbo updated FLINK-21104: - Priority: Blocker (was: Critical) > UnalignedCheckpointITCase.execute failed with

[jira] [Commented] (FLINK-21104) UnalignedCheckpointITCase.execute failed with "IllegalStateException"

2021-01-22 Thread Huang Xingbo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270536#comment-17270536 ] Huang Xingbo commented on FLINK-21104: --

[jira] [Commented] (FLINK-17274) Maven: Premature end of Content-Length delimited message body

2021-01-22 Thread Huang Xingbo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270535#comment-17270535 ] Huang Xingbo commented on FLINK-17274: --

[jira] [Commented] (FLINK-21104) UnalignedCheckpointITCase.execute failed with "IllegalStateException"

2021-01-22 Thread Huang Xingbo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270534#comment-17270534 ] Huang Xingbo commented on FLINK-21104: -- in release-1.12

[jira] [Updated] (FLINK-21104) UnalignedCheckpointITCase.execute failed with "IllegalStateException"

2021-01-22 Thread Huang Xingbo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huang Xingbo updated FLINK-21104: - Affects Version/s: 1.12.0 > UnalignedCheckpointITCase.execute failed with

[jira] [Created] (FLINK-21104) UnalignedCheckpointITCase.execute failed with "IllegalStateException"

2021-01-22 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-21104: Summary: UnalignedCheckpointITCase.execute failed with "IllegalStateException" Key: FLINK-21104 URL: https://issues.apache.org/jira/browse/FLINK-21104 Project: Flink

[GitHub] [flink] flinkbot edited a comment on pull request #14731: [hotfix][docs][concepts] fix wrong word of jobMaster

2021-01-22 Thread GitBox
flinkbot edited a comment on pull request #14731: URL: https://github.com/apache/flink/pull/14731#issuecomment-765816188 ## CI report: * 55181914aaa14c21c84092a79b9acc257d961331 Azure:

[GitHub] [flink] flinkbot commented on pull request #14731: [hotfix][docs][concepts] fix wrong word of jobMaster

2021-01-22 Thread GitBox
flinkbot commented on pull request #14731: URL: https://github.com/apache/flink/pull/14731#issuecomment-765816188 ## CI report: * 55181914aaa14c21c84092a79b9acc257d961331 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot

[jira] [Issue Comment Deleted] (FLINK-20904) Maven enforce goal dependency-convergence failed on flink-avro-glue-schema-registry

2021-01-22 Thread Mohit Paliwal (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mohit Paliwal updated FLINK-20904: -- Comment: was deleted (was: * *mvn clean package -DskipTests validate -Dcheck-convergence* *

[GitHub] [flink] flinkbot commented on pull request #14731: [hotfix][docs][concepts] fix wrong word of jobMaster

2021-01-22 Thread GitBox
flinkbot commented on pull request #14731: URL: https://github.com/apache/flink/pull/14731#issuecomment-765812528 Thanks a lot for your contribution to the Apache Flink project. I'm the @flinkbot. I help the community to review your pull request. We will use this comment to track the

[GitHub] [flink] nicygan opened a new pull request #14731: [hotfix][docs][concepts] fix wrong word of jobMaster

2021-01-22 Thread GitBox
nicygan opened a new pull request #14731: URL: https://github.com/apache/flink/pull/14731 ## What is the purpose of the change *(For example: This pull request makes task deployment go through the blob server, rather than through RPC. That way we avoid re-transferring them

[GitHub] [flink] flinkbot edited a comment on pull request #14678: [FLINK-20833][runtime] Add pluggable failure listener in job manager

2021-01-22 Thread GitBox
flinkbot edited a comment on pull request #14678: URL: https://github.com/apache/flink/pull/14678#issuecomment-761905721 ## CI report: * cade20e85b29ca63c51383dca04976c1d9801042 UNKNOWN * a4c68763883ef4f3c411fa606d0907ef334a6e76 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14678: [FLINK-20833][runtime] Add pluggable failure listener in job manager

2021-01-22 Thread GitBox
flinkbot edited a comment on pull request #14678: URL: https://github.com/apache/flink/pull/14678#issuecomment-761905721 ## CI report: * cade20e85b29ca63c51383dca04976c1d9801042 UNKNOWN * a4c68763883ef4f3c411fa606d0907ef334a6e76 Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #13797: [FLINK-19465][runtime / statebackends] Add CheckpointStorage interface and wire through runtime

2021-01-22 Thread GitBox
flinkbot edited a comment on pull request #13797: URL: https://github.com/apache/flink/pull/13797#issuecomment-716854695 ## CI report: * c06b3dcd4eb4045f66352c8b65c14a7b60163ecd UNKNOWN * 185e46fd046c5f39a87ac3583ad559b065a275e1 UNKNOWN *

[GitHub] [flink] flinkbot edited a comment on pull request #13797: [FLINK-19465][runtime / statebackends] Add CheckpointStorage interface and wire through runtime

2021-01-22 Thread GitBox
flinkbot edited a comment on pull request #13797: URL: https://github.com/apache/flink/pull/13797#issuecomment-716854695 ## CI report: * c06b3dcd4eb4045f66352c8b65c14a7b60163ecd UNKNOWN * 185e46fd046c5f39a87ac3583ad559b065a275e1 UNKNOWN *

[GitHub] [flink] flinkbot edited a comment on pull request #14635: [FLINK-19462][checkpointing] Update failed checkpoint stats

2021-01-22 Thread GitBox
flinkbot edited a comment on pull request #14635: URL: https://github.com/apache/flink/pull/14635#issuecomment-759750009 ## CI report: * 3618093d3ed7359710c9f73ced3031ff2ab8def8 Azure:

[jira] [Closed] (FLINK-21070) Overloaded aggregate functions cause converter errors

2021-01-22 Thread Timo Walther (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timo Walther closed FLINK-21070. Fix Version/s: 1.12.2 1.11.4 1.13.0 Resolution: Fixed

[GitHub] [flink] flinkbot edited a comment on pull request #13797: [FLINK-19465][runtime / statebackends] Add CheckpointStorage interface and wire through runtime

2021-01-22 Thread GitBox
flinkbot edited a comment on pull request #13797: URL: https://github.com/apache/flink/pull/13797#issuecomment-716854695 ## CI report: * c06b3dcd4eb4045f66352c8b65c14a7b60163ecd UNKNOWN * 185e46fd046c5f39a87ac3583ad559b065a275e1 UNKNOWN *

[jira] [Commented] (FLINK-20904) Maven enforce goal dependency-convergence failed on flink-avro-glue-schema-registry

2021-01-22 Thread Mohit Paliwal (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270401#comment-17270401 ] Mohit Paliwal commented on FLINK-20904: --- * *mvn clean package -DskipTests validate

[GitHub] [flink] flinkbot edited a comment on pull request #13797: [FLINK-19465][runtime / statebackends] Add CheckpointStorage interface and wire through runtime

2021-01-22 Thread GitBox
flinkbot edited a comment on pull request #13797: URL: https://github.com/apache/flink/pull/13797#issuecomment-716854695 ## CI report: * c06b3dcd4eb4045f66352c8b65c14a7b60163ecd UNKNOWN * 185e46fd046c5f39a87ac3583ad559b065a275e1 UNKNOWN *

[GitHub] [flink] twalthr closed pull request #14720: [FLINK-21070][table-runtime-blink] Fix invalid reuse of generated code

2021-01-22 Thread GitBox
twalthr closed pull request #14720: URL: https://github.com/apache/flink/pull/14720 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Closed] (FLINK-21050) Add an example for complex UDFs

2021-01-22 Thread Timo Walther (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timo Walther closed FLINK-21050. Fix Version/s: 1.13.0 Resolution: Fixed Fixed in 1.13.0:

[GitHub] [flink] twalthr closed pull request #14714: [FLINK-21050][examples-table] Add some advanced function examples

2021-01-22 Thread GitBox
twalthr closed pull request #14714: URL: https://github.com/apache/flink/pull/14714 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [flink] sjwiesman commented on pull request #13797: [FLINK-19465][runtime / statebackends] Add CheckpointStorage interface and wire through runtime

2021-01-22 Thread GitBox
sjwiesman commented on pull request #13797: URL: https://github.com/apache/flink/pull/13797#issuecomment-765647307 @rkhachatryan appreciate the speedy review. I hope I've addressed all your comments. Please take a look and let me know if you have any other concerns.

[GitHub] [flink] sjwiesman commented on a change in pull request #13797: [FLINK-19465][runtime / statebackends] Add CheckpointStorage interface and wire through runtime

2021-01-22 Thread GitBox
sjwiesman commented on a change in pull request #13797: URL: https://github.com/apache/flink/pull/13797#discussion_r562866385 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/rest/messages/checkpoints/CheckpointConfigInfo.java ## @@ -79,6 +81,9 @@

[GitHub] [flink] sjwiesman commented on a change in pull request #13797: [FLINK-19465][runtime / statebackends] Add CheckpointStorage interface and wire through runtime

2021-01-22 Thread GitBox
sjwiesman commented on a change in pull request #13797: URL: https://github.com/apache/flink/pull/13797#discussion_r562860032 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/rest/messages/checkpoints/CheckpointConfigInfo.java ## @@ -79,6 +81,9 @@

[GitHub] [flink] sjwiesman commented on a change in pull request #13797: [FLINK-19465][runtime / statebackends] Add CheckpointStorage interface and wire through runtime

2021-01-22 Thread GitBox
sjwiesman commented on a change in pull request #13797: URL: https://github.com/apache/flink/pull/13797#discussion_r562862511 ## File path: flink-streaming-java/src/main/java/org/apache/flink/streaming/api/graph/StreamGraphGenerator.java ## @@ -328,6 +329,7 @@ private void

[GitHub] [flink] twalthr commented on pull request #14714: [FLINK-21050][examples-table] Add some advanced function examples

2021-01-22 Thread GitBox
twalthr commented on pull request #14714: URL: https://github.com/apache/flink/pull/14714#issuecomment-765637047 Thanks for the review @sjwiesman. I agree general UDF blog post would be nice. Better examples are just the beginning ;)

[GitHub] [flink] sjwiesman commented on a change in pull request #13797: [FLINK-19465][runtime / statebackends] Add CheckpointStorage interface and wire through runtime

2021-01-22 Thread GitBox
sjwiesman commented on a change in pull request #13797: URL: https://github.com/apache/flink/pull/13797#discussion_r562860032 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/rest/messages/checkpoints/CheckpointConfigInfo.java ## @@ -79,6 +81,9 @@

[GitHub] [flink] sjwiesman commented on a change in pull request #13797: [FLINK-19465][runtime / statebackends] Add CheckpointStorage interface and wire through runtime

2021-01-22 Thread GitBox
sjwiesman commented on a change in pull request #13797: URL: https://github.com/apache/flink/pull/13797#discussion_r562856816 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/state/CheckpointStorageLoader.java ## @@ -0,0 +1,180 @@ +/* + * Licensed to the

[GitHub] [flink-web] AHeise opened a new pull request #414: Add a warning for corrupt unaligned checkpoints in 1.12 release blog post.

2021-01-22 Thread GitBox
AHeise opened a new pull request #414: URL: https://github.com/apache/flink-web/pull/414 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [flink] flinkbot edited a comment on pull request #14591: FLINK-20359 Added Owner Reference to Job Manager in native kubernetes

2021-01-22 Thread GitBox
flinkbot edited a comment on pull request #14591: URL: https://github.com/apache/flink/pull/14591#issuecomment-756825239 ## CI report: * 80ea1fb2b7987d406c153526f420e2c73834bea6 Azure:

[GitHub] [flink] sjwiesman commented on a change in pull request #13797: [FLINK-19465][runtime / statebackends] Add CheckpointStorage interface and wire through runtime

2021-01-22 Thread GitBox
sjwiesman commented on a change in pull request #13797: URL: https://github.com/apache/flink/pull/13797#discussion_r562848702 ## File path: flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/RocksDBStateBackend.java ## @@

[GitHub] [flink] sjwiesman commented on a change in pull request #13797: [FLINK-19465][runtime / statebackends] Add CheckpointStorage interface and wire through runtime

2021-01-22 Thread GitBox
sjwiesman commented on a change in pull request #13797: URL: https://github.com/apache/flink/pull/13797#discussion_r562845447 ## File path: flink-runtime/src/test/java/org/apache/flink/runtime/state/CheckpointStorageLoadingTest.java ## @@ -0,0 +1,228 @@ +/* + * Licensed to

[GitHub] [flink] flinkbot edited a comment on pull request #14719: [FLINK-21072] Refactor the SnapshotStrategy hierarchy

2021-01-22 Thread GitBox
flinkbot edited a comment on pull request #14719: URL: https://github.com/apache/flink/pull/14719#issuecomment-764631410 ## CI report: * 4197ba5c2e6681045851248a784f79b8ebf9ffdd UNKNOWN * cc6c13e40d5b3a60ad6c2df1a3a09049f1cded44 Azure:

[GitHub] [flink] sjwiesman commented on a change in pull request #13797: [FLINK-19465][runtime / statebackends] Add CheckpointStorage interface and wire through runtime

2021-01-22 Thread GitBox
sjwiesman commented on a change in pull request #13797: URL: https://github.com/apache/flink/pull/13797#discussion_r562842079 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/state/CheckpointStorageLoader.java ## @@ -0,0 +1,180 @@ +/* + * Licensed to the

[GitHub] [flink] sjwiesman commented on a change in pull request #13797: [FLINK-19465][runtime / statebackends] Add CheckpointStorage interface and wire through runtime

2021-01-22 Thread GitBox
sjwiesman commented on a change in pull request #13797: URL: https://github.com/apache/flink/pull/13797#discussion_r562841036 ## File path: flink-runtime/src/main/java/org/apache/flink/runtime/state/CheckpointStorageLoader.java ## @@ -0,0 +1,180 @@ +/* + * Licensed to the

[jira] [Updated] (FLINK-20654) Unaligned checkpoint recovery may lead to corrupted data stream

2021-01-22 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-20654: Release Note: Using unaligned checkpoints in Flink 1.12.0 combined with two/multiple inputs

[jira] [Updated] (FLINK-20654) Unaligned checkpoint recovery may lead to corrupted data stream

2021-01-22 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise updated FLINK-20654: Release Note: Using UnalignedCheckpoints in Flink 1.12.0 combined with two/multiple inputs tasks

[jira] [Resolved] (FLINK-20654) Unaligned checkpoint recovery may lead to corrupted data stream

2021-01-22 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arvid Heise resolved FLINK-20654. - Resolution: Fixed > Unaligned checkpoint recovery may lead to corrupted data stream >

[jira] [Commented] (FLINK-20654) Unaligned checkpoint recovery may lead to corrupted data stream

2021-01-22 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270361#comment-17270361 ] Arvid Heise commented on FLINK-20654: - Merged a fix into master as

[GitHub] [flink] AHeise merged pull request #14730: [FLINK-20645][network] Fix corrupted unaligned checkpoints. [1.12]

2021-01-22 Thread GitBox
AHeise merged pull request #14730: URL: https://github.com/apache/flink/pull/14730 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [flink] flinkbot edited a comment on pull request #14730: [FLINK-20645][network] Fix corrupted unaligned checkpoints. [1.12]

2021-01-22 Thread GitBox
flinkbot edited a comment on pull request #14730: URL: https://github.com/apache/flink/pull/14730#issuecomment-765430097 ## CI report: * 2e0834c84ae2d3bd5597f8f2699f597184fda9bf Azure:

[GitHub] [flink] flinkbot edited a comment on pull request #14722: [FLINK-21077] Introduce SlotPoolService to abstract SlotPool from JobMaster

2021-01-22 Thread GitBox
flinkbot edited a comment on pull request #14722: URL: https://github.com/apache/flink/pull/14722#issuecomment-764831307 ## CI report: * 4979927cd36c67a1a88f8f119a2dd9361b42d452 Azure:

[GitHub] [flink-benchmarks] pnowojski commented on pull request #7: [FLINK-20612][runtime] Add benchmarks for scheduler

2021-01-22 Thread GitBox
pnowojski commented on pull request #7: URL: https://github.com/apache/flink-benchmarks/pull/7#issuecomment-76797 Thanks for the changes @Thesharing. I haven't looked at the code at benchmarks, so it would be great if for example @zhuzhurk could review this. Besides that, the

[GitHub] [flink] flinkbot edited a comment on pull request #14635: [FLINK-19462][checkpointing] Update failed checkpoint stats

2021-01-22 Thread GitBox
flinkbot edited a comment on pull request #14635: URL: https://github.com/apache/flink/pull/14635#issuecomment-759750009 ## CI report: * 89004265ced3fe4c638a46d58dba64157fa06d08 Azure:

[jira] [Comment Edited] (FLINK-21036) Consider removing automatic configuration fo number of slots from docker

2021-01-22 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270268#comment-17270268 ] Chesnay Schepler edited comment on FLINK-21036 at 1/22/21, 4:50 PM:

[jira] [Commented] (FLINK-21036) Consider removing automatic configuration fo number of slots from docker

2021-01-22 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270268#comment-17270268 ] Chesnay Schepler commented on FLINK-21036: -- hmm...for plain docker that certainly works, but

[jira] [Updated] (FLINK-21103) E2e tests time out on azure

2021-01-22 Thread Dawid Wysakowicz (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dawid Wysakowicz updated FLINK-21103: - Description:

[jira] [Created] (FLINK-21103) E2e tests time out on azure

2021-01-22 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-21103: Summary: E2e tests time out on azure Key: FLINK-21103 URL: https://issues.apache.org/jira/browse/FLINK-21103 Project: Flink Issue Type: Bug

[GitHub] [flink] flinkbot edited a comment on pull request #14635: [FLINK-19462][checkpointing] Update failed checkpoint stats

2021-01-22 Thread GitBox
flinkbot edited a comment on pull request #14635: URL: https://github.com/apache/flink/pull/14635#issuecomment-759750009 ## CI report: * 89004265ced3fe4c638a46d58dba64157fa06d08 Azure:

[jira] [Commented] (FLINK-21036) Consider removing automatic configuration fo number of slots from docker

2021-01-22 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270262#comment-17270262 ] Till Rohrmann commented on FLINK-21036: --- This is a bit off-topic but I have to admit that I don't

[jira] [Commented] (FLINK-21008) ClusterEntrypoint#shutDownAsync may not be fully executed

2021-01-22 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270260#comment-17270260 ] Till Rohrmann commented on FLINK-21008: --- Wouldn't it work if {{ClusterEntrypoint.closeAsync()}}

[GitHub] [flink] NicoK commented on pull request #14635: [FLINK-19462][checkpointing] Update failed checkpoint stats

2021-01-22 Thread GitBox
NicoK commented on pull request #14635: URL: https://github.com/apache/flink/pull/14635#issuecomment-765514464 So, as soon as we are through the sync phase, we will get stats (if the CP is aborted during the sync phase, that won't interrupt the sync part anyway and will wait for it to

[jira] [Commented] (FLINK-21036) Consider removing automatic configuration fo number of slots from docker

2021-01-22 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270249#comment-17270249 ] Chesnay Schepler commented on FLINK-21036: -- I'd say so as well. Users can currently set either

[jira] [Assigned] (FLINK-21036) Consider removing automatic configuration fo number of slots from docker

2021-01-22 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler reassigned FLINK-21036: Assignee: Chesnay Schepler > Consider removing automatic configuration fo number

[jira] [Commented] (FLINK-21036) Consider removing automatic configuration fo number of slots from docker

2021-01-22 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270240#comment-17270240 ] Yang Wang commented on FLINK-21036: --- So maybe the existing configuration option 

[jira] [Updated] (FLINK-21045) Support 'load module' and 'unload module' SQL syntax

2021-01-22 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-21045: Fix Version/s: 1.13.0 > Support 'load module' and 'unload module' SQL syntax >

[jira] [Commented] (FLINK-20947) Unable to trigger Hive partition commit when use table sql to write data from Kafka into a Hive table

2021-01-22 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270227#comment-17270227 ] Jark Wu commented on FLINK-20947: - Hi [~weijiaxu], we have fixed this problem in master branch. Could

[jira] [Commented] (FLINK-20947) Unable to trigger Hive partition commit when use table sql to write data from Kafka into a Hive table

2021-01-22 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270226#comment-17270226 ] Jark Wu commented on FLINK-20947: - Fixed in - master: 90e680c9c579b2ffa1ca93ad7dfbaa5502dd8701 >

[GitHub] [flink] wuchong merged pull request #14679: [FLINK-20947][planner] Fix idle source doesn't work when pushing watermark into the source

2021-01-22 Thread GitBox
wuchong merged pull request #14679: URL: https://github.com/apache/flink/pull/14679 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Commented] (FLINK-21008) ClusterEntrypoint#shutDownAsync may not be fully executed

2021-01-22 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270224#comment-17270224 ] Yang Wang commented on FLINK-21008: --- After more consideration, I think it might be wrong to do the

[GitHub] [flink] flinkbot edited a comment on pull request #14635: [FLINK-19462][checkpointing] Update failed checkpoint stats

2021-01-22 Thread GitBox
flinkbot edited a comment on pull request #14635: URL: https://github.com/apache/flink/pull/14635#issuecomment-759750009 ## CI report: * 89004265ced3fe4c638a46d58dba64157fa06d08 Azure:

[jira] [Updated] (FLINK-10407) FLIP-159: Reactive mode

2021-01-22 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-10407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann updated FLINK-10407: -- Summary: FLIP-159: Reactive mode (was: Reactive mode) > FLIP-159: Reactive mode >

[jira] [Closed] (FLINK-20589) Remove old scheduling strategies

2021-01-22 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Till Rohrmann closed FLINK-20589. - Resolution: Fixed All sub tasks have been completed. Closing this ticket. New issues should go

[jira] [Commented] (FLINK-15626) Remove legacy scheduler

2021-01-22 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17270216#comment-17270216 ] Till Rohrmann commented on FLINK-15626: --- [~zhuzh] do we want to remove other parts of the legacy

[jira] [Created] (FLINK-21102) Add ScaleUpController

2021-01-22 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-21102: - Summary: Add ScaleUpController Key: FLINK-21102 URL: https://issues.apache.org/jira/browse/FLINK-21102 Project: Flink Issue Type: Sub-task

[GitHub] [flink] blublinsky edited a comment on pull request #14629: [FLINK-15656][k8s] Support pod template for native kubernetes integration

2021-01-22 Thread GitBox
blublinsky edited a comment on pull request #14629: URL: https://github.com/apache/flink/pull/14629#issuecomment-765482738 Thanks @wangyang0918, I did fix owner reference PR As for this one, its still up to the user to decide how he wants to set certain parameters - via template or

[jira] [Created] (FLINK-21101) Set up cron job to run CI with declarative scheduler

2021-01-22 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-21101: - Summary: Set up cron job to run CI with declarative scheduler Key: FLINK-21101 URL: https://issues.apache.org/jira/browse/FLINK-21101 Project: Flink Issue

[GitHub] [flink] blublinsky commented on pull request #14629: [FLINK-15656][k8s] Support pod template for native kubernetes integration

2021-01-22 Thread GitBox
blublinsky commented on pull request #14629: URL: https://github.com/apache/flink/pull/14629#issuecomment-765482738 Thanks @wangyang0918, I did fix owner reference PR As for this one, its still up to the user to decide how he wants to set certain parameters - via template or via

[jira] [Created] (FLINK-21100) Add DeclarativeScheduler skeleton

2021-01-22 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-21100: - Summary: Add DeclarativeScheduler skeleton Key: FLINK-21100 URL: https://issues.apache.org/jira/browse/FLINK-21100 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-21099) Introduce JobType to distinguish between batch and streaming jobs

2021-01-22 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-21099: - Summary: Introduce JobType to distinguish between batch and streaming jobs Key: FLINK-21099 URL: https://issues.apache.org/jira/browse/FLINK-21099 Project: Flink

  1   2   >