[jira] [Created] (FLINK-30272) Introduce a Predicate Visitor

2022-12-01 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-30272: Summary: Introduce a Predicate Visitor Key: FLINK-30272 URL: https://issues.apache.org/jira/browse/FLINK-30272 Project: Flink Issue Type: Improvement

[jira] [Updated] (FLINK-30271) Introduce Table.copy from dynamic options

2022-12-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-30271: --- Labels: pull-request-available (was: ) > Introduce Table.copy from dynamic options >

[GitHub] [flink-table-store] JingsongLi opened a new pull request, #416: [FLINK-30271] Introduce Table.copy from dynamic options

2022-12-01 Thread GitBox
JingsongLi opened a new pull request, #416: URL: https://github.com/apache/flink-table-store/pull/416 At present, our processing of dynamic options is relatively independent. In FileStoreTableFactory, this is not conducive to other engines configuring dynamic options. We should

[jira] [Created] (FLINK-30271) Introduce Table.copy from dynamic options

2022-12-01 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-30271: Summary: Introduce Table.copy from dynamic options Key: FLINK-30271 URL: https://issues.apache.org/jira/browse/FLINK-30271 Project: Flink Issue Type:

[jira] [Commented] (FLINK-30036) Force delete pod when k8s node is not ready

2022-12-01 Thread Peng Yuan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642330#comment-17642330 ] Peng Yuan commented on FLINK-30036: --- TM Pod in terminating status:

[jira] [Created] (FLINK-30270) FlinkJoinToMultiJoinRule incorrectly combines Left/Right outer join to MultiJoin

2022-12-01 Thread Yunhong Zheng (Jira)
Yunhong Zheng created FLINK-30270: - Summary: FlinkJoinToMultiJoinRule incorrectly combines Left/Right outer join to MultiJoin Key: FLINK-30270 URL: https://issues.apache.org/jira/browse/FLINK-30270

[jira] [Updated] (FLINK-30128) Introduce Azure Data Lake Gen2 APIs in the Hadoop Recoverable path

2022-12-01 Thread ramkrishna.s.vasudevan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated FLINK-30128: --- Attachment: Flink_ABFS_support_1.pdf > Introduce Azure Data Lake Gen2 APIs

[GitHub] [flink] LadyForest commented on a diff in pull request #20652: [FLINK-22315][table] Support add/modify column/constraint/watermark for ALTER TABLE statement

2022-12-01 Thread GitBox
LadyForest commented on code in PR #20652: URL: https://github.com/apache/flink/pull/20652#discussion_r1037830908 ## flink-table/flink-table-planner/src/main/java/org/apache/flink/table/planner/operations/AlterTableSchemaUtil.java: ## @@ -0,0 +1,783 @@ +/* + * Licensed to the

[jira] [Updated] (FLINK-30128) Introduce Azure Data Lake Gen2 APIs in the Hadoop Recoverable path

2022-12-01 Thread ramkrishna.s.vasudevan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated FLINK-30128: --- Attachment: (was: Flink_ABFS_support.pdf) > Introduce Azure Data Lake

[GitHub] [flink] LadyForest commented on a diff in pull request #20652: [FLINK-22315][table] Support add/modify column/constraint/watermark for ALTER TABLE statement

2022-12-01 Thread GitBox
LadyForest commented on code in PR #20652: URL: https://github.com/apache/flink/pull/20652#discussion_r1037823484 ## flink-table/flink-table-planner/src/main/java/org/apache/flink/table/planner/operations/AlterTableSchemaUtil.java: ## @@ -0,0 +1,783 @@ +/* + * Licensed to the

[GitHub] [flink-table-store] zjureel commented on a diff in pull request #415: [FLINK-30269] Validate table name for metadata table

2022-12-01 Thread GitBox
zjureel commented on code in PR #415: URL: https://github.com/apache/flink-table-store/pull/415#discussion_r1037816739 ## flink-table-store-connector/src/main/java/org/apache/flink/table/store/connector/FlinkCatalog.java: ## @@ -190,6 +191,12 @@ public void

[GitHub] [flink-table-store] zjureel commented on a diff in pull request #415: [FLINK-30269] Validate table name for metadata table

2022-12-01 Thread GitBox
zjureel commented on code in PR #415: URL: https://github.com/apache/flink-table-store/pull/415#discussion_r1037815747 ## flink-table-store-connector/src/main/java/org/apache/flink/table/store/connector/FlinkCatalog.java: ## @@ -190,6 +191,12 @@ public void

[GitHub] [flink-table-store] JingsongLi commented on a diff in pull request #415: [FLINK-30269] Validate table name for metadata table

2022-12-01 Thread GitBox
JingsongLi commented on code in PR #415: URL: https://github.com/apache/flink-table-store/pull/415#discussion_r1037812078 ## flink-table-store-connector/src/main/java/org/apache/flink/table/store/connector/FlinkCatalog.java: ## @@ -190,6 +191,12 @@ public void

[jira] [Updated] (FLINK-30269) Validate table name for metadata table

2022-12-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-30269: --- Labels: pull-request-available (was: ) > Validate table name for metadata table >

[GitHub] [flink-table-store] zjureel opened a new pull request, #415: [FLINK-30269] Validate table name for metadata table

2022-12-01 Thread GitBox
zjureel opened a new pull request, #415: URL: https://github.com/apache/flink-table-store/pull/415 Currently user can create tables `tablename` and `tablename$snapshots`, but can't insert into values into `tablename$snapshots` and execute query on it. At the same time, user can

[jira] [Updated] (FLINK-27844) Partition Evolution: Schema evolution for ManifestFileMeta

2022-12-01 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-27844: - Parent: (was: FLINK-27365) Issue Type: New Feature (was: Sub-task) > Partition

[jira] [Updated] (FLINK-27844) Partition Evolution: Schema evolution for ManifestFileMeta

2022-12-01 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-27844: - Fix Version/s: (was: table-store-0.3.0) > Partition Evolution: Schema evolution for

[jira] [Updated] (FLINK-27844) Partition Evolution: Schema evolution for ManifestFileMeta

2022-12-01 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated FLINK-27844: - Summary: Partition Evolution: Schema evolution for ManifestFileMeta (was: Schema evolution for

[jira] [Closed] (FLINK-27847) SchemaManager supports schema evolution

2022-12-01 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-27847. Resolution: Fixed master: 36ed2c37201cabea3779dcb95b9a425f03a80d8e > SchemaManager supports

[GitHub] [flink-table-store] JingsongLi merged pull request #347: [FLINK-27847] Support rename/drop column in SchemaManager

2022-12-01 Thread GitBox
JingsongLi merged PR #347: URL: https://github.com/apache/flink-table-store/pull/347 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Created] (FLINK-30269) Validate table name for metadata table

2022-12-01 Thread Shammon (Jira)
Shammon created FLINK-30269: --- Summary: Validate table name for metadata table Key: FLINK-30269 URL: https://issues.apache.org/jira/browse/FLINK-30269 Project: Flink Issue Type: Sub-task

[jira] [Commented] (FLINK-30128) Introduce Azure Data Lake Gen2 APIs in the Hadoop Recoverable path

2022-12-01 Thread ramkrishna.s.vasudevan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642287#comment-17642287 ] ramkrishna.s.vasudevan commented on FLINK-30128: Attaching a simple diagram that talks

[jira] [Updated] (FLINK-30128) Introduce Azure Data Lake Gen2 APIs in the Hadoop Recoverable path

2022-12-01 Thread ramkrishna.s.vasudevan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ramkrishna.s.vasudevan updated FLINK-30128: --- Attachment: Flink_ABFS_support.pdf > Introduce Azure Data Lake Gen2 APIs in

[GitHub] [flink-table-store] zjureel commented on pull request #347: [FLINK-27847] Support rename/drop column in SchemaManager

2022-12-01 Thread GitBox
zjureel commented on PR #347: URL: https://github.com/apache/flink-table-store/pull/347#issuecomment-1334767791 Hi @JingsongLi DONE -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Updated] (FLINK-30255) Throw exception for upper case fields are used in hive metastore

2022-12-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-30255: --- Labels: pull-request-available (was: ) > Throw exception for upper case fields are used in

[GitHub] [flink-table-store] zjureel commented on pull request #413: [FLINK-30255] Throw exception when names are upper case in HiveCatalog

2022-12-01 Thread GitBox
zjureel commented on PR #413: URL: https://github.com/apache/flink-table-store/pull/413#issuecomment-1334767311 Hi @JingsongLi Can you help to review this PR? THX -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [flink] 1996fanrui commented on pull request #21420: [FLINK-30239][rest] Fix the problem that FlameGraph cannot be generated due to using ImmutableSet incorrectly

2022-12-01 Thread GitBox
1996fanrui commented on PR #21420: URL: https://github.com/apache/flink/pull/21420#issuecomment-1334741798 Hi @xintongsong , this is a bug about flame graph and it's caused by #19228 [FLINK-26074]. The flame graph doesn't work due this bug after flink 1.16, please help take a look

[GitHub] [flink-ml] jiangxin369 commented on a diff in pull request #187: [FLINK-29601] Add Estimator and Transformer for UnivariateFeatureSelector

2022-12-01 Thread GitBox
jiangxin369 commented on code in PR #187: URL: https://github.com/apache/flink-ml/pull/187#discussion_r1037760329 ## docs/content/docs/operators/feature/univariategeatureselector.md: ## @@ -0,0 +1,220 @@ +--- +title: "Univariate Feature Selector" +weight: 1 +type: docs

[jira] [Updated] (FLINK-30263) Introduce schemas meta table

2022-12-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-30263: --- Labels: pull-request-available (was: ) > Introduce schemas meta table >

[GitHub] [flink-table-store] zjureel opened a new pull request, #414: [FLINK-30263] Introduce schemas table in table store

2022-12-01 Thread GitBox
zjureel opened a new pull request, #414: URL: https://github.com/apache/flink-table-store/pull/414 Introduce schemas table in table store, user can query historical schemas of table through sql: SELECT * FROM Table$schemas -- This is an automated message from the Apache Git Service. To

[jira] [Closed] (FLINK-29809) REST API for running a Flink job

2022-12-01 Thread Zhu Zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhu Zhu closed FLINK-29809. --- Resolution: Invalid > REST API for running a Flink job > > >

[GitHub] [flink-table-store] JingsongLi commented on a diff in pull request #347: [FLINK-27847] Support rename/drop column in SchemaManager

2022-12-01 Thread GitBox
JingsongLi commented on code in PR #347: URL: https://github.com/apache/flink-table-store/pull/347#discussion_r1036924742 ## flink-table-store-core/src/main/java/org/apache/flink/table/store/file/schema/SchemaManager.java: ## @@ -221,6 +217,52 @@ public TableSchema

[GitHub] [flink] maosuhan commented on a diff in pull request #21436: [FLINK-30093] [formats] Protobuf Timestamp Compile Error

2022-12-01 Thread GitBox
maosuhan commented on code in PR #21436: URL: https://github.com/apache/flink/pull/21436#discussion_r1037743338 ## flink-formats/flink-protobuf/src/test/java/org/apache/flink/formats/protobuf/Pb3ToRowTest.java: ## @@ -85,6 +88,8 @@ public void testDeserialization() throws

[jira] [Closed] (FLINK-27341) TaskManager running together with JobManager are bind to 127.0.0.1

2022-12-01 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao closed FLINK-27341. --- Resolution: Fixed > TaskManager running together with JobManager are bind to 127.0.0.1 >

[jira] [Commented] (FLINK-27341) TaskManager running together with JobManager are bind to 127.0.0.1

2022-12-01 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642246#comment-17642246 ] Yun Gao commented on FLINK-27341: - Merged on master via fc5e8bacef34119579defca6256476482da523f9 Merged

[jira] [Updated] (FLINK-27341) TaskManager running together with JobManager are bind to 127.0.0.1

2022-12-01 Thread Yun Gao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-27341: Fix Version/s: 1.17.0 1.16.1 1.15.4 > TaskManager running together

[jira] [Commented] (FLINK-30251) Move the IO with DFS during abort checkpoint to an asynchronous thread.

2022-12-01 Thread Yanfei Lei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642245#comment-17642245 ] Yanfei Lei commented on FLINK-30251: Thanks for the proposal, this helps reduce the time blocked

[GitHub] [flink] gaoyunhaii closed pull request #21422: [1.16] [FLINK-27341][runtime] Remove LOOPBACK from TaskManager findConnectingAddress.

2022-12-01 Thread GitBox
gaoyunhaii closed pull request #21422: [1.16] [FLINK-27341][runtime] Remove LOOPBACK from TaskManager findConnectingAddress. URL: https://github.com/apache/flink/pull/21422 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [flink] gaoyunhaii closed pull request #21423: [1.15] [FLINK-27341][runtime] Remove LOOPBACK from TaskManager findConnectingAddress.

2022-12-01 Thread GitBox
gaoyunhaii closed pull request #21423: [1.15] [FLINK-27341][runtime] Remove LOOPBACK from TaskManager findConnectingAddress. URL: https://github.com/apache/flink/pull/21423 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [flink] syhily closed pull request #21206: [FLINK-28082][Connector/Pulsar] Add end-to-end encryption support for Pulsar connector.

2022-12-01 Thread GitBox
syhily closed pull request #21206: [FLINK-28082][Connector/Pulsar] Add end-to-end encryption support for Pulsar connector. URL: https://github.com/apache/flink/pull/21206 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [flink] gaoyunhaii closed pull request #21319: [FLINK-27341][runtime] Remove LOOPBACK from TaskManager findConnectingAddress.

2022-12-01 Thread GitBox
gaoyunhaii closed pull request #21319: [FLINK-27341][runtime] Remove LOOPBACK from TaskManager findConnectingAddress. URL: https://github.com/apache/flink/pull/21319 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Commented] (FLINK-28177) Elasticsearch6DynamicSinkITCase.testWritingDocumentsNoPrimaryKey failed with 503 Service Unavailable

2022-12-01 Thread KurtDing (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642242#comment-17642242 ] KurtDing commented on FLINK-28177: -- Sorry for a late response. I will check this issue today  >

[GitHub] [flink] maosuhan commented on pull request #21436: [FLINK-30093] [formats] Protobuf Timestamp Compile Error

2022-12-01 Thread GitBox
maosuhan commented on PR #21436: URL: https://github.com/apache/flink/pull/21436#issuecomment-1334684715 @hdulay Thanks for raising this issue and your fix PR. I will help to review this PR. cc @MartijnVisser -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [flink] luoyuxia commented on a diff in pull request #20377: [FLINK-27338][hive] Improve splitting file for Hive table with orc format

2022-12-01 Thread GitBox
luoyuxia commented on code in PR #20377: URL: https://github.com/apache/flink/pull/20377#discussion_r1037725058 ## flink-connectors/flink-connector-hive/src/main/java/org/apache/flink/connectors/hive/HiveSourceFileEnumerator.java: ## @@ -76,10 +98,68 @@ public static List

[GitHub] [flink] luoyuxia commented on a diff in pull request #20377: [FLINK-27338][hive] Improve splitting file for Hive table with orc format

2022-12-01 Thread GitBox
luoyuxia commented on code in PR #20377: URL: https://github.com/apache/flink/pull/20377#discussion_r1037727995 ## docs/content.zh/docs/connectors/table/hive/hive_read_write.md: ## @@ -150,6 +150,41 @@ Flink 允许你灵活的配置并发推断策略。你可以在 `TableConfig` +### 读 Hive 表时调整数据分片(Split)

[GitHub] [flink] luoyuxia commented on a diff in pull request #20377: [FLINK-27338][hive] Improve splitting file for Hive table with orc format

2022-12-01 Thread GitBox
luoyuxia commented on code in PR #20377: URL: https://github.com/apache/flink/pull/20377#discussion_r1037725058 ## flink-connectors/flink-connector-hive/src/main/java/org/apache/flink/connectors/hive/HiveSourceFileEnumerator.java: ## @@ -76,10 +98,68 @@ public static List

[GitHub] [flink] syhily commented on pull request #21411: [BP-1.16][FLINK-29830][Connector/Pulsar] Create the topic with schema before consuming messages in PulsarSinkITCase. (#21252)

2022-12-01 Thread GitBox
syhily commented on PR #21411: URL: https://github.com/apache/flink/pull/21411#issuecomment-1334672389 This LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [flink] luoyuxia commented on a diff in pull request #20016: [FLINK-27857][hive] HiveSource supports filter push down for orc format

2022-12-01 Thread GitBox
luoyuxia commented on code in PR #20016: URL: https://github.com/apache/flink/pull/20016#discussion_r1037722863 ## flink-connectors/flink-connector-hive/src/main/java/org/apache/flink/connectors/hive/HiveTableSource.java: ## @@ -257,6 +279,12 @@ public void

[GitHub] [flink-table-store] JingsongLi commented on pull request #411: [FLINK-30207] Move split initialization and discovery logic fully into SnapshotEnumerator in Table Store

2022-12-01 Thread GitBox
JingsongLi commented on PR #411: URL: https://github.com/apache/flink-table-store/pull/411#issuecomment-1334666512 Do you think we should have an enumerator for static (batch) too? For example, for the current read-compacted, time traveling may specify the commit time to read snapshots

[jira] [Updated] (FLINK-28645) Clean up logging in FlinkService / Reconciler

2022-12-01 Thread Matyas Orhidi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matyas Orhidi updated FLINK-28645: -- Fix Version/s: kubernetes-operator-1.4.0 (was:

[jira] [Updated] (FLINK-27448) Enable standalone mode for old Flink versions

2022-12-01 Thread Matyas Orhidi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matyas Orhidi updated FLINK-27448: -- Fix Version/s: kubernetes-operator-1.4.0 (was:

[jira] [Updated] (FLINK-30268) HA metadata and other cluster submission related errors should not throw DeploymentFailedException

2022-12-01 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora updated FLINK-30268: --- Issue Type: Bug (was: Improvement) > HA metadata and other cluster submission related errors

[jira] [Created] (FLINK-30268) HA metadata and other cluster submission related errors should not throw DeploymentFailedException

2022-12-01 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-30268: -- Summary: HA metadata and other cluster submission related errors should not throw DeploymentFailedException Key: FLINK-30268 URL: https://issues.apache.org/jira/browse/FLINK-30268

[GitHub] [flink-kubernetes-operator] gyfora commented on pull request #458: [FLINK-27852] Add OLM bundle generator

2022-12-01 Thread GitBox
gyfora commented on PR #458: URL: https://github.com/apache/flink-kubernetes-operator/pull/458#issuecomment-1334479821 cc @gaborgsomogyi -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Commented] (FLINK-30119) Breaking change: Flink Kubernetes Operator should store last savepoint in the SavepointInfo.lastSavepoint field whether it is completed or pending

2022-12-01 Thread Clara Xiong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642168#comment-17642168 ] Clara Xiong commented on FLINK-30119: - This is a breaking change: * Existing application using

[jira] [Updated] (FLINK-30119) Breaking change: Flink Kubernetes Operator should store last savepoint in the SavepointInfo.lastSavepoint field whether it is completed or pending

2022-12-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-30119: --- Labels: pull-request-available (was: ) > Breaking change: Flink Kubernetes Operator should

[GitHub] [flink-kubernetes-operator] clarax opened a new pull request, #463: [FLINK-30119] Breaking change: Flink Kubernetes Operator should store…

2022-12-01 Thread GitBox
clarax opened a new pull request, #463: URL: https://github.com/apache/flink-kubernetes-operator/pull/463 … last savepoint in the SavepointInfo.lastSavepoint field whether it is completed or pending ## What is the purpose of the change End user experience proposal:

[jira] [Commented] (FLINK-30119) Breaking change: Flink Kubernetes Operator should store last savepoint in the SavepointInfo.lastSavepoint field whether it is completed or pending

2022-12-01 Thread Clara Xiong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642162#comment-17642162 ] Clara Xiong commented on FLINK-30119: - Updating the title to reflect the fact this could break

[jira] [Updated] (FLINK-30119) Breaking change: Flink Kubernetes Operator should store last savepoint in the SavepointInfo.lastSavepoint field whether it is completed or pending

2022-12-01 Thread Clara Xiong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Clara Xiong updated FLINK-30119: Summary: Breaking change: Flink Kubernetes Operator should store last savepoint in the

[jira] [Commented] (FLINK-30266) Recovery reconciliation loop fails if no checkpoint has been created yet

2022-12-01 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642133#comment-17642133 ] Thomas Weise commented on FLINK-30266: -- I believe this was discussed before and the reason we

[GitHub] [flink-kubernetes-operator] jbusche commented on pull request #420: FLINK-29536 - Add WATCH_NAMESPACE env var to operator

2022-12-01 Thread GitBox
jbusche commented on PR #420: URL: https://github.com/apache/flink-kubernetes-operator/pull/420#issuecomment-1334199315 Hi @tagarr @morhidi @tedhtchang I've tested Tony's PR. With a helm install, it acts as before, no change in behavior. ``` oc logs -f

[GitHub] [flink] rmetzger commented on pull request #21266: [FLINK-29940] ExecutionGraph logs job state change at ERROR level when job fails

2022-12-01 Thread GitBox
rmetzger commented on PR #21266: URL: https://github.com/apache/flink/pull/21266#issuecomment-1334179714 Sry that I didn't react. I'll take a look at the Jira. I recently wondered about the log level there as well. -- This is an automated message from the Apache Git Service. To respond

[jira] [Updated] (FLINK-30266) Recovery reconciliation loop fails if no checkpoint has been created yet

2022-12-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-30266: --- Labels: pull-request-available (was: ) > Recovery reconciliation loop fails if no

[GitHub] [flink-kubernetes-operator] gyfora opened a new pull request, #462: [FLINK-30266] Roll back change to HA metadata check logic

2022-12-01 Thread GitBox
gyfora opened a new pull request, #462: URL: https://github.com/apache/flink-kubernetes-operator/pull/462 ## What is the purpose of the change Revert an "improvement" to the HA metadata checking logic that actually only causes problems. In this case it did not allow jobs to recover

[jira] [Commented] (FLINK-30081) Local executor can not accept different jvm-overhead.min/max values

2022-12-01 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642100#comment-17642100 ] Mingliang Liu commented on FLINK-30081: --- Thanks [~gaoyunhaii] It makes perfect sense to me now

[jira] [Closed] (FLINK-29928) Allow sharing (RocksDB) memory between slots

2022-12-01 Thread Roman Khachatryan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Khachatryan closed FLINK-29928. - Release Note: Added new config parameters: - state.backend.rocksdb.memory.fixed-per-tm

[GitHub] [flink] rkhachatryan commented on pull request #21264: [FLINK-29928][runtime, state] Share RocksDB memory across TM slots

2022-12-01 Thread GitBox
rkhachatryan commented on PR #21264: URL: https://github.com/apache/flink/pull/21264#issuecomment-1334144107 Thanks for the review! Merged into master as 3b6d08e57f644cddcdac1fb5a110d44172652c3a. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [flink] rkhachatryan merged pull request #21264: [FLINK-29928][runtime, state] Share RocksDB memory across TM slots

2022-12-01 Thread GitBox
rkhachatryan merged PR #21264: URL: https://github.com/apache/flink/pull/21264 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (FLINK-27246) Code of method "processElement(Lorg/apache/flink/streaming/runtime/streamrecord/StreamRecord;)V" of class "HashAggregateWithKeys$9211" grows beyond 64 KB

2022-12-01 Thread Krzysztof Chmielewski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642072#comment-17642072 ] Krzysztof Chmielewski commented on FLINK-27246: --- [~TsReaper] I would love for your

[jira] [Comment Edited] (FLINK-27246) Code of method "processElement(Lorg/apache/flink/streaming/runtime/streamrecord/StreamRecord;)V" of class "HashAggregateWithKeys$9211" grows beyond 64 KB

2022-12-01 Thread Krzysztof Chmielewski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642072#comment-17642072 ] Krzysztof Chmielewski edited comment on FLINK-27246 at 12/1/22 5:42 PM:

[GitHub] [flink] liuml07 closed pull request #21266: [FLINK-29940] ExecutionGraph logs job state change at ERROR level when job fails

2022-12-01 Thread GitBox
liuml07 closed pull request #21266: [FLINK-29940] ExecutionGraph logs job state change at ERROR level when job fails URL: https://github.com/apache/flink/pull/21266 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [flink] liuml07 commented on pull request #21266: [FLINK-29940] ExecutionGraph logs job state change at ERROR level when job fails

2022-12-01 Thread GitBox
liuml07 commented on PR #21266: URL: https://github.com/apache/flink/pull/21266#issuecomment-1334119366 [JIRA](https://issues.apache.org/jira/browse/FLINK-29940?focusedCommentId=17641758=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-17641758) was closed by PMC

[jira] [Commented] (FLINK-29940) ExecutionGraph logs job state change at ERROR level when job fails

2022-12-01 Thread Mingliang Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642069#comment-17642069 ] Mingliang Liu commented on FLINK-29940: --- Yes we now search for "switched from RUNNING to FAILED"

[jira] [Updated] (FLINK-30266) Recovery reconciliation loop fails if no checkpoint has been created yet

2022-12-01 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora updated FLINK-30266: --- Priority: Blocker (was: Major) > Recovery reconciliation loop fails if no checkpoint has been

[jira] [Updated] (FLINK-30266) Recovery reconciliation loop fails if no checkpoint has been created yet

2022-12-01 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora updated FLINK-30266: --- Fix Version/s: kubernetes-operator-1.3.0 > Recovery reconciliation loop fails if no checkpoint has

[jira] [Commented] (FLINK-29801) OperatorCoordinator need open the way to operate metricGroup interface

2022-12-01 Thread Steven Zhen Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642050#comment-17642050 ] Steven Zhen Wu commented on FLINK-29801: @ruanhang1993 I am not sure if `numEventsIn` is a very

[GitHub] [flink-kubernetes-operator] gaborgsomogyi commented on pull request #461: DO_NOT_MERGE just testing old code

2022-12-01 Thread GitBox
gaborgsomogyi commented on PR #461: URL: https://github.com/apache/flink-kubernetes-operator/pull/461#issuecomment-1334044708 I've had a look at Flink side as well and seems like there is a general infra issue so closing. -- This is an automated message from the Apache Git Service. To

[GitHub] [flink-kubernetes-operator] gaborgsomogyi closed pull request #461: DO_NOT_MERGE just testing old code

2022-12-01 Thread GitBox
gaborgsomogyi closed pull request #461: DO_NOT_MERGE just testing old code URL: https://github.com/apache/flink-kubernetes-operator/pull/461 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Commented] (FLINK-30267) PyFlink YARN per-job on Docker test failed because it could not build hadoop image

2022-12-01 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642036#comment-17642036 ] Gabor Somogyi commented on FLINK-30267: --- It builds locally + the following error tells me that

[jira] [Commented] (FLINK-30267) PyFlink YARN per-job on Docker test failed because it could not build hadoop image

2022-12-01 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642035#comment-17642035 ] Gabor Somogyi commented on FLINK-30267: --- Seems like there is a generic infra issue. In the

[GitHub] [flink-kubernetes-operator] gaborgsomogyi commented on pull request #461: DO_NOT_MERGE just testing old code

2022-12-01 Thread GitBox
gaborgsomogyi commented on PR #461: URL: https://github.com/apache/flink-kubernetes-operator/pull/461#issuecomment-1334000633 Not sure what's the issue but seems like the infra is not stable: ``` failed to solve with frontend dockerfile.v0: failed to create LLB definition: failed to

[jira] [Commented] (FLINK-27944) IO metrics collision happens if a task has union inputs

2022-12-01 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642032#comment-17642032 ] Piotr Nowojski commented on FLINK-27944: Thanks! Merged to release 1.15 as dd3c3473a85^ and

[jira] [Closed] (FLINK-27944) IO metrics collision happens if a task has union inputs

2022-12-01 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski closed FLINK-27944. -- Resolution: Fixed > IO metrics collision happens if a task has union inputs >

[GitHub] [flink] pnowojski merged pull request #21439: [BP-1.15][FLINK-27944] Input channel metric will no longer be registered multiple times

2022-12-01 Thread GitBox
pnowojski merged PR #21439: URL: https://github.com/apache/flink/pull/21439 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink-kubernetes-operator] gaborgsomogyi closed pull request #447: DO_NOT_MERGE [FLINK-30151] Remove AuditUtils from operator error

2022-12-01 Thread GitBox
gaborgsomogyi closed pull request #447: DO_NOT_MERGE [FLINK-30151] Remove AuditUtils from operator error URL: https://github.com/apache/flink-kubernetes-operator/pull/447 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [flink-kubernetes-operator] gaborgsomogyi commented on pull request #447: DO_NOT_MERGE [FLINK-30151] Remove AuditUtils from operator error

2022-12-01 Thread GitBox
gaborgsomogyi commented on PR #447: URL: https://github.com/apache/flink-kubernetes-operator/pull/447#issuecomment-1333983990 Now not having time to push this so closing temporarily. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Commented] (FLINK-30267) PyFlink YARN per-job on Docker test failed because it could not build hadoop image

2022-12-01 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642020#comment-17642020 ] Martijn Visser commented on FLINK-30267: [~gsomogyi] [~gaborgsomogyi] Can you take a look? >

[jira] [Created] (FLINK-30267) PyFlink YARN per-job on Docker test failed because it could not build hadoop image

2022-12-01 Thread Martijn Visser (Jira)
Martijn Visser created FLINK-30267: -- Summary: PyFlink YARN per-job on Docker test failed because it could not build hadoop image Key: FLINK-30267 URL: https://issues.apache.org/jira/browse/FLINK-30267

[jira] [Updated] (FLINK-30267) PyFlink YARN per-job on Docker test failed because it could not build hadoop image

2022-12-01 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martijn Visser updated FLINK-30267: --- Priority: Critical (was: Major) > PyFlink YARN per-job on Docker test failed because it

[GitHub] [flink-docker] mbalassi merged pull request #146: [FLINK-27671] Add arm support for snapshot docker images

2022-12-01 Thread GitBox
mbalassi merged PR #146: URL: https://github.com/apache/flink-docker/pull/146 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink-docker] mbalassi opened a new pull request, #146: [FLINK-27671] Add arm support for snapshot docker images

2022-12-01 Thread GitBox
mbalassi opened a new pull request, #146: URL: https://github.com/apache/flink-docker/pull/146 Here is a successful run on my fork: https://github.com/mbalassi/flink-docker/actions/runs/3593973278/jobs/6051630896 -- This is an automated message from the Apache Git Service. To respond

[GitHub] [flink-docker] mbalassi merged pull request #145: [FLINK-27671] Add arm support for snapshot docker images

2022-12-01 Thread GitBox
mbalassi merged PR #145: URL: https://github.com/apache/flink-docker/pull/145 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink-docker] mbalassi opened a new pull request, #145: [FLINK-27671] Add arm support for snapshot docker images

2022-12-01 Thread GitBox
mbalassi opened a new pull request, #145: URL: https://github.com/apache/flink-docker/pull/145 Just the docker bake file, GHA is on the master branch. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Commented] (FLINK-27836) RocksDBMapState iteration may stop too early for var-length prefixes

2022-12-01 Thread Nico Kruber (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642013#comment-17642013 ] Nico Kruber commented on FLINK-27836: - Unfortunately, it's not that simple because Flink doesn't

[GitHub] [flink-docker] mbalassi merged pull request #144: [FLINK-27671] Add arm support for snapshot docker images

2022-12-01 Thread GitBox
mbalassi merged PR #144: URL: https://github.com/apache/flink-docker/pull/144 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink-docker] mbalassi opened a new pull request, #144: [FLINK-27671] Add arm support for snapshot docker images

2022-12-01 Thread GitBox
mbalassi opened a new pull request, #144: URL: https://github.com/apache/flink-docker/pull/144 Just the docker bake file, GHA is on the master branch. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [flink-docker] mbalassi merged pull request #143: [FLINK-27671] Add arm support for snapshot docker images

2022-12-01 Thread GitBox
mbalassi merged PR #143: URL: https://github.com/apache/flink-docker/pull/143 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink-docker] mbalassi opened a new pull request, #143: [FLINK-27671] Add arm support for snapshot docker images

2022-12-01 Thread GitBox
mbalassi opened a new pull request, #143: URL: https://github.com/apache/flink-docker/pull/143 Just the docker bake file, GHA is on the master branch. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Commented] (FLINK-29836) PulsarUnorderedSourceITCase failed due to an expected job restart not happening

2022-12-01 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17642011#comment-17642011 ] Martijn Visser commented on FLINK-29836:

[GitHub] [flink] XComp commented on a diff in pull request #21368: [FLINK-30165][runtime][JUnit5 Migration] Migrate unaligned checkpoint related tests under flink-runtime module to junit5

2022-12-01 Thread GitBox
XComp commented on code in PR #21368: URL: https://github.com/apache/flink/pull/21368#discussion_r1037196683 ## flink-runtime/src/test/java/org/apache/flink/runtime/checkpoint/channel/ChannelStateWriterImplTest.java: ## @@ -36,52 +35,49 @@ import static

  1   2   3   >