[GitHub] [flink] flinkbot commented on pull request #21970: [FLINK-31041][runtime] Fix multiple restoreState when GlobalFailure occurs in a short period.

2023-02-19 Thread via GitHub
flinkbot commented on PR #21970: URL: https://github.com/apache/flink/pull/21970#issuecomment-1436498806 ## CI report: * 4c52486daaedac91df70f06ed39adc0d7625fd84 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] flinkbot commented on pull request #21969: [FLINK-30948][Formats/AWS] Remove GlueSchemaRegistry Avro and JSON fo…

2023-02-19 Thread via GitHub
flinkbot commented on PR #21969: URL: https://github.com/apache/flink/pull/21969#issuecomment-1436498684 ## CI report: * 17c5c2be3017e934870ebdacef583a4c00ddc6c7 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] JunRuiLee commented on a diff in pull request #21963: [FLINK-31114][runtime] Allow different parallelism of multiple downstream job vertices in dynamic graph

2023-02-19 Thread via GitHub
JunRuiLee commented on code in PR #21963: URL: https://github.com/apache/flink/pull/21963#discussion_r580649 ## flink-runtime/src/main/java/org/apache/flink/runtime/executiongraph/IntermediateResult.java: ## @@ -175,35 +175,28 @@ int getNumParallelProducers() {

[GitHub] [flink] huwh commented on pull request #21970: [FLINK-31041][runtime] Fix multiple restoreState when GlobalFailure occurs in a short period.

2023-02-19 Thread via GitHub
huwh commented on PR #21970: URL: https://github.com/apache/flink/pull/21970#issuecomment-1436495616 @zhuzhurk Please help review the code. thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [flink] huwh opened a new pull request, #21970: [FLINK-31041][runtime] Fix multiple restoreState when GlobalFailure occurs in a short period.

2023-02-19 Thread via GitHub
huwh opened a new pull request, #21970: URL: https://github.com/apache/flink/pull/21970 ## What is the purpose of the change This pull request allows DefaultScheduler to skip the restoreState which is a heavy invocation when no task needs to be restarted. ## Brief change log

[GitHub] [flink] hlteoh37 opened a new pull request, #21969: [FLINK-30948][Formats/AWS] Remove GlueSchemaRegistry Avro and JSON fo…

2023-02-19 Thread via GitHub
hlteoh37 opened a new pull request, #21969: URL: https://github.com/apache/flink/pull/21969 …rmats from main repository ## What is the purpose of the change Externalize the GlueSchemaRegistry Avro and JSON formats to flink-connectors-aws

[GitHub] [flink] flinkbot commented on pull request #21968: [FLINK-31123][connector/files] Add IT cases for FileSink speculative …

2023-02-19 Thread via GitHub
flinkbot commented on PR #21968: URL: https://github.com/apache/flink/pull/21968#issuecomment-1436489480 ## CI report: * 3bd80c18f4629e8554e039b4eb6a7a21f0424ae0 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-31123) Add it case for FileSink speculative execution

2023-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-31123: --- Labels: pull-request-available (was: ) > Add it case for FileSink speculative execution >

[GitHub] [flink] Rruop opened a new pull request, #21968: [FLINK-31123][connector/files] Add IT cases for FileSink speculative …

2023-02-19 Thread via GitHub
Rruop opened a new pull request, #21968: URL: https://github.com/apache/flink/pull/21968 …execution ## What is the purpose of the change *(For example: This pull request makes task deployment go through the blob server, rather than through RPC. That way we avoid

[GitHub] [flink] zhuzhurk commented on a diff in pull request #21943: [FLINK-31077][runtime] Mark pending checkpoint onCompletionPromise complete only after the completed checkpoint is added to the st

2023-02-19 Thread via GitHub
zhuzhurk commented on code in PR #21943: URL: https://github.com/apache/flink/pull/21943#discussion_r563249 ## flink-runtime/src/main/java/org/apache/flink/runtime/checkpoint/CheckpointCoordinator.java: ## @@ -1373,6 +1371,7 @@ private void cleanupAfterCompletedCheckpoint(

[GitHub] [flink] flinkbot commented on pull request #21967: [FLINK-31130][doc] Improve version info shown in the doc of SQL Gateway

2023-02-19 Thread via GitHub
flinkbot commented on PR #21967: URL: https://github.com/apache/flink/pull/21967#issuecomment-1436471565 ## CI report: * 12a89f7f6824db8d9a3b86926c024d7f5f74fe44 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-31130) Improve version info shown in the doc of SQL Gateway

2023-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-31130: --- Labels: pull-request-available (was: ) > Improve version info shown in the doc of SQL

[GitHub] [flink] luoyuxia opened a new pull request, #21967: [FLINK-31130][doc] Improve version info shown in the doc of SQL Gateway

2023-02-19 Thread via GitHub
luoyuxia opened a new pull request, #21967: URL: https://github.com/apache/flink/pull/21967 ## What is the purpose of the change To improve version info shown in the doc of SQL Gateway. It should change with the flink version instead of a constant value `1.16-SNAPSHOT`.

[jira] [Commented] (FLINK-30938) Release Testing: Verify FLINK-29766 Adaptive Batch Scheduler should also work with hybrid shuffle mode

2023-02-19 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691031#comment-17691031 ] Weijie Guo commented on FLINK-30938: Through offline communication, unassigned [~xuzifu] as he has

[jira] [Assigned] (FLINK-30938) Release Testing: Verify FLINK-29766 Adaptive Batch Scheduler should also work with hybrid shuffle mode

2023-02-19 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo reassigned FLINK-30938: -- Assignee: Yufan Sheng (was: Weijie Guo) > Release Testing: Verify FLINK-29766 Adaptive

[jira] [Assigned] (FLINK-30938) Release Testing: Verify FLINK-29766 Adaptive Batch Scheduler should also work with hybrid shuffle mode

2023-02-19 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo reassigned FLINK-30938: -- Assignee: Weijie Guo (was: xy) > Release Testing: Verify FLINK-29766 Adaptive Batch

[jira] [Updated] (FLINK-31130) Improve version info shown in the doc of SQL Gateway

2023-02-19 Thread luoyuxia (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luoyuxia updated FLINK-31130: - Summary: Improve version info shown in the doc of SQL Gateway (was: Improve version info for the doc

[jira] [Created] (FLINK-31130) Improve version info for the doc of SQL Gateway

2023-02-19 Thread luoyuxia (Jira)
luoyuxia created FLINK-31130: Summary: Improve version info for the doc of SQL Gateway Key: FLINK-31130 URL: https://issues.apache.org/jira/browse/FLINK-31130 Project: Flink Issue Type:

[GitHub] [flink] fsk119 commented on a diff in pull request #21959: [hotfix][doc] Fix documentation of table's configuration option 'table.exec.sink.keyed-shuffle' in ExecutionConfigOptions

2023-02-19 Thread via GitHub
fsk119 commented on code in PR #21959: URL: https://github.com/apache/flink/pull/21959#discussion_r528130 ## flink-table/flink-table-api-java/src/main/java/org/apache/flink/table/api/config/ExecutionConfigOptions.java: ## @@ -160,7 +160,7 @@ public class

[jira] [Commented] (FLINK-31112) How to Change the default mode of the volume attached to flink-config-volume in a pod on Flink native Kubernetes

2023-02-19 Thread Weihua Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691024#comment-17691024 ] Weihua Hu commented on FLINK-31112: --- The Flink pod will only run TM/JM processes internally, no other

[jira] [Updated] (FLINK-30951) Release Testing: Verify FLINK-29635 Hive sink should support merge files in batch mode

2023-02-19 Thread luoyuxia (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] luoyuxia updated FLINK-30951: - Description: The issue aims to verfiy FLINK-29635. Please verify in batch mode, the document is in

[GitHub] [flink] fsk119 commented on a diff in pull request #21945: [FLINK-31091][Table SQL/Client] Add Ser/de for Interval types

2023-02-19 Thread via GitHub
fsk119 commented on code in PR #21945: URL: https://github.com/apache/flink/pull/21945#discussion_r508444 ## flink-table/flink-sql-gateway/src/main/java/org/apache/flink/table/gateway/rest/serde/LogicalTypeJsonSerializer.java: ## @@ -87,6 +89,10 @@ public final class

[jira] [Commented] (FLINK-30936) Release Testing: Verify FLINK-29941 Support SQL Client connects to SQL Gateway

2023-02-19 Thread luoyuxia (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691023#comment-17691023 ] luoyuxia commented on FLINK-30936: -- Verify embedded mode: 1: try with different CLI parameters such as

[jira] [Comment Edited] (FLINK-31062) Release Testing: Verify FLINK-30365 New dynamic partition pruning strategy to support more dpp patterns

2023-02-19 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691022#comment-17691022 ] Weijie Guo edited comment on FLINK-31062 at 2/20/23 6:39 AM: - Thanks

[jira] [Comment Edited] (FLINK-31062) Release Testing: Verify FLINK-30365 New dynamic partition pruning strategy to support more dpp patterns

2023-02-19 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691022#comment-17691022 ] Weijie Guo edited comment on FLINK-31062 at 2/20/23 6:38 AM: - Thanks

[jira] [Comment Edited] (FLINK-31062) Release Testing: Verify FLINK-30365 New dynamic partition pruning strategy to support more dpp patterns

2023-02-19 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691022#comment-17691022 ] Weijie Guo edited comment on FLINK-31062 at 2/20/23 6:36 AM: - Thanks

[jira] [Comment Edited] (FLINK-31062) Release Testing: Verify FLINK-30365 New dynamic partition pruning strategy to support more dpp patterns

2023-02-19 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691022#comment-17691022 ] Weijie Guo edited comment on FLINK-31062 at 2/20/23 6:35 AM: - Thanks

[jira] [Comment Edited] (FLINK-31062) Release Testing: Verify FLINK-30365 New dynamic partition pruning strategy to support more dpp patterns

2023-02-19 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691022#comment-17691022 ] Weijie Guo edited comment on FLINK-31062 at 2/20/23 6:35 AM: - Thanks

[jira] [Updated] (FLINK-31062) Release Testing: Verify FLINK-30365 New dynamic partition pruning strategy to support more dpp patterns

2023-02-19 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31062?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-31062: --- Attachment: dpp-test-result > Release Testing: Verify FLINK-30365 New dynamic partition pruning

[jira] [Commented] (FLINK-31062) Release Testing: Verify FLINK-30365 New dynamic partition pruning strategy to support more dpp patterns

2023-02-19 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691022#comment-17691022 ] Weijie Guo commented on FLINK-31062: Thanks [~337361...@qq.com] for your patient guidance. I have

[GitHub] [flink] zhuzhurk commented on pull request #21943: [FLINK-31077][runtime] Mark pending checkpoint onCompletionPromise complete only after the completed checkpoint is added to the store.

2023-02-19 Thread via GitHub
zhuzhurk commented on PR #21943: URL: https://github.com/apache/flink/pull/21943#issuecomment-1436387155 @gaoyunhaii would you take a look at this change of checkpointing? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Commented] (FLINK-30723) Introduce filter pushdown for parquet format

2023-02-19 Thread Nicholas Jiang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691013#comment-17691013 ] Nicholas Jiang commented on FLINK-30723: [~zjureel], [~lzljs3620320], this is duplicated by 

[jira] [Created] (FLINK-31129) Introduce FlinkEmbeddedHiveRunner for junit5 in table store

2023-02-19 Thread Shammon (Jira)
Shammon created FLINK-31129: --- Summary: Introduce FlinkEmbeddedHiveRunner for junit5 in table store Key: FLINK-31129 URL: https://issues.apache.org/jira/browse/FLINK-31129 Project: Flink Issue

[jira] [Comment Edited] (FLINK-31089) pin L0 index in memory can lead to slow memory grow finally lead to memory beyond limit

2023-02-19 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690999#comment-17690999 ] xiaogang zhou edited comment on FLINK-31089 at 2/20/23 4:56 AM: [~yunta] 

[GitHub] [flink-table-store] SteNicholas commented on pull request #546: [FLINK-31009] Add recordCount to snapshot meta

2023-02-19 Thread via GitHub
SteNicholas commented on PR #546: URL: https://github.com/apache/flink-table-store/pull/546#issuecomment-1436325253 @JingsongLi, @FangYongs, PTAL. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [flink] liuyongvs commented on pull request #21947: [FLINK-31098][table] Add ARRAY_SIZE function.

2023-02-19 Thread via GitHub
liuyongvs commented on PR #21947: URL: https://github.com/apache/flink/pull/21947#issuecomment-1436314638 hi @snuyanzin please review it again -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Commented] (FLINK-31061) Release Testing: Verify FLINK-30376 Introduce a new flink bushy join reorder rule which based on greedy algorithm

2023-02-19 Thread Junrui Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691004#comment-17691004 ] Junrui Li commented on FLINK-31061: --- I have tested it and it looks good to me. I used sql client to do

[jira] [Assigned] (FLINK-30810) Rework the CliClientITCase to extend AbstractSqlGatewayStatementITCase

2023-02-19 Thread Shengkai Fang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shengkai Fang reassigned FLINK-30810: - Assignee: Shammon > Rework the CliClientITCase to extend

[jira] [Commented] (FLINK-30810) Rework the CliClientITCase to extend AbstractSqlGatewayStatementITCase

2023-02-19 Thread Shammon (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691003#comment-17691003 ] Shammon commented on FLINK-30810: - Hi [~fsk119] I'd like to fix this issue, can you assign it to me?

[GitHub] [flink] fsk119 commented on a diff in pull request #21901: [FLINK-30968][sql-client] Sql client supports dynamic config to open session

2023-02-19 Thread via GitHub
fsk119 commented on code in PR #21901: URL: https://github.com/apache/flink/pull/21901#discussion_r428607 ## docs/content.zh/docs/dev/table/sqlClient.md: ## @@ -223,6 +223,8 @@ Mode "embedded" (default) submits Flink jobs from the local machine. Syntax: [embedded]

[jira] [Commented] (FLINK-29729) Support including the configured properties from flink-conf.yaml during create ParquetReader

2023-02-19 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17691000#comment-17691000 ] dalongliu commented on FLINK-29729: --- Sorry for responding later, after taking a deep analysis of the

[jira] [Commented] (FLINK-31089) pin L0 index in memory can lead to slow memory grow finally lead to memory beyond limit

2023-02-19 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690999#comment-17690999 ] xiaogang zhou commented on FLINK-31089: --- [~yunta]  got some update with l0 pin open, see attache

[jira] [Updated] (FLINK-31089) pin L0 index in memory can lead to slow memory grow finally lead to memory beyond limit

2023-02-19 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-31089: -- Attachment: l0pin_open-1.png > pin L0 index in memory can lead to slow memory grow finally

[jira] [Updated] (FLINK-31089) pin L0 index in memory can lead to slow memory grow finally lead to memory beyond limit

2023-02-19 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-31089: -- Attachment: l0pin_open.png > pin L0 index in memory can lead to slow memory grow finally lead

[jira] [Updated] (FLINK-31089) pin L0 index in memory can lead to slow memory grow finally lead to memory beyond limit

2023-02-19 Thread xiaogang zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xiaogang zhou updated FLINK-31089: -- Attachment: (was: l0pin_open-1.png) > pin L0 index in memory can lead to slow memory grow

[GitHub] [flink] flinkbot commented on pull request #21966: [FLINK-29729][Parquet] Support including the configured properties from flink-conf.yaml during create ParquetReader

2023-02-19 Thread via GitHub
flinkbot commented on PR #21966: URL: https://github.com/apache/flink/pull/21966#issuecomment-1436276237 ## CI report: * d4b4469382934358da015ec57791da352070d79c UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] lsyldliu opened a new pull request, #21966: [FLINK-29729][Parquet] Support including the configured properties from flink-conf.yaml during create ParquetReader

2023-02-19 Thread via GitHub
lsyldliu opened a new pull request, #21966: URL: https://github.com/apache/flink/pull/21966 ## What is the purpose of the change *As the issue description, currently we can't get Hadoop-related authentication information from flink-conf.yaml when create `ParquetReader` using

[GitHub] [flink] flinkbot commented on pull request #21965: [FLINK-31121] Support discarding too large records in kafka sink

2023-02-19 Thread via GitHub
flinkbot commented on PR #21965: URL: https://github.com/apache/flink/pull/21965#issuecomment-1436255817 ## CI report: * 5344dec8b734fa071d0d1170097a85076f6e5898 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-31121) KafkaSink should be able to catch and ignore exp via config on/off

2023-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-31121: --- Labels: pull-request-available (was: ) > KafkaSink should be able to catch and ignore exp

[GitHub] [flink] FangYongs opened a new pull request, #21965: [FLINK-31121] Support discarding too large records in kafka sink

2023-02-19 Thread via GitHub
FangYongs opened a new pull request, #21965: URL: https://github.com/apache/flink/pull/21965 ## What is the purpose of the change This PR aims to add an option `flink.sink.discard-too-large-records` to support discarding too large records in kafka sink. ## Brief change log

[jira] [Commented] (FLINK-31115) Support a task to specify multiple slots

2023-02-19 Thread waywtdcc (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690993#comment-17690993 ] waywtdcc commented on FLINK-31115: -- Fine-Grained Resource Management is not enough. Fine-Grained

[jira] [Commented] (FLINK-31116) Support taskmanager related parameters in session mode Support job granularity setting

2023-02-19 Thread waywtdcc (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690992#comment-17690992 ] waywtdcc commented on FLINK-31116: -- It is used for real-time synchronization, using yarn session mode.

[jira] [Commented] (FLINK-31116) Support taskmanager related parameters in session mode Support job granularity setting

2023-02-19 Thread waywtdcc (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690991#comment-17690991 ] waywtdcc commented on FLINK-31116: -- Fine-Grained Resource Management is not enough. Fine-Grained

[jira] [Closed] (FLINK-31025) Release Testing: Verify FLINK-30650 Introduce EXPLAIN PLAN_ADVICE to provide SQL advice

2023-02-19 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo closed FLINK-31025. -- Resolution: Done > Release Testing: Verify FLINK-30650 Introduce EXPLAIN PLAN_ADVICE to provide >

[jira] [Commented] (FLINK-26541) SQL Client should support submitting SQL jobs in application mode

2023-02-19 Thread Paul Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690985#comment-17690985 ] Paul Lin commented on FLINK-26541: -- Is there any ongoing effort currently? I'm happy to take over this

[jira] [Commented] (FLINK-30274) Upgrade commons-collections 3.x to commons-collections4

2023-02-19 Thread Ran Tao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690982#comment-17690982 ] Ran Tao commented on FLINK-30274: - [~martijnvisser] Hi, Can u help me to review it again? > Upgrade

[jira] [Assigned] (FLINK-31060) Release Testing: Verify FLINK-30542 Support adaptive local hash aggregate in runtime

2023-02-19 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu reassigned FLINK-31060: -- Assignee: dalongliu > Release Testing: Verify FLINK-30542 Support adaptive local hash

[jira] [Closed] (FLINK-30908) Fatal error in ResourceManager caused YARNSessionFIFOSecuredITCase.testDetachedMode to fail

2023-02-19 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-30908. Fix Version/s: 1.17.0 Resolution: Fixed - master (1.18):

[jira] [Assigned] (FLINK-30936) Release Testing: Verify FLINK-29941 Support SQL Client connects to SQL Gateway

2023-02-19 Thread Shengkai Fang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shengkai Fang reassigned FLINK-30936: - Assignee: luoyuxia > Release Testing: Verify FLINK-29941 Support SQL Client connects

[GitHub] [flink] xintongsong closed pull request #21868: [FLINK-30908] Fix YARNSessionFIFOSecuredITCase#testDetachedMode

2023-02-19 Thread via GitHub
xintongsong closed pull request #21868: [FLINK-30908] Fix YARNSessionFIFOSecuredITCase#testDetachedMode URL: https://github.com/apache/flink/pull/21868 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [flink] liuyongvs commented on a diff in pull request #21947: [FLINK-31098][table] Add ARRAY_SIZE function.

2023-02-19 Thread via GitHub
liuyongvs commented on code in PR #21947: URL: https://github.com/apache/flink/pull/21947#discussion_r1110050019 ## flink-table/flink-table-common/src/main/java/org/apache/flink/table/functions/BuiltInFunctionDefinitions.java: ## @@ -178,6 +178,35 @@ ANY,

[jira] [Commented] (FLINK-31104) TPC-DS test timed out in query 36

2023-02-19 Thread Shengkai Fang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17690974#comment-17690974 ] Shengkai Fang commented on FLINK-31104: --- [~zhengyunhong97] and [~lsy]  Could you share some

[GitHub] [flink-table-store] SteNicholas commented on a diff in pull request #547: [FLINK-31128] Add Create Table As for flink table store

2023-02-19 Thread via GitHub
SteNicholas commented on code in PR #547: URL: https://github.com/apache/flink-table-store/pull/547#discussion_r378285 ## docs/content/docs/how-to/creating-tables.md: ## @@ -114,6 +114,78 @@ Partition keys must be a subset of primary keys if primary keys are defined. By

[GitHub] [flink-table-store] SteNicholas commented on a diff in pull request #547: [FLINK-31128] Add Create Table As for flink table store

2023-02-19 Thread via GitHub
SteNicholas commented on code in PR #547: URL: https://github.com/apache/flink-table-store/pull/547#discussion_r378087 ## docs/content/docs/how-to/creating-tables.md: ## @@ -114,6 +114,78 @@ Partition keys must be a subset of primary keys if primary keys are defined. By

[jira] [Assigned] (FLINK-31046) Provide extra environment variables from field ref

2023-02-19 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora reassigned FLINK-31046: -- Assignee: Tamir Sagi > Provide extra environment variables from field ref >

[jira] [Closed] (FLINK-31047) Support topology spread constrains

2023-02-19 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora closed FLINK-31047. -- Fix Version/s: kubernetes-operator-1.5.0 Assignee: Tamir Sagi Resolution: Fixed

[jira] [Closed] (FLINK-31046) Provide extra environment variables from field ref

2023-02-19 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora closed FLINK-31046. -- Fix Version/s: kubernetes-operator-1.5.0 Resolution: Fixed merged to main

[GitHub] [flink-kubernetes-operator] gyfora merged pull request #531: [FLINK-31046][FLINK-31047][Kubernetes-Operator] - Improvement/enhance Flink operator template YAML

2023-02-19 Thread via GitHub
gyfora merged PR #531: URL: https://github.com/apache/flink-kubernetes-operator/pull/531 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink] Aitozi commented on pull request #21622: [FLINK-30570] Fix error inferred partition condition

2023-02-19 Thread via GitHub
Aitozi commented on PR #21622: URL: https://github.com/apache/flink/pull/21622#issuecomment-1436035723 Hi @swuferhong , thank you for helping review this PR, I have fixed your comment, please take a look again. -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [flink] Aitozi commented on a diff in pull request #21622: [FLINK-30570] Fix error inferred partition condition

2023-02-19 Thread via GitHub
Aitozi commented on code in PR #21622: URL: https://github.com/apache/flink/pull/21622#discussion_r276427 ## flink-table/flink-table-planner/src/test/scala/org/apache/flink/table/planner/plan/stream/sql/PartitionableSourceTest.scala: ## @@ -148,6 +148,16 @@ class

[GitHub] [flink] Aitozi commented on a diff in pull request #21622: [FLINK-30570] Fix error inferred partition condition

2023-02-19 Thread via GitHub
Aitozi commented on code in PR #21622: URL: https://github.com/apache/flink/pull/21622#discussion_r272704 ## flink-table/flink-table-planner/src/test/scala/org/apache/flink/table/planner/plan/utils/RexNodeExtractorTest.scala: ## @@ -721,6 +722,70 @@ class

[GitHub] [flink-kubernetes-operator] tamirsagi commented on a diff in pull request #531: [FLINK-31046][FLINK-31047][Kubernetes-Operator] - Improvement/enhance Flink operator template YAML

2023-02-19 Thread via GitHub
tamirsagi commented on code in PR #531: URL: https://github.com/apache/flink-kubernetes-operator/pull/531#discussion_r250574 ## docs/content/docs/custom-resource/pod-template.md: ## @@ -53,13 +53,13 @@ spec: flinkVersion: v1_16 flinkConfiguration:

[GitHub] [flink-kubernetes-operator] gyfora commented on a diff in pull request #531: [FLINK-31046][FLINK-31047][Kubernetes-Operator] - Improvement/enhance Flink operator template YAML

2023-02-19 Thread via GitHub
gyfora commented on code in PR #531: URL: https://github.com/apache/flink-kubernetes-operator/pull/531#discussion_r259286 ## docs/content/docs/custom-resource/pod-template.md: ## @@ -53,13 +53,13 @@ spec: flinkVersion: v1_16 flinkConfiguration:

[GitHub] [flink-kubernetes-operator] tamirsagi commented on a diff in pull request #531: [FLINK-31046][FLINK-31047][Kubernetes-Operator] - Improvement/enhance Flink operator template YAML

2023-02-19 Thread via GitHub
tamirsagi commented on code in PR #531: URL: https://github.com/apache/flink-kubernetes-operator/pull/531#discussion_r250574 ## docs/content/docs/custom-resource/pod-template.md: ## @@ -53,13 +53,13 @@ spec: flinkVersion: v1_16 flinkConfiguration:

[GitHub] [flink-kubernetes-operator] tamirsagi commented on a diff in pull request #531: [FLINK-31046][FLINK-31047][Kubernetes-Operator] - Improvement/enhance Flink operator template YAML

2023-02-19 Thread via GitHub
tamirsagi commented on code in PR #531: URL: https://github.com/apache/flink-kubernetes-operator/pull/531#discussion_r250574 ## docs/content/docs/custom-resource/pod-template.md: ## @@ -53,13 +53,13 @@ spec: flinkVersion: v1_16 flinkConfiguration:

[GitHub] [flink-kubernetes-operator] tamirsagi commented on a diff in pull request #531: [FLINK-31046][FLINK-31047][Kubernetes-Operator] - Improvement/enhance Flink operator template YAML

2023-02-19 Thread via GitHub
tamirsagi commented on code in PR #531: URL: https://github.com/apache/flink-kubernetes-operator/pull/531#discussion_r250574 ## docs/content/docs/custom-resource/pod-template.md: ## @@ -53,13 +53,13 @@ spec: flinkVersion: v1_16 flinkConfiguration:

[GitHub] [flink-kubernetes-operator] tamirsagi commented on a diff in pull request #531: [FLINK-31046][FLINK-31047][Kubernetes-Operator] - Improvement/enhance Flink operator template YAML

2023-02-19 Thread via GitHub
tamirsagi commented on code in PR #531: URL: https://github.com/apache/flink-kubernetes-operator/pull/531#discussion_r250574 ## docs/content/docs/custom-resource/pod-template.md: ## @@ -53,13 +53,13 @@ spec: flinkVersion: v1_16 flinkConfiguration:

[GitHub] [flink] Aitozi commented on a diff in pull request #21622: [FLINK-30570] Fix error inferred partition condition

2023-02-19 Thread via GitHub
Aitozi commented on code in PR #21622: URL: https://github.com/apache/flink/pull/21622#discussion_r254636 ## flink-table/flink-table-planner/src/main/scala/org/apache/flink/table/planner/plan/utils/RexNodeExtractor.scala: ## @@ -271,6 +271,12 @@ object RexNodeExtractor

[GitHub] [flink] Aitozi commented on a diff in pull request #21622: [FLINK-30570] Fix error inferred partition condition

2023-02-19 Thread via GitHub
Aitozi commented on code in PR #21622: URL: https://github.com/apache/flink/pull/21622#discussion_r252624 ## flink-table/flink-table-planner/src/main/scala/org/apache/flink/table/planner/plan/utils/RexNodeExtractor.scala: ## @@ -209,7 +209,7 @@ object RexNodeExtractor

[jira] [Updated] (FLINK-31128) Add Create Table As for flink table store

2023-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-31128: --- Labels: pull-request-available (was: ) > Add Create Table As for flink table store >

[GitHub] [flink-table-store] zhangjun0x01 opened a new pull request, #547: [FLINK-31128] Add Create Table As for flink table store

2023-02-19 Thread via GitHub
zhangjun0x01 opened a new pull request, #547: URL: https://github.com/apache/flink-table-store/pull/547 Add Create Table As for flink table store -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [flink] Aitozi commented on a diff in pull request #21622: [FLINK-30570] Fix error inferred partition condition

2023-02-19 Thread via GitHub
Aitozi commented on code in PR #21622: URL: https://github.com/apache/flink/pull/21622#discussion_r252163 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/factories/TestValuesTableFactory.java: ## @@ -1219,14 +1219,14 @@ public void

[jira] [Created] (FLINK-31128) Add Create Table As for flink table store

2023-02-19 Thread Jun Zhang (Jira)
Jun Zhang created FLINK-31128: - Summary: Add Create Table As for flink table store Key: FLINK-31128 URL: https://issues.apache.org/jira/browse/FLINK-31128 Project: Flink Issue Type: Improvement

[GitHub] [flink-kubernetes-operator] tamirsagi commented on a diff in pull request #531: [FLINK-31046][FLINK-31047][Kubernetes-Operator] - Improvement/enhance Flink operator template YAML

2023-02-19 Thread via GitHub
tamirsagi commented on code in PR #531: URL: https://github.com/apache/flink-kubernetes-operator/pull/531#discussion_r250574 ## docs/content/docs/custom-resource/pod-template.md: ## @@ -53,13 +53,13 @@ spec: flinkVersion: v1_16 flinkConfiguration:

[GitHub] [flink-kubernetes-operator] tamirsagi commented on a diff in pull request #531: [FLINK-31046][FLINK-31047][Kubernetes-Operator] - Improvement/enhance Flink operator template YAML

2023-02-19 Thread via GitHub
tamirsagi commented on code in PR #531: URL: https://github.com/apache/flink-kubernetes-operator/pull/531#discussion_r250574 ## docs/content/docs/custom-resource/pod-template.md: ## @@ -53,13 +53,13 @@ spec: flinkVersion: v1_16 flinkConfiguration:

[GitHub] [flink-kubernetes-operator] gyfora commented on a diff in pull request #531: [FLINK-31046][FLINK-31047][Kubernetes-Operator] - Improvement/enhance Flink operator template YAML

2023-02-19 Thread via GitHub
gyfora commented on code in PR #531: URL: https://github.com/apache/flink-kubernetes-operator/pull/531#discussion_r250103 ## docs/content/docs/custom-resource/pod-template.md: ## @@ -53,13 +53,13 @@ spec: flinkVersion: v1_16 flinkConfiguration:

[GitHub] [flink] flinkbot commented on pull request #21964: [FLINK-30948][Formats/AWS] Remove GlueSchemaRegistry Avro and JSON fo…

2023-02-19 Thread via GitHub
flinkbot commented on PR #21964: URL: https://github.com/apache/flink/pull/21964#issuecomment-1435953182 ## CI report: * 51350354a69950e56bfe7bb22df3ff929e5ecf59 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-30948) Remove flink-avro-glue-schema-registry and flink-json-glue-schema-registry from Flink main repo

2023-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-30948: --- Labels: pull-request-available (was: ) > Remove flink-avro-glue-schema-registry and

[GitHub] [flink] hlteoh37 opened a new pull request, #21964: [FLINK-30948][Formats/AWS] Remove GlueSchemaRegistry Avro and JSON fo…

2023-02-19 Thread via GitHub
hlteoh37 opened a new pull request, #21964: URL: https://github.com/apache/flink/pull/21964 …rmats from main repository ## What is the purpose of the change Externalize the GlueSchemaRegistry Avro and JSON formats to flink-connectors-aws ## Brief change log - Removed

[jira] [Updated] (FLINK-30715) FLIP-289: Support Online Inference

2023-02-19 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-30715: - Issue Type: New Feature (was: Improvement) > FLIP-289: Support Online Inference >

[GitHub] [flink-ml] lindong28 closed pull request #199: [demo-only] Refactor modules

2023-02-19 Thread via GitHub
lindong28 closed pull request #199: [demo-only] Refactor modules URL: https://github.com/apache/flink-ml/pull/199 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[jira] [Updated] (FLINK-31127) Add public API classes for FLIP-289

2023-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-31127: --- Labels: pull-request-available (was: ) > Add public API classes for FLIP-289 >

[GitHub] [flink-ml] lindong28 opened a new pull request, #214: [FLINK-31127] Add public API classes for FLIP-289

2023-02-19 Thread via GitHub
lindong28 opened a new pull request, #214: URL: https://github.com/apache/flink-ml/pull/214 ## What is the purpose of the change Add public API classes for FLIP-289. Note that some methods are added but not fully implemented. ## Brief change log Added all public API

[jira] [Assigned] (FLINK-31127) Add public API classes for FLIP-289

2023-02-19 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin reassigned FLINK-31127: Assignee: Dong Lin > Add public API classes for FLIP-289 > --- >

[jira] [Updated] (FLINK-31126) Move classes not depending on Flink runtime from flink-ml-core to flink-ml-servable-core

2023-02-19 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-31126: - Component/s: Library / Machine Learning > Move classes not depending on Flink runtime from

[jira] [Updated] (FLINK-31126) Move classes not depending on Flink runtime from flink-ml-core to flink-ml-servable-core

2023-02-19 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-31126: - Fix Version/s: ml-2.2.0 > Move classes not depending on Flink runtime from flink-ml-core to >

[jira] [Updated] (FLINK-31127) Add public API classes for FLIP-289

2023-02-19 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-31127: - Component/s: Library / Machine Learning > Add public API classes for FLIP-289 >

[jira] [Updated] (FLINK-31127) Add public API classes for FLIP-289

2023-02-19 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-31127: - Fix Version/s: ml-2.2.0 > Add public API classes for FLIP-289 > --- > >

[jira] [Created] (FLINK-31127) Add public API classes for FLIP-289

2023-02-19 Thread Dong Lin (Jira)
Dong Lin created FLINK-31127: Summary: Add public API classes for FLIP-289 Key: FLINK-31127 URL: https://issues.apache.org/jira/browse/FLINK-31127 Project: Flink Issue Type: Sub-task

[jira] [Updated] (FLINK-31126) Move classes not depending on Flink runtime from flink-ml-core to flink-ml-servable-core

2023-02-19 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-31126: --- Labels: pull-request-available (was: ) > Move classes not depending on Flink runtime from

  1   2   >