[GitHub] [flink] snuyanzin commented on pull request #20128: [FLINK-28347][Test infrastructure] Update testcontainers dependency to v1.17.6

2023-03-28 Thread via GitHub
snuyanzin commented on PR #20128: URL: https://github.com/apache/flink/pull/20128#issuecomment-1487979862 @MartijnVisser seems I found the reason It looks the issue was in inconsistent jna dependency provided by flink-end-to-end-tests. At the same time testcontainers 1.17.6. depends

[GitHub] [flink] paul8263 commented on pull request #20343: [FLINK-25916][connector-kafka] Using upsert-kafka with a flush buffer…

2023-03-28 Thread via GitHub
paul8263 commented on PR #20343: URL: https://github.com/apache/flink/pull/20343#issuecomment-1487976782 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Commented] (FLINK-31220) Replace Pod with PodTemplateSpec for the pod template properties

2023-03-28 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706223#comment-17706223 ] Gyula Fora commented on FLINK-31220: The key here is the additionalProperties field that captures

[jira] [Commented] (FLINK-31220) Replace Pod with PodTemplateSpec for the pod template properties

2023-03-28 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706222#comment-17706222 ] Gyula Fora commented on FLINK-31220: Seems to me that this will be a backward compatible change.

[GitHub] [flink-ml] lindong28 commented on pull request #228: [hotfix][doc] Update website doc to avoid space in the feature engineering algorithm names

2023-03-28 Thread via GitHub
lindong28 commented on PR #228: URL: https://github.com/apache/flink-ml/pull/228#issuecomment-1487958825 @zhipeng93 Can you help review this PR? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[jira] [Commented] (FLINK-30607) Table.to_pandas doesn't support Map type

2023-03-28 Thread Xuannan Su (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706208#comment-17706208 ] Xuannan Su commented on FLINK-30607: [~dianfu] Thanks for the patch! This is very useful in our use

[GitHub] [flink] reswqa commented on pull request #22280: [FLINK-31626] HsSubpartitionFileReaderImpl should recycle skipped read buffers.

2023-03-28 Thread via GitHub
reswqa commented on PR #22280: URL: https://github.com/apache/flink/pull/22280#issuecomment-1487919501 Thanks @TanYuxin-tyx for the review, I have addressed all the comments in the fix-up commit, please take a look again. -- This is an automated message from the Apache Git Service. To

[GitHub] [flink] reswqa commented on a diff in pull request #22280: [FLINK-31626] HsSubpartitionFileReaderImpl should recycle skipped read buffers.

2023-03-28 Thread via GitHub
reswqa commented on code in PR #22280: URL: https://github.com/apache/flink/pull/22280#discussion_r1151370945 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsSubpartitionFileReaderImpl.java: ## @@ -251,6 +273,18 @@ public Buffer.DataType

[GitHub] [flink] reswqa commented on a diff in pull request #22280: [FLINK-31626] HsSubpartitionFileReaderImpl should recycle skipped read buffers.

2023-03-28 Thread via GitHub
reswqa commented on code in PR #22280: URL: https://github.com/apache/flink/pull/22280#discussion_r1151370945 ## flink-runtime/src/main/java/org/apache/flink/runtime/io/network/partition/hybrid/HsSubpartitionFileReaderImpl.java: ## @@ -251,6 +273,18 @@ public Buffer.DataType

[GitHub] [flink] flinkbot commented on pull request #22292: [FLINK-31651][runtime] Improve logging of granting/revoking leadership in JobMasterServiceLeadershipRunner to INFO level

2023-03-28 Thread via GitHub
flinkbot commented on PR #22292: URL: https://github.com/apache/flink/pull/22292#issuecomment-1487913850 ## CI report: * f6d2f99966982ac7a3360aaf4fdefd5cda3d4995 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink-ml] lindong28 opened a new pull request, #228: [hotfix][doc] Update website doc to avoid space in the feature engineering algorithm names

2023-03-28 Thread via GitHub
lindong28 opened a new pull request, #228: URL: https://github.com/apache/flink-ml/pull/228 ## What is the purpose of the change Make the feature engineering algorithm names consistent in the website

[jira] [Updated] (FLINK-31651) Improve logging of granting/revoking leadership in JobMasterServiceLeadershipRunner to INFO level

2023-03-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-31651: --- Labels: pull-request-available (was: ) > Improve logging of granting/revoking leadership

[GitHub] [flink] wanglijie95 opened a new pull request, #22292: [FLINK-31651][runtime] Improve logging of granting/revoking leadership in JobMasterServiceLeadershipRunner to INFO level

2023-03-28 Thread via GitHub
wanglijie95 opened a new pull request, #22292: URL: https://github.com/apache/flink/pull/22292 ## What is the purpose of the change Currently, the log level of granting/revoking leadership of JobMasterServiceLeadershipRunner is DEBUG. However, we usually configure it to INFO level in

[GitHub] [flink] flinkbot commented on pull request #22291: [FLINK-31632] maxAllowedWatermark overflow

2023-03-28 Thread via GitHub
flinkbot commented on PR #22291: URL: https://github.com/apache/flink/pull/22291#issuecomment-1487893751 ## CI report: * 27545880e14511404102f8c5390a03d152b8e03e UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Commented] (FLINK-31632) watermark aligned idle source can't resume

2023-03-28 Thread haishui (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706201#comment-17706201 ] haishui commented on FLINK-31632: - This problem seems to be caused by the overflow of 

[jira] [Updated] (FLINK-31632) watermark aligned idle source can't resume

2023-03-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-31632: --- Labels: pull-request-available (was: ) > watermark aligned idle source can't resume >

[GitHub] [flink] haishui126 opened a new pull request, #22291: [FLINK-31632] maxAllowedWatermark overflow

2023-03-28 Thread via GitHub
haishui126 opened a new pull request, #22291: URL: https://github.com/apache/flink/pull/22291 ## What is the purpose of the change This PR aims to fix maxAllowedWatermark overflow when source is idle, which leads to source can't resume to active. ## Brief change log

[GitHub] [flink] haishui126 closed pull request #22290: 31632

2023-03-28 Thread via GitHub
haishui126 closed pull request #22290: 31632 URL: https://github.com/apache/flink/pull/22290 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Assigned] (FLINK-31545) FlinkConnection creates and manages statements

2023-03-28 Thread Benchao Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benchao Li reassigned FLINK-31545: -- Assignee: Fang Yong > FlinkConnection creates and manages statements >

[jira] [Created] (FLINK-31651) Improve logging of granting/revoking leadership in JobMasterServiceLeadershipRunner to INFO level

2023-03-28 Thread Lijie Wang (Jira)
Lijie Wang created FLINK-31651: -- Summary: Improve logging of granting/revoking leadership in JobMasterServiceLeadershipRunner to INFO level Key: FLINK-31651 URL: https://issues.apache.org/jira/browse/FLINK-31651

[jira] [Assigned] (FLINK-31547) Introduce FlinkResultSetMetaData for jdbc driver

2023-03-28 Thread Benchao Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31547?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Benchao Li reassigned FLINK-31547: -- Assignee: Fang Yong > Introduce FlinkResultSetMetaData for jdbc driver >

[jira] [Updated] (FLINK-31650) Incorrect busyMsTimePerSecond metric value for FINISHED task

2023-03-28 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang updated FLINK-31650: --- Affects Version/s: 1.15.4 > Incorrect busyMsTimePerSecond metric value for FINISHED task >

[jira] [Commented] (FLINK-31650) Incorrect busyMsTimePerSecond metric value for FINISHED task

2023-03-28 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706199#comment-17706199 ] Lijie Wang commented on FLINK-31650: I guess this is because the value of busyMsTimePerSecond is

[GitHub] [flink] haishui126 opened a new pull request, #22290: 31632

2023-03-28 Thread via GitHub
haishui126 opened a new pull request, #22290: URL: https://github.com/apache/flink/pull/22290 ## What is the purpose of the change This PR aims to fix maxAllowedWatermark overflow when source is idle, which leads to source can't resume to active. ## Brief change log

[jira] [Closed] (FLINK-31429) Support CTAS(create table as) streaming job with schema changes in table store

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-31429. Resolution: Fixed > Support CTAS(create table as) streaming job with schema changes in table

[jira] [Closed] (FLINK-31435) Introduce event parser for MySql Debezium JSON format in Table Store

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-31435. Resolution: Fixed > Introduce event parser for MySql Debezium JSON format in Table Store >

[jira] [Closed] (FLINK-30419) Allow tuning of transaction timeout

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-30419. Resolution: Fixed > Allow tuning of transaction timeout > --- > >

[jira] [Commented] (FLINK-30419) Allow tuning of transaction timeout

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706198#comment-17706198 ] Jingsong Lee commented on FLINK-30419: -- https://github.com/apache/incubator-paimon/issues/754 >

[jira] [Closed] (FLINK-27958) Compare batch maxKey to reduce comparisons in SortMergeReader

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-27958. Resolution: Fixed > Compare batch maxKey to reduce comparisons in SortMergeReader >

[jira] [Closed] (FLINK-31111) Introduce CatalogTestBase

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-3?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-3. Resolution: Fixed > Introduce CatalogTestBase > - > >

[jira] [Closed] (FLINK-31001) Introduce Hive writer

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-31001. Resolution: Fixed > Introduce Hive writer > - > > Key:

[jira] [Closed] (FLINK-27103) Don't store redundant primary key fields

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-27103. Resolution: Fixed > Don't store redundant primary key fields >

[jira] [Closed] (FLINK-27002) Optimize batch multiple partitions inserting

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-27002. Resolution: Fixed > Optimize batch multiple partitions inserting >

[jira] [Closed] (FLINK-31190) Supports Spark call procedure command on Table Store

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-31190. Resolution: Fixed > Supports Spark call procedure command on Table Store >

[jira] [Closed] (FLINK-28086) Table Store Catalog supports partition methods

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-28086. Resolution: Fixed > Table Store Catalog supports partition methods >

[jira] [Closed] (FLINK-31194) Introduces savepoint mechanism of Table Store

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-31194. Resolution: Fixed > Introduces savepoint mechanism of Table Store >

[jira] [Closed] (FLINK-31195) FullChangelogStoreSinkWrite bucket writer conflicts with rescale

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-31195. Resolution: Fixed > FullChangelogStoreSinkWrite bucket writer conflicts with rescale >

[jira] [Commented] (FLINK-31593) Update reference data for Migration Tests

2023-03-28 Thread Yanfei Lei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706196#comment-17706196 ] Yanfei Lei commented on FLINK-31593: I found the following log in  

[jira] [Closed] (FLINK-30945) FTS does not support multiple writers into the same table and topic

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-30945. Resolution: Fixed https://github.com/apache/incubator-paimon/issues/745 > FTS does not support

[GitHub] [flink] mynkyu closed pull request #22265: [docs] task_failure_recovery.md typo fix

2023-03-28 Thread via GitHub
mynkyu closed pull request #22265: [docs] task_failure_recovery.md typo fix URL: https://github.com/apache/flink/pull/22265 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [flink] FangYongs closed pull request #18490: [FLINK-25794][sql-runtime] Clean cache after memory segments in it after they are released to MemoryManager

2023-03-28 Thread via GitHub
FangYongs closed pull request #18490: [FLINK-25794][sql-runtime] Clean cache after memory segments in it after they are released to MemoryManager URL: https://github.com/apache/flink/pull/18490 -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [flink] flinkbot commented on pull request #22289: [FLINK-31545][jdbc-driver] Create executor in flink connection

2023-03-28 Thread via GitHub
flinkbot commented on PR #22289: URL: https://github.com/apache/flink/pull/22289#issuecomment-1487875564 ## CI report: * 351a2da4884f5e57cf0e71bf2c35905bf03a3d7b UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-31545) FlinkConnection creates and manages statements

2023-03-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-31545: --- Labels: pull-request-available (was: ) > FlinkConnection creates and manages statements >

[GitHub] [flink] FangYongs opened a new pull request, #22289: [FLINK-31545][jdbc-driver] Create executor in flink connection

2023-03-28 Thread via GitHub
FangYongs opened a new pull request, #22289: URL: https://github.com/apache/flink/pull/22289 ## What is the purpose of the change This PR aims to create `Executor` in `FlinkConnection` and supports catalog/schema related operations ## Brief change log - Create `Executor`

[jira] [Created] (FLINK-31650) Incorrect busyMsTimePerSecond metric value for FINISHED task

2023-03-28 Thread Lijie Wang (Jira)
Lijie Wang created FLINK-31650: -- Summary: Incorrect busyMsTimePerSecond metric value for FINISHED task Key: FLINK-31650 URL: https://issues.apache.org/jira/browse/FLINK-31650 Project: Flink

[jira] [Updated] (FLINK-31650) Incorrect busyMsTimePerSecond metric value for FINISHED task

2023-03-28 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang updated FLINK-31650: --- Description: As shown in the figure below, the busyMsTimePerSecond of the FINISHED task is 100%,

[GitHub] [flink] liuyongvs commented on a diff in pull request #22267: [FLINK-31602][table] Add built-in ARRAY_POSITION function.

2023-03-28 Thread via GitHub
liuyongvs commented on code in PR #22267: URL: https://github.com/apache/flink/pull/22267#discussion_r1151334278 ## flink-table/flink-table-runtime/src/main/java/org/apache/flink/table/runtime/functions/scalar/ArrayPositionFunction.java: ## @@ -0,0 +1,91 @@ +/* + * Licensed to

[GitHub] [flink] liuyongvs commented on a diff in pull request #22267: [FLINK-31602][table] Add built-in ARRAY_POSITION function.

2023-03-28 Thread via GitHub
liuyongvs commented on code in PR #22267: URL: https://github.com/apache/flink/pull/22267#discussion_r1151333109 ## docs/data/sql_functions.yml: ## @@ -634,6 +634,9 @@ collection: - sql: ARRAY_DISTINCT(haystack) table: haystack.arrayDistinct() description: Returns

[GitHub] [flink] liuyongvs commented on a diff in pull request #22267: [FLINK-31602][table] Add built-in ARRAY_POSITION function.

2023-03-28 Thread via GitHub
liuyongvs commented on code in PR #22267: URL: https://github.com/apache/flink/pull/22267#discussion_r1151332401 ## docs/data/sql_functions.yml: ## @@ -634,6 +634,9 @@ collection: - sql: ARRAY_DISTINCT(haystack) table: haystack.arrayDistinct() description: Returns

[GitHub] [flink] liuyongvs commented on a diff in pull request #22267: [FLINK-31602][table] Add built-in ARRAY_POSITION function.

2023-03-28 Thread via GitHub
liuyongvs commented on code in PR #22267: URL: https://github.com/apache/flink/pull/22267#discussion_r1151331431 ## docs/data/sql_functions.yml: ## @@ -634,6 +634,9 @@ collection: - sql: ARRAY_DISTINCT(haystack) table: haystack.arrayDistinct() description: Returns

[GitHub] [flink] TanYuxin-tyx commented on a diff in pull request #22280: [FLINK-31626] HsSubpartitionFileReaderImpl should recycle skipped read buffers.

2023-03-28 Thread via GitHub
TanYuxin-tyx commented on code in PR #22280: URL: https://github.com/apache/flink/pull/22280#discussion_r1150216597 ## flink-runtime/src/test/java/org/apache/flink/runtime/io/network/partition/hybrid/HsSubpartitionFileReaderImplTest.java: ## @@ -392,6 +395,46 @@ void

[jira] [Commented] (FLINK-24456) Support bounded offset in the Kafka table connector

2023-03-28 Thread Xuannan Su (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706184#comment-17706184 ] Xuannan Su commented on FLINK-24456: Thanks for the effort! This is a particularly useful feature in

[GitHub] [flink] luoyuxia commented on a diff in pull request #22267: [FLINK-31602][table] Add built-in ARRAY_POSITION function.

2023-03-28 Thread via GitHub
luoyuxia commented on code in PR #22267: URL: https://github.com/apache/flink/pull/22267#discussion_r1151325075 ## flink-table/flink-table-runtime/src/main/java/org/apache/flink/table/runtime/functions/scalar/ArrayPositionFunction.java: ## @@ -0,0 +1,91 @@ +/* + * Licensed to

[jira] [Commented] (FLINK-30327) Adding a values.schema.json to the Helm chart source to support schema validation on Helm chart configuration

2023-03-28 Thread Xin Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706183#comment-17706183 ] Xin Li commented on FLINK-30327: Hi [~mapohl] I would like to try this.  > Adding a values.schema.json

[jira] [Commented] (FLINK-31220) Replace Pod with PodTemplateSpec for the pod template properties

2023-03-28 Thread Xin Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706180#comment-17706180 ] Xin Li commented on FLINK-31220: Hi [~gyfora], this heard like importing the pod spec in the controller

[GitHub] [flink] liuyongvs commented on pull request #19873: [FLINK-27891][Table] Add ARRAY_APPEND and ARRAY_PREPEND functions

2023-03-28 Thread via GitHub
liuyongvs commented on PR #19873: URL: https://github.com/apache/flink/pull/19873#issuecomment-1487848508 hi @snuyanzin ,will you go on? if not, i can take it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Closed] (FLINK-31076) Supports filter predicate in Parquet format of table store

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-31076. Resolution: Fixed > Supports filter predicate in Parquet format of table store >

[jira] [Closed] (FLINK-30723) Introduce filter pushdown for parquet format

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-30723. Resolution: Fixed > Introduce filter pushdown for parquet format >

[jira] [Closed] (FLINK-30572) Make parquet as default data file format

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-30572. Resolution: Fixed > Make parquet as default data file format >

[jira] [Closed] (FLINK-31224) Add metrics for flink table store

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-31224. Resolution: Fixed > Add metrics for flink table store > - > >

[jira] [Closed] (FLINK-26465) Optimize SortMergeReader: use loser tree to reduce comparisons

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-26465. Resolution: Fixed > Optimize SortMergeReader: use loser tree to reduce comparisons >

[jira] [Closed] (FLINK-30857) Create table does not create topic with multiple partitions

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-30857. Resolution: Fixed > Create table does not create topic with multiple partitions >

[jira] [Commented] (FLINK-30857) Create table does not create topic with multiple partitions

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706179#comment-17706179 ] Jingsong Lee commented on FLINK-30857: -- Kafka topic should be created by users.. > Create table

[jira] [Closed] (FLINK-31039) ChangelogWithKeyFileStoreTableITCase in table store is not stable

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-31039. Resolution: Fixed > ChangelogWithKeyFileStoreTableITCase in table store is not stable >

[jira] [Closed] (FLINK-31011) upgrade hiverunner version

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-31011. Resolution: Fixed > upgrade hiverunner version > -- > >

[jira] [Closed] (FLINK-31074) Introduce value filter for table store

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-31074. Resolution: Fixed > Introduce value filter for table store >

[jira] [Closed] (FLINK-31013) Session window aggregation cannot trigger window using event time

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-31013. Resolution: Fixed > Session window aggregation cannot trigger window using event time >

[jira] [Closed] (FLINK-30580) [umbrella] Refactor tests for table store

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-30580. Resolution: Fixed > [umbrella] Refactor tests for table store >

[jira] [Closed] (FLINK-31129) Introduce FlinkEmbeddedHiveRunner for junit5 in table store

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-31129. Resolution: Fixed > Introduce FlinkEmbeddedHiveRunner for junit5 in table store >

[jira] [Closed] (FLINK-30603) CompactActionITCase in table store is unstable

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-30603. Resolution: Fixed > CompactActionITCase in table store is unstable >

[jira] [Closed] (FLINK-30740) INSERT to Kafka does not work when Kafka config auto.create.topics.enabled is set to false

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-30740. Resolution: Fixed https://github.com/apache/incubator-paimon/issues/740 > INSERT to Kafka does

[jira] [Closed] (FLINK-28661) Introduce generic mode for table store catalog

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-28661. Resolution: Fixed > Introduce generic mode for table store catalog >

[jira] [Closed] (FLINK-30248) Spark writer supports insert overwrite

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-30248. Resolution: Fixed > Spark writer supports insert overwrite >

[jira] [Closed] (FLINK-27628) Table Store records and fetches incorrect results with NaN

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-27628. Resolution: Fixed > Table Store records and fetches incorrect results with NaN >

[jira] [Closed] (FLINK-29953) Get rid of flink-connector-hive dependency in flink-table-store-hive

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-29953. Resolution: Fixed > Get rid of flink-connector-hive dependency in flink-table-store-hive >

[jira] [Closed] (FLINK-29756) Support materialized column to improve query performance for complex types

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-29756. Resolution: Fixed https://github.com/apache/incubator-paimon/issues/735 > Support materialized

[jira] [Closed] (FLINK-29490) Timestamp LTZ is unsupported in table store

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-29490. Resolution: Fixed > Timestamp LTZ is unsupported in table store >

[jira] [Closed] (FLINK-30326) SQL Client should not create table directory structure

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-30326. Resolution: Fixed I close this, I think it is difficult to implement in paimon, if necessary,

[jira] [Closed] (FLINK-30590) Remove set default value manually for table options

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-30590. Resolution: Fixed > Remove set default value manually for table options >

[jira] [Closed] (FLINK-30317) Create table in FTS catalog with s3 warehouse throws DatabaseNotExistException

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-30317. Resolution: Fixed > Create table in FTS catalog with s3 warehouse throws

[jira] [Commented] (FLINK-30317) Create table in FTS catalog with s3 warehouse throws DatabaseNotExistException

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30317?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706174#comment-17706174 ] Jingsong Lee commented on FLINK-30317: -- https://github.com/apache/incubator-paimon/issues/733 >

[jira] [Closed] (FLINK-30390) Ensure that no compaction is in progress before closing the writer

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-30390. Resolution: Fixed > Ensure that no compaction is in progress before closing the writer >

[jira] [Closed] (FLINK-30564) Select from a new table with Kafka LogStore crashes with UnknownTopicOrPartitionException

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-30564. Resolution: Fixed > Select from a new table with Kafka LogStore crashes with >

[jira] [Closed] (FLINK-30394) [umbrella] Refactor filesystem support in table store

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee closed FLINK-30394. Resolution: Fixed > [umbrella] Refactor filesystem support in table store >

[jira] [Commented] (FLINK-30564) Select from a new table with Kafka LogStore crashes with UnknownTopicOrPartitionException

2023-03-28 Thread Jingsong Lee (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17706173#comment-17706173 ] Jingsong Lee commented on FLINK-30564: -- https://github.com/apache/incubator-paimon/issues/732 >

[GitHub] [flink] liuyongvs commented on pull request #22277: [FLINK-31621][table] Add built-in ARRAY_REVERSE function.

2023-03-28 Thread via GitHub
liuyongvs commented on PR #22277: URL: https://github.com/apache/flink/pull/22277#issuecomment-1487759850 hi @snuyanzin @fsk119 @damumu0625 fix all your reviews, thanks very much -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [flink] liuyongvs commented on a diff in pull request #22277: [FLINK-31621][table] Add built-in ARRAY_REVERSE function.

2023-03-28 Thread via GitHub
liuyongvs commented on code in PR #22277: URL: https://github.com/apache/flink/pull/22277#discussion_r1151267746 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/CollectionFunctionsITCase.java: ## @@ -287,4 +301,46 @@ Stream

[GitHub] [flink] liuyongvs commented on a diff in pull request #22277: [FLINK-31621][table] Add built-in ARRAY_REVERSE function.

2023-03-28 Thread via GitHub
liuyongvs commented on code in PR #22277: URL: https://github.com/apache/flink/pull/22277#discussion_r1151267646 ## flink-table/flink-table-runtime/src/main/java/org/apache/flink/table/runtime/functions/scalar/ArrayReverseFunction.java: ## @@ -0,0 +1,59 @@ +/* + * Licensed to

[GitHub] [flink-connector-kafka] mas-chen opened a new pull request, #19: [Sync apache/flink:master][FLINK-31305] Propagate producer exceptions outside of mailbox execut…

2023-03-28 Thread via GitHub
mas-chen opened a new pull request, #19: URL: https://github.com/apache/flink-connector-kafka/pull/19 …or so that checkpoints can correctly fail This closes #22150. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [flink-connector-kafka] RamanVerma commented on a diff in pull request #15: [FLINK-31363] Do not checkpoint a KafkaCommittable if the transaction was empty

2023-03-28 Thread via GitHub
RamanVerma commented on code in PR #15: URL: https://github.com/apache/flink-connector-kafka/pull/15#discussion_r1151169873 ## flink-connector-kafka/src/test/java/org/apache/flink/connector/kafka/sink/FlinkKafkaInternalProducerITCase.java: ## @@ -81,12 +80,58 @@ void

[GitHub] [flink-connector-kafka] tzulitai commented on a diff in pull request #15: [FLINK-31363] Do not checkpoint a KafkaCommittable if the transaction was empty

2023-03-28 Thread via GitHub
tzulitai commented on code in PR #15: URL: https://github.com/apache/flink-connector-kafka/pull/15#discussion_r1151180651 ## flink-connector-kafka/src/main/java/org/apache/flink/connector/kafka/sink/FlinkKafkaInternalProducer.java: ## @@ -67,6 +72,14 @@ private static

[GitHub] [flink-connector-kafka] tzulitai commented on a diff in pull request #15: [FLINK-31363] Do not checkpoint a KafkaCommittable if the transaction was empty

2023-03-28 Thread via GitHub
tzulitai commented on code in PR #15: URL: https://github.com/apache/flink-connector-kafka/pull/15#discussion_r1151177809 ## flink-connector-kafka/src/main/java/org/apache/flink/connector/kafka/sink/FlinkKafkaInternalProducer.java: ## @@ -67,6 +72,14 @@ private static

[GitHub] [flink-connector-kafka] tzulitai commented on a diff in pull request #15: [FLINK-31363] Do not checkpoint a KafkaCommittable if the transaction was empty

2023-03-28 Thread via GitHub
tzulitai commented on code in PR #15: URL: https://github.com/apache/flink-connector-kafka/pull/15#discussion_r1151177809 ## flink-connector-kafka/src/main/java/org/apache/flink/connector/kafka/sink/FlinkKafkaInternalProducer.java: ## @@ -67,6 +72,14 @@ private static

[GitHub] [flink-connector-kafka] tzulitai commented on a diff in pull request #15: [FLINK-31363] Do not checkpoint a KafkaCommittable if the transaction was empty

2023-03-28 Thread via GitHub
tzulitai commented on code in PR #15: URL: https://github.com/apache/flink-connector-kafka/pull/15#discussion_r1151177809 ## flink-connector-kafka/src/main/java/org/apache/flink/connector/kafka/sink/FlinkKafkaInternalProducer.java: ## @@ -67,6 +72,14 @@ private static

[GitHub] [flink-connector-kafka] RamanVerma commented on a diff in pull request #15: [FLINK-31363] Do not checkpoint a KafkaCommittable if the transaction was empty

2023-03-28 Thread via GitHub
RamanVerma commented on code in PR #15: URL: https://github.com/apache/flink-connector-kafka/pull/15#discussion_r1151154666 ## flink-connector-kafka/src/main/java/org/apache/flink/connector/kafka/sink/FlinkKafkaInternalProducer.java: ## @@ -67,6 +72,14 @@ private static

[GitHub] [flink] snuyanzin commented on a diff in pull request #22277: [FLINK-31621][table] Add built-in ARRAY_REVERSE function.

2023-03-28 Thread via GitHub
snuyanzin commented on code in PR #22277: URL: https://github.com/apache/flink/pull/22277#discussion_r1151097522 ## flink-table/flink-table-planner/src/test/java/org/apache/flink/table/planner/functions/CollectionFunctionsITCase.java: ## @@ -287,4 +301,46 @@ Stream

[GitHub] [flink-kubernetes-operator] mbalassi commented on a diff in pull request #551: [FLINK-31592] Improve Flink dependent resource deletion

2023-03-28 Thread via GitHub
mbalassi commented on code in PR #551: URL: https://github.com/apache/flink-kubernetes-operator/pull/551#discussion_r1151088576 ## docs/layouts/shortcodes/generated/kubernetes_operator_config_configuration.html: ## @@ -236,6 +236,12 @@ Duration The

[GitHub] [flink] snuyanzin commented on a diff in pull request #22277: [FLINK-31621][table] Add built-in ARRAY_REVERSE function.

2023-03-28 Thread via GitHub
snuyanzin commented on code in PR #22277: URL: https://github.com/apache/flink/pull/22277#discussion_r1151088509 ## flink-table/flink-table-runtime/src/main/java/org/apache/flink/table/runtime/functions/scalar/ArrayReverseFunction.java: ## @@ -0,0 +1,59 @@ +/* + * Licensed to

[GitHub] [flink-kubernetes-operator] mxm opened a new pull request, #556: [FLINK-30575] Set processing capacity to infinite if task is idle

2023-03-28 Thread via GitHub
mxm opened a new pull request, #556: URL: https://github.com/apache/flink-kubernetes-operator/pull/556 In a prior change we set the processing rates and capacity (true processing rate) to near zero values to allow scaling down in case of idle tasks. This has worked well but caused issues

[GitHub] [flink-connector-kafka] tzulitai commented on pull request #5: [FLINK-25916][connector-kafka] Using upsert-kafka with a flush buffer…

2023-03-28 Thread via GitHub
tzulitai commented on PR #5: URL: https://github.com/apache/flink-connector-kafka/pull/5#issuecomment-1487370775 Changes LGTM, +1 to @Ge's comment on extending `UpsertKafkaTableITCase` before we merge this. -- This is an automated message from the Apache Git Service. To respond to

  1   2   3   >