[jira] [Commented] (FLINK-33170) HybridSourceSplitEnumerator causes dropped records in Hybrid Sources with 3+ sources

2023-09-29 Thread Robert Hoyt (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17770650#comment-17770650 ] Robert Hoyt commented on FLINK-33170: - If someone can point me to how to Flink's policies on

[jira] [Updated] (FLINK-33170) HybridSourceSplitEnumerator causes dropped records in Hybrid Sources with 3+ sources

2023-09-29 Thread Robert Hoyt (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Hoyt updated FLINK-33170: Description: Possibly related to FLINK-27916.   In all versions since 1.15.x there's a subtle

[jira] [Comment Edited] (FLINK-33155) Flink ResourceManager continuously fails to start TM container on YARN when Kerberos enabled

2023-09-29 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-33155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17770648#comment-17770648 ] 袁枫 edited comment on FLINK-33155 at 9/30/23 4:22 AM: - The root cause might be that

[jira] [Updated] (FLINK-33170) HybridSourceSplitEnumerator causes dropped records in Hybrid Sources with 3+ sources

2023-09-29 Thread Robert Hoyt (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Hoyt updated FLINK-33170: Description: Possibly related to FLINK-27916.   In all versions since 1.15.x there's a subtle

[jira] [Commented] (FLINK-33155) Flink ResourceManager continuously fails to start TM container on YARN when Kerberos enabled

2023-09-29 Thread Jira
[ https://issues.apache.org/jira/browse/FLINK-33155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17770648#comment-17770648 ] 袁枫 commented on FLINK-33155: The root cause might be that we are reading the delegation token from JM local

[jira] [Commented] (FLINK-31689) Filesystem sink fails when parallelism of compactor operator changed

2023-09-29 Thread jirawech.s (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17770637#comment-17770637 ] jirawech.s commented on FLINK-31689: [~martijnvisser] Could you help with this PR, seems like no one

[jira] [Updated] (FLINK-31689) Filesystem sink fails when parallelism of compactor operator changed

2023-09-29 Thread jirawech.s (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jirawech.s updated FLINK-31689: --- Labels: pull-request-available (was: pull-request-available stale-assigned) > Filesystem sink

[jira] [Created] (FLINK-33170) HybridSourceSplitEnumerator causes dropped records in Hybrid Sources with 3+ sources

2023-09-29 Thread Robert Hoyt (Jira)
Robert Hoyt created FLINK-33170: --- Summary: HybridSourceSplitEnumerator causes dropped records in Hybrid Sources with 3+ sources Key: FLINK-33170 URL: https://issues.apache.org/jira/browse/FLINK-33170

[jira] [Closed] (FLINK-33028) FLIP-348: Make expanding behavior of virtual metadata columns configurable

2023-09-29 Thread Timo Walther (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timo Walther closed FLINK-33028. Resolution: Fixed > FLIP-348: Make expanding behavior of virtual metadata columns configurable >

[jira] [Closed] (FLINK-33169) Window TVFs don't consider column expansion

2023-09-29 Thread Timo Walther (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timo Walther closed FLINK-33169. Fix Version/s: 1.19.0 Resolution: Fixed Fixed in master:

[GitHub] [flink] alexey-lv commented on a diff in pull request #23477: [FLINK-33169] Consider descriptor information during system column expansion

2023-09-29 Thread via GitHub
alexey-lv commented on code in PR #23477: URL: https://github.com/apache/flink/pull/23477#discussion_r1341861500 ## flink-table/flink-table-planner/src/main/java/org/apache/flink/table/planner/calcite/FlinkCalciteSqlValidator.java: ## @@ -321,4 +332,131 @@ protected void

[jira] [Updated] (FLINK-33056) NettyClientServerSslTest#testValidSslConnection fails on AZP

2023-09-29 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-33056: --- Labels: auto-deprioritized-critical test-stability (was: stale-critical test-stability)

[jira] [Updated] (FLINK-31406) Do not delete jobgraph on scale only last-state upgrades

2023-09-29 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-31406: --- Labels: pull-request-available stale-assigned (was: pull-request-available) I am the

[jira] [Updated] (FLINK-16987) FLIP-95: Add new table source and sink interfaces

2023-09-29 Thread Flink Jira Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-16987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-16987: --- Labels: auto-deprioritized-major pull-request-available (was: pull-request-available

[GitHub] [flink] flinkbot commented on pull request #23477: [FLINK-33169] Consider descriptor information during system column expansion

2023-09-29 Thread via GitHub
flinkbot commented on PR #23477: URL: https://github.com/apache/flink/pull/23477#issuecomment-1741552430 ## CI report: * f87f3c33e5c345226efebdfbba51fe205f126a4f UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-33169) Window TVFs don't consider column expansion

2023-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-33169: --- Labels: pull-request-available (was: ) > Window TVFs don't consider column expansion >

[GitHub] [flink] twalthr opened a new pull request, #23477: [FLINK-33169] Consider descriptor information during system column expansion

2023-09-29 Thread via GitHub
twalthr opened a new pull request, #23477: URL: https://github.com/apache/flink/pull/23477 ## What is the purpose of the change "TABLE t" is translated into an implicit "SELECT * FROM t". This would ignore columns that are not expanded by default. However, the descriptor

[jira] [Closed] (FLINK-29398) Utilize Rack Awareness in Flink Consumer

2023-09-29 Thread Tzu-Li (Gordon) Tai (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai closed FLINK-29398. --- Resolution: Fixed > Utilize Rack Awareness in Flink Consumer >

[jira] [Updated] (FLINK-29398) Utilize Rack Awareness in Flink Consumer

2023-09-29 Thread Tzu-Li (Gordon) Tai (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tzu-Li (Gordon) Tai updated FLINK-29398: Fix Version/s: kafka-3.1.0 > Utilize Rack Awareness in Flink Consumer >

[jira] [Commented] (FLINK-29398) Utilize Rack Awareness in Flink Consumer

2023-09-29 Thread Tzu-Li (Gordon) Tai (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29398?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17770582#comment-17770582 ] Tzu-Li (Gordon) Tai commented on FLINK-29398: - Thanks for driving this to the finish line

[GitHub] [flink-connector-kafka] tzulitai closed pull request #53: [FLINK-29398][connector/kafka] Provide rack ID to Kafka Source to take advantage of Rack Awareness

2023-09-29 Thread via GitHub
tzulitai closed pull request #53: [FLINK-29398][connector/kafka] Provide rack ID to Kafka Source to take advantage of Rack Awareness URL: https://github.com/apache/flink-connector-kafka/pull/53 -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [flink-connector-kafka] jeremy-degroot opened a new pull request, #53: [FLINK-29398][connector/kafka] Provide rack ID to Kafka Source to take advantage of Rack Awareness

2023-09-29 Thread via GitHub
jeremy-degroot opened a new pull request, #53: URL: https://github.com/apache/flink-connector-kafka/pull/53 ## What is the purpose of the change This PR adds a new method to KafkaSourceBuilder that sets the `client.id` config for the KafkaSource to the value returned by the provided

[GitHub] [flink] snuyanzin closed pull request #22412: [FLINK-31778][table-planner] Fix RowToRowCastRule

2023-09-29 Thread via GitHub
snuyanzin closed pull request #22412: [FLINK-31778][table-planner] Fix RowToRowCastRule URL: https://github.com/apache/flink/pull/22412 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [flink] snuyanzin commented on pull request #22412: [FLINK-31778][table-planner] Fix RowToRowCastRule

2023-09-29 Thread via GitHub
snuyanzin commented on PR #22412: URL: https://github.com/apache/flink/pull/22412#issuecomment-1741286141 Thanks for the contibution and sorry for the fact that the fix was merged under a different PR I didn't know about this one till today -- This is an automated message from the

[jira] [Closed] (FLINK-31778) Casting array of rows produces incorrect result

2023-09-29 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin closed FLINK-31778. --- Resolution: Duplicate It looks like this issue has been fixed under

[GitHub] [flink-connector-kafka] jeremy-degroot closed pull request #20: [FLINK-29398][connector/kafka] Provide rack ID to Kafka Source to take advantage of Rack Awareness

2023-09-29 Thread via GitHub
jeremy-degroot closed pull request #20: [FLINK-29398][connector/kafka] Provide rack ID to Kafka Source to take advantage of Rack Awareness URL: https://github.com/apache/flink-connector-kafka/pull/20 -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [flink-connector-kafka] tzulitai commented on pull request #20: [FLINK-29398][connector/kafka] Provide rack ID to Kafka Source to take advantage of Rack Awareness

2023-09-29 Thread via GitHub
tzulitai commented on PR #20: URL: https://github.com/apache/flink-connector-kafka/pull/20#issuecomment-1741283245 Actually, @jeremy-degroot would you be able to squash all your changes into one commit that is rebased on latest `main` branch? That would be super helpful. -- This is an

[GitHub] [flink-connector-kafka] tzulitai commented on a diff in pull request #20: [FLINK-29398][connector/kafka] Provide rack ID to Kafka Source to take advantage of Rack Awareness

2023-09-29 Thread via GitHub
tzulitai commented on code in PR #20: URL: https://github.com/apache/flink-connector-kafka/pull/20#discussion_r1341644229 ## flink-connector-kafka/src/main/java/org/apache/flink/connector/kafka/source/KafkaSourceBuilder.java: ## @@ -355,6 +360,17 @@ public KafkaSourceBuilder

[jira] [Created] (FLINK-33169) Window TVFs don't consider column expansion

2023-09-29 Thread Timo Walther (Jira)
Timo Walther created FLINK-33169: Summary: Window TVFs don't consider column expansion Key: FLINK-33169 URL: https://issues.apache.org/jira/browse/FLINK-33169 Project: Flink Issue Type:

[jira] [Commented] (FLINK-30238) Unified Sink committer does not clean up state on final savepoint

2023-09-29 Thread Tzu-Li (Gordon) Tai (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17770492#comment-17770492 ] Tzu-Li (Gordon) Tai commented on FLINK-30238: - [~martijnvisser] I've replied to your

[jira] [Reopened] (FLINK-33028) FLIP-348: Make expanding behavior of virtual metadata columns configurable

2023-09-29 Thread Timo Walther (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timo Walther reopened FLINK-33028: -- > FLIP-348: Make expanding behavior of virtual metadata columns configurable >

[jira] [Updated] (FLINK-33089) Drop Flink 1.13 support

2023-09-29 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora updated FLINK-33089: --- Summary: Drop Flink 1.13 support (was: Drop Flink 1.14 support) > Drop Flink 1.13 support >

[jira] [Updated] (FLINK-33156) Remove flakiness from tests in OperatorStateBackendTest.java

2023-09-29 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-33156: --- Labels: pull-request-available (was: ) > Remove flakiness from tests in

[GitHub] [flink] asha-boyapati commented on pull request #23464: [FLINK-33156][Test]Remove flakiness from tests in OperatorStateBackendTest.java

2023-09-29 Thread via GitHub
asha-boyapati commented on PR #23464: URL: https://github.com/apache/flink/pull/23464#issuecomment-1741011694 Thanks for your comments. I updated the title. I will look into your suggestion of finding and fixing similar problems together. -- This is an automated message from the Apache

[jira] [Commented] (FLINK-31778) Casting array of rows produces incorrect result

2023-09-29 Thread david radley (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17770463#comment-17770463 ] david radley commented on FLINK-31778: -- [~soin08]  It looks like this is fixed in master

[GitHub] [flink] gaborgsomogyi commented on pull request #23417: [FLINK-33030][python]Add python 3.11 support

2023-09-29 Thread via GitHub
gaborgsomogyi commented on PR #23417: URL: https://github.com/apache/flink/pull/23417#issuecomment-1740951700 Rebased to the latest master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [flink] davidradl commented on pull request #22412: [FLINK-31778][table-planner] Fix RowToRowCastRule

2023-09-29 Thread via GitHub
davidradl commented on PR #22412: URL: https://github.com/apache/flink/pull/22412#issuecomment-1740879352 @soin08 hi , we are interested in getting this fix in - are you in a position to fix the conflicts that are now present. Manyt thanks. -- This is an automated message from the

[jira] [Commented] (FLINK-31778) Casting array of rows produces incorrect result

2023-09-29 Thread david radley (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17770414#comment-17770414 ] david radley commented on FLINK-31778: -- [~nictownsend]  I have done a test on the scenario you

[GitHub] [flink-web] rmetzger commented on pull request #676: [FLINK-33046][FLIP-333] Redesign Apache Flink website

2023-09-29 Thread via GitHub
rmetzger commented on PR #676: URL: https://github.com/apache/flink-web/pull/676#issuecomment-1740784269 Why is "Powered By" in the footer and not in the "About" menu? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [flink] RainerMatthiasS commented on pull request #23239: [FLINK-26585][state-processor-api] replace implementation of MultiStateKeyIterator with Stream-free implementation

2023-09-29 Thread via GitHub
RainerMatthiasS commented on PR #23239: URL: https://github.com/apache/flink/pull/23239#issuecomment-1740768001 Hi @masteryhx , thank you for the review again, I also synced my fork with the upstream, if that was what you meant by 'Could you also rebase all your commits to the master ?'

[GitHub] [flink-web] rmetzger commented on a diff in pull request #676: [FLINK-33046][FLIP-333] Redesign Apache Flink website

2023-09-29 Thread via GitHub
rmetzger commented on code in PR #676: URL: https://github.com/apache/flink-web/pull/676#discussion_r1341269756 ## docs/i18n/zh.yaml: ## @@ -0,0 +1,163 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE

[GitHub] [flink-web] rmetzger commented on a diff in pull request #676: [FLINK-33046][FLIP-333] Redesign Apache Flink website

2023-09-29 Thread via GitHub
rmetzger commented on code in PR #676: URL: https://github.com/apache/flink-web/pull/676#discussion_r1341269428 ## docs/i18n/en.yaml: ## @@ -0,0 +1,163 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE

[jira] [Commented] (FLINK-32223) Add Hive delegation token support

2023-09-29 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17770398#comment-17770398 ] Gabor Somogyi commented on FLINK-32223: --- The normal build passed against master:

[GitHub] [flink-web] rmetzger commented on a diff in pull request #676: [FLINK-33046][FLIP-333] Redesign Apache Flink website

2023-09-29 Thread via GitHub
rmetzger commented on code in PR #676: URL: https://github.com/apache/flink-web/pull/676#discussion_r1341267362 ## docs/i18n/en.yaml: ## @@ -0,0 +1,163 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE

[GitHub] [flink-web] dannycranmer merged pull request #677: Update powered-by page to rename AWS service

2023-09-29 Thread via GitHub
dannycranmer merged PR #677: URL: https://github.com/apache/flink-web/pull/677 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink] echauchot commented on pull request #23443: [FLINK-33059] Support transparent compression for file-connector for all file input formats

2023-09-29 Thread via GitHub
echauchot commented on PR #23443: URL: https://github.com/apache/flink/pull/23443#issuecomment-1740565364 R: @xintongsong I see your name in that code history, would you have time to take a look ? -- This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Commented] (FLINK-33104) Nightly run for Flink Kafka connector fails due to architecture tests failing

2023-09-29 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17770338#comment-17770338 ] Etienne Chauchot commented on FLINK-33104: -- [~martijnvisser] actually it was never fixed in

[jira] [Closed] (FLINK-32223) Add Hive delegation token support

2023-09-29 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi closed FLINK-32223. - > Add Hive delegation token support > -- > > Key:

[jira] [Resolved] (FLINK-32223) Add Hive delegation token support

2023-09-29 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gabor Somogyi resolved FLINK-32223. --- Fix Version/s: 1.19.0 Resolution: Fixed e4c15aa on master > Add Hive delegation

[GitHub] [flink] gaborgsomogyi commented on pull request #23127: [FLINK-32223][runtime][security] Add Hive delegation token support

2023-09-29 Thread via GitHub
gaborgsomogyi commented on PR #23127: URL: https://github.com/apache/flink/pull/23127#issuecomment-1740510003 We must track the nightly + all other builds not to break something. I'm going to track things but I'm ask you @jiaoqingbo to do it also. -- This is an automated message from the

[GitHub] [flink] gaborgsomogyi merged pull request #23127: [FLINK-32223][runtime][security] Add Hive delegation token support

2023-09-29 Thread via GitHub
gaborgsomogyi merged PR #23127: URL: https://github.com/apache/flink/pull/23127 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink] dawidwys commented on a diff in pull request #23223: [FLINK-32873][table] - Add config to allow disabling QUERY hints

2023-09-29 Thread via GitHub
dawidwys commented on code in PR #23223: URL: https://github.com/apache/flink/pull/23223#discussion_r1340991937 ## docs/layouts/shortcodes/generated/table_config_configuration.html: ## @@ -62,6 +62,12 @@ String The local time zone defines current

[jira] [Updated] (FLINK-33168) An error occurred when executing sql, java.lang.NoSuchFieldError: operands

2023-09-29 Thread macdoor615 (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] macdoor615 updated FLINK-33168: --- Description: Environment:   {code:java} Linux hb3-prod-hadoop-006 4.18.0-477.27.1.el8_8.x86_64 #1

[jira] [Created] (FLINK-33168) An error occurred when executing sql, java.lang.NoSuchFieldError: operands

2023-09-29 Thread macdoor615 (Jira)
macdoor615 created FLINK-33168: -- Summary: An error occurred when executing sql, java.lang.NoSuchFieldError: operands Key: FLINK-33168 URL: https://issues.apache.org/jira/browse/FLINK-33168 Project: