Re: [PR] [FLINK-33041][docs] Add an article to guide users to migrate their DataSet jobs to DataStream [flink]

2023-10-31 Thread via GitHub
WencongLiu commented on code in PR #23362: URL: https://github.com/apache/flink/pull/23362#discussion_r1378418615 ## docs/content/docs/dev/datastream/dataset_migration.md: ## @@ -0,0 +1,778 @@ +--- +title: "How to Migrate from DataSet to DataStream" +weight: 302 +type: docs

Re: [PR] [FLINK-33041][docs] Add an article to guide users to migrate their DataSet jobs to DataStream [flink]

2023-10-31 Thread via GitHub
WencongLiu commented on code in PR #23362: URL: https://github.com/apache/flink/pull/23362#discussion_r1378417184 ## docs/content/docs/dev/datastream/dataset_migration.md: ## @@ -0,0 +1,778 @@ +--- +title: "How to Migrate from DataSet to DataStream" +weight: 302 +type: docs

Re: [PR] [FLINK-33041][docs] Add an article to guide users to migrate their DataSet jobs to DataStream [flink]

2023-10-31 Thread via GitHub
WencongLiu commented on code in PR #23362: URL: https://github.com/apache/flink/pull/23362#discussion_r1378417033 ## docs/content/docs/dev/datastream/dataset_migration.md: ## @@ -0,0 +1,778 @@ +--- +title: "How to Migrate from DataSet to DataStream" +weight: 302 +type: docs

Re: [PR] [FLINK-33041][docs] Add an article to guide users to migrate their DataSet jobs to DataStream [flink]

2023-10-31 Thread via GitHub
WencongLiu commented on code in PR #23362: URL: https://github.com/apache/flink/pull/23362#discussion_r1378416760 ## docs/content/docs/dev/datastream/dataset_migration.md: ## @@ -0,0 +1,778 @@ +--- +title: "How to Migrate from DataSet to DataStream" +weight: 302 +type: docs

Re: [PR] [FLINK-33041][docs] Add an article to guide users to migrate their DataSet jobs to DataStream [flink]

2023-10-31 Thread via GitHub
WencongLiu commented on code in PR #23362: URL: https://github.com/apache/flink/pull/23362#discussion_r1378416526 ## docs/content/docs/dev/datastream/dataset_migration.md: ## @@ -0,0 +1,778 @@ +--- +title: "How to Migrate from DataSet to DataStream" +weight: 302 +type: docs

Re: [PR] [FLINK-33041][docs] Add an article to guide users to migrate their DataSet jobs to DataStream [flink]

2023-10-31 Thread via GitHub
WencongLiu commented on code in PR #23362: URL: https://github.com/apache/flink/pull/23362#discussion_r1378416167 ## docs/content/docs/dev/datastream/dataset_migration.md: ## @@ -0,0 +1,778 @@ +--- +title: "How to Migrate from DataSet to DataStream" +weight: 302 +type: docs

Re: [PR] [FLINK-33041][docs] Add an article to guide users to migrate their DataSet jobs to DataStream [flink]

2023-10-31 Thread via GitHub
WencongLiu commented on code in PR #23362: URL: https://github.com/apache/flink/pull/23362#discussion_r1378414045 ## docs/content/docs/dev/datastream/dataset_migration.md: ## @@ -0,0 +1,778 @@ +--- +title: "How to Migrate from DataSet to DataStream" +weight: 302 +type: docs

Re: [PR] [FLINK-33041][docs] Add an article to guide users to migrate their DataSet jobs to DataStream [flink]

2023-10-31 Thread via GitHub
WencongLiu commented on code in PR #23362: URL: https://github.com/apache/flink/pull/23362#discussion_r1378413855 ## docs/content/docs/dev/datastream/dataset_migration.md: ## @@ -0,0 +1,778 @@ +--- +title: "How to Migrate from DataSet to DataStream" +weight: 302 +type: docs

Re: [PR] [FLINK-33041][docs] Add an article to guide users to migrate their DataSet jobs to DataStream [flink]

2023-10-31 Thread via GitHub
WencongLiu commented on code in PR #23362: URL: https://github.com/apache/flink/pull/23362#discussion_r1378413349 ## docs/content/docs/dev/datastream/dataset_migration.md: ## @@ -0,0 +1,778 @@ +--- +title: "How to Migrate from DataSet to DataStream" +weight: 302 +type: docs

Re: [PR] [FLINK-33041][docs] Add an article to guide users to migrate their DataSet jobs to DataStream [flink]

2023-10-31 Thread via GitHub
WencongLiu commented on code in PR #23362: URL: https://github.com/apache/flink/pull/23362#discussion_r1378413003 ## docs/content/docs/dev/datastream/dataset_migration.md: ## @@ -0,0 +1,778 @@ +--- +title: "How to Migrate from DataSet to DataStream" +weight: 302 +type: docs

Re: [PR] [FLINK-33041][docs] Add an article to guide users to migrate their DataSet jobs to DataStream [flink]

2023-10-31 Thread via GitHub
WencongLiu commented on code in PR #23362: URL: https://github.com/apache/flink/pull/23362#discussion_r1378412748 ## docs/content/docs/dev/datastream/dataset_migration.md: ## @@ -0,0 +1,778 @@ +--- +title: "How to Migrate from DataSet to DataStream" +weight: 302 +type: docs

Re: [PR] [FLINK-33041][docs] Add an article to guide users to migrate their DataSet jobs to DataStream [flink]

2023-10-31 Thread via GitHub
WencongLiu commented on code in PR #23362: URL: https://github.com/apache/flink/pull/23362#discussion_r1378412480 ## docs/content/docs/dev/datastream/dataset_migration.md: ## @@ -0,0 +1,778 @@ +--- +title: "How to Migrate from DataSet to DataStream" +weight: 302 +type: docs

Re: [PR] [FLINK-33041][docs] Add an article to guide users to migrate their DataSet jobs to DataStream [flink]

2023-10-31 Thread via GitHub
WencongLiu commented on code in PR #23362: URL: https://github.com/apache/flink/pull/23362#discussion_r1378412317 ## docs/content/docs/dev/datastream/dataset_migration.md: ## @@ -0,0 +1,778 @@ +--- +title: "How to Migrate from DataSet to DataStream" +weight: 302 +type: docs

Re: [PR] [FLINK-32309][sql-gateway] Use independent resource manager for table environment [flink]

2023-10-31 Thread via GitHub
FangYongs commented on code in PR #22768: URL: https://github.com/apache/flink/pull/22768#discussion_r1378393971 ## flink-table/flink-sql-gateway/src/main/java/org/apache/flink/table/gateway/service/operation/OperationExecutor.java: ## @@ -176,14 +184,17 @@ public ResultFetcher

Re: [PR] [FLINK-26907][Tests] OffHeapUnsafeMemorySegmentTest.testCallCleanerOnceOnConcurrentFree prints IllegalStateException [flink]

2023-10-31 Thread via GitHub
flinkbot commented on PR #23641: URL: https://github.com/apache/flink/pull/23641#issuecomment-1788392864 ## CI report: * ccdfdc101e0b67b72aa5d5e6dfe291987ae72cbf UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[PR] [FLINK-26907][Tests] OffHeapUnsafeMemorySegmentTest.testCallCleanerOnceOnConcurrentFree prints IllegalStateException [flink]

2023-10-31 Thread via GitHub
victor9309 opened a new pull request, #23641: URL: https://github.com/apache/flink/pull/23641 ## What is the purpose of the change *RMQSourceITCase failed on azure due to ContainerLaunchException: Container startup failed, Increase the number of TestContainer startup

Re: [PR] [FLINK-26088][Connectors/ElasticSearch] Add Elasticsearch 8.0 support [flink-connector-elasticsearch]

2023-10-31 Thread via GitHub
StefanXiepj commented on code in PR #74: URL: https://github.com/apache/flink-connector-elasticsearch/pull/74#discussion_r1378366427 ## flink-connector-elasticsearch8/src/main/java/org/apache/flink/connector/elasticsearch/sink/Elasticsearch8Sink.java: ## @@ -0,0 +1,85 @@

Re: [PR] [BP-1.17][FLINK-32426][table-runtime] Fix adaptive local hash can't work when auxGrouping exists [flink]

2023-10-31 Thread via GitHub
flinkbot commented on PR #23640: URL: https://github.com/apache/flink/pull/23640#issuecomment-1788357441 ## CI report: * 68d2083bb1e8be0e89408a8dc73e1c26646f4981 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Closed] (FLINK-33014) flink jobmanager raise java.io.IOException: Connection reset by peer

2023-10-31 Thread zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhu closed FLINK-33014. --- Resolution: Not A Bug Insufficient resource allocation for Tm > flink jobmanager raise java.io.IOException:

[jira] [Closed] (FLINK-32943) run batch tasks concurrently, the tasks still in the initialization status

2023-10-31 Thread zhu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhu closed FLINK-32943. --- Resolution: Not A Bug > run batch tasks concurrently, the tasks still in the initialization status >

[jira] [Updated] (FLINK-26907) RMQSourceITCase failed on azure due to ContainerLaunchException: Container startup failed

2023-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-26907: --- Labels: auto-deprioritized-major pull-request-available starter test-stability (was:

Re: [PR] [FLINK-33386][runtime] Support tasks balancing at slot level for Default Scheduler [flink]

2023-10-31 Thread via GitHub
RocMarshal commented on code in PR #23635: URL: https://github.com/apache/flink/pull/23635#discussion_r1378358266 ## flink-core/src/main/java/org/apache/flink/configuration/TaskManagerOptions.java: ## @@ -708,6 +708,20 @@ public class TaskManagerOptions {

Re: [PR] [FLINK-26907][Tests] OffHeapUnsafeMemorySegmentTest.testCallCleanerOnceOnConcurrentFree prints IllegalStateException [flink]

2023-10-31 Thread via GitHub
flinkbot commented on PR #23639: URL: https://github.com/apache/flink/pull/23639#issuecomment-1788353704 ## CI report: * b914c663f2955c007ac560a465e2799328ef3e04 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-33386][runtime] Support tasks balancing at slot level for Default Scheduler [flink]

2023-10-31 Thread via GitHub
RocMarshal commented on code in PR #23635: URL: https://github.com/apache/flink/pull/23635#discussion_r1378352765 ## flink-runtime/src/main/java/org/apache/flink/runtime/scheduler/BalancedPreferredSlotSharingStrategy.java: ## @@ -0,0 +1,275 @@ +/* + * Licensed to the Apache

[PR] [BP-1.17][FLINK-32426][table-runtime] Fix adaptive local hash can't work when auxGrouping exists [flink]

2023-10-31 Thread via GitHub
lsyldliu opened a new pull request, #23640: URL: https://github.com/apache/flink/pull/23640 ## What is the purpose of the change *Fix adaptive local hash can't work when auxGrouping exists* ## Brief change log - *Fix adaptive local hash can't work when auxGrouping

[PR] [BP-1.15][FLINK-31244][Tests] OffHeapUnsafeMemorySegmentTest.testCallCleanerOnceOnConcurrentFree prints IllegalStateException [flink]

2023-10-31 Thread via GitHub
victor9309 opened a new pull request, #23639: URL: https://github.com/apache/flink/pull/23639 ## What is the purpose of the change *RMQSourceITCase failed on azure due to ContainerLaunchException: Container startup failed, Increase the number of TestContainer startup

Re: [PR] [FLINK-26088][Connectors/ElasticSearch] Add Elasticsearch 8.0 support [flink-connector-elasticsearch]

2023-10-31 Thread via GitHub
liyubin117 commented on code in PR #74: URL: https://github.com/apache/flink-connector-elasticsearch/pull/74#discussion_r1378357036 ## flink-connector-elasticsearch8/src/main/java/org/apache/flink/connector/elasticsearch/sink/Elasticsearch8Sink.java: ## @@ -0,0 +1,85 @@

Re: [PR] [FLINK-32309][sql-gateway] Use independent resource manager for table environment [flink]

2023-10-31 Thread via GitHub
KarmaGYZ commented on code in PR #22768: URL: https://github.com/apache/flink/pull/22768#discussion_r1364801781 ## flink-table/flink-sql-client/src/main/java/org/apache/flink/table/client/resource/ClientResourceManager.java: ## @@ -59,4 +68,10 @@ public URL

Re: [PR] [FLINK-33358][sql] Fix Flink SQL Client fail to start in Flink on YARN [flink]

2023-10-31 Thread via GitHub
lsyldliu commented on PR #23629: URL: https://github.com/apache/flink/pull/23629#issuecomment-1788343978 > In my humble opinion, this change is fine. But I don't know much about the details of flink sql, and I'm not sure whether this change introduces additional risks. It would be better

Re: [PR] [FLINK-33317][runtime] Add cleaning mechanism for initial configs to reduce the memory usage [flink]

2023-10-31 Thread via GitHub
1996fanrui commented on PR #23589: URL: https://github.com/apache/flink/pull/23589#issuecomment-1788342771 Hi @pnowojski @RocMarshal , some unit tests failed when `getStreamOperatorFactory` throwing an exception after `SERIALIZED_UDF` is removed. I researched it for a while and

Re: [PR] [FLINK-26088][Connectors/ElasticSearch] Add Elasticsearch 8.0 support [flink-connector-elasticsearch]

2023-10-31 Thread via GitHub
liyubin117 commented on code in PR #74: URL: https://github.com/apache/flink-connector-elasticsearch/pull/74#discussion_r1377514898 ## flink-connector-elasticsearch8/src/test/java/org/apache/flink/connector/elasticsearch/sink/Elasticsearch8SinkBaseITCase.java: ## @@ -0,0

Re: [PR] [FLINK-26088][Connectors/ElasticSearch] Add Elasticsearch 8.0 support [flink-connector-elasticsearch]

2023-10-31 Thread via GitHub
liyubin117 commented on code in PR #74: URL: https://github.com/apache/flink-connector-elasticsearch/pull/74#discussion_r1377503899 ## flink-connector-elasticsearch8/.gitignore: ## @@ -0,0 +1,38 @@ +target/ +!.mvn/wrapper/maven-wrapper.jar +!**/src/main/**/target/

Re: [PR] [FLINK-33386][runtime] Support tasks balancing at slot level for Default Scheduler [flink]

2023-10-31 Thread via GitHub
1996fanrui commented on code in PR #23635: URL: https://github.com/apache/flink/pull/23635#discussion_r1378332744 ## flink-core/src/main/java/org/apache/flink/configuration/TaskManagerOptions.java: ## @@ -708,6 +708,20 @@ public class TaskManagerOptions {

Re: [PR] [FLINK-33386][runtime] Support tasks balancing at slot level for Default Scheduler [flink]

2023-10-31 Thread via GitHub
1996fanrui commented on code in PR #23635: URL: https://github.com/apache/flink/pull/23635#discussion_r1378331133 ## flink-core/src/main/java/org/apache/flink/configuration/TaskManagerOptions.java: ## @@ -708,6 +708,20 @@ public class TaskManagerOptions {

Re: [PR] [FLINK-32107] [Tests] 1.17 Kubernetes test failed because ofunable to establish ssl connection to github on AZP [flink]

2023-10-31 Thread via GitHub
victor9309 closed pull request #23636: [FLINK-32107] [Tests] 1.17 Kubernetes test failed because ofunable to establish ssl connection to github on AZP URL: https://github.com/apache/flink/pull/23636 -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] [FLINK-32107] [Tests] 1.17 Kubernetes test failed because ofunable to establish ssl connection to github on AZP [flink]

2023-10-31 Thread via GitHub
victor9309 closed pull request #23636: [FLINK-32107] [Tests] 1.17 Kubernetes test failed because ofunable to establish ssl connection to github on AZP URL: https://github.com/apache/flink/pull/23636 -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] [BP-1.17][FLINK-32107] [Tests] Kubernetes test failed because ofunable to establish ssl connection to github on AZP [flink]

2023-10-31 Thread via GitHub
flinkbot commented on PR #23638: URL: https://github.com/apache/flink/pull/23638#issuecomment-1788261124 ## CI report: * d07d72543b49f24c788d5c52834e286f8e5350d7 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [BP-1.18][FLINK-32107] [Tests] Kubernetes test failed because ofunable to establish ssl connection to github on AZP [flink]

2023-10-31 Thread via GitHub
flinkbot commented on PR #23637: URL: https://github.com/apache/flink/pull/23637#issuecomment-1788260613 ## CI report: * 1c7554f97aee03b0ab87c129eb2defd63d949718 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[PR] [BP-1.17][FLINK-32107] [Tests] Kubernetes test failed because ofunable to establish ssl connection to github on AZP [flink]

2023-10-31 Thread via GitHub
victor9309 opened a new pull request, #23638: URL: https://github.com/apache/flink/pull/23638 ## What is the purpose of the change * Backport of https://github.com/apache/flink/pull/23528 to release-1.17,We could make CI fail earlier when download fails.* ## Brief

[PR] [BP-1.18][FLINK-32107] [Tests] Kubernetes test failed because ofunable to establish ssl connection to github on AZP [flink]

2023-10-31 Thread via GitHub
victor9309 opened a new pull request, #23637: URL: https://github.com/apache/flink/pull/23637 ## What is the purpose of the change * Backport of https://github.com/apache/flink/pull/23528 to release-1.18,We could make CI fail earlier when download fails.* ## Brief

Re: [PR] [FLINK-32107] [Tests] 1.17 Kubernetes test failed because ofunable to establish ssl connection to github on AZP [flink]

2023-10-31 Thread via GitHub
flinkbot commented on PR #23636: URL: https://github.com/apache/flink/pull/23636#issuecomment-1788253541 ## CI report: * d07d72543b49f24c788d5c52834e286f8e5350d7 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[PR] [FLINK-32107] [Tests] 1.17 Kubernetes test failed because ofunable to establish ssl connection to github on AZP [flink]

2023-10-31 Thread via GitHub
victor9309 opened a new pull request, #23636: URL: https://github.com/apache/flink/pull/23636 ## What is the purpose of the change *(We could make CI fail earlier when download fails.)* ## Brief change log - *backports 1.17,modify common_kubernetes.sh*

[jira] [Comment Edited] (FLINK-33401) Kafka connector has broken version

2023-10-31 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781563#comment-17781563 ] Yuxin Tan edited comment on FLINK-33401 at 11/1/23 12:24 AM: - [~pavelhp] If

[jira] [Commented] (FLINK-33401) Kafka connector has broken version

2023-10-31 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781563#comment-17781563 ] Yuxin Tan commented on FLINK-33401: --- [~pavelhp] If you wish to try it in Flink 1.18, you may need to

Re: [PR] [FLINK-33401][connectors/kafka] Fix the wrong download link and version in the connector doc [flink-connector-kafka]

2023-10-31 Thread via GitHub
TanYuxin-tyx commented on PR #64: URL: https://github.com/apache/flink-connector-kafka/pull/64#issuecomment-1788206919 @MartijnVisser, Thanks for helping review. This fix aims to resolve the issue of displaying the incorrect version number (-1.18) for the Kafka connector.

[jira] [Updated] (FLINK-33422) Implement restore tests for Calc node

2023-10-31 Thread Bonnie Varghese (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bonnie Varghese updated FLINK-33422: Summary: Implement restore tests for Calc node (was: Add restore tests for Calc node) >

[jira] [Created] (FLINK-33422) Add restore tests for Calc node

2023-10-31 Thread Bonnie Varghese (Jira)
Bonnie Varghese created FLINK-33422: --- Summary: Add restore tests for Calc node Key: FLINK-33422 URL: https://issues.apache.org/jira/browse/FLINK-33422 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-33421) Implement ExecNode Restore Tests

2023-10-31 Thread Bonnie Varghese (Jira)
Bonnie Varghese created FLINK-33421: --- Summary: Implement ExecNode Restore Tests Key: FLINK-33421 URL: https://issues.apache.org/jira/browse/FLINK-33421 Project: Flink Issue Type:

[jira] [Comment Edited] (FLINK-33402) Hybrid Source Concurrency Race Condition Fixes and Related Bugs Results in Data Loss

2023-10-31 Thread Varun Narayanan Chakravarthy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781516#comment-17781516 ] Varun Narayanan Chakravarthy edited comment on FLINK-33402 at 10/31/23 9:10 PM:

[jira] [Commented] (FLINK-33402) Hybrid Source Concurrency Race Condition Fixes and Related Bugs Results in Data Loss

2023-10-31 Thread Varun Narayanan Chakravarthy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781516#comment-17781516 ] Varun Narayanan Chakravarthy commented on FLINK-33402: -- I had previously

[jira] (FLINK-27758) [JUnit5 Migration] Module: flink-table-runtime

2023-10-31 Thread Chao Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27758 ] Chao Liu deleted comment on FLINK-27758: -- was (Author: JIRAUSER302840): Hi [~Sergey Nuyanzin] I'd like to work on this ticket, could I get assigned to this? > [JUnit5 Migration] Module:

Re: [PR] [FLINK-28050][connectors] Migrate StreamExecutionEnvironment#fromElements() implementation to FLIP-27 Source API [flink]

2023-10-31 Thread via GitHub
afedulov commented on PR #23553: URL: https://github.com/apache/flink/pull/23553#issuecomment-1787923597 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Updated] (FLINK-33420) Run e2e test fails Intermetiently with ClientCoordinationHandler : Unhandled exception

2023-10-31 Thread Samrat Deb (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Samrat Deb updated FLINK-33420: --- Description:   ``` Oct 31 08:49:37 2023-10-31 08:49:33,348 ERROR

[jira] [Created] (FLINK-33420) Run e2e test fails Intermetiently with ClientCoordinationHandler : Unhandled exception

2023-10-31 Thread Samrat Deb (Jira)
Samrat Deb created FLINK-33420: -- Summary: Run e2e test fails Intermetiently with ClientCoordinationHandler : Unhandled exception Key: FLINK-33420 URL: https://issues.apache.org/jira/browse/FLINK-33420

[jira] [Updated] (FLINK-33402) Hybrid Source Concurrency Race Condition Fixes and Related Bugs Results in Data Loss

2023-10-31 Thread Varun Narayanan Chakravarthy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Narayanan Chakravarthy updated FLINK-33402: - Description: Hello Team, I noticed that there is data loss when

[jira] [Updated] (FLINK-33402) Hybrid Source Concurrency Race Condition Fixes and Related Bugs

2023-10-31 Thread Varun Narayanan Chakravarthy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Narayanan Chakravarthy updated FLINK-33402: - Priority: Blocker (was: Major) > Hybrid Source Concurrency

[jira] [Commented] (FLINK-33402) Hybrid Source Concurrency Race Condition Fixes and Related Bugs

2023-10-31 Thread Varun Narayanan Chakravarthy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781476#comment-17781476 ] Varun Narayanan Chakravarthy commented on FLINK-33402: -- Similar issues

[jira] [Updated] (FLINK-33402) Hybrid Source Concurrency Race Condition Fixes and Related Bugs Results in Data Loss

2023-10-31 Thread Varun Narayanan Chakravarthy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Narayanan Chakravarthy updated FLINK-33402: - Summary: Hybrid Source Concurrency Race Condition Fixes and

[jira] [Commented] (FLINK-31275) Flink supports reporting and storage of source/sink tables relationship

2023-10-31 Thread Maciej Obuchowski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781471#comment-17781471 ] Maciej Obuchowski commented on FLINK-31275: --- [~zjureel] Sorry, it's probably too late for this

[jira] (FLINK-31275) Flink supports reporting and storage of source/sink tables relationship

2023-10-31 Thread Maciej Obuchowski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31275 ] Maciej Obuchowski deleted comment on FLINK-31275: --- was (Author: mobuchowski): [~zjureel] Sorry, it's probably too late for this comment as FLIP is accepted. But I'll still voice

[jira] [Commented] (FLINK-31275) Flink supports reporting and storage of source/sink tables relationship

2023-10-31 Thread Maciej Obuchowski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781458#comment-17781458 ] Maciej Obuchowski commented on FLINK-31275: --- [~zjureel] Sorry, it's probably too late for this

[jira] [Commented] (FLINK-33418) SqlGatewayE2ECase failed due to ConnectException

2023-10-31 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781449#comment-17781449 ] Matthias Pohl commented on FLINK-33418: ---

Re: [PR] [FLINK-33358][sql] Fix Flink SQL Client fail to start in Flink on YARN [flink]

2023-10-31 Thread via GitHub
PrabhuJoseph commented on PR #23629: URL: https://github.com/apache/flink/pull/23629#issuecomment-1787531140 @Samrat002 @1996fanrui Could you review this patch when you have time? Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Assigned] (FLINK-24379) Support AWS Glue Schema Registry Avro for Table API

2023-10-31 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer reassigned FLINK-24379: - Assignee: Lorenzo Nicora > Support AWS Glue Schema Registry Avro for Table API >

Re: [PR] [FLINK-32380] Support Java Records with PojoTypeInfo/Serializer [flink]

2023-10-31 Thread via GitHub
gyfora commented on PR #23490: URL: https://github.com/apache/flink/pull/23490#issuecomment-1787514161 @XComp we have a green CI run with the Java tests enabled , I will remove that commit before merging. Do you have any further comments? I think I addressed most things -- This is

Re: [PR] [FLINK-33386][runtime] Support tasks balancing at slot level for Default Scheduler [flink]

2023-10-31 Thread via GitHub
flinkbot commented on PR #23635: URL: https://github.com/apache/flink/pull/23635#issuecomment-1787488771 ## CI report: * 0816a1779cbf97c1e3526e18e70d3d2e09817a05 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-33419] Port PROCTIME/ROWTIME functions to the new inference stack [flink]

2023-10-31 Thread via GitHub
flinkbot commented on PR #23634: URL: https://github.com/apache/flink/pull/23634#issuecomment-1787478201 ## CI report: * e204a5e3d94da5b0e4f31af5f31846c910a924f3 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-33386) Support tasks balancing at slot level for Default Scheduler

2023-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-33386: --- Labels: pull-request-available (was: ) > Support tasks balancing at slot level for Default

[PR] [FLINK-33386][runtime] Support tasks balancing at slot level for Default Scheduler [flink]

2023-10-31 Thread via GitHub
RocMarshal opened a new pull request, #23635: URL: https://github.com/apache/flink/pull/23635 ## What is the purpose of the change - Support tasks balancing at slot level for Default Scheduler ## Brief change log - *Introduce

[jira] [Commented] (FLINK-33242) misc module: YARN tests are flaky

2023-10-31 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781430#comment-17781430 ] Matthias Pohl commented on FLINK-33242: --- Interestingly, we have a build where the yarn tests

[jira] [Updated] (FLINK-33419) Port PROCTIME/ROWTIME functions to the new inference stack

2023-10-31 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-33419: --- Labels: pull-request-available (was: ) > Port PROCTIME/ROWTIME functions to the new

[PR] [FLINK-33419] Port PROCTIME/ROWTIME functions to the new inference stack [flink]

2023-10-31 Thread via GitHub
dawidwys opened a new pull request, #23634: URL: https://github.com/apache/flink/pull/23634 ## What is the purpose of the change Ports `PROCTIME` & `ROWTIME` functions to the new inference stack. ## Verifying this change Added tests for the input type strategy ##

[jira] [Created] (FLINK-33419) Port PROCTIME/ROWTIME functions to the new inference stack

2023-10-31 Thread Dawid Wysakowicz (Jira)
Dawid Wysakowicz created FLINK-33419: Summary: Port PROCTIME/ROWTIME functions to the new inference stack Key: FLINK-33419 URL: https://issues.apache.org/jira/browse/FLINK-33419 Project: Flink

[jira] [Commented] (FLINK-33418) SqlGatewayE2ECase failed due to ConnectException

2023-10-31 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781426#comment-17781426 ] Matthias Pohl commented on FLINK-33418: ---

[jira] [Updated] (FLINK-33418) SqlGatewayE2ECase failed due to ConnectException

2023-10-31 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-33418: -- Description: The container couldn't be started in [this

[jira] [Created] (FLINK-33418) SqlGatewayE2ECase failed due to ConnectException

2023-10-31 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-33418: - Summary: SqlGatewayE2ECase failed due to ConnectException Key: FLINK-33418 URL: https://issues.apache.org/jira/browse/FLINK-33418 Project: Flink Issue

Re: [PR] [FLINK-33408] Fixing the container vulnerability by upgrade the SnakeYaml Maven dependency in flink-kubernetes module. [flink]

2023-10-31 Thread via GitHub
ShijieHome commented on PR #23631: URL: https://github.com/apache/flink/pull/23631#issuecomment-1787444937 @tweise @mbalassi @gyfora , could you please check this PR for me. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[PR] Adding AWS Connectors v4.2.0 [flink-web]

2023-10-31 Thread via GitHub
dannycranmer opened a new pull request, #693: URL: https://github.com/apache/flink-web/pull/693 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[jira] [Commented] (FLINK-33283) core stage: WebFrontendBootstrapTest.testHandlersMustBeLoaded

2023-10-31 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781422#comment-17781422 ] Matthias Pohl commented on FLINK-33283: --- I did a test run where I repeatedly run

[jira] [Updated] (FLINK-33259) flink-connector-aws should use/extend the common connector workflow

2023-10-31 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-33259: -- Fix Version/s: aws-connector-4.3.0 (was: aws-connector-4.2.0) >

[jira] [Updated] (FLINK-33260) Custom Error Handling for Kinesis Consumer

2023-10-31 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-33260: -- Affects Version/s: aws-connector-4.2.0 > Custom Error Handling for Kinesis Consumer >

[jira] [Updated] (FLINK-33260) Custom Error Handling for Kinesis Consumer

2023-10-31 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-33260: -- Fix Version/s: aws-connector-4.3.0 (was: aws-connector-4.2.0) > Custom

[jira] [Updated] (FLINK-33259) flink-connector-aws should use/extend the common connector workflow

2023-10-31 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-33259: -- Affects Version/s: aws-connector-4.2.0 (was: aws-connector-4.1.0)

[jira] [Resolved] (FLINK-33072) Implement end-to-end tests for AWS Kinesis Connectors

2023-10-31 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer resolved FLINK-33072. --- Assignee: Hong Liang Teoh Resolution: Done > Implement end-to-end tests for AWS

[jira] [Updated] (FLINK-32116) FlinkKinesisConsumer cannot stop-with-savepoint when configured with watermark assigner and watermark tracker

2023-10-31 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-32116: -- Affects Version/s: aws-connector-4.2.0 (was: aws-connector-4.1.0)

[jira] [Updated] (FLINK-33072) Implement end-to-end tests for AWS Kinesis Connectors

2023-10-31 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-33072: -- Fix Version/s: aws-connector-4.2.0 (was: 2.0.0) > Implement end-to-end

[jira] [Resolved] (FLINK-33073) Implement end-to-end tests for the Kinesis Streams Sink

2023-10-31 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer resolved FLINK-33073. --- Resolution: Fixed > Implement end-to-end tests for the Kinesis Streams Sink >

[jira] [Updated] (FLINK-32116) FlinkKinesisConsumer cannot stop-with-savepoint when configured with watermark assigner and watermark tracker

2023-10-31 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-32116: -- Fix Version/s: aws-connector-4.3.0 (was: aws-connector-4.2.0) >

[jira] [Updated] (FLINK-31872) Add Support for Configuring AIMD Ratelimiting strategy parameters by Sink users for KinesisStreamsSink

2023-10-31 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-31872: -- Fix Version/s: aws-connector-4.3.0 (was: aws-connector-4.2.0) > Add

[jira] [Updated] (FLINK-31872) Add Support for Configuring AIMD Ratelimiting strategy parameters by Sink users for KinesisStreamsSink

2023-10-31 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-31872: -- Affects Version/s: aws-connector-4.2.0 > Add Support for Configuring AIMD Ratelimiting

[jira] [Updated] (FLINK-31922) Port over Kinesis Client configurations for retry and backoff

2023-10-31 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-31922: -- Affects Version/s: aws-connector-4.2.0 > Port over Kinesis Client configurations for retry

[jira] [Updated] (FLINK-31922) Port over Kinesis Client configurations for retry and backoff

2023-10-31 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-31922: -- Fix Version/s: aws-connector-4.3.0 (was: aws-connector-4.2.0) > Port

[jira] [Assigned] (FLINK-24379) Support AWS Glue Schema Registry Avro for Table API

2023-10-31 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer reassigned FLINK-24379: - Assignee: (was: Karthi Thyagarajan) > Support AWS Glue Schema Registry Avro for

[jira] [Updated] (FLINK-25779) Define ConfigOption for aws, scan and sink map in Kinesis

2023-10-31 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-25779: -- Fix Version/s: aws-connector-4.3.0 (was: aws-connector-4.2.0) > Define

[jira] [Updated] (FLINK-24379) Support AWS Glue Schema Registry Avro for Table API

2023-10-31 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-24379: -- Fix Version/s: aws-connector-4.3.0 (was: aws-connector-4.2.0) >

[jira] [Updated] (FLINK-25779) Define ConfigOption for aws, scan and sink map in Kinesis

2023-10-31 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-25779: -- Affects Version/s: aws-connector-4.2.0 > Define ConfigOption for aws, scan and sink map in

[jira] [Updated] (FLINK-24379) Support AWS Glue Schema Registry Avro for Table API

2023-10-31 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-24379: -- Affects Version/s: aws-connector-4.2.0 (was: 1.14.0) > Support AWS

[jira] [Commented] (FLINK-31815) Fixing the container vulnerability by upgrade the SnakeYaml Maven dependency

2023-10-31 Thread Zhou Shijie (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17781407#comment-17781407 ] Zhou Shijie commented on FLINK-31815: - Hi, [~gyfora], could you help me review the issue

[jira] [Closed] (FLINK-25809) Introduce test infra for building FLIP-190 tests

2023-10-31 Thread Timo Walther (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timo Walther closed FLINK-25809. Resolution: Fixed Based on recent feedback, we slightly improved the API. Fixed in master:

[jira] [Reopened] (FLINK-25809) Introduce test infra for building FLIP-190 tests

2023-10-31 Thread Timo Walther (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timo Walther reopened FLINK-25809: -- > Introduce test infra for building FLIP-190 tests >

  1   2   3   >