Re: [PR] [FLINK-32082][docs] Documentation of checkpoint file-merging [flink]

2024-05-12 Thread via GitHub
masteryhx commented on code in PR #24766: URL: https://github.com/apache/flink/pull/24766#discussion_r1597905886 ## docs/content/docs/dev/datastream/fault-tolerance/checkpointing.md: ## @@ -292,4 +292,25 @@ The final checkpoint would be triggered immediately after all

Re: [PR] [FLINK-35030][runtime] Introduce Epoch Manager under async execution [flink]

2024-05-12 Thread via GitHub
yunfengzhou-hub commented on code in PR #24748: URL: https://github.com/apache/flink/pull/24748#discussion_r1597912452 ## flink-runtime/src/main/java/org/apache/flink/runtime/asyncprocessing/EpochManager.java: ## @@ -0,0 +1,202 @@ +/* + * Licensed to the Apache Software

Re: [PR] [FLINK-35168][State] Basic State Iterator for async processing [flink]

2024-05-12 Thread via GitHub
masteryhx commented on code in PR #24690: URL: https://github.com/apache/flink/pull/24690#discussion_r1597852929 ## flink-runtime/src/main/java/org/apache/flink/runtime/asyncprocessing/AbstractStateIterator.java: ## @@ -0,0 +1,141 @@ +/* + * Licensed to the Apache Software

[PR] [hot][doc-ci] Add release 3.1 and enable build check for pr [flink-cdc]

2024-05-12 Thread via GitHub
GOODBOY008 opened a new pull request, #3317: URL: https://github.com/apache/flink-cdc/pull/3317 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [FLINK-35047][state] Shutdown StateExecutors when ForStKeyedStateBackend is disposed [flink]

2024-05-12 Thread via GitHub
masteryhx commented on code in PR #24768: URL: https://github.com/apache/flink/pull/24768#discussion_r1597840604 ## flink-state-backends/flink-statebackend-forst/src/main/java/org/apache/flink/state/forst/ForStKeyedStateBackend.java: ## @@ -147,15 +160,30 @@ public S

[jira] [Updated] (FLINK-35237) Allow Sink to Choose HashFunction in PrePartitionOperator

2024-05-12 Thread zhangdingxin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangdingxin updated FLINK-35237: - Fix Version/s: cdc-3.2.0 > Allow Sink to Choose HashFunction in PrePartitionOperator >

Re: [PR] [FLINK-35328] AutoScale supports setting the maximum floating parallelism by the number of Pulsar partitions [flink-kubernetes-operator]

2024-05-12 Thread via GitHub
wenbingshen commented on PR #827: URL: https://github.com/apache/flink-kubernetes-operator/pull/827#issuecomment-2106527073 > Thanks for the improvement! > > LGTM > > cc @gyfora @1996fanrui Can anyone else review this PR? Thanks. -- This is an automated message from

Re: [PR] [FLINK-34615]Split `ExternalizedCheckpointCleanup` out of `Checkpoint… [flink]

2024-05-12 Thread via GitHub
spoon-lz commented on PR #24461: URL: https://github.com/apache/flink/pull/24461#issuecomment-2106510219 @Zakelly @masteryhx A new `ExternalizedCheckpointRetention.py` is created, the old one is marked as deprecated, and a separate commit for the python part is split. -- This is an

Re: [PR] [FLINK-33986][runtime] Extend ShuffleMaster to support snapshot and restore state. [flink]

2024-05-12 Thread via GitHub
flinkbot commented on PR #24774: URL: https://github.com/apache/flink/pull/24774#issuecomment-2106499628 ## CI report: * 93334c7356336561bc6a97c1eb8ceb7509f647a7 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-33986) Extend shuffleMaster to support batch snapshot.

2024-05-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-33986: --- Labels: pull-request-available (was: ) > Extend shuffleMaster to support batch snapshot. >

[PR] [FLINK-33986][runtime] Extend ShuffleMaster to support snapshot and restore state. [flink]

2024-05-12 Thread via GitHub
JunRuiLee opened a new pull request, #24774: URL: https://github.com/apache/flink/pull/24774 ## What is the purpose of the change Extend ShuffleMaster to support snapshot and restore state. ## Brief change log Extend shuffleMaster to support batch

[jira] [Commented] (FLINK-35197) Support the execution of suspend, resume materialized table in continuous refresh mode

2024-05-12 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845761#comment-17845761 ] dalongliu commented on FLINK-35197: --- Merged in master: e4972c003f68da6dc4066459d4c6e5d981f07e96 >

[jira] [Resolved] (FLINK-35197) Support the execution of suspend, resume materialized table in continuous refresh mode

2024-05-12 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dalongliu resolved FLINK-35197. --- Resolution: Fixed > Support the execution of suspend, resume materialized table in continuous >

Re: [PR] [FLINK-35197][table] Support the execution of supsend materialized table in continuous refresh mode [flink]

2024-05-12 Thread via GitHub
lsyldliu closed pull request #24765: [FLINK-35197][table] Support the execution of supsend materialized table in continuous refresh mode URL: https://github.com/apache/flink/pull/24765 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] [FLINK-24379][Formats] Avro Glue Schema Registry table format [flink-connector-aws]

2024-05-12 Thread via GitHub
nicusX commented on code in PR #122: URL: https://github.com/apache/flink-connector-aws/pull/122#discussion_r1597692785 ## flink-formats-aws/flink-sql-avro-glue-schema-registry/pom.xml: ## @@ -0,0 +1,163 @@ + + +http://maven.apache.org/POM/4.0.0; +

Re: [PR] [FLINK-31228] Update kafka and zookeeper docker image [flink-playgrounds]

2024-05-12 Thread via GitHub
robertkosz commented on PR #41: URL: https://github.com/apache/flink-playgrounds/pull/41#issuecomment-2106323518 Since all wurstmeister images are gone on docker, this is kind of a must now, docker compose up fails on operations-playground. -- This is an automated message from the

Re: [PR] [FLINK-34108][table] Add built-in URL_ENCODE and URL_DECODE function. [flink]

2024-05-12 Thread via GitHub
superdiaodiao commented on PR #24773: URL: https://github.com/apache/flink/pull/24773#issuecomment-2106260978 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Comment Edited] (FLINK-34108) Add URL_ENCODE and URL_DECODE function

2024-05-12 Thread chesterxu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845659#comment-17845659 ] chesterxu edited comment on FLINK-34108 at 5/12/24 1:42 PM: Hey, there~ If

Re: [PR] [FLINK-34108][table] Add built-in URL_ENCODE and URL_DECODE function. [flink]

2024-05-12 Thread via GitHub
superdiaodiao commented on PR #24773: URL: https://github.com/apache/flink/pull/24773#issuecomment-2106248298 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [FLINK-34108][table] Add built-in URL_ENCODE and URL_DECODE function. [flink]

2024-05-12 Thread via GitHub
flinkbot commented on PR #24773: URL: https://github.com/apache/flink/pull/24773#issuecomment-2106247014 ## CI report: * d7b8727596cda8b1feb6edb3c465043ed764fa4c UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Comment Edited] (FLINK-34108) Add URL_ENCODE and URL_DECODE function

2024-05-12 Thread chesterxu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845659#comment-17845659 ] chesterxu edited comment on FLINK-34108 at 5/12/24 1:24 PM:

[jira] [Updated] (FLINK-34108) Add URL_ENCODE and URL_DECODE function

2024-05-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-34108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-34108: --- Labels: pull-request-available (was: ) > Add URL_ENCODE and URL_DECODE function >

[PR] [FLINK-34108][table] Add built-in URL_ENCODE and URL_DECODE function. [flink]

2024-05-12 Thread via GitHub
superdiaodiao opened a new pull request, #24773: URL: https://github.com/apache/flink/pull/24773 ## What is the purpose of the change This is an implementation of URL_ENCODE and URL_DECODE 1. URL_ENCODE: Translates a string into 'application/x-www-form-urlencoded'

[jira] [Commented] (FLINK-35322) PubSub Connector Weekly build fails

2024-05-12 Thread Ahmed Hamdy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845682#comment-17845682 ] Ahmed Hamdy commented on FLINK-35322: - [~Sergey Nuyanzin] yes, let's keep it till after the release

[jira] [Commented] (FLINK-35322) PubSub Connector Weekly build fails

2024-05-12 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845676#comment-17845676 ] Sergey Nuyanzin commented on FLINK-35322: - Currently not sure whether we can close this task,

[jira] [Commented] (FLINK-35322) PubSub Connector Weekly build fails

2024-05-12 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17845675#comment-17845675 ] Sergey Nuyanzin commented on FLINK-35322: - Merged as

Re: [PR] [FLINK-35322][Connectors/Google PubSub] Remove weekly tests of 1.19 for unsupporting version v3.0 [flink-connector-gcp-pubsub]

2024-05-12 Thread via GitHub
boring-cyborg[bot] commented on PR #26: URL: https://github.com/apache/flink-connector-gcp-pubsub/pull/26#issuecomment-2106180994 Awesome work, congrats on your first merged pull request! -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [PR] [FLINK-35322][Connectors/Google PubSub] Remove weekly tests of 1.19 for unsupporting version v3.0 [flink-connector-gcp-pubsub]

2024-05-12 Thread via GitHub
snuyanzin merged PR #26: URL: https://github.com/apache/flink-connector-gcp-pubsub/pull/26 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Assigned] (FLINK-35322) PubSub Connector Weekly build fails

2024-05-12 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-35322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin reassigned FLINK-35322: --- Assignee: Ahmed Hamdy > PubSub Connector Weekly build fails >

Re: [PR] [FLINK-35322][Connectors/Google PubSub] Remove weekly tests of 1.19 for unsupporting version v3.0 [flink-connector-gcp-pubsub]

2024-05-12 Thread via GitHub
vahmed-hamdy commented on PR #26: URL: https://github.com/apache/flink-connector-gcp-pubsub/pull/26#issuecomment-2106175939 @snuyanzin yes, I added the rub link to the PR description for the same

Re: [PR] [FLINK-35305](https://issues.apache.org/jira/browse/FLINK-35305)Amazon SQS Sink Connector [flink-connector-aws]

2024-05-12 Thread via GitHub
vahmed-hamdy commented on code in PR #141: URL: https://github.com/apache/flink-connector-aws/pull/141#discussion_r1597507484 ## flink-connector-aws/flink-connector-sqs/src/test/java/org.apache.flink/connector.sqs/sink/testutils/SqsTestUtils.java: ## @@ -0,0 +1,76 @@ +/* + *

[jira] [Updated] (FLINK-33859) Support OpenSearch v2

2024-05-12 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin updated FLINK-33859: Affects Version/s: (was: opensearch-1.2.0) > Support OpenSearch v2 >

[jira] [Updated] (FLINK-33859) Support OpenSearch v2

2024-05-12 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin updated FLINK-33859: Affects Version/s: opensearch-1.1.0 > Support OpenSearch v2 > - > >