[GitHub] [flink] 1996fanrui commented on pull request #23119: [FLINK-32663][checkpoint] Fix the bug that checkpoint should not be triggered after all tasks have received end-of-data when checkpoint is

2023-08-01 Thread via GitHub
1996fanrui commented on PR #23119: URL: https://github.com/apache/flink/pull/23119#issuecomment-1661540796 Thanks @lindong28 for the quick review and merge! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Closed] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin closed FLINK-32663. Resolution: Fixed > RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on > AZP

[jira] [Commented] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750102#comment-17750102 ] Dong Lin commented on FLINK-32663: -- Merged to apache/flink master branch

[GitHub] [flink] lindong28 merged pull request #23119: [FLINK-32663][checkpoint] Fix the bug that checkpoint should not be triggered after all tasks have received end-of-data when checkpoint is disabl

2023-08-01 Thread via GitHub
lindong28 merged PR #23119: URL: https://github.com/apache/flink/pull/23119 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink] lindong28 commented on pull request #23119: [FLINK-32663][checkpoint] Fix the bug that checkpoint should not be triggered after all tasks have received end-of-data when checkpoint is

2023-08-01 Thread via GitHub
lindong28 commented on PR #23119: URL: https://github.com/apache/flink/pull/23119#issuecomment-1661514057 Thanks for the PR! LGTM. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [flink] 1996fanrui commented on pull request #23119: [FLINK-32663][checkpoint] Fix the bug that checkpoint should not be triggered after all tasks have received end-of-data when checkpoint is

2023-08-01 Thread via GitHub
1996fanrui commented on PR #23119: URL: https://github.com/apache/flink/pull/23119#issuecomment-1661496280 cc @lindong28 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Commented] (FLINK-32658) State should not be silently removed when ignore-unclaimed-state is false

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750097#comment-17750097 ] Rui Fan commented on FLINK-32658: - Hi [~Zakelly], thanks for your reply. {quote}you mean there is a

[jira] [Commented] (FLINK-32730) BatchExecMultipleInput may contain unsupported SourceTransformation

2023-08-01 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750096#comment-17750096 ] Weijie Guo commented on FLINK-32730: By offline discuss with [~lsy], this is caused by FLINK-32608.

[jira] [Commented] (FLINK-32730) BatchExecMultipleInput may contain unsupported SourceTransformation

2023-08-01 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750095#comment-17750095 ] Weijie Guo commented on FLINK-32730: Marked as blocker as this can be stably reproduced. >

[jira] [Updated] (FLINK-32730) BatchExecMultipleInput may contain unsupported SourceTransformation

2023-08-01 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-32730: --- Component/s: Table SQL / Planner > BatchExecMultipleInput may contain unsupported

[jira] [Updated] (FLINK-32730) BatchExecMultipleInput may contain unsupported SourceTransformation

2023-08-01 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-32730: --- Affects Version/s: 1.18.0 > BatchExecMultipleInput may contain unsupported SourceTransformation >

[jira] [Created] (FLINK-32730) BatchExecMultipleInput may contain unsupported SourceTransformation

2023-08-01 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-32730: -- Summary: BatchExecMultipleInput may contain unsupported SourceTransformation Key: FLINK-32730 URL: https://issues.apache.org/jira/browse/FLINK-32730 Project: Flink

[jira] [Resolved] (FLINK-32676) Add doc for catalog modification listener

2023-08-01 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren resolved FLINK-32676. --- Resolution: Fixed > Add doc for catalog modification listener >

[jira] [Commented] (FLINK-32676) Add doc for catalog modification listener

2023-08-01 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750092#comment-17750092 ] Qingsheng Ren commented on FLINK-32676: --- master: 7a5500e390a8ea7076fc1fb73eb248468a42032b > Add

[jira] [Updated] (FLINK-32676) Add doc for catalog modification listener

2023-08-01 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren updated FLINK-32676: -- Fix Version/s: 1.18.0 > Add doc for catalog modification listener >

[GitHub] [flink] PatrickRen merged pull request #23078: [FLINK-32676][doc] Add doc for catalog modification listener

2023-08-01 Thread via GitHub
PatrickRen merged PR #23078: URL: https://github.com/apache/flink/pull/23078 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink] Satzyakiz closed pull request #23120: Added initial spatial support

2023-08-01 Thread via GitHub
Satzyakiz closed pull request #23120: Added initial spatial support URL: https://github.com/apache/flink/pull/23120 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[jira] [Commented] (FLINK-32658) State should not be silently removed when ignore-unclaimed-state is false

2023-08-01 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750090#comment-17750090 ] Zakelly Lan commented on FLINK-32658: - [~fanrui] IIUC, you mean there is a problem when the state

[GitHub] [flink] Satzyakiz opened a new pull request, #23120: Added initial spatial support

2023-08-01 Thread via GitHub
Satzyakiz opened a new pull request, #23120: URL: https://github.com/apache/flink/pull/23120 ## What is the purpose of the change * This PR adds spatial support to the Flink framework. * ## Brief change log *(for example:)* - *The TaskInfo is

[GitHub] [flink] flinkbot commented on pull request #23119: [FLINK-32663][checkpoint] Fix the bug that checkpoint should not be triggered after all tasks have received end-of-data when checkpoint is d

2023-08-01 Thread via GitHub
flinkbot commented on PR #23119: URL: https://github.com/apache/flink/pull/23119#issuecomment-1661453151 ## CI report: * ca6d610b3ea26671ac62115acf1a186ffd2d42c6 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-32663: --- Labels: pull-request-available test-stability (was: test-stability) >

[jira] [Comment Edited] (FLINK-31757) Optimize Flink un-balanced tasks scheduling

2023-08-01 Thread RocMarshal (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750078#comment-17750078 ] RocMarshal edited comment on FLINK-31757 at 8/2/23 3:54 AM: Hi,

[GitHub] [flink] 1996fanrui opened a new pull request, #23119: [FLINK-32663][checkpoint] Fix the bug that checkpoint should not be triggered after all tasks have received end-of-data when checkpoint i

2023-08-01 Thread via GitHub
1996fanrui opened a new pull request, #23119: URL: https://github.com/apache/flink/pull/23119 ## What is the purpose of the change Fix the bug that checkpoint should not be triggered after all tasks have received end-of-data when checkpoint is disabled. ## Brief change log

[jira] [Commented] (FLINK-31757) Optimize Flink un-balanced tasks scheduling

2023-08-01 Thread RocMarshal (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750078#comment-17750078 ] RocMarshal commented on FLINK-31757: Hi, [~heigebupahei] Thanks for your attention. we've updated

[jira] [Commented] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750073#comment-17750073 ] Dong Lin commented on FLINK-32663: -- [~fanrui] Thanks for the investigation! FLINK-27386 is expected to

[jira] [Commented] (FLINK-32107) Kubernetes test failed because ofunable to establish ssl connection to github on AZP

2023-08-01 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750067#comment-17750067 ] Leonard Xu commented on FLINK-32107: another instance:

[jira] [Resolved] (FLINK-28046) Annotate SourceFunction as deprecated

2023-08-01 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu resolved FLINK-28046. Resolution: Resolved Fixed in master(1.18): fc3035b40fbdf32694eb90c78c4dd68608c1c9d1 > Annotate

[jira] [Commented] (FLINK-32548) Make watermark alignment ready for production use

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750064#comment-17750064 ] Rui Fan commented on FLINK-32548: - Hi [~knaufk], the beta and Experimental of watermark alignment have

[GitHub] [flink] leonardBang merged pull request #23106: [FLINK-28046][connectors] Mark SourceFunction interface as @Deprecated

2023-08-01 Thread via GitHub
leonardBang merged PR #23106: URL: https://github.com/apache/flink/pull/23106 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Resolved] (FLINK-32705) Remove the beta for watermark alignment

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan resolved FLINK-32705. - Fix Version/s: 1.18.0 Resolution: Fixed > Remove the beta for watermark alignment >

[jira] [Commented] (FLINK-32705) Remove the beta for watermark alignment

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17750061#comment-17750061 ] Rui Fan commented on FLINK-32705: - Thanks [~pnowojski] help review, merged via:

[GitHub] [flink] 1996fanrui merged pull request #23094: [FLINK-32705][connectors/common] Remove the beta for watermark alignment

2023-08-01 Thread via GitHub
1996fanrui merged PR #23094: URL: https://github.com/apache/flink/pull/23094 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink] 1996fanrui commented on a diff in pull request #22985: [FLINK-21883][scheduler] Implement cooldown period for adaptive scheduler

2023-08-01 Thread via GitHub
1996fanrui commented on code in PR #22985: URL: https://github.com/apache/flink/pull/22985#discussion_r1281303552 ## flink-core/src/main/java/org/apache/flink/configuration/JobManagerOptions.java: ## @@ -488,6 +488,23 @@ public enum SchedulerType {

[jira] [Created] (FLINK-32729) allow create an initial deployment with suspend state

2023-08-01 Thread Zhenqiu Huang (Jira)
Zhenqiu Huang created FLINK-32729: - Summary: allow create an initial deployment with suspend state Key: FLINK-32729 URL: https://issues.apache.org/jira/browse/FLINK-32729 Project: Flink

[GitHub] [flink] XComp commented on pull request #23103: [DRAFT][FLINK-31168] Fix JobManagerHAProcessFailureRecoveryITCase

2023-08-01 Thread via GitHub
XComp commented on PR #23103: URL: https://github.com/apache/flink/pull/23103#issuecomment-1660946900 Removed the debug commit to get a proper CI run -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[jira] [Closed] (FLINK-32195) Add SQL Gateway custom headers support

2023-08-01 Thread Alexander Fedulov (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexander Fedulov closed FLINK-32195. - Release Note: Duplicate of FLINK-32373 Resolution: Duplicate > Add SQL Gateway

[jira] [Updated] (FLINK-32728) Metrics are not reported in Python UDF (used inside FlinkSQL) when exception is raised

2023-08-01 Thread Elkhan Dadashov (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elkhan Dadashov updated FLINK-32728: Issue Type: Bug (was: New Feature) > Metrics are not reported in Python UDF (used inside

[jira] [Created] (FLINK-32728) Metrics are not reported in Python UDF (used inside FlinkSQL) when exception is raised

2023-08-01 Thread Elkhan Dadashov (Jira)
Elkhan Dadashov created FLINK-32728: --- Summary: Metrics are not reported in Python UDF (used inside FlinkSQL) when exception is raised Key: FLINK-32728 URL: https://issues.apache.org/jira/browse/FLINK-32728

[jira] [Commented] (FLINK-32673) Migrage Google PubSub connector to V2

2023-08-01 Thread Ryan Skraba (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749975#comment-17749975 ] Ryan Skraba commented on FLINK-32673: - In the short term, it would be really helpful to have a

[GitHub] [flink-kubernetes-operator] afedulov commented on pull request #637: [FLINK-29634] Support periodic checkpoint triggering

2023-08-01 Thread via GitHub
afedulov commented on PR #637: URL: https://github.com/apache/flink-kubernetes-operator/pull/637#issuecomment-1660814494 @mxm please re-trigger the pipeline, I fixed the test. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [flink-connector-jdbc] whhe commented on pull request #72: [FLINK-32714] Add dialect for OceanBase database

2023-08-01 Thread via GitHub
whhe commented on PR #72: URL: https://github.com/apache/flink-connector-jdbc/pull/72#issuecomment-1660785887 The last ci tests failed because the resources (cpu, disk and memory) were insufficient to run OceanBase docker image. I tested on my server and the output is as below:

[jira] [Commented] (FLINK-24736) Non vulenerable jar files for Apache Flink 1.14.4

2023-08-01 Thread Parag Somani (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749942#comment-17749942 ] Parag Somani commented on FLINK-24736: -- This is the reason of security vulnerabilities, we moved

[GitHub] [flink] netvl commented on pull request #22854: [FLINK-32137] Added filtering of lambdas when building the flame graph

2023-08-01 Thread via GitHub
netvl commented on PR #22854: URL: https://github.com/apache/flink/pull/22854#issuecomment-1660728380 @1996fanrui rebased. And no, I don't mind at all, 1.19 is totally fine! Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [flink] zoltar9264 commented on pull request #22669: [FLINK-29913] fix shared state be discarded by mistake when maxConcurrentCheckpoint>1

2023-08-01 Thread via GitHub
zoltar9264 commented on PR #22669: URL: https://github.com/apache/flink/pull/22669#issuecomment-1660702064 Hi @rkhachatryan , looking forward to your feedback :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [flink] flinkbot commented on pull request #23118: Hashcode

2023-08-01 Thread via GitHub
flinkbot commented on PR #23118: URL: https://github.com/apache/flink/pull/23118#issuecomment-1660695510 ## CI report: * 6d708ad099864aa82ddf47b92b4f13ecaae82b7d UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] hanyuzheng7 opened a new pull request, #23118: Hashcode

2023-08-01 Thread via GitHub
hanyuzheng7 opened a new pull request, #23118: URL: https://github.com/apache/flink/pull/23118 ## What is the purpose of the change *(For example: This pull request makes task deployment go through the blob server, rather than through RPC. That way we avoid re-transferring

[jira] [Commented] (FLINK-32587) The results returned from the CDC sql query are null or the value was changed unexpectly

2023-08-01 Thread Jiabao Sun (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749932#comment-17749932 ] Jiabao Sun commented on FLINK-32587: Thanks [~jasonliangyc] to report this problem. It is

[jira] [Commented] (FLINK-32673) Migrage Google PubSub connector to V2

2023-08-01 Thread Yinghai Zhao (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749917#comment-17749917 ] Yinghai Zhao commented on FLINK-32673: -- We started using GCP Pubsub connectors with Flink but

[jira] [Closed] (FLINK-32681) RocksDBStateDownloaderTest.testMultiThreadCleanupOnFailure unstablie

2023-08-01 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stefan Richter closed FLINK-32681. -- Resolution: Fixed merged into master d11cc32 >

[jira] [Created] (FLINK-32727) Adding capability of setting Attributes in Google Pub/Sub sink

2023-08-01 Thread Yinghai Zhao (Jira)
Yinghai Zhao created FLINK-32727: Summary: Adding capability of setting Attributes in Google Pub/Sub sink Key: FLINK-32727 URL: https://issues.apache.org/jira/browse/FLINK-32727 Project: Flink

[jira] [Commented] (FLINK-24736) Non vulenerable jar files for Apache Flink 1.14.4

2023-08-01 Thread LEONID ILYEVSKY (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749887#comment-17749887 ] LEONID ILYEVSKY commented on FLINK-24736: - Half a year later, in 1.18-SNAPSHOT, it is still the

[jira] [Commented] (FLINK-32722) 239 exit code in flink-runtime

2023-08-01 Thread Patrick Lucas (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749863#comment-17749863 ] Patrick Lucas commented on FLINK-32722: --- Possibly related: FLINK-18290 > 239 exit code in

[jira] [Commented] (FLINK-32583) RestClient can deadlock if request made after Netty event executor terminated

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749836#comment-17749836 ] Matthias Pohl commented on FLINK-32583: --- Good point. Thanks for verifying the release notes (y) >

[jira] [Updated] (FLINK-32583) RestClient can deadlock if request made after Netty event executor terminated

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-32583: -- Release Note: Fixes a bug in the RestClient where making a request after the client was

[jira] [Comment Edited] (FLINK-32583) RestClient can deadlock if request made after Netty event executor terminated

2023-08-01 Thread Patrick Lucas (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749829#comment-17749829 ] Patrick Lucas edited comment on FLINK-32583 at 8/1/23 2:33 PM: --- [~mapohl]

[jira] [Commented] (FLINK-32583) RestClient can deadlock if request made after Netty event executor terminated

2023-08-01 Thread Patrick Lucas (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749829#comment-17749829 ] Patrick Lucas commented on FLINK-32583: --- [~mapohl] regarding the release note, I just wanted to

[jira] [Closed] (FLINK-32680) Job vertex names get messed up once there is a source vertex chained with a MultipleInput vertex in job graph

2023-08-01 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang closed FLINK-32680. -- Fix Version/s: 1.18.0 1.16.3 1.17.2 Resolution: Fixed >

[jira] [Commented] (FLINK-32680) Job vertex names get messed up once there is a source vertex chained with a MultipleInput vertex in job graph

2023-08-01 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749791#comment-17749791 ] Lijie Wang commented on FLINK-32680: Fixed via: master(1.18):

[GitHub] [flink] wanglijie95 closed pull request #23085: [FLINK-32680][streaming] Fix the messed up JobVertex name when the source nodes chained with a MultipleInput node.

2023-08-01 Thread via GitHub
wanglijie95 closed pull request #23085: [FLINK-32680][streaming] Fix the messed up JobVertex name when the source nodes chained with a MultipleInput node. URL: https://github.com/apache/flink/pull/23085 -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [flink] flinkbot commented on pull request #23117: [FLINK-32662][test] Fixes JobMasterTest#testRetrievingCheckpointStats with the AdaptiveScheduler

2023-08-01 Thread via GitHub
flinkbot commented on PR #23117: URL: https://github.com/apache/flink/pull/23117#issuecomment-1660384516 ## CI report: * ce9264b05678dad2696a23c68d15df5864e319e7 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Comment Edited] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749762#comment-17749762 ] Matthias Pohl edited comment on FLINK-32223 at 8/1/23 1:51 PM: --- {quote}

[jira] [Comment Edited] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749762#comment-17749762 ] Matthias Pohl edited comment on FLINK-32223 at 8/1/23 1:51 PM: --- {quote}

[jira] [Updated] (FLINK-32662) JobMasterTest.testRetrievingCheckpointStats fails with NPE on AZP

2023-08-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-32662: --- Labels: pull-request-available test-stability (was: test-stability) >

[GitHub] [flink] XComp opened a new pull request, #23117: [FLINK-32662][test] Fixes JobMasterTest#testRetrievingCheckpointStats with the AdaptiveScheduler

2023-08-01 Thread via GitHub
XComp opened a new pull request, #23117: URL: https://github.com/apache/flink/pull/23117 ## What is the purpose of the change The `AdaptiveScheduler` requires resources to be available before starting the job. The previous version of the test didn't provide these resources which

[jira] [Comment Edited] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749752#comment-17749752 ] Matthias Pohl edited comment on FLINK-32223 at 8/1/23 1:43 PM: --- I merged

[jira] [Commented] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749762#comment-17749762 ] Matthias Pohl commented on FLINK-32223: --- {quote} How can one double check that before merge not to

[jira] [Updated] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-32223: -- Priority: Major (was: Blocker) > Add Hive delegation token support >

[jira] [Commented] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749752#comment-17749752 ] Matthias Pohl commented on FLINK-32223: --- I merged the revert into {{master}} and updated the Jira

[jira] [Updated] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-32223: -- Fix Version/s: (was: 1.18.0) > Add Hive delegation token support >

[GitHub] [flink-kubernetes-operator] mxm commented on pull request #637: [FLINK-29634] Support periodic checkpoint triggering

2023-08-01 Thread via GitHub
mxm commented on PR #637: URL: https://github.com/apache/flink-kubernetes-operator/pull/637#issuecomment-1660275978 There was a test failure in the last run which probably is not fixed by the latest changes:

[jira] [Commented] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749725#comment-17749725 ] Rui Fan commented on FLINK-32663: - Hi [~lindong], thanks for your quick feedback. {quote}For example,

[jira] [Commented] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749719#comment-17749719 ] Dong Lin commented on FLINK-32663: -- Hi [~fanrui], FLINK-28386 will let Flink runtime trigger a

[jira] [Assigned] (FLINK-32662) JobMasterTest.testRetrievingCheckpointStats fails with NPE on AZP

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl reassigned FLINK-32662: - Assignee: Matthias Pohl (was: Hong Liang Teoh) >

[jira] [Comment Edited] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749656#comment-17749656 ] Rui Fan edited comment on FLINK-32663 at 8/1/23 12:39 PM: -- Hi [~lindong], I see

[jira] [Updated] (FLINK-28386) Trigger an immediate checkpoint after all tasks has reached end-of-data

2023-08-01 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-28386: - Description: Currently for bounded job in streaming mode, by default it will wait for one more

[jira] [Updated] (FLINK-28386) Trigger an immediate checkpoint after all tasks has reached end-of-data

2023-08-01 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-28386: - Summary: Trigger an immediate checkpoint after all tasks has reached end-of-data (was: Trigger an

[jira] [Updated] (FLINK-28386) Trigger an immediate checkpoint after all tasks has received end-of-data

2023-08-01 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-28386: - Description: Currently for bounded job in streaming mode, by default it will wait for one more

[jira] [Updated] (FLINK-28386) Trigger an immediate checkpoint after all tasks has received end-of-data

2023-08-01 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-28386: - Summary: Trigger an immediate checkpoint after all tasks has received end-of-data (was: Trigger an

[jira] [Updated] (FLINK-28386) Trigger an immediate checkpoint after all tasks finished

2023-08-01 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-28386: - Summary: Trigger an immediate checkpoint after all tasks finished (was: Trigger an immediate

[jira] [Updated] (FLINK-32709) Fix the bug of low memory utilization for Hybrid Shuffle

2023-08-01 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-32709: -- Summary: Fix the bug of low memory utilization for Hybrid Shuffle (was: Improve memory utilization

[GitHub] [flink] TanYuxin-tyx commented on a diff in pull request #23077: [FLINK-32675][doc] Add document for the tiered storage of hybrid shuffle

2023-08-01 Thread via GitHub
TanYuxin-tyx commented on code in PR #23077: URL: https://github.com/apache/flink/pull/23077#discussion_r1280543215 ## docs/content.zh/docs/ops/batch/batch_shuffle.md: ## @@ -127,6 +127,12 @@ These could be configured via [jobmanager.partition.hybrid.partition-data-consum -

[GitHub] [flink] TanYuxin-tyx commented on a diff in pull request #23077: [FLINK-32675][doc] Add document for the tiered storage of hybrid shuffle

2023-08-01 Thread via GitHub
TanYuxin-tyx commented on code in PR #23077: URL: https://github.com/apache/flink/pull/23077#discussion_r1280542679 ## docs/content.zh/docs/ops/batch/batch_shuffle.md: ## @@ -127,6 +127,12 @@ These could be configured via [jobmanager.partition.hybrid.partition-data-consum -

[GitHub] [flink] flinkbot commented on pull request #23116: [FLINK-32581][docs] Add docs for atomic CTAS and RTAS

2023-08-01 Thread via GitHub
flinkbot commented on PR #23116: URL: https://github.com/apache/flink/pull/23116#issuecomment-1660196198 ## CI report: * b03be34d352ba59c03a768fa9d1576887467e01b UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Closed] (FLINK-32686) Performance regression on startScheduling.BATCH and startScheduling.STREAMING since 2023-07-24

2023-08-01 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo closed FLINK-32686. -- > Performance regression on startScheduling.BATCH and startScheduling.STREAMING > since 2023-07-24 >

[jira] [Resolved] (FLINK-32686) Performance regression on startScheduling.BATCH and startScheduling.STREAMING since 2023-07-24

2023-08-01 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo resolved FLINK-32686. Fix Version/s: 1.18.0 Resolution: Fixed master(1.18) via

[jira] [Assigned] (FLINK-32686) Performance regression on startScheduling.BATCH and startScheduling.STREAMING since 2023-07-24

2023-08-01 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo reassigned FLINK-32686: -- Assignee: Wencong Liu > Performance regression on startScheduling.BATCH and

[jira] [Commented] (FLINK-32685) Performance regression on sortedMultiInput and sortedTwoInput since 2023-07-18

2023-08-01 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749668#comment-17749668 ] Weijie Guo commented on FLINK-32685: Through some investigation, I have found this may caused by the

[jira] [Commented] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749667#comment-17749667 ] Rui Fan commented on FLINK-32663: - The priority is upgraded to blocker due to it's caused in 1.18. cc

[jira] [Updated] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-32663: Priority: Blocker (was: Critical) > RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList

[GitHub] [flink] Tartarus0zm commented on pull request #23116: [FLINK-32581][docs] Add docs for atomic CTAS and RTAS

2023-08-01 Thread via GitHub
Tartarus0zm commented on PR #23116: URL: https://github.com/apache/flink/pull/23116#issuecomment-1660176464 @luoyuxia PTAL, if you have time, thanks~ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Comment Edited] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749651#comment-17749651 ] Rui Fan edited comment on FLINK-32663 at 8/1/23 12:04 PM: -- This bug is caused

[jira] [Updated] (FLINK-32581) Add document for atomic CTAS

2023-08-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-32581: --- Labels: pull-request-available (was: ) > Add document for atomic CTAS >

[jira] [Assigned] (FLINK-32685) Performance regression on sortedMultiInput and sortedTwoInput since 2023-07-18

2023-08-01 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo reassigned FLINK-32685: -- Assignee: Weijie Guo > Performance regression on sortedMultiInput and sortedTwoInput since

[GitHub] [flink] Tartarus0zm opened a new pull request, #23116: [FLINK-32581][docs] Add docs for atomic CTAS and RTAS

2023-08-01 Thread via GitHub
Tartarus0zm opened a new pull request, #23116: URL: https://github.com/apache/flink/pull/23116 ## What is the purpose of the change Add docs for atomic CTAS and RTAS ## Brief change log add docs ## Verifying this change no need test ## Does this

[jira] [Updated] (FLINK-28386) Trigger an immediate checkpoint after all sources finished

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-28386: Fix Version/s: 1.18.0 > Trigger an immediate checkpoint after all sources finished >

[jira] [Commented] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749656#comment-17749656 ] Rui Fan commented on FLINK-32663: - Hi [~lindong], I see you help reviewed the FLINK-28386, it caused

[jira] [Commented] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749651#comment-17749651 ] Rui Fan commented on FLINK-32663: - This bug is caused by FLINK-28386, this test doesn't enable

[jira] [Updated] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-32663: Attachment: screenshot-1.png > RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails

[jira] [Commented] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749628#comment-17749628 ] Gabor Somogyi commented on FLINK-32223: --- Thanks for taking care, approved the revert. >

[GitHub] [flink] flinkbot commented on pull request #23115: [FLINK-32681] Wait for RocksDBStateDownloader threads on failure to ensure proper cleanup.

2023-08-01 Thread via GitHub
flinkbot commented on PR #23115: URL: https://github.com/apache/flink/pull/23115#issuecomment-1660101777 ## CI report: * 15e5ae87167dc6ecf69f2ad1e830552b1dd9af5a UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

  1   2   >