[GitHub] [flink] reswqa commented on a diff in pull request #23013: [FLINK-32620][sink] Migrate DiscardingSink to sinkv2.

2023-08-01 Thread via GitHub
reswqa commented on code in PR #23013: URL: https://github.com/apache/flink/pull/23013#discussion_r1280153766 ## flink-connectors/flink-connector-files/src/main/java/org/apache/flink/connector/file/table/stream/StreamingSink.java: ## @@ -173,7 +173,7 @@ public static

[GitHub] [flink] wanglijie95 commented on a diff in pull request #23085: [FLINK-32680][streaming] Fix the messed up JobVertex name when the source nodes chained with a MultipleInput node.

2023-08-01 Thread via GitHub
wanglijie95 commented on code in PR #23085: URL: https://github.com/apache/flink/pull/23085#discussion_r1280165421 ## flink-streaming-java/src/main/java/org/apache/flink/streaming/api/graph/StreamingJobGraphGenerator.java: ## @@ -896,12 +896,13 @@ private String

[jira] [Created] (FLINK-32722) 239 exit code in flink-runtime

2023-08-01 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-32722: - Summary: 239 exit code in flink-runtime Key: FLINK-32722 URL: https://issues.apache.org/jira/browse/FLINK-32722 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-32723) FLIP-334 : Decoupling autoscaler and kubernetes

2023-08-01 Thread Rui Fan (Jira)
Rui Fan created FLINK-32723: --- Summary: FLIP-334 : Decoupling autoscaler and kubernetes Key: FLINK-32723 URL: https://issues.apache.org/jira/browse/FLINK-32723 Project: Flink Issue Type: New

[GitHub] [flink] JunRuiLee commented on a diff in pull request #23085: [FLINK-32680][streaming] Fix the messed up JobVertex name when the source nodes chained with a MultipleInput node.

2023-08-01 Thread via GitHub
JunRuiLee commented on code in PR #23085: URL: https://github.com/apache/flink/pull/23085#discussion_r1280227631 ## flink-streaming-java/src/test/java/org/apache/flink/streaming/api/graph/StreamingJobGraphGeneratorTest.java: ## @@ -1693,6 +1723,10 @@ public JobGraph

[GitHub] [flink] zoltar9264 opened a new pull request, #23111: [FLINK-32681][rocksdb][tests] Add TaskFailureCleaner to RocksDBStateD…

2023-08-01 Thread via GitHub
zoltar9264 opened a new pull request, #23111: URL: https://github.com/apache/flink/pull/23111 …ownloader ## What is the purpose of the change Fix unstable test : RocksDBStateDownloaderTest.testMultiThreadCleanupOnFailure , discuss in

[jira] [Updated] (FLINK-32681) RocksDBStateDownloaderTest.testMultiThreadCleanupOnFailure unstablie

2023-08-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-32681: --- Labels: pull-request-available test-stability (was: test-stability) >

[GitHub] [flink] flinkbot commented on pull request #23111: [FLINK-32681][rocksdb][tests] Add TaskFailureCleaner to RocksDBStateD…

2023-08-01 Thread via GitHub
flinkbot commented on PR #23111: URL: https://github.com/apache/flink/pull/23111#issuecomment-1659784617 ## CI report: * 4194cd88a4b5f3e51d2d54d99fb7325cc0a2b8b7 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Assigned] (FLINK-32706) Add SPLIT(STRING) support in SQL & Table API

2023-08-01 Thread Konstantin Knauf (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Knauf reassigned FLINK-32706: Assignee: Hanyu Zheng > Add SPLIT(STRING) support in SQL & Table API >

[GitHub] [flink] lindong28 commented on a diff in pull request #22931: [FLINK-32514] Support configuring checkpointing interval during process backlog

2023-08-01 Thread via GitHub
lindong28 commented on code in PR #22931: URL: https://github.com/apache/flink/pull/22931#discussion_r1280153092 ## flink-runtime/src/main/java/org/apache/flink/runtime/source/event/EndOfDataEvent.java: ## @@ -0,0 +1,24 @@ +/* + * Licensed to the Apache Software Foundation

[jira] [Assigned] (FLINK-32681) RocksDBStateDownloaderTest.testMultiThreadCleanupOnFailure unstablie

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl reassigned FLINK-32681: - Assignee: Stefan Richter > RocksDBStateDownloaderTest.testMultiThreadCleanupOnFailure

[GitHub] [flink] JunRuiLee commented on a diff in pull request #23085: [FLINK-32680][streaming] Fix the messed up JobVertex name when the source nodes chained with a MultipleInput node.

2023-08-01 Thread via GitHub
JunRuiLee commented on code in PR #23085: URL: https://github.com/apache/flink/pull/23085#discussion_r1280228067 ## flink-streaming-java/src/test/java/org/apache/flink/streaming/api/graph/StreamingJobGraphGeneratorTest.java: ## @@ -1693,6 +1723,10 @@ public JobGraph

[GitHub] [flink] JunRuiLee commented on pull request #23085: [FLINK-32680][streaming] Fix the messed up JobVertex name when the source nodes chained with a MultipleInput node.

2023-08-01 Thread via GitHub
JunRuiLee commented on PR #23085: URL: https://github.com/apache/flink/pull/23085#issuecomment-1659747018 @wanglijie95 Thanks for CR and I've updated this pr, PTAL. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[jira] [Commented] (FLINK-32681) RocksDBStateDownloaderTest.testMultiThreadCleanupOnFailure unstablie

2023-08-01 Thread Feifan Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749541#comment-17749541 ] Feifan Wang commented on FLINK-32681: - Sorry [~mapohl]  I didn't notice that the ticket has been

[GitHub] [flink] xintongsong commented on a diff in pull request #23026: [FLINK-32558][flink-java] Deprecate all DataSet API

2023-08-01 Thread via GitHub
xintongsong commented on code in PR #23026: URL: https://github.com/apache/flink/pull/23026#discussion_r1280146390 ## flink-examples/flink-examples-batch/pom.xml: ## @@ -48,25 +48,6 @@ under the License. - -

[jira] [Commented] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749498#comment-17749498 ] Qingsheng Ren commented on FLINK-32223: --- I can't find any confirmation from RMs about this issue

[jira] [Commented] (FLINK-32645) Flink pulsar sink is having poor performance

2023-08-01 Thread Vijaya Bhaskar V (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749501#comment-17749501 ] Vijaya Bhaskar V commented on FLINK-32645: -- [~syhily]  thanks its working fine now. Will report

[jira] [Comment Edited] (FLINK-32681) RocksDBStateDownloaderTest.testMultiThreadCleanupOnFailure unstablie

2023-08-01 Thread Feifan Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749522#comment-17749522 ] Feifan Wang edited comment on FLINK-32681 at 8/1/23 8:03 AM: - Hi [~srichter]

[GitHub] [flink] flinkbot commented on pull request #23112: Do not suspend task thread if changelog writer is available.

2023-08-01 Thread via GitHub
flinkbot commented on PR #23112: URL: https://github.com/apache/flink/pull/23112#issuecomment-1659808707 ## CI report: * ead319a56e310e4d0c9330d68736bbde25708a4a UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink-connector-hbase] whhe commented on pull request #17: [FLINK-28013] Shade all netty dependencies in sql jar

2023-08-01 Thread via GitHub
whhe commented on PR #17: URL: https://github.com/apache/flink-connector-hbase/pull/17#issuecomment-1659629496 Any progress? @MartijnVisser -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[jira] [Commented] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749491#comment-17749491 ] Matthias Pohl commented on FLINK-32223: --- That said, was this issue confirmed by the release

[jira] [Reopened] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl reopened FLINK-32223: --- [~gaborgsomogyi] [~jiaoqb] I'm reopening the issue. It introduced a compilation error on

[jira] [Updated] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-32223: -- Component/s: Connectors / Hadoop Compatibility > Add Hive delegation token support >

[jira] [Updated] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-32223: -- Priority: Blocker (was: Minor) > Add Hive delegation token support >

[jira] [Commented] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749523#comment-17749523 ] Qingsheng Ren commented on FLINK-32663: --- [~fanrui] Could you help investigating this issue? It's

[jira] [Commented] (FLINK-32681) RocksDBStateDownloaderTest.testMultiThreadCleanupOnFailure unstablie

2023-08-01 Thread Feifan Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749522#comment-17749522 ] Feifan Wang commented on FLINK-32681: - Hi [~srichter] , I'm also very interested in this problem. I

[jira] [Updated] (FLINK-32570) Deprecate API that uses Flink's Time implementation (related to FLINK-14638)

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-32570: -- Parent: (was: FLINK-32557) Issue Type: Technical Debt (was: Sub-task) >

[GitHub] [flink] luoyuxia commented on a diff in pull request #23013: [FLINK-32620][sink] Migrate DiscardingSink to sinkv2.

2023-08-01 Thread via GitHub
luoyuxia commented on code in PR #23013: URL: https://github.com/apache/flink/pull/23013#discussion_r1280147373 ## flink-connectors/flink-connector-files/src/main/java/org/apache/flink/connector/file/table/stream/StreamingSink.java: ## @@ -173,7 +173,7 @@ public static

[jira] [Commented] (FLINK-32268) KafkaTableITCase.testKafkaSourceSinkWithBoundedTimestamp failed to create topic

2023-08-01 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749492#comment-17749492 ] Qingsheng Ren commented on FLINK-32268: --- I checked the log but found no clue... Probably some

[jira] [Updated] (FLINK-32268) KafkaTableITCase.testKafkaSourceSinkWithBoundedTimestamp failed to create topic

2023-08-01 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren updated FLINK-32268: -- Priority: Major (was: Critical) > KafkaTableITCase.testKafkaSourceSinkWithBoundedTimestamp

[jira] [Updated] (FLINK-32268) KafkaTableITCase.testKafkaSourceSinkWithBoundedTimestamp failed to create topic

2023-08-01 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren updated FLINK-32268: -- Affects Version/s: kafka-4.0.0 (was: 1.18.0) >

[jira] [Commented] (FLINK-32722) 239 exit code in flink-runtime

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749506#comment-17749506 ] Matthias Pohl commented on FLINK-32722: --- I did a log analysis on unfinished tests without success.

[GitHub] [flink] JunRuiLee commented on a diff in pull request #23085: [FLINK-32680][streaming] Fix the messed up JobVertex name when the source nodes chained with a MultipleInput node.

2023-08-01 Thread via GitHub
JunRuiLee commented on code in PR #23085: URL: https://github.com/apache/flink/pull/23085#discussion_r1280229513 ## flink-streaming-java/src/test/java/org/apache/flink/streaming/api/graph/StreamingJobGraphGeneratorTest.java: ## @@ -1655,28 +1655,58 @@ void

[jira] [Commented] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749525#comment-17749525 ] Rui Fan commented on FLINK-32663: - Thanks for the report, I will take a look asap. cc [~renqs] >

[GitHub] [flink] reswqa opened a new pull request, #23112: Do not suspend task thread if changelog writer is available.

2023-08-01 Thread via GitHub
reswqa opened a new pull request, #23112: URL: https://github.com/apache/flink/pull/23112 ## What is the purpose of the change *(For example: This pull request makes task deployment go through the blob server, rather than through RPC. That way we avoid re-transferring them on

[GitHub] [flink] xintongsong commented on a diff in pull request #23026: [FLINK-32558][flink-java] Deprecate all DataSet API

2023-08-01 Thread via GitHub
xintongsong commented on code in PR #23026: URL: https://github.com/apache/flink/pull/23026#discussion_r1280173681 ## flink-examples/flink-examples-batch/pom.xml: ## @@ -48,25 +48,6 @@ under the License. - -

[jira] [Commented] (FLINK-32662) JobMasterTest.testRetrievingCheckpointStats fails with NPE on AZP

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749486#comment-17749486 ] Matthias Pohl commented on FLINK-32662: ---

[jira] [Comment Edited] (FLINK-32645) Flink pulsar sink is having poor performance

2023-08-01 Thread Vijaya Bhaskar V (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17746603#comment-17746603 ] Vijaya Bhaskar V edited comment on FLINK-32645 at 8/1/23 7:04 AM: --

[jira] [Commented] (FLINK-15736) Support Java 17 (LTS)

2023-08-01 Thread Konstantin Knauf (Jira)
[ https://issues.apache.org/jira/browse/FLINK-15736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749535#comment-17749535 ] Konstantin Knauf commented on FLINK-15736: -- How do users usually learn about support for new

[GitHub] [flink] reswqa commented on pull request #23112: Do not suspend task thread if changelog writer is available.

2023-08-01 Thread via GitHub
reswqa commented on PR #23112: URL: https://github.com/apache/flink/pull/23112#issuecomment-1659794575 Before: ![image](https://github.com/apache/flink/assets/19502505/f61aecb8-63e2-45b0-93f6-a0e4e90e9737) After:

[GitHub] [flink] gaborgsomogyi commented on pull request #21788: [FLINK-30812][yarn] Fix uploading local files when using YARN with S3

2023-08-01 Thread via GitHub
gaborgsomogyi commented on PR #21788: URL: https://github.com/apache/flink/pull/21788#issuecomment-1659816555 @MartijnVisser are you fine w/ the PR? I'm merging if you say to... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[jira] [Updated] (FLINK-32559) Deprecate Queryable State

2023-08-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-32559: --- Labels: pull-request-available (was: ) > Deprecate Queryable State >

[GitHub] [flink] WencongLiu commented on pull request #23100: [FLINK-32708][network] Fix the write logic in remote tier of hybrid shuffle

2023-08-01 Thread via GitHub
WencongLiu commented on PR #23100: URL: https://github.com/apache/flink/pull/23100#issuecomment-1659886610 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Updated] (FLINK-32678) Release Testing: Stress-Test to cover multiple low-level changes in Flink

2023-08-01 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren updated FLINK-32678: -- Summary: Release Testing: Stress-Test to cover multiple low-level changes in Flink (was:

[jira] [Updated] (FLINK-32678) Stress-Test to cover multiple low-level changes in Flink

2023-08-01 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren updated FLINK-32678: -- Parent: FLINK-32726 Issue Type: Sub-task (was: Technical Debt) > Stress-Test to

[jira] [Updated] (FLINK-32570) Deprecate API that uses Flink's Time implementation (related to FLINK-14638)

2023-08-01 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32570?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren updated FLINK-32570: -- Priority: Major (was: Blocker) > Deprecate API that uses Flink's Time implementation

[GitHub] [flink] flinkbot commented on pull request #23115: [FLINK-32681] Wait for RocksDBStateDownloader threads on failure to ensure proper cleanup.

2023-08-01 Thread via GitHub
flinkbot commented on PR #23115: URL: https://github.com/apache/flink/pull/23115#issuecomment-1660101777 ## CI report: * 15e5ae87167dc6ecf69f2ad1e830552b1dd9af5a UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Assigned] (FLINK-32685) Performance regression on sortedMultiInput and sortedTwoInput since 2023-07-18

2023-08-01 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo reassigned FLINK-32685: -- Assignee: Weijie Guo > Performance regression on sortedMultiInput and sortedTwoInput since

[jira] [Comment Edited] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749651#comment-17749651 ] Rui Fan edited comment on FLINK-32663 at 8/1/23 12:04 PM: -- This bug is caused

[jira] [Updated] (FLINK-32581) Add document for atomic CTAS

2023-08-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-32581: --- Labels: pull-request-available (was: ) > Add document for atomic CTAS >

[GitHub] [flink] Tartarus0zm commented on pull request #23116: [FLINK-32581][docs] Add docs for atomic CTAS and RTAS

2023-08-01 Thread via GitHub
Tartarus0zm commented on PR #23116: URL: https://github.com/apache/flink/pull/23116#issuecomment-1660176464 @luoyuxia PTAL, if you have time, thanks~ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Updated] (FLINK-32709) Fix the bug of low memory utilization for Hybrid Shuffle

2023-08-01 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-32709: -- Summary: Fix the bug of low memory utilization for Hybrid Shuffle (was: Improve memory utilization

[GitHub] [flink] flinkbot commented on pull request #23117: [FLINK-32662][test] Fixes JobMasterTest#testRetrievingCheckpointStats with the AdaptiveScheduler

2023-08-01 Thread via GitHub
flinkbot commented on PR #23117: URL: https://github.com/apache/flink/pull/23117#issuecomment-1660384516 ## CI report: * ce9264b05678dad2696a23c68d15df5864e319e7 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Closed] (FLINK-32680) Job vertex names get messed up once there is a source vertex chained with a MultipleInput vertex in job graph

2023-08-01 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lijie Wang closed FLINK-32680. -- Fix Version/s: 1.18.0 1.16.3 1.17.2 Resolution: Fixed >

[jira] [Commented] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749616#comment-17749616 ] Gabor Somogyi commented on FLINK-32223: --- > It introduced a compilation error on master in the

[jira] [Commented] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749667#comment-17749667 ] Rui Fan commented on FLINK-32663: - The priority is upgraded to blocker due to it's caused in 1.18. cc

[jira] [Assigned] (FLINK-32662) JobMasterTest.testRetrievingCheckpointStats fails with NPE on AZP

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl reassigned FLINK-32662: - Assignee: Matthias Pohl (was: Hong Liang Teoh) >

[jira] [Commented] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749725#comment-17749725 ] Rui Fan commented on FLINK-32663: - Hi [~lindong], thanks for your quick feedback. {quote}For example,

[jira] [Commented] (FLINK-32680) Job vertex names get messed up once there is a source vertex chained with a MultipleInput vertex in job graph

2023-08-01 Thread Lijie Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749791#comment-17749791 ] Lijie Wang commented on FLINK-32680: Fixed via: master(1.18):

[jira] [Created] (FLINK-32726) [Umbrella] Test Flink Release 1.18

2023-08-01 Thread Qingsheng Ren (Jira)
Qingsheng Ren created FLINK-32726: - Summary: [Umbrella] Test Flink Release 1.18 Key: FLINK-32726 URL: https://issues.apache.org/jira/browse/FLINK-32726 Project: Flink Issue Type: Bug

[jira] [Updated] (FLINK-32558) Properly deprecate DataSet API

2023-08-01 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren updated FLINK-32558: -- Priority: Major (was: Blocker) > Properly deprecate DataSet API >

[jira] [Updated] (FLINK-32557) API deprecations in Flink 1.18

2023-08-01 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren updated FLINK-32557: -- Priority: Major (was: Blocker) > API deprecations in Flink 1.18 >

[jira] [Updated] (FLINK-32559) Deprecate Queryable State

2023-08-01 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren updated FLINK-32559: -- Priority: Major (was: Blocker) > Deprecate Queryable State > - > >

[jira] [Commented] (FLINK-32557) API deprecations in Flink 1.18

2023-08-01 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749579#comment-17749579 ] Qingsheng Ren commented on FLINK-32557: --- As discussed in the release sync, these deprecations will

[GitHub] [flink] XComp commented on pull request #23114: [REVERT][FLINK-32223][runtime][security] Add Hive delegation token support

2023-08-01 Thread via GitHub
XComp commented on PR #23114: URL: https://github.com/apache/flink/pull/23114#issuecomment-1660067221 `git revert 70e6359` performed without any conflicts -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Commented] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Gabor Somogyi (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749628#comment-17749628 ] Gabor Somogyi commented on FLINK-32223: --- Thanks for taking care, approved the revert. >

[jira] [Assigned] (FLINK-32686) Performance regression on startScheduling.BATCH and startScheduling.STREAMING since 2023-07-24

2023-08-01 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo reassigned FLINK-32686: -- Assignee: Wencong Liu > Performance regression on startScheduling.BATCH and

[jira] [Updated] (FLINK-28386) Trigger an immediate checkpoint after all tasks finished

2023-08-01 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-28386: - Summary: Trigger an immediate checkpoint after all tasks finished (was: Trigger an immediate

[jira] [Updated] (FLINK-28386) Trigger an immediate checkpoint after all tasks has received end-of-data

2023-08-01 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-28386: - Summary: Trigger an immediate checkpoint after all tasks has received end-of-data (was: Trigger an

[jira] [Updated] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-32223: -- Fix Version/s: (was: 1.18.0) > Add Hive delegation token support >

[jira] [Commented] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749752#comment-17749752 ] Matthias Pohl commented on FLINK-32223: --- I merged the revert into {{master}} and updated the Jira

[jira] [Updated] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias Pohl updated FLINK-32223: -- Priority: Major (was: Blocker) > Add Hive delegation token support >

[GitHub] [flink] wanglijie95 closed pull request #23085: [FLINK-32680][streaming] Fix the messed up JobVertex name when the source nodes chained with a MultipleInput node.

2023-08-01 Thread via GitHub
wanglijie95 closed pull request #23085: [FLINK-32680][streaming] Fix the messed up JobVertex name when the source nodes chained with a MultipleInput node. URL: https://github.com/apache/flink/pull/23085 -- This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Updated] (FLINK-32726) [Umbrella] Test Flink Release 1.18

2023-08-01 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren updated FLINK-32726: -- Labels: release-testing (was: ) > [Umbrella] Test Flink Release 1.18 >

[GitHub] [flink] xintongsong commented on a diff in pull request #23077: [FLINK-32675][doc] Add document for the tiered storage of hybrid shuffle

2023-08-01 Thread via GitHub
xintongsong commented on code in PR #23077: URL: https://github.com/apache/flink/pull/23077#discussion_r1280384166 ## docs/content.zh/docs/ops/batch/batch_shuffle.md: ## @@ -127,6 +127,12 @@ These could be configured via [jobmanager.partition.hybrid.partition-data-consum -

[jira] [Commented] (FLINK-32681) RocksDBStateDownloaderTest.testMultiThreadCleanupOnFailure unstablie

2023-08-01 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749599#comment-17749599 ] Stefan Richter commented on FLINK-32681: [~Feifan Wang]Thanks for the offer but I've already

[jira] [Comment Edited] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749619#comment-17749619 ] Matthias Pohl edited comment on FLINK-32223 at 8/1/23 10:53 AM: Thanks

[jira] [Comment Edited] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749619#comment-17749619 ] Matthias Pohl edited comment on FLINK-32223 at 8/1/23 10:53 AM: Thanks

[GitHub] [flink] xintongsong commented on a diff in pull request #23113: [FLINK-32559] Deprecate Queryable State

2023-08-01 Thread via GitHub
xintongsong commented on code in PR #23113: URL: https://github.com/apache/flink/pull/23113#discussion_r1280456502 ## docs/content.zh/docs/deployment/resource-providers/standalone/docker.md: ## @@ -574,7 +574,7 @@ You can customize the Flink image in several ways: $ echo

[jira] [Commented] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749656#comment-17749656 ] Rui Fan commented on FLINK-32663: - Hi [~lindong], I see you help reviewed the FLINK-28386, it caused

[GitHub] [flink] TanYuxin-tyx commented on a diff in pull request #23077: [FLINK-32675][doc] Add document for the tiered storage of hybrid shuffle

2023-08-01 Thread via GitHub
TanYuxin-tyx commented on code in PR #23077: URL: https://github.com/apache/flink/pull/23077#discussion_r1280542679 ## docs/content.zh/docs/ops/batch/batch_shuffle.md: ## @@ -127,6 +127,12 @@ These could be configured via [jobmanager.partition.hybrid.partition-data-consum -

[jira] [Updated] (FLINK-28386) Trigger an immediate checkpoint after all tasks has received end-of-data

2023-08-01 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-28386: - Description: Currently for bounded job in streaming mode, by default it will wait for one more

[jira] [Updated] (FLINK-28386) Trigger an immediate checkpoint after all tasks has reached end-of-data

2023-08-01 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-28386: - Summary: Trigger an immediate checkpoint after all tasks has reached end-of-data (was: Trigger an

[jira] [Updated] (FLINK-28386) Trigger an immediate checkpoint after all tasks has reached end-of-data

2023-08-01 Thread Dong Lin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin updated FLINK-28386: - Description: Currently for bounded job in streaming mode, by default it will wait for one more

[jira] [Comment Edited] (FLINK-32663) RescalingITCase.testSavepointRescalingInPartitionedOperatorStateList fails on AZP

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749656#comment-17749656 ] Rui Fan edited comment on FLINK-32663 at 8/1/23 12:39 PM: -- Hi [~lindong], I see

[jira] [Comment Edited] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749762#comment-17749762 ] Matthias Pohl edited comment on FLINK-32223 at 8/1/23 1:51 PM: --- {quote}

[jira] [Updated] (FLINK-31634) FLIP-301: Hybrid Shuffle supports Remote Storage

2023-08-01 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-31634: -- Release Note: Hybrid Shuffle supports storing the shuffle data in remote storage. The remote storage

[jira] [Updated] (FLINK-31634) FLIP-301: Hybrid Shuffle supports Remote Storage

2023-08-01 Thread Yuxin Tan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuxin Tan updated FLINK-31634: -- Release Note: Hybrid Shuffle supports storing the shuffle data in remote storage. The remote storage

[GitHub] [flink] flinkbot commented on pull request #23114: [REVERT][FLINK-32223][runtime][security] Add Hive delegation token support

2023-08-01 Thread via GitHub
flinkbot commented on PR #23114: URL: https://github.com/apache/flink/pull/23114#issuecomment-1660075239 ## CI report: * 8639303d70e39376a1de051345aa4d1e053a9bba UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] StefanRRichter opened a new pull request, #23115: [FLINK-32681] Wait for RocksDBStateDownloader threads on failure to ensure proper cleanup.

2023-08-01 Thread via GitHub
StefanRRichter opened a new pull request, #23115: URL: https://github.com/apache/flink/pull/23115 ## What is the purpose of the change Fixes a test failure in `RocksDBStateDownloaderTest` by ensuring that on failure we first wait for all parallel download threads to complete and

[jira] [Updated] (FLINK-28386) Trigger an immediate checkpoint after all sources finished

2023-08-01 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-28386: Fix Version/s: 1.18.0 > Trigger an immediate checkpoint after all sources finished >

[GitHub] [flink] Tartarus0zm opened a new pull request, #23116: [FLINK-32581][docs] Add docs for atomic CTAS and RTAS

2023-08-01 Thread via GitHub
Tartarus0zm opened a new pull request, #23116: URL: https://github.com/apache/flink/pull/23116 ## What is the purpose of the change Add docs for atomic CTAS and RTAS ## Brief change log add docs ## Verifying this change no need test ## Does this

[jira] [Resolved] (FLINK-32686) Performance regression on startScheduling.BATCH and startScheduling.STREAMING since 2023-07-24

2023-08-01 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo resolved FLINK-32686. Fix Version/s: 1.18.0 Resolution: Fixed master(1.18) via

[jira] [Closed] (FLINK-32686) Performance regression on startScheduling.BATCH and startScheduling.STREAMING since 2023-07-24

2023-08-01 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo closed FLINK-32686. -- > Performance regression on startScheduling.BATCH and startScheduling.STREAMING > since 2023-07-24 >

[GitHub] [flink-kubernetes-operator] mxm commented on pull request #637: [FLINK-29634] Support periodic checkpoint triggering

2023-08-01 Thread via GitHub
mxm commented on PR #637: URL: https://github.com/apache/flink-kubernetes-operator/pull/637#issuecomment-1660275978 There was a test failure in the last run which probably is not fixed by the latest changes:

[jira] [Commented] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749762#comment-17749762 ] Matthias Pohl commented on FLINK-32223: --- {quote} How can one double check that before merge not to

[jira] [Comment Edited] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749752#comment-17749752 ] Matthias Pohl edited comment on FLINK-32223 at 8/1/23 1:43 PM: --- I merged

[jira] [Comment Edited] (FLINK-32223) Add Hive delegation token support

2023-08-01 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17749762#comment-17749762 ] Matthias Pohl edited comment on FLINK-32223 at 8/1/23 1:51 PM: --- {quote}

[jira] [Updated] (FLINK-32662) JobMasterTest.testRetrievingCheckpointStats fails with NPE on AZP

2023-08-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-32662: --- Labels: pull-request-available test-stability (was: test-stability) >

[jira] [Updated] (FLINK-32560) Properly deprecate all Scala APIs

2023-08-01 Thread Qingsheng Ren (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qingsheng Ren updated FLINK-32560: -- Priority: Major (was: Blocker) > Properly deprecate all Scala APIs >

  1   2   >