[GitHub] [flink] godfreyhe closed pull request #20462: [FLINK-28821][table-planner] Adjust join cost for dpp query pattern which could help more plans use dpp

2022-08-09 Thread GitBox
godfreyhe closed pull request #20462: [FLINK-28821][table-planner] Adjust join cost for dpp query pattern which could help more plans use dpp URL: https://github.com/apache/flink/pull/20462 -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[jira] [Closed] (FLINK-28706) FLIP-248: Introduce dynamic partition pruning

2022-08-09 Thread godfrey he (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] godfrey he closed FLINK-28706. -- Resolution: Fixed Fixed in master > FLIP-248: Introduce dynamic partition pruning >

[jira] (FLINK-24332) Support to mount a dynamically-created persistent volume claim per TaskManager

2022-08-09 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24332 ] Yang Wang deleted comment on FLINK-24332: --- was (Author: fly_in_gis): Thanks for the volunteer. You have got assigned and I will get to the PR in this week. > Support to mount a

[GitHub] [flink] lincoln-lil commented on pull request #20482: [FLINK-28848][table-planner] Introduces LOOKUP join hint to support delayed retry for lookup join (table alias unsupported in hint)

2022-08-09 Thread GitBox
lincoln-lil commented on PR #20482: URL: https://github.com/apache/flink/pull/20482#issuecomment-1210169749 local verify ok for table modules(the ci pipeline was too slow) ![image](https://user-images.githubusercontent.com/3712895/183821142-ff4c25ab-4812-425b-ac21-275d2139b784.png)

[GitHub] [flink] wuchong commented on pull request #20419: [FLINK-28774][hive] Allow user to configure whether to enable sort not when it's for dynamic partition writing for HiveSource

2022-08-09 Thread GitBox
wuchong commented on PR #20419: URL: https://github.com/apache/flink/pull/20419#issuecomment-1210176326 CI is passed: https://dev.azure.com/imjark/Flink/_build/results?buildId=576=results -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [flink] wuchong merged pull request #20419: [FLINK-28774][hive] Allow user to configure whether to enable sort not when it's for dynamic partition writing for HiveSource

2022-08-09 Thread GitBox
wuchong merged PR #20419: URL: https://github.com/apache/flink/pull/20419 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Closed] (FLINK-27338) Improve spliting file for Hive table with orc format

2022-08-09 Thread godfrey he (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] godfrey he closed FLINK-27338. -- Resolution: Fixed Fixed in master: dd16b0801305c98b3e2876d7cb9e4631a7c5621a > Improve spliting file

[GitHub] [flink] SteNicholas commented on a diff in pull request #20390: [FLINK-28481][k8s] Bump the fabric8 k8s-client to 5.12.3

2022-08-09 Thread GitBox
SteNicholas commented on code in PR #20390: URL: https://github.com/apache/flink/pull/20390#discussion_r941943372 ## flink-kubernetes/src/main/resources/META-INF/NOTICE: ## @@ -14,27 +14,27 @@ This project bundles the following dependencies under the Apache Software Licens -

[GitHub] [flink] godfreyhe closed pull request #20377: [FLINK-27338][hive] Improve splitting file for Hive table with orc format

2022-08-09 Thread GitBox
godfreyhe closed pull request #20377: [FLINK-27338][hive] Improve splitting file for Hive table with orc format URL: https://github.com/apache/flink/pull/20377 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [flink] SteNicholas commented on a diff in pull request #20390: [FLINK-28481][k8s] Bump the fabric8 k8s-client to 5.12.3

2022-08-09 Thread GitBox
SteNicholas commented on code in PR #20390: URL: https://github.com/apache/flink/pull/20390#discussion_r941943372 ## flink-kubernetes/src/main/resources/META-INF/NOTICE: ## @@ -14,27 +14,27 @@ This project bundles the following dependencies under the Apache Software Licens -

[jira] [Closed] (FLINK-28481) Bump the fabric8 kubernetes-client to 5.12.3

2022-08-09 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang closed FLINK-28481. - Resolution: Fixed Fixed via: master: f2ec01241c5e5bcb860180dae5c0a660bc816926 > Bump the fabric8

[GitHub] [flink] Myasuka commented on a diff in pull request #20421: [FLINK-28732][state] Deprecate ambiguous StateTTLConfig#cleanFullSnapshot API

2022-08-09 Thread GitBox
Myasuka commented on code in PR #20421: URL: https://github.com/apache/flink/pull/20421#discussion_r941969248 ## docs/content/docs/dev/datastream/fault-tolerance/state.md: ## @@ -474,9 +474,10 @@ ttl_config = StateTtlConfig \ For more fine-grained control over some special

[jira] [Created] (FLINK-28896) Test Flink Release 1.16

2022-08-09 Thread Huang Xingbo (Jira)
Huang Xingbo created FLINK-28896: Summary: Test Flink Release 1.16 Key: FLINK-28896 URL: https://issues.apache.org/jira/browse/FLINK-28896 Project: Flink Issue Type: Improvement

[GitHub] [flink] lincoln-lil commented on pull request #20482: [FLINK-28848][table-planner] Introduces LOOKUP join hint to support delayed retry for lookup join (table alias unsupported in hint)

2022-08-09 Thread GitBox
lincoln-lil commented on PR #20482: URL: https://github.com/apache/flink/pull/20482#issuecomment-1210159092 there're several merge conflicts for the latest master, so need to verify the merged pr completely, the local verify are running -- This is an automated message from the Apache Git

[jira] [Updated] (FLINK-28876) Support writing RowData to Orc files in PyFlink

2022-08-09 Thread Dian Fu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu updated FLINK-28876: Affects Version/s: (was: 1.15.1) > Support writing RowData to Orc files in PyFlink >

[jira] [Closed] (FLINK-28876) Support writing RowData to Orc files in PyFlink

2022-08-09 Thread Dian Fu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dian Fu closed FLINK-28876. --- Assignee: Juntao Hu Resolution: Fixed Merged to master via cf3beff586a088c20833d8a8fc72bbc37d87a2b1

[jira] [Closed] (FLINK-28701) Minimize the explosion range during failover for hybrid shuffle

2022-08-09 Thread Xintong Song (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song closed FLINK-28701. Resolution: Fixed master (1.16): 56e91700ca56f5535f677314167b94b476eb6c3f > Minimize the

[GitHub] [flink] lincoln-lil commented on pull request #20482: [FLINK-28848][table-planner] Introduces LOOKUP join hint to support delayed retry for lookup join (table alias unsupported in hint)

2022-08-09 Thread GitBox
lincoln-lil commented on PR #20482: URL: https://github.com/apache/flink/pull/20482#issuecomment-1210064098 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Created] (FLINK-28895) Eliminate the map to convert RowData to Row before RowData FileSink

2022-08-09 Thread Juntao Hu (Jira)
Juntao Hu created FLINK-28895: - Summary: Eliminate the map to convert RowData to Row before RowData FileSink Key: FLINK-28895 URL: https://issues.apache.org/jira/browse/FLINK-28895 Project: Flink

[GitHub] [flink] SteNicholas commented on pull request #20390: [FLINK-28481][k8s] Bump the fabric8 k8s-client to 5.12.3

2022-08-09 Thread GitBox
SteNicholas commented on PR #20390: URL: https://github.com/apache/flink/pull/20390#issuecomment-1210068123 @bzhaoopenstack, thanks for your contribution. There are a few inconsistencies for NOTICE file. You could refer to

[GitHub] [flink] godfreyhe commented on pull request #20462: [FLINK-28821][table-planner] Adjust join cost for dpp query pattern which could help more plans use dpp

2022-08-09 Thread GitBox
godfreyhe commented on PR #20462: URL: https://github.com/apache/flink/pull/20462#issuecomment-1210068656 The private CI is green: https://dev.azure.com/leonardBang/Azure_CI/_build/results?buildId=715=results. I will merge it -- This is an automated message from the Apache Git Service.

[GitHub] [flink] wuchong merged pull request #20365: [FLINK-26929][table-runtime] Introduce adaptive hash join strategy for batch hash join

2022-08-09 Thread GitBox
wuchong merged PR #20365: URL: https://github.com/apache/flink/pull/20365 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink] fredia commented on a diff in pull request #20421: [FLINK-28732][state] Deprecate ambiguous StateTTLConfig#cleanFullSnapshot API

2022-08-09 Thread GitBox
fredia commented on code in PR #20421: URL: https://github.com/apache/flink/pull/20421#discussion_r941966732 ## docs/content/docs/dev/datastream/fault-tolerance/state.md: ## @@ -474,9 +474,10 @@ ttl_config = StateTtlConfig \ For more fine-grained control over some special

[jira] [Created] (FLINK-28897) Fail to use udf in added jar when enabling checkpoint

2022-08-09 Thread Liu (Jira)
Liu created FLINK-28897: --- Summary: Fail to use udf in added jar when enabling checkpoint Key: FLINK-28897 URL: https://issues.apache.org/jira/browse/FLINK-28897 Project: Flink Issue Type: Bug

[jira] [Commented] (FLINK-28897) Fail to use udf in added jar when enabling checkpoint

2022-08-09 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17577750#comment-17577750 ] dalongliu commented on FLINK-28897: --- [~Jiangang] Thanks for report it, I will take a look. > Fail to

[jira] [Commented] (FLINK-28767) SqlGatewayServiceITCase.testCancelOperation failed with AssertionFailedError

2022-08-09 Thread luoyuxia (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17577765#comment-17577765 ] luoyuxia commented on FLINK-28767: --

[jira] [Assigned] (FLINK-28632) Allow to GetColumns/GetTableTypes/GetPrimaryKeys in the HiveServer2 Endpoint

2022-08-09 Thread Shengkai Fang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shengkai Fang reassigned FLINK-28632: - Assignee: yuzelin (was: Shengkai Fang) > Allow to

[jira] [Updated] (FLINK-28895) Eliminate RowRowConverter between RowData source and sink

2022-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-28895: --- Labels: pull-request-available (was: ) > Eliminate RowRowConverter between RowData source

[jira] [Updated] (FLINK-28897) Fail to use udf in added jar when enabling checkpoint

2022-08-09 Thread Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liu updated FLINK-28897: Description: The problem can be reproduced when enabling checkpoint for that

[GitHub] [flink] Vancior opened a new pull request, #20525: [FLINK-28895][python] Eliminate RowRowConverter between RowData source and sink

2022-08-09 Thread GitBox
Vancior opened a new pull request, #20525: URL: https://github.com/apache/flink/pull/20525 ## What is the purpose of the change This PR eliminates using a `RowRowConverter` between RowData sources and sinks, which frees users from creating a identity map to convert records type.

[jira] [Commented] (FLINK-28898) ChangelogRecoverySwitchStateBackendITCase.testSwitchFromEnablingToDisablingWithRescalingOut failed

2022-08-09 Thread Xingbo Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17577747#comment-17577747 ] Xingbo Huang commented on FLINK-28898: -- [~Yanfei Lei] Could you help take a look? >

[jira] [Created] (FLINK-28898) ChangelogRecoverySwitchStateBackendITCase.testSwitchFromEnablingToDisablingWithRescalingOut failed

2022-08-09 Thread Xingbo Huang (Jira)
Xingbo Huang created FLINK-28898: Summary: ChangelogRecoverySwitchStateBackendITCase.testSwitchFromEnablingToDisablingWithRescalingOut failed Key: FLINK-28898 URL:

[jira] [Commented] (FLINK-28855) ThriftObjectConversions compile failed

2022-08-09 Thread Xingbo Huang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17577748#comment-17577748 ] Xingbo Huang commented on FLINK-28855: --

[GitHub] [flink] flinkbot commented on pull request #20525: [FLINK-28895][python] Eliminate RowRowConverter between RowData source and sink

2022-08-09 Thread GitBox
flinkbot commented on PR #20525: URL: https://github.com/apache/flink/pull/20525#issuecomment-1210130236 ## CI report: * 542a70de56e96f8e1be2d5166df42c7b678b1766 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-28896) [Umbrella] Test Flink Release 1.16

2022-08-09 Thread godfrey he (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] godfrey he updated FLINK-28896: --- Summary: [Umbrella] Test Flink Release 1.16 (was: Test Flink Release 1.16) > [Umbrella] Test Flink

[jira] [Updated] (FLINK-28897) Fail to use udf in added jar when enabling checkpoint

2022-08-09 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-28897: Priority: Critical (was: Major) > Fail to use udf in added jar when enabling checkpoint >

[jira] [Closed] (FLINK-28774) Allow user to configure whether to enable sort or not when it's for dynamic parition writing for HiveSource

2022-08-09 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-28774. --- Fix Version/s: 1.16.0 Assignee: luoyuxia Resolution: Fixed Fixed in master:

[jira] [Updated] (FLINK-28774) Allow user to configure whether to enable sort or not when it's for dynamic parition writing for HiveSource

2022-08-09 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-28774: Component/s: Connectors / Hive > Allow user to configure whether to enable sort or not when it's for

[jira] [Assigned] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

2022-08-09 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler reassigned FLINK-28060: Assignee: Chesnay Schepler > Kafka Commit on checkpointing fails repeatedly

[jira] [Updated] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

2022-08-09 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler updated FLINK-28060: - Fix Version/s: 1.16.0 > Kafka Commit on checkpointing fails repeatedly after a broker

[GitHub] [flink] luoyuxia commented on pull request #20419: [FLINK-28774][hive] Allow user to configure whether to enable sort not when it's for dynamic partition writing for HiveSource

2022-08-09 Thread GitBox
luoyuxia commented on PR #20419: URL: https://github.com/apache/flink/pull/20419#issuecomment-1210069019 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Closed] (FLINK-26929) Introduce adaptive hash join for batch sql optimization

2022-08-09 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu closed FLINK-26929. --- Resolution: Fixed Fixed in master: 10acb641a036ae9d171452695b660c46d97c865a > Introduce adaptive hash join

[jira] [Commented] (FLINK-26929) Introduce adaptive hash join for batch sql optimization

2022-08-09 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17577710#comment-17577710 ] Jark Wu commented on FLINK-26929: - [~Runking], yes, you are right. > Introduce adaptive hash join for

[jira] [Closed] (FLINK-28821) Adjust join cost for dpp query pattern which could help more plans use dpp

2022-08-09 Thread godfrey he (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] godfrey he closed FLINK-28821. -- Resolution: Fixed Fixed in master: 320f4cd5e5f3e851ad14f9d1e504959e58106157 > Adjust join cost for

[GitHub] [flink] wangyang0918 commented on pull request #20390: [FLINK-28481][k8s] Bump the fabric8 k8s-client to 5.12.3

2022-08-09 Thread GitBox
wangyang0918 commented on PR #20390: URL: https://github.com/apache/flink/pull/20390#issuecomment-1210089927 Using the following command to get the bundled dependencies and verified. ``` cd flink-kubernetes mvn clean install -DskipTests | grep Including | grep -v

[jira] [Assigned] (FLINK-28898) ChangelogRecoverySwitchStateBackendITCase.testSwitchFromEnablingToDisablingWithRescalingOut failed

2022-08-09 Thread Yanfei Lei (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanfei Lei reassigned FLINK-28898: -- Assignee: Hangxiang Yu >

[jira] [Commented] (FLINK-28766) UnalignedCheckpointStressITCase.runStressTest failed with NoSuchFileException

2022-08-09 Thread Huang Xingbo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17577741#comment-17577741 ] Huang Xingbo commented on FLINK-28766: --

[GitHub] [flink] xintongsong closed pull request #20429: [FLINK-28701][runtime] Minimize the explosion range during failover for hybrid shuffle

2022-08-09 Thread GitBox
xintongsong closed pull request #20429: [FLINK-28701][runtime] Minimize the explosion range during failover for hybrid shuffle URL: https://github.com/apache/flink/pull/20429 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[jira] [Updated] (FLINK-28895) Eliminate RowRowConverter between RowData source and sink

2022-08-09 Thread Juntao Hu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juntao Hu updated FLINK-28895: -- Summary: Eliminate RowRowConverter between RowData source and sink (was: Eliminate the map to

[GitHub] [flink] Myracle commented on pull request #20269: [FLINK-28548][Connectors / FileSystem] Fix the exception FileNotFoundException when the commit partition base path is not created

2022-08-09 Thread GitBox
Myracle commented on PR #20269: URL: https://github.com/apache/flink/pull/20269#issuecomment-1210072884 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [flink] dependabot[bot] commented on pull request #20279: Bump kubernetes-client from 5.5.0 to 5.7.4 in /flink-kubernetes

2022-08-09 Thread GitBox
dependabot[bot] commented on PR #20279: URL: https://github.com/apache/flink/pull/20279#issuecomment-1210093057 Looks like io.fabric8:kubernetes-client is up-to-date now, so this is no longer needed. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [flink] wangyang0918 merged pull request #20390: [FLINK-28481][k8s] Bump the fabric8 k8s-client to 5.12.3

2022-08-09 Thread GitBox
wangyang0918 merged PR #20390: URL: https://github.com/apache/flink/pull/20390 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Updated] (FLINK-28481) Bump the fabric8 kubernetes-client to 5.12.3

2022-08-09 Thread Yang Wang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Wang updated FLINK-28481: -- Fix Version/s: 1.16.0 > Bump the fabric8 kubernetes-client to 5.12.3 >

[GitHub] [flink] dependabot[bot] closed pull request #20279: Bump kubernetes-client from 5.5.0 to 5.7.4 in /flink-kubernetes

2022-08-09 Thread GitBox
dependabot[bot] closed pull request #20279: Bump kubernetes-client from 5.5.0 to 5.7.4 in /flink-kubernetes URL: https://github.com/apache/flink/pull/20279 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [flink] fsk119 closed pull request #20493: [FLINK-28632][sql-gateway][hive] Allow to GetColumns/GetPrimaryKeys/GetTableTypes in the HiveServer2 Endpoint.

2022-08-09 Thread GitBox
fsk119 closed pull request #20493: [FLINK-28632][sql-gateway][hive] Allow to GetColumns/GetPrimaryKeys/GetTableTypes in the HiveServer2 Endpoint. URL: https://github.com/apache/flink/pull/20493 -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [flink] lincoln-lil commented on pull request #20482: [FLINK-28848][table-planner] Introduces LOOKUP join hint to support delayed retry for lookup join (table alias unsupported in hint)

2022-08-09 Thread GitBox
lincoln-lil commented on PR #20482: URL: https://github.com/apache/flink/pull/20482#issuecomment-1210095530 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [flink] dianfu closed pull request #20505: [FLINK-28876][python][format/orc] Support writing RowData into Orc files

2022-08-09 Thread GitBox
dianfu closed pull request #20505: [FLINK-28876][python][format/orc] Support writing RowData into Orc files URL: https://github.com/apache/flink/pull/20505 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[jira] [Commented] (FLINK-26721) PulsarSourceITCase.testSavepoint failed on azure pipeline

2022-08-09 Thread Huang Xingbo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17577742#comment-17577742 ] Huang Xingbo commented on FLINK-26721: --

[jira] [Updated] (FLINK-28897) Fail to use udf in added jar when enabling checkpoint

2022-08-09 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-28897: Component/s: Table SQL / Client > Fail to use udf in added jar when enabling checkpoint >

[jira] [Updated] (FLINK-28897) Fail to use udf in added jar when enabling checkpoint

2022-08-09 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-28897: Fix Version/s: 1.16.0 > Fail to use udf in added jar when enabling checkpoint >

[GitHub] [flink] leonardBang merged pull request #18469: [FLINK-25485][connector/jdbc] Append default JDBC URL option of batch writing in MySQL.

2022-08-09 Thread GitBox
leonardBang merged PR #18469: URL: https://github.com/apache/flink/pull/18469 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (FLINK-27691) RankHarnessTest. testUpdateRankWithRowNumberSortKeyDropsToNotLast test failed with result mismatch

2022-08-09 Thread Yunfeng Zhou (Jira)
[ https://issues.apache.org/jira/browse/FLINK-27691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17577255#comment-17577255 ] Yunfeng Zhou commented on FLINK-27691: --

[jira] [Updated] (FLINK-28815) Translate the "Real Time Reporting with the Table API" page into Chinese

2022-08-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-28815: --- Labels: pull-request-available (was: ) > Translate the "Real Time Reporting with the Table

[GitHub] [flink] zhuzhurk commented on a diff in pull request #20507: [FLINK-28139][docs] Add documentation for speculative execution

2022-08-09 Thread GitBox
zhuzhurk commented on code in PR #20507: URL: https://github.com/apache/flink/pull/20507#discussion_r941037269 ## docs/content/docs/deployment/speculative_execution.md: ## @@ -0,0 +1,100 @@ +--- +title: Speculative Execution +weight: 5 +type: docs + +--- + + +# Speculative

[GitHub] [flink] flinkbot commented on pull request #20511: Unlink symlink before creation

2022-08-09 Thread GitBox
flinkbot commented on PR #20511: URL: https://github.com/apache/flink/pull/20511#issuecomment-1209085049 ## CI report: * e0654a81c17f975f5f9729d0eb2c015cca6c3bde UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Closed] (FLINK-28811) Enable Java 11 tests for Hbase 2

2022-08-09 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-28811. Resolution: Fixed master: 5fb135e23e3251bcacf19d8db8cf358ddda76d6e > Enable Java 11

[GitHub] [flink] zentol merged pull request #20453: [FLINK-25244][hbase] Enable Java 11 tests for HBase 2.2

2022-08-09 Thread GitBox
zentol merged PR #20453: URL: https://github.com/apache/flink/pull/20453 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink] swuferhong opened a new pull request, #20513: [FLINK-28858][docs] Add document to describe join hints for batch sql

2022-08-09 Thread GitBox
swuferhong opened a new pull request, #20513: URL: https://github.com/apache/flink/pull/20513 ## What is the purpose of the change This pr is aims to add document for introduce join hints for batch sql. ## Brief change log - Adding join hints contents in

[GitHub] [flink] Myasuka commented on a diff in pull request #20421: [FLINK-28732][state] Deprecate ambiguous StateTTLConfig#cleanFullSnapshot API

2022-08-09 Thread GitBox
Myasuka commented on code in PR #20421: URL: https://github.com/apache/flink/pull/20421#discussion_r941081228 ## docs/content/docs/dev/datastream/fault-tolerance/state.md: ## @@ -474,9 +474,10 @@ ttl_config = StateTtlConfig \ For more fine-grained control over some special

[GitHub] [flink] gaoyunhaii closed pull request #20512: [FLINK-28860][tests] Disable CacheITCase

2022-08-09 Thread GitBox
gaoyunhaii closed pull request #20512: [FLINK-28860][tests] Disable CacheITCase URL: https://github.com/apache/flink/pull/20512 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Updated] (FLINK-28883) HiveTableSink support to report metrics to metastore

2022-08-09 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated FLINK-28883: --- Description: like  file number, total line number and total size  > HiveTableSink support to report

[jira] [Updated] (FLINK-28883) HiveTableSink support to report metrics to metastore

2022-08-09 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated FLINK-28883: --- Summary: HiveTableSink support to report metrics to metastore (was: Report hive tasks' file

[jira] [Updated] (FLINK-28883) Fix HiveTableSink failed to report metrics to hive metastore

2022-08-09 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-28883: Description: Currently, HiveTableSink is failed to report metrics to metastores, like file number, total

[GitHub] [flink] flinkbot commented on pull request #20514: [Fix] Fix 'Table.INDEX_TABLE' not found in the Hive3

2022-08-09 Thread GitBox
flinkbot commented on PR #20514: URL: https://github.com/apache/flink/pull/20514#issuecomment-1209133788 ## CI report: * ce5b5703c44161b675cb5004d267f33c96ac1fe6 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] yunfengzhou-hub commented on pull request #20454: [FLINK-28639][Runtime/Checkpointing] Preserve consistency of events from subtask to OC

2022-08-09 Thread GitBox
yunfengzhou-hub commented on PR #20454: URL: https://github.com/apache/flink/pull/20454#issuecomment-1209157911 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Created] (FLINK-28889) Hybrid shuffle writes multiple copies of broadcast data

2022-08-09 Thread Weijie Guo (Jira)
Weijie Guo created FLINK-28889: -- Summary: Hybrid shuffle writes multiple copies of broadcast data Key: FLINK-28889 URL: https://issues.apache.org/jira/browse/FLINK-28889 Project: Flink Issue

[GitHub] [flink] flinkbot commented on pull request #20515: [FLINK-28886][python] Support HybridSource in Python DataStream API

2022-08-09 Thread GitBox
flinkbot commented on PR #20515: URL: https://github.com/apache/flink/pull/20515#issuecomment-1209172445 ## CI report: * 879ff1c6f3f4301df8c675092d8dd451c7670203 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] rmetzger commented on a diff in pull request #19972: [FLINK-27399][Connector/Pulsar] Change initial consuming position setting logic for better handle the checkpoint.

2022-08-09 Thread GitBox
rmetzger commented on code in PR #19972: URL: https://github.com/apache/flink/pull/19972#discussion_r941153631 ## flink-connectors/flink-connector-pulsar/src/test/java/org/apache/flink/connector/pulsar/source/PulsarSourceITCase.java: ## @@ -33,8 +33,10 @@ import

[GitHub] [flink] Grypse commented on pull request #20516: [FLINK-27856][flink-kubernetes]solve the NPE error of no spec field in taskmanager pod template.

2022-08-09 Thread GitBox
Grypse commented on PR #20516: URL: https://github.com/apache/flink/pull/20516#issuecomment-1209190506 @wangyang0918 Please help me review this PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [flink] rkhachatryan commented on pull request #20091: [FLINK-27570][runtime] Fix checkFailureCounter in CheckpointFailureManager for finalize failure

2022-08-09 Thread GitBox
rkhachatryan commented on PR #20091: URL: https://github.com/apache/flink/pull/20091#issuecomment-1209195638 Previously, I had a class-loading issue in this test. Byut trying to debug your test, I see that the custom `CheckpointStorage` doesn't override `configure()`;

[GitHub] [flink] rkhachatryan commented on pull request #20217: [FLINK-27693][state] Support local recovery for non-materialized part

2022-08-09 Thread GitBox
rkhachatryan commented on PR #20217: URL: https://github.com/apache/flink/pull/20217#issuecomment-1209205537 Merged manually as 1f9632a07199854c0225bd7f416c038fbf59abe0..52eb7e76b5d66ff5c4d9d4af8a213b5b8f9f8322 (build

[GitHub] [flink] rkhachatryan closed pull request #20217: [FLINK-27693][state] Support local recovery for non-materialized part

2022-08-09 Thread GitBox
rkhachatryan closed pull request #20217: [FLINK-27693][state] Support local recovery for non-materialized part URL: https://github.com/apache/flink/pull/20217 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Created] (FLINK-28892) Update NOTICE for flink-kubernetes-operator 1.1.1

2022-08-09 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-28892: -- Summary: Update NOTICE for flink-kubernetes-operator 1.1.1 Key: FLINK-28892 URL: https://issues.apache.org/jira/browse/FLINK-28892 Project: Flink Issue Type:

[GitHub] [flink-kubernetes-operator] gyfora commented on pull request #344: [FLINK-28574] Bump the fabric8 kubernetes-client to 5.12.3

2022-08-09 Thread GitBox
gyfora commented on PR #344: URL: https://github.com/apache/flink-kubernetes-operator/pull/344#issuecomment-1209241084 This is based on the command: ``` mvn clean install -DskipTests -pl flink-kubernetes-operator | grep Including | grep -v org.apache.flink | cut -d' ' -f3 | sort

[GitHub] [flink] luoyuxia commented on pull request #20377: [FLINK-27338][hive] Improve splitting file for Hive table with orc format

2022-08-09 Thread GitBox
luoyuxia commented on PR #20377: URL: https://github.com/apache/flink/pull/20377#issuecomment-1209247982 @godfreyhe Thanks for reviewing. I have addressed your comments. Could you please help review again? -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [flink] dannycranmer commented on pull request #20245: [FLINK-28487][connectors] Introduce configurable RateLimitingStrategy…

2022-08-09 Thread GitBox
dannycranmer commented on PR #20245: URL: https://github.com/apache/flink/pull/20245#issuecomment-1209258678 @pnowojski any final comments? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [flink] Vancior commented on a diff in pull request #20505: [FLINK-28876][python][format/orc] Support writing RowData into Orc files

2022-08-09 Thread GitBox
Vancior commented on code in PR #20505: URL: https://github.com/apache/flink/pull/20505#discussion_r941223474 ## docs/content/docs/connectors/datastream/filesystem.md: ## @@ -792,6 +792,36 @@ class PersonVectorizer(schema: String) extends Vectorizer[Person](schema) { {{< /tab

[jira] [Commented] (FLINK-28060) Kafka Commit on checkpointing fails repeatedly after a broker restart

2022-08-09 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17577368#comment-17577368 ] Chesnay Schepler commented on FLINK-28060: -- I ran CI with Kafka 3.2.1 and it passed without

[GitHub] [flink] rkhachatryan commented on pull request #20103: [FLINK-28178][runtime-web] Show the delegated StateBackend and whethe…

2022-08-09 Thread GitBox
rkhachatryan commented on PR #20103: URL: https://github.com/apache/flink/pull/20103#issuecomment-1209275667 The build [succeeded](https://dev.azure.com/khachatryanroman/flink/_build/results?buildId=1601=results) in a private branch, merging. -- This is an automated message from the

[GitHub] [flink] Myasuka commented on a diff in pull request #20421: [FLINK-28732][state] Deprecate ambiguous StateTTLConfig#cleanFullSnapshot API

2022-08-09 Thread GitBox
Myasuka commented on code in PR #20421: URL: https://github.com/apache/flink/pull/20421#discussion_r941272331 ## docs/content/docs/dev/datastream/fault-tolerance/state.md: ## @@ -474,9 +474,10 @@ ttl_config = StateTtlConfig \ For more fine-grained control over some special

[jira] [Resolved] (FLINK-25485) JDBC connector implicitly append url options when use mysql

2022-08-09 Thread Leonard Xu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Leonard Xu resolved FLINK-25485. Fix Version/s: 1.16.0 Resolution: Resolved Resolved in master(1.16):

[jira] [Updated] (FLINK-28884) Downstream task may never be notified of data available in hybrid shuffle when number of credits is zero.

2022-08-09 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weijie Guo updated FLINK-28884: --- Description: Downstream task may never be notified of data available in hybrid shuffle when number

[GitHub] [flink] Myasuka commented on a diff in pull request #20405: [FLINK-28010][state] Use deleteRange to optimize the clear method of RocksDBMapState.

2022-08-09 Thread GitBox
Myasuka commented on code in PR #20405: URL: https://github.com/apache/flink/pull/20405#discussion_r941079853 ## flink-state-backends/flink-statebackend-rocksdb/src/main/java/org/apache/flink/contrib/streaming/state/AbstractRocksDBState.java: ## @@ -223,4 +223,27 @@ public

[GitHub] [flink] libenchao commented on pull request #20140: [Flink 16024][Connector][JDBC] Support FilterPushdown

2022-08-09 Thread GitBox
libenchao commented on PR #20140: URL: https://github.com/apache/flink/pull/20140#issuecomment-1209118740 > I believe IN is supported out of the box, because Flink compile IN into multiple X=Y condition chained together by OR Not exactly, we have a threshold (default 4):

[jira] [Created] (FLINK-28885) Improve LookupFunction to support different kinds of RowData as key row

2022-08-09 Thread Qingsheng Ren (Jira)
Qingsheng Ren created FLINK-28885: - Summary: Improve LookupFunction to support different kinds of RowData as key row Key: FLINK-28885 URL: https://issues.apache.org/jira/browse/FLINK-28885 Project:

[jira] [Updated] (FLINK-28883) HiveTableSink supports to report metrics to hive metastore

2022-08-09 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated FLINK-28883: --- Description: HiveTableSink support to report metrics to metastores, like file number, total line

[jira] [Updated] (FLINK-28883) HiveTableSink supports to report metrics to hive metastore

2022-08-09 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated FLINK-28883: --- Fix Version/s: (was: 1.16.0) > HiveTableSink supports to report metrics to hive metastore >

[jira] [Updated] (FLINK-28883) HiveTableSink supports to report metrics to hive metastore

2022-08-09 Thread Jing Zhang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhang updated FLINK-28883: --- Fix Version/s: 1.16.0 > HiveTableSink supports to report metrics to hive metastore >

[GitHub] [flink] Vancior commented on a diff in pull request #20499: [FLINK-28862][python][format/parquet] Support ParquetRowDataWriter

2022-08-09 Thread GitBox
Vancior commented on code in PR #20499: URL: https://github.com/apache/flink/pull/20499#discussion_r941102426 ## flink-python/pyflink/fn_execution/coders.py: ## @@ -725,13 +725,17 @@ def from_type_info_proto(type_info): return RowCoder(

[GitHub] [flink] luoyuxia commented on a diff in pull request #20377: [FLINK-27338][hive] Improve splitting file for Hive table with orc format

2022-08-09 Thread GitBox
luoyuxia commented on code in PR #20377: URL: https://github.com/apache/flink/pull/20377#discussion_r941114418 ## flink-connectors/flink-connector-hive/src/test/java/org/apache/flink/connectors/hive/PartitionMonitorTest.java: ## @@ -99,6 +99,10 @@ private void

  1   2   3   4   >