Re: [PR] [FLINK-33448][runtime] Introduce a new configuration item 'taskmanager.load-balance.mode' [flink]

2023-11-03 Thread via GitHub
1996fanrui commented on code in PR #23658: URL: https://github.com/apache/flink/pull/23658#discussion_r1382337335 ## flink-core/src/test/java/org/apache/flink/configuration/TaskManagerLoadBalanceModeTest.java: ## @@ -0,0 +1,62 @@ +/* + * Licensed to the Apache Software

Re: [PR] [FLINK-33457][tests] FlinkImageBuilder checks for Java 21 [flink]

2023-11-03 Thread via GitHub
flinkbot commented on PR #23662: URL: https://github.com/apache/flink/pull/23662#issuecomment-1793334269 ## CI report: * 8acb8844cc95e026a3657cd130bc7a51c429dcc3 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-33457) FlinkImageBuilder checks for Java 21

2023-11-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-33457: --- Labels: pull-request-available (was: ) > FlinkImageBuilder checks for Java 21 >

[PR] [FLINK-33457][tests] FlinkImageBuilder checks for Java 21 [flink]

2023-11-03 Thread via GitHub
snuyanzin opened a new pull request, #23662: URL: https://github.com/apache/flink/pull/23662 ## What is the purpose of the change The PR allows to pass `FlinkImageBuilder` to proceed with e2e tests ## Verifying this change This change is a trivial rework

[jira] [Assigned] (FLINK-33457) FlinkImageBuilder checks for Java 21

2023-11-03 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin reassigned FLINK-33457: --- Assignee: Sergey Nuyanzin > FlinkImageBuilder checks for Java 21 >

[jira] [Created] (FLINK-33457) FlinkImageBuilder checks for Java 21

2023-11-03 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-33457: --- Summary: FlinkImageBuilder checks for Java 21 Key: FLINK-33457 URL: https://issues.apache.org/jira/browse/FLINK-33457 Project: Flink Issue Type:

[jira] [Commented] (FLINK-12302) Fixed the wrong finalStatus of yarn application when application finished

2023-11-03 Thread Xin Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782815#comment-17782815 ] Xin Chen commented on FLINK-12302: -- [~lamber-ken][~gjy][~trohrmann] Hi, Thank you for your

[jira] [Comment Edited] (FLINK-12302) Fixed the wrong finalStatus of yarn application when application finished

2023-11-03 Thread Xin Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782815#comment-17782815 ] Xin Chen edited comment on FLINK-12302 at 11/4/23 3:20 AM: ---

Re: [PR] [FLINK-33448][runtime] Introduce a new configuration item 'taskmanager.load-balance.mode' [flink]

2023-11-03 Thread via GitHub
1996fanrui commented on code in PR #23658: URL: https://github.com/apache/flink/pull/23658#discussion_r1382318102 ## flink-core/src/main/java/org/apache/flink/configuration/TaskManagerLoadBalanceMode.java: ## @@ -0,0 +1,54 @@ +/* + * Licensed to the Apache Software Foundation

Re: [PR] [FLINK-33448][runtime] Introduce a new configuration item 'taskmanager.load-balance.mode' [flink]

2023-11-03 Thread via GitHub
RocMarshal commented on PR #23658: URL: https://github.com/apache/flink/pull/23658#issuecomment-1793300301 Hi, @1996fanrui Could you help take a look in your free time? Thank you~ :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Commented] (FLINK-32902) Docs creation and checks in multiple locations

2023-11-03 Thread ZY tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782804#comment-17782804 ] ZY tang commented on FLINK-32902: - I can merge the scrips to reduce redundancy. Could you assign it to

Re: [PR] [FLINK-33456] Upgrade maven-shade-plugin to 3.5.1 to support jdk20+ [flink]

2023-11-03 Thread via GitHub
flinkbot commented on PR #23661: URL: https://github.com/apache/flink/pull/23661#issuecomment-1793176908 ## CI report: * 50c25f9959d72c8dbc897811a2b50c31edd2517a UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-33456) Upgrade maven-shade-plugin to 3.5.1

2023-11-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-33456: --- Labels: pull-request-available (was: ) > Upgrade maven-shade-plugin to 3.5.1 >

[PR] [FLINK-33456] Upgrade maven-shade-plugin to 3.5.1 to support jdk20+ [flink]

2023-11-03 Thread via GitHub
snuyanzin opened a new pull request, #23661: URL: https://github.com/apache/flink/pull/23661 ## What is the purpose of the change The issue with current shade plugin is that it does not support jdk 20, 21 The support was added at 3.5.1 within

[jira] [Created] (FLINK-33456) Upgrade maven-shade-plugin to 3.5.1

2023-11-03 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-33456: --- Summary: Upgrade maven-shade-plugin to 3.5.1 Key: FLINK-33456 URL: https://issues.apache.org/jira/browse/FLINK-33456 Project: Flink Issue Type:

Re: [PR] [FLINK-33453][build] Add java21-target profile [flink]

2023-11-03 Thread via GitHub
snuyanzin commented on PR #23657: URL: https://github.com/apache/flink/pull/23657#issuecomment-1793115293 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] [FLINK-33455] Implement restore tests for SortLimit node [flink]

2023-11-03 Thread via GitHub
flinkbot commented on PR #23660: URL: https://github.com/apache/flink/pull/23660#issuecomment-1792915868 ## CI report: * dca323127703ddbd196ec80ab7b33a374d30f29a UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-33455) Implement restore tests for SortLimit node

2023-11-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-33455: --- Labels: pull-request-available (was: ) > Implement restore tests for SortLimit node >

[PR] [FLINK-33455] Implement restore tests for SortLimit node [flink]

2023-11-03 Thread via GitHub
bvarghese1 opened a new pull request, #23660: URL: https://github.com/apache/flink/pull/23660 ## What is the purpose of the change Implement restore tests for SortLimit node ## Verifying this change This change added tests and can be verified as follows:

[jira] [Created] (FLINK-33455) Implement restore tests for SortLimit node

2023-11-03 Thread Bonnie Varghese (Jira)
Bonnie Varghese created FLINK-33455: --- Summary: Implement restore tests for SortLimit node Key: FLINK-33455 URL: https://issues.apache.org/jira/browse/FLINK-33455 Project: Flink Issue Type:

[jira] [Updated] (FLINK-33311) FlinkSecurityManagerITCase fails on java 21

2023-11-03 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin updated FLINK-33311: Component/s: Tests > FlinkSecurityManagerITCase fails on java 21 >

[jira] [Assigned] (FLINK-33311) FlinkSecurityManagerITCase fails on java 21

2023-11-03 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin reassigned FLINK-33311: --- Assignee: Sergey Nuyanzin > FlinkSecurityManagerITCase fails on java 21 >

[jira] [Commented] (FLINK-33311) FlinkSecurityManagerITCase fails on java 21

2023-11-03 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782684#comment-17782684 ] Sergey Nuyanzin commented on FLINK-33311: - It seems I found the root cause. [~chesnay] I

Re: [PR] [FLINK-33311] `surefire.module.config` args should be before entry point classname to work with java 21 [flink]

2023-11-03 Thread via GitHub
flinkbot commented on PR #23659: URL: https://github.com/apache/flink/pull/23659#issuecomment-1792841228 ## CI report: * ce711b80cf3ee1d43aa85cb373db845128db5475 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-33311) FlinkSecurityManagerITCase fails on java 21

2023-11-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-33311: --- Labels: pull-request-available (was: ) > FlinkSecurityManagerITCase fails on java 21 >

[PR] [FLINK-33311] `surefire.module.config` args should be before entry point classname to work with java 21 [flink]

2023-11-03 Thread via GitHub
snuyanzin opened a new pull request, #23659: URL: https://github.com/apache/flink/pull/23659 The issue with `TestJvmProccess` is that properties from `surefire.module.config` are putting in a command line after entry point class name and as a result will be ignored that leads to

Re: [PR] [FLINK-33448][runtime] Introduce a new configuration item 'taskmanager.load-balance.mode' [flink]

2023-11-03 Thread via GitHub
flinkbot commented on PR #23658: URL: https://github.com/apache/flink/pull/23658#issuecomment-1792805398 ## CI report: * b4d6bef71fe5bee3a299422a9e2037c38cf33bdf UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-33448) Introduce a new configuration item 'taskmanager.load-balance.mode'

2023-11-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-33448: --- Labels: pull-request-available (was: ) > Introduce a new configuration item

[PR] [FLINK-33448][runtime] Introduce a new configuration item 'taskmanager.load-balance.mode' [flink]

2023-11-03 Thread via GitHub
RocMarshal opened a new pull request, #23658: URL: https://github.com/apache/flink/pull/23658 ## What is the purpose of the change Introduce a new configuration item 'taskmanager.load-balance.mode' The PR resulted from

[jira] [Closed] (FLINK-33447) Avoid CompiledPlan recompilation during loading

2023-11-03 Thread Timo Walther (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timo Walther closed FLINK-33447. Fix Version/s: 1.19.0 Resolution: Fixed Fixed in master:

Re: [PR] [FLINK-33447][table-planner] Avoid CompiledPlan recompilation during loading [flink]

2023-11-03 Thread via GitHub
twalthr merged PR #23655: URL: https://github.com/apache/flink/pull/23655 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (FLINK-32444) Enable object reuse for Flink SQL jobs by default

2023-11-03 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782658#comment-17782658 ] Piotr Nowojski commented on FLINK-32444: {quote} Does it give us a performance benefits?

[jira] [Commented] (FLINK-32444) Enable object reuse for Flink SQL jobs by default

2023-11-03 Thread Timo Walther (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782654#comment-17782654 ] Timo Walther commented on FLINK-32444: -- [~jark] is there a reason why you didn't implement this

[jira] [Updated] (FLINK-33454) Adding tls configuration to IngressSpec

2023-11-03 Thread dongwoo.kim (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dongwoo.kim updated FLINK-33454: Description: Hello, I want to propose new configuration parameter for IngressSpec. Currently

[jira] [Created] (FLINK-33454) Adding tls configuration to IngressSpec

2023-11-03 Thread dongwoo.kim (Jira)
dongwoo.kim created FLINK-33454: --- Summary: Adding tls configuration to IngressSpec Key: FLINK-33454 URL: https://issues.apache.org/jira/browse/FLINK-33454 Project: Flink Issue Type: New

[jira] [Commented] (FLINK-33429) Metric collection during stabilization phase may error due to missing metrics

2023-11-03 Thread Maximilian Michels (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782643#comment-17782643 ] Maximilian Michels commented on FLINK-33429: Thanks for closing! > Metric collection during

[jira] [Closed] (FLINK-33164) HBase connector support ignore null value for partial update

2023-11-03 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martijn Visser closed FLINK-33164. -- Fix Version/s: hbase-3.0.1 Resolution: Fixed Fixed in apache/flink-connector-hbase

[jira] [Assigned] (FLINK-33164) HBase connector support ignore null value for partial update

2023-11-03 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martijn Visser reassigned FLINK-33164: -- Assignee: tanjialiang > HBase connector support ignore null value for partial update

Re: [PR] [FLINK-33164] Support write option sink.ignore-null-value [flink-connector-hbase]

2023-11-03 Thread via GitHub
MartijnVisser merged PR #21: URL: https://github.com/apache/flink-connector-hbase/pull/21 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Updated] (FLINK-33446) SubQueryAntiJoinTest#testMultiNotExistsWithCorrelatedOnWhere_NestedCorrelation doesn't produce the correct plan

2023-11-03 Thread Shengkai Fang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shengkai Fang updated FLINK-33446: -- Description: Although this test doesn't throw an exception, the final plan produces 3

Re: [PR] [FLINK-33164] Support write option sink.ignore-null-value [flink-connector-hbase]

2023-11-03 Thread via GitHub
ferenc-csaky commented on PR #21: URL: https://github.com/apache/flink-connector-hbase/pull/21#issuecomment-1792667480 @MartijnVisser this is also in a mergeable state I think. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[jira] [Commented] (FLINK-33293) Data loss with Kafka Sink

2023-11-03 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782614#comment-17782614 ] Martijn Visser commented on FLINK-33293: [~tzulitai] WDYT? > Data loss with Kafka Sink >

[jira] [Closed] (FLINK-33304) Atomicity of RowMutations would broken when Delete and Put on same columnFamily/column/row

2023-11-03 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martijn Visser closed FLINK-33304. -- Resolution: Fixed > Atomicity of RowMutations would broken when Delete and Put on same >

[jira] [Commented] (FLINK-33304) Atomicity of RowMutations would broken when Delete and Put on same columnFamily/column/row

2023-11-03 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782611#comment-17782611 ] Martijn Visser commented on FLINK-33304: Fixed in apache/flink-connector-hbase main:

[jira] [Updated] (FLINK-33304) Atomicity of RowMutations would broken when Delete and Put on same columnFamily/column/row

2023-11-03 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martijn Visser updated FLINK-33304: --- Fix Version/s: hbase-3.0.1 > Atomicity of RowMutations would broken when Delete and Put on

[jira] [Commented] (FLINK-33293) Data loss with Kafka Sink

2023-11-03 Thread Jasmin Redzepovic (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782609#comment-17782609 ] Jasmin Redzepovic commented on FLINK-33293: --- Not before, but did that test now.

Re: [PR] [FLINK-33304] Introduce the DeduplicatedMutator to resolve the mutation write conflict problem [flink-connector-hbase]

2023-11-03 Thread via GitHub
boring-cyborg[bot] commented on PR #30: URL: https://github.com/apache/flink-connector-hbase/pull/30#issuecomment-1792620397 Awesome work, congrats on your first merged pull request! -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [PR] [FLINK-33304] Introduce the DeduplicatedMutator to resolve the mutation write conflict problem [flink-connector-hbase]

2023-11-03 Thread via GitHub
MartijnVisser merged PR #30: URL: https://github.com/apache/flink-connector-hbase/pull/30 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] [FLINK-33453][build] Add java21-target profile [flink]

2023-11-03 Thread via GitHub
flinkbot commented on PR #23657: URL: https://github.com/apache/flink/pull/23657#issuecomment-1792612522 ## CI report: * 9631cdc52af010c6cedd37f4ba25e61e6d20e62e UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-33453) Add java21-target profile

2023-11-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-33453: --- Labels: pull-request-available (was: ) > Add java21-target profile >

[PR] [FLINK-33453][build] Add java21-target profile [flink]

2023-11-03 Thread via GitHub
snuyanzin opened a new pull request, #23657: URL: https://github.com/apache/flink/pull/23657 ## What is the purpose of the change Add java21-target profile ## Brief change log pom.xml ## Verifying this change This change is a trivial rework ##

[jira] [Created] (FLINK-33453) Add java21-target profile

2023-11-03 Thread Sergey Nuyanzin (Jira)
Sergey Nuyanzin created FLINK-33453: --- Summary: Add java21-target profile Key: FLINK-33453 URL: https://issues.apache.org/jira/browse/FLINK-33453 Project: Flink Issue Type: Sub-task

[jira] [Assigned] (FLINK-33453) Add java21-target profile

2023-11-03 Thread Sergey Nuyanzin (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Nuyanzin reassigned FLINK-33453: --- Assignee: Sergey Nuyanzin > Add java21-target profile > -

[jira] [Updated] (FLINK-33099) Introduce the Standalone Autoscaler and support flink cluster

2023-11-03 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-33099: Fix Version/s: kubernetes-operator-1.7.0 > Introduce the Standalone Autoscaler and support flink cluster

[jira] [Comment Edited] (FLINK-33451) Implement FileSytemAutoScalerStateStore

2023-11-03 Thread Samrat Deb (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782590#comment-17782590 ] Samrat Deb edited comment on FLINK-33451 at 11/3/23 2:47 PM: - Thank you

[jira] [Updated] (FLINK-33102) Document the standalone autoscaler

2023-11-03 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-33102: Fix Version/s: kubernetes-operator-1.7.0 > Document the standalone autoscaler >

[jira] [Comment Edited] (FLINK-33451) Implement FileSytemAutoScalerStateStore

2023-11-03 Thread Samrat Deb (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782590#comment-17782590 ] Samrat Deb edited comment on FLINK-33451 at 11/3/23 2:46 PM: - Thank you

[jira] [Commented] (FLINK-33429) Metric collection during stabilization phase may error due to missing metrics

2023-11-03 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782599#comment-17782599 ] Rui Fan commented on FLINK-33429: - Merged master<1.7.0> via :  03c9eb6f57d5d61f68cd93ff765b663d13b01ffe

[jira] [Resolved] (FLINK-33429) Metric collection during stabilization phase may error due to missing metrics

2023-11-03 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan resolved FLINK-33429. - Resolution: Fixed > Metric collection during stabilization phase may error due to missing metrics >

[jira] [Updated] (FLINK-32723) FLIP-334 : Decoupling autoscaler and kubernetes and support the Standalone Autoscaler

2023-11-03 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-32723: Fix Version/s: kubernetes-operator-1.7.0 > FLIP-334 : Decoupling autoscaler and kubernetes and support

[jira] [Commented] (FLINK-32723) FLIP-334 : Decoupling autoscaler and kubernetes and support the Standalone Autoscaler

2023-11-03 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782593#comment-17782593 ] Rui Fan commented on FLINK-32723: - FLIP-334 (FLINK-32723) wants to decouple autoscalers and kubernetes

[jira] [Comment Edited] (FLINK-33451) Implement FileSytemAutoScalerStateStore

2023-11-03 Thread Samrat Deb (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782590#comment-17782590 ] Samrat Deb edited comment on FLINK-33451 at 11/3/23 2:35 PM: - Thank you

[jira] [Commented] (FLINK-33451) Implement FileSytemAutoScalerStateStore

2023-11-03 Thread Samrat Deb (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782590#comment-17782590 ] Samrat Deb commented on FLINK-33451: Thank you [~fanrui] for explaining the concern , these are all

[jira] [Commented] (FLINK-33451) Implement FileSytemAutoScalerStateStore

2023-11-03 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782585#comment-17782585 ] Rui Fan commented on FLINK-33451: - Hi [~samrat007] , thanks for creating this JIRA. I have assigned it

[jira] [Assigned] (FLINK-33451) Implement FileSytemAutoScalerStateStore

2023-11-03 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan reassigned FLINK-33451: --- Assignee: Samrat Deb > Implement FileSytemAutoScalerStateStore >

[jira] [Updated] (FLINK-33451) Implement FileSytemAutoScalerStateStore

2023-11-03 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-33451: Parent: (was: FLINK-32723) Issue Type: Improvement (was: Sub-task) > Implement

[jira] [Updated] (FLINK-33099) Introduce the Standalone Autoscaler and support flink cluster

2023-11-03 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-33099: Summary: Introduce the Standalone Autoscaler and support flink cluster (was: Support the Standalone

[jira] [Updated] (FLINK-33287) Using the flink shaded jackson for flink-autoscaler

2023-11-03 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-33287: Parent: FLINK-33452 Issue Type: Sub-task (was: Improvement) > Using the flink shaded jackson for

[jira] [Updated] (FLINK-33287) Using the flink shaded jackson for flink-autoscaler

2023-11-03 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-33287: Parent: (was: FLINK-32723) Issue Type: Improvement (was: Sub-task) > Using the flink shaded

[jira] [Updated] (FLINK-33101) Add the integration test for standalone autoscaler

2023-11-03 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-33101: Parent: FLINK-33452 Issue Type: Sub-task (was: Improvement) > Add the integration test for

[jira] [Updated] (FLINK-33101) Add the integration test for standalone autoscaler

2023-11-03 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-33101: Parent: (was: FLINK-32723) Issue Type: Improvement (was: Sub-task) > Add the integration

[jira] [Updated] (FLINK-33450) Implement JdbcAutoScalerStateStore

2023-11-03 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-33450: Parent: FLINK-33452 Issue Type: Sub-task (was: Improvement) > Implement JdbcAutoScalerStateStore

[jira] [Updated] (FLINK-33450) Implement JdbcAutoScalerStateStore

2023-11-03 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-33450: Parent: (was: FLINK-32723) Issue Type: Improvement (was: Sub-task) > Implement

[jira] [Updated] (FLINK-32947) Standalone autoscaler supports the metric reporter

2023-11-03 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-32947: Parent: FLINK-33452 Issue Type: Sub-task (was: Improvement) > Standalone autoscaler supports the

[jira] [Updated] (FLINK-32947) Standalone autoscaler supports the metric reporter

2023-11-03 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-32947: Parent: (was: FLINK-32723) Issue Type: Improvement (was: Sub-task) > Standalone autoscaler

[jira] [Updated] (FLINK-33100) Implement YarnJobFetcher for Standalone Autoscaler

2023-11-03 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-33100: Parent: FLINK-33452 Issue Type: Sub-task (was: New Feature) > Implement YarnJobFetcher for

[jira] [Updated] (FLINK-33100) Implement YarnJobFetcher for Standalone Autoscaler

2023-11-03 Thread Rui Fan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Fan updated FLINK-33100: Parent: (was: FLINK-32723) Issue Type: New Feature (was: Sub-task) > Implement

[jira] [Created] (FLINK-33452) A series of improvements of Autoscaler Standalone

2023-11-03 Thread Rui Fan (Jira)
Rui Fan created FLINK-33452: --- Summary: A series of improvements of Autoscaler Standalone Key: FLINK-33452 URL: https://issues.apache.org/jira/browse/FLINK-33452 Project: Flink Issue Type:

[jira] [Comment Edited] (FLINK-33451) Implement FileSytemAutoScalerStateStore

2023-11-03 Thread Samrat Deb (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782578#comment-17782578 ] Samrat Deb edited comment on FLINK-33451 at 11/3/23 1:54 PM: - i would like

[jira] [Commented] (FLINK-33451) Implement FileSytemAutoScalerStateStore

2023-11-03 Thread Samrat Deb (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782578#comment-17782578 ] Samrat Deb commented on FLINK-33451: i would like to work on the tasks  Rui can you please assign me

[jira] [Created] (FLINK-33451) Implement FileSytemAutoScalerStateStore

2023-11-03 Thread Samrat Deb (Jira)
Samrat Deb created FLINK-33451: -- Summary: Implement FileSytemAutoScalerStateStore Key: FLINK-33451 URL: https://issues.apache.org/jira/browse/FLINK-33451 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-33450) Implement JdbcAutoScalerStateStore

2023-11-03 Thread Rui Fan (Jira)
Rui Fan created FLINK-33450: --- Summary: Implement JdbcAutoScalerStateStore Key: FLINK-33450 URL: https://issues.apache.org/jira/browse/FLINK-33450 Project: Flink Issue Type: Sub-task

[jira] [Updated] (FLINK-30960) OutOfMemory error using jdbc sink

2023-11-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-30960: --- Labels: pull-request-available (was: ) > OutOfMemory error using jdbc sink >

Re: [PR] [FLINK-30960] Fix a corner case oom error [flink-connector-jdbc]

2023-11-03 Thread via GitHub
boring-cyborg[bot] commented on PR #77: URL: https://github.com/apache/flink-connector-jdbc/pull/77#issuecomment-1792455939 Thanks for opening this pull request! Please check out our contributing guidelines. (https://flink.apache.org/contributing/how-to-contribute.html) -- This is

[PR] [FLINK-30960] Fix a corner case oom error [flink-connector-jdbc]

2023-11-03 Thread via GitHub
bs352 opened a new pull request, #77: URL: https://github.com/apache/flink-connector-jdbc/pull/77 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[jira] [Updated] (FLINK-30960) OutOfMemory error using jdbc sink

2023-11-03 Thread Bo Shen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-30960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bo Shen updated FLINK-30960: Description: Here in production I have an environment consisting of a kafka source, to which third-party

Re: [PR] [FLINK-33099][autoscaler] Introduce the Standalone Autoscaler and support flink cluster [flink-kubernetes-operator]

2023-11-03 Thread via GitHub
1996fanrui commented on code in PR #698: URL: https://github.com/apache/flink-kubernetes-operator/pull/698#discussion_r1381684156 ## flink-autoscaler/src/main/java/org/apache/flink/autoscaler/event/AutoScalerEventHandler.java: ## @@ -32,32 +35,45 @@ import static

Re: [PR] [FLINK-33099][autoscaler] Introduce the Standalone Autoscaler and support flink cluster [flink-kubernetes-operator]

2023-11-03 Thread via GitHub
1996fanrui commented on code in PR #698: URL: https://github.com/apache/flink-kubernetes-operator/pull/698#discussion_r1381682586 ## flink-autoscaler-standalone/README.md: ## @@ -0,0 +1,83 @@ +# Flink Autoscaler Standalone + +## What's the autoscaler standalone? + +`Flink

Re: [PR] [FLINK-33449][table]Support array_contains_seq function [flink]

2023-11-03 Thread via GitHub
MartijnVisser commented on PR #23656: URL: https://github.com/apache/flink/pull/23656#issuecomment-1792398513 > we need use this function, so can we suuport this function? That's not something that we should decide over a PR, but before opening a Jira ticket and a PR should be

[jira] [Comment Edited] (FLINK-33443) Make the test "testWriteComplexType" stable

2023-11-03 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782557#comment-17782557 ] Martijn Visser edited comment on FLINK-33443 at 11/3/23 12:50 PM: --

[jira] [Commented] (FLINK-33443) Make the test "testWriteComplexType" stable

2023-11-03 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17782557#comment-17782557 ] Martijn Visser commented on FLINK-33443: [~krishaudt14] There's very little/no value in tickets

[jira] [Closed] (FLINK-33443) Make the test "testWriteComplexType" stable

2023-11-03 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martijn Visser closed FLINK-33443. -- Resolution: Cannot Reproduce > Make the test "testWriteComplexType" stable >

Re: [PR] [FLINK-33449][table]Support array_contains_seq function [flink]

2023-11-03 Thread via GitHub
leoyy0316 commented on PR #23656: URL: https://github.com/apache/flink/pull/23656#issuecomment-1792384316 > I'm not sure that we want to support this function (I have no strong opinion there, but I don't see this in other technologies like Hive or Spark). However, without tests, this PR

Re: [PR] [FLINK-18286] Implement type inference for functions on composite types [flink]

2023-11-03 Thread via GitHub
dawidwys commented on code in PR #23622: URL: https://github.com/apache/flink/pull/23622#discussion_r1381630850 ## flink-table/flink-table-common/src/test/java/org/apache/flink/table/types/inference/strategies/ArrayElementTypeStrategyTest.java: ## @@ -0,0 +1,43 @@ +/* + *

Re: [PR] [FLINK-18286] Implement type inference for functions on composite types [flink]

2023-11-03 Thread via GitHub
dawidwys commented on code in PR #23622: URL: https://github.com/apache/flink/pull/23622#discussion_r1381627176 ## flink-table/flink-table-planner/src/test/scala/org/apache/flink/table/planner/expressions/utils/ArrayTypeTestBase.scala: ## @@ -19,7 +19,9 @@ package

Re: [PR] [FLINK-18286] Implement type inference for functions on composite types [flink]

2023-11-03 Thread via GitHub
dawidwys commented on code in PR #23622: URL: https://github.com/apache/flink/pull/23622#discussion_r1381624710 ## flink-table/flink-table-common/src/main/java/org/apache/flink/table/types/inference/strategies/ItemAtIndexArgumentTypeStrategy.java: ## @@ -0,0 +1,97 @@ +/* + *

Re: [PR] [FLINK-33099][autoscaler] Introduce the Standalone Autoscaler and support flink cluster [flink-kubernetes-operator]

2023-11-03 Thread via GitHub
gyfora commented on code in PR #698: URL: https://github.com/apache/flink-kubernetes-operator/pull/698#discussion_r1381618479 ## flink-autoscaler/src/main/java/org/apache/flink/autoscaler/event/AutoScalerEventHandler.java: ## @@ -32,32 +35,45 @@ import static

Re: [PR] [FLINK-33449][table]Support array_contains_seq function [flink]

2023-11-03 Thread via GitHub
flinkbot commented on PR #23656: URL: https://github.com/apache/flink/pull/23656#issuecomment-1792360510 ## CI report: * 31d5c1e7a3896f8b5958dc56486f510c9bfdd263 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

Re: [PR] [FLINK-18286] Implement type inference for functions on composite types [flink]

2023-11-03 Thread via GitHub
dawidwys commented on code in PR #23622: URL: https://github.com/apache/flink/pull/23622#discussion_r1381612404 ## flink-table/flink-table-planner/src/main/scala/org/apache/flink/table/planner/expressions/collection.scala: ## @@ -1,105 +0,0 @@ -/* - * Licensed to the Apache

[jira] [Updated] (FLINK-33449) Support array_contains_seq function

2023-11-03 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-33449: --- Labels: pull-request-available (was: ) > Support array_contains_seq function >

  1   2   >