[GitHub] [flink-connector-opensearch] reswqa merged pull request #21: [hotfix] Workaround new violations message

2023-05-12 Thread via GitHub
reswqa merged PR #21: URL: https://github.com/apache/flink-connector-opensearch/pull/21 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink-connector-opensearch] reswqa commented on pull request #21: [hotfix] Workaround new violations message

2023-05-12 Thread via GitHub
reswqa commented on PR #21: URL: https://github.com/apache/flink-connector-opensearch/pull/21#issuecomment-1546537951 Thanks for the review! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [flink] Mrart commented on a diff in pull request #21527: [FLINK-27925] [kubernetes]Performance optimization when watch tm pod and list pod.

2023-05-12 Thread via GitHub
Mrart commented on code in PR #21527: URL: https://github.com/apache/flink/pull/21527#discussion_r1192918839 ## flink-kubernetes/src/test/java/org/apache/flink/kubernetes/KubernetesClientTestBase.java: ## @@ -143,6 +147,34 @@ protected void mockGetDeploymentWithError() {

[jira] [Updated] (FLINK-32072) Create and wire FileMergingSnapshotManager with TaskManagerServices

2023-05-12 Thread Zakelly Lan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zakelly Lan updated FLINK-32072: Fix Version/s: 1.18.0 > Create and wire FileMergingSnapshotManager with TaskManagerServices >

[jira] [Created] (FLINK-32092) Integrate snapshot file-merging with existing IT cases

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32092: --- Summary: Integrate snapshot file-merging with existing IT cases Key: FLINK-32092 URL: https://issues.apache.org/jira/browse/FLINK-32092 Project: Flink Issue

[jira] [Created] (FLINK-32091) Add necessary metrics for file-merging

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32091: --- Summary: Add necessary metrics for file-merging Key: FLINK-32091 URL: https://issues.apache.org/jira/browse/FLINK-32091 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-32089) Do fast copy in best-effort during first checkpoint after restoration

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32089: --- Summary: Do fast copy in best-effort during first checkpoint after restoration Key: FLINK-32089 URL: https://issues.apache.org/jira/browse/FLINK-32089 Project: Flink

[jira] [Created] (FLINK-32090) Python API for enabling and configuring file merging snapshot

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32090: --- Summary: Python API for enabling and configuring file merging snapshot Key: FLINK-32090 URL: https://issues.apache.org/jira/browse/FLINK-32090 Project: Flink

[jira] [Created] (FLINK-32088) Re-uploading in state file-merging for space amplification control

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32088: --- Summary: Re-uploading in state file-merging for space amplification control Key: FLINK-32088 URL: https://issues.apache.org/jira/browse/FLINK-32088 Project: Flink

[jira] [Created] (FLINK-32087) Space amplification statistics of file merging

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32087: --- Summary: Space amplification statistics of file merging Key: FLINK-32087 URL: https://issues.apache.org/jira/browse/FLINK-32087 Project: Flink Issue Type:

[jira] [Created] (FLINK-32084) Migrate current file merging of channel state into the file merging framework

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32084: --- Summary: Migrate current file merging of channel state into the file merging framework Key: FLINK-32084 URL: https://issues.apache.org/jira/browse/FLINK-32084 Project:

[jira] [Created] (FLINK-32086) Cleanup non-reported managed directory on exit of TM

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32086: --- Summary: Cleanup non-reported managed directory on exit of TM Key: FLINK-32086 URL: https://issues.apache.org/jira/browse/FLINK-32086 Project: Flink Issue

[jira] [Created] (FLINK-32085) Implement and migrate batch uploading in changelog files into the file merging framework

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32085: --- Summary: Implement and migrate batch uploading in changelog files into the file merging framework Key: FLINK-32085 URL: https://issues.apache.org/jira/browse/FLINK-32085

[jira] [Created] (FLINK-32083) Chinese translation of documentation of checkpoint file-merging

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32083: --- Summary: Chinese translation of documentation of checkpoint file-merging Key: FLINK-32083 URL: https://issues.apache.org/jira/browse/FLINK-32083 Project: Flink

[jira] [Created] (FLINK-32082) Documentation of checkpoint file-merging

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32082: --- Summary: Documentation of checkpoint file-merging Key: FLINK-32082 URL: https://issues.apache.org/jira/browse/FLINK-32082 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-32081) Compatibility between file-merging on and off across job runs

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32081: --- Summary: Compatibility between file-merging on and off across job runs Key: FLINK-32081 URL: https://issues.apache.org/jira/browse/FLINK-32081 Project: Flink

[jira] [Created] (FLINK-32079) Read/write checkpoint metadata of merged files

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32079: --- Summary: Read/write checkpoint metadata of merged files Key: FLINK-32079 URL: https://issues.apache.org/jira/browse/FLINK-32079 Project: Flink Issue Type:

[jira] [Created] (FLINK-32080) Restoration of FileMergingSnapshotManager

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32080: --- Summary: Restoration of FileMergingSnapshotManager Key: FLINK-32080 URL: https://issues.apache.org/jira/browse/FLINK-32080 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-32076) Add file pool for concurrent file reusing

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32076: --- Summary: Add file pool for concurrent file reusing Key: FLINK-32076 URL: https://issues.apache.org/jira/browse/FLINK-32076 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-32077) Implement shared state file merging

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32077: --- Summary: Implement shared state file merging Key: FLINK-32077 URL: https://issues.apache.org/jira/browse/FLINK-32077 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-32078) Implement private state file merging

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32078: --- Summary: Implement private state file merging Key: FLINK-32078 URL: https://issues.apache.org/jira/browse/FLINK-32078 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-32075) Delete merged files on checkpoint abort

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32075: --- Summary: Delete merged files on checkpoint abort Key: FLINK-32075 URL: https://issues.apache.org/jira/browse/FLINK-32075 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-32074) Support file merging across checkpoints

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32074: --- Summary: Support file merging across checkpoints Key: FLINK-32074 URL: https://issues.apache.org/jira/browse/FLINK-32074 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-32073) Implement file merging in snapshot

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32073: --- Summary: Implement file merging in snapshot Key: FLINK-32073 URL: https://issues.apache.org/jira/browse/FLINK-32073 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-32072) Create and wire FileMergingSnapshotManager with TaskManagerServices

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32072: --- Summary: Create and wire FileMergingSnapshotManager with TaskManagerServices Key: FLINK-32072 URL: https://issues.apache.org/jira/browse/FLINK-32072 Project: Flink

[jira] [Created] (FLINK-32071) Implement the snapshot manager for merged checkpoint files in TM

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32071: --- Summary: Implement the snapshot manager for merged checkpoint files in TM Key: FLINK-32071 URL: https://issues.apache.org/jira/browse/FLINK-32071 Project: Flink

[jira] [Created] (FLINK-32070) FLIP-306 Unified File Merging Mechanism for Checkpoints

2023-05-12 Thread Zakelly Lan (Jira)
Zakelly Lan created FLINK-32070: --- Summary: FLIP-306 Unified File Merging Mechanism for Checkpoints Key: FLINK-32070 URL: https://issues.apache.org/jira/browse/FLINK-32070 Project: Flink Issue

[GitHub] [flink] xuzhiwen1255 commented on a diff in pull request #21971: [FLINK-31084][connectors/dataGen] Add default value for dataGen seque…

2023-05-12 Thread via GitHub
xuzhiwen1255 commented on code in PR #21971: URL: https://github.com/apache/flink/pull/21971#discussion_r1192908722 ## flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/source/datagen/SequenceGenerator.java: ## @@ -111,11 +120,20 @@ public boolean

[GitHub] [flink] xuzhiwen1255 commented on a diff in pull request #22010: [FLINK-31192][connectors/dataGen] Fix dataGen takes too long to initi…

2023-05-12 Thread via GitHub
xuzhiwen1255 commented on code in PR #22010: URL: https://github.com/apache/flink/pull/22010#discussion_r1192906502 ## flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/source/datagen/SequenceGenerator.java: ## @@ -65,33 +72,46 @@ public void open(

[GitHub] [flink] xuzhiwen1255 commented on a diff in pull request #22010: [FLINK-31192][connectors/dataGen] Fix dataGen takes too long to initi…

2023-05-12 Thread via GitHub
xuzhiwen1255 commented on code in PR #22010: URL: https://github.com/apache/flink/pull/22010#discussion_r1192906438 ## flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/source/datagen/SequenceGenerator.java: ## @@ -65,33 +72,46 @@ public void open(

[GitHub] [flink-connector-aws] dannycranmer commented on a diff in pull request #49: [FLINK-24438] Add Kinesis connector using FLIP-27

2023-05-12 Thread via GitHub
dannycranmer commented on code in PR #49: URL: https://github.com/apache/flink-connector-aws/pull/49#discussion_r1192703805 ## flink-connector-aws-kinesis-streams/src/main/java/org/apache/flink/connector/kinesis/source/enumerator/assigner/UniformShardAssigner.java: ## @@ -0,0

[GitHub] [flink-web] youngminz commented on a diff in pull request #615: Fix typo

2023-05-12 Thread via GitHub
youngminz commented on code in PR #615: URL: https://github.com/apache/flink-web/pull/615#discussion_r1192674124 ## docs/content/posts/2023-02-27-release-kubernetes-operator-1.4.0.md: ## @@ -84,7 +84,7 @@ We rely on users to share feedback so we can improve and make this a

[jira] [Commented] (FLINK-29533) Add proper table style to Flink website

2023-05-12 Thread Sakshi Sharma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17722260#comment-17722260 ] Sakshi Sharma commented on FLINK-29533: --- Can you please guide me on where the issue is? The

[jira] [Commented] (FLINK-32069) jobClient.getJobStatus() can return status RUNNING for finished insert operation

2023-05-12 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17722259#comment-17722259 ] Martijn Visser commented on FLINK-32069: [~mapohl] Any thoughts? > jobClient.getJobStatus() can

[jira] [Updated] (FLINK-29533) Add proper table style to Flink website

2023-05-12 Thread Sakshi Sharma (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sakshi Sharma updated FLINK-29533: -- Attachment: image-2023-05-12-14-14-58-020.png > Add proper table style to Flink website >

[GitHub] [flink-connector-aws] dannycranmer commented on a diff in pull request #49: [FLINK-24438] Add Kinesis connector using FLIP-27

2023-05-12 Thread via GitHub
dannycranmer commented on code in PR #49: URL: https://github.com/apache/flink-connector-aws/pull/49#discussion_r1192670238 ## flink-connector-aws-kinesis-streams/src/main/java/org/apache/flink/connector/kinesis/source/config/SourceConfigUtil.java: ## @@ -0,0 +1,61 @@ +/* + *

[GitHub] [flink-connector-aws] dannycranmer commented on a diff in pull request #49: [FLINK-24438] Add Kinesis connector using FLIP-27

2023-05-12 Thread via GitHub
dannycranmer commented on code in PR #49: URL: https://github.com/apache/flink-connector-aws/pull/49#discussion_r1192668358 ## flink-connector-aws-kinesis-streams/src/main/java/org/apache/flink/connector/kinesis/source/KinesisStreamsSource.java: ## @@ -0,0 +1,167 @@ +/* + *

[GitHub] [flink-connector-aws] dannycranmer commented on a diff in pull request #49: [FLINK-24438] Add Kinesis connector using FLIP-27

2023-05-12 Thread via GitHub
dannycranmer commented on code in PR #49: URL: https://github.com/apache/flink-connector-aws/pull/49#discussion_r1175101246 ## flink-connector-aws-kinesis-streams/src/main/java/org/apache/flink/connector/kinesis/source/config/SourceConfigConstants.java: ## @@ -0,0 +1,369 @@

[GitHub] [flink-connector-aws] reswqa commented on pull request #73: [FLINK-32024][docs] Short code related to externalized connector retrieve version from its own data yaml

2023-05-12 Thread via GitHub
reswqa commented on PR #73: URL: https://github.com/apache/flink-connector-aws/pull/73#issuecomment-1546060123 Thanks for the review! I will merge this after `FLINK-32024` merged. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Commented] (FLINK-31810) RocksDBException: Bad table magic number on checkpoint rescale

2023-05-12 Thread David Artiga (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17722245#comment-17722245 ] David Artiga commented on FLINK-31810: -- Something quite similar just happened to us (using

[jira] [Resolved] (FLINK-32066) Flink CI service on Azure stops responding to pull requests

2023-05-12 Thread Jing Ge (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Ge resolved FLINK-32066. - Fix Version/s: 1.18.0 Resolution: Fixed > Flink CI service on Azure stops responding to pull

[GitHub] [flink] JTaky commented on pull request #22394: [FLINK-31780][component=Runtime/Coordination] Allow users to disable 'Ensemble tracking' feature for ZooKeeper Curator framework

2023-05-12 Thread via GitHub
JTaky commented on PR #22394: URL: https://github.com/apache/flink/pull/22394#issuecomment-1546005491 Thanks a lot for the review! Sorry but I think I cannot merge this PR. https://github.com/apache/flink/assets/1190166/b189cc24-b9ea-4b35-be12-c2b4a815d045;> -- This is an

[jira] [Commented] (FLINK-32066) Flink CI service on Azure stops responding to pull requests

2023-05-12 Thread Jing Ge (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1776#comment-1776 ] Jing Ge commented on FLINK-32066: - should work now, please check and share the feedback for confirmation

[GitHub] [flink-connector-aws] usamj commented on a diff in pull request #49: [FLINK-24438] Add Kinesis connector using FLIP-27

2023-05-12 Thread via GitHub
usamj commented on code in PR #49: URL: https://github.com/apache/flink-connector-aws/pull/49#discussion_r1192556373 ## flink-connector-aws-kinesis-streams/src/main/java/org/apache/flink/connector/kinesis/source/KinesisStreamsSource.java: ## @@ -0,0 +1,167 @@ +/* + * Licensed

[GitHub] [flink] flinkbot commented on pull request #22575: Updating docs on how to upgrade kafka connectors

2023-05-12 Thread via GitHub
flinkbot commented on PR #22575: URL: https://github.com/apache/flink/pull/22575#issuecomment-1545956373 ## CI report: * d0b8d571c4900d50f52744e3d622c476428bb5bf UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] flinkbot commented on pull request #22574: [FLINK-32060][test] Migrate subclasses of BatchAbstractTestBase in table and other modules to JUnit5

2023-05-12 Thread via GitHub
flinkbot commented on PR #22574: URL: https://github.com/apache/flink/pull/22574#issuecomment-1545956251 ## CI report: * c7e02124129c26fbabb41f24e6f89d2dc848b510 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] flinkbot commented on pull request #22573: [FLINK-32058][tests] Migrate the subclasses of BatchAbstractTestBase in runtime.batch.sql to JUnit5

2023-05-12 Thread via GitHub
flinkbot commented on PR #22573: URL: https://github.com/apache/flink/pull/22573#issuecomment-1545956110 ## CI report: * dd980a1bfd99b12404368abd94d93f299ee72d74 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] flinkbot commented on pull request #22572: [FLINK-29618] Remove Timeout annotation in YARNSessionFIFOSecuredITCase

2023-05-12 Thread via GitHub
flinkbot commented on PR #22572: URL: https://github.com/apache/flink/pull/22572#issuecomment-1545955981 ## CI report: * 3e82df924333d6f676f20a50c068bb35fa7c3076 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Commented] (FLINK-32066) Flink CI service on Azure stops responding to pull requests

2023-05-12 Thread Jing Ge (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17722212#comment-17722212 ] Jing Ge commented on FLINK-32066: - working on it > Flink CI service on Azure stops responding to pull

[jira] [Assigned] (FLINK-32066) Flink CI service on Azure stops responding to pull requests

2023-05-12 Thread Jing Ge (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Ge reassigned FLINK-32066: --- Assignee: Jing Ge > Flink CI service on Azure stops responding to pull requests >

[GitHub] [flink-web] RyanSkraba commented on a diff in pull request #615: Fix typo

2023-05-12 Thread via GitHub
RyanSkraba commented on code in PR #615: URL: https://github.com/apache/flink-web/pull/615#discussion_r1192516634 ## docs/content/posts/2023-02-27-release-kubernetes-operator-1.4.0.md: ## @@ -84,7 +84,7 @@ We rely on users to share feedback so we can improve and make this a

[GitHub] [flink] RyanSkraba commented on a diff in pull request #22010: [FLINK-31192][connectors/dataGen] Fix dataGen takes too long to initi…

2023-05-12 Thread via GitHub
RyanSkraba commented on code in PR #22010: URL: https://github.com/apache/flink/pull/22010#discussion_r1192511163 ## flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/source/datagen/SequenceGenerator.java: ## @@ -65,33 +72,46 @@ public void open(

[jira] [Updated] (FLINK-32069) jobClient.getJobStatus() can return status RUNNING for finished insert operation

2023-05-12 Thread Aleksandr Iushmanov (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksandr Iushmanov updated FLINK-32069: Description: Using zeppelin with remote cluster I came across some race condition

[jira] [Updated] (FLINK-32069) jobClient.getJobStatus() can return status RUNNING for finished insert operation

2023-05-12 Thread Aleksandr Iushmanov (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksandr Iushmanov updated FLINK-32069: Description: Using zeppelin with remote cluster I came across some race condition

[jira] [Created] (FLINK-32069) jobClient.getJobStatus() can return status RUNNING for finished insert operation

2023-05-12 Thread Aleksandr Iushmanov (Jira)
Aleksandr Iushmanov created FLINK-32069: --- Summary: jobClient.getJobStatus() can return status RUNNING for finished insert operation Key: FLINK-32069 URL: https://issues.apache.org/jira/browse/FLINK-32069

[GitHub] [flink-web] RyanSkraba opened a new pull request, #648: [hotfix] Minor grammar fixes

2023-05-12 Thread via GitHub
RyanSkraba opened a new pull request, #648: URL: https://github.com/apache/flink-web/pull/648 I've batched together some observations that I've noted on the website, mostly grammar fixes and polish. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [flink-kubernetes-operator] gyfora merged pull request #595: [backport][FLINK-32002] Autoscaler default config improvements

2023-05-12 Thread via GitHub
gyfora merged PR #595: URL: https://github.com/apache/flink-kubernetes-operator/pull/595 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (FLINK-32047) Fix args in JobSpec not being passed through to Flink in Standalone mode - 1.4.0

2023-05-12 Thread Usamah Jassat (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17722198#comment-17722198 ] Usamah Jassat commented on FLINK-32047: --- Hey  Gil, have you got an example FlinkDeployment to

[GitHub] [flink-connector-opensearch] reswqa opened a new pull request, #21: [hotfix] Workaround new violations message

2023-05-12 Thread via GitHub
reswqa opened a new pull request, #21: URL: https://github.com/apache/flink-connector-opensearch/pull/21 apache/flink `1.18` changes the `archunit-violations` rule about `MiniCluster` use in `ITCase`. Due to our workflow testing both `1.17` and `1.18` versions, duplicate a bit of the

[GitHub] [flink-kubernetes-operator] gyfora opened a new pull request, #595: [backport][FLINK-32002] Autoscaler default config improvements

2023-05-12 Thread via GitHub
gyfora opened a new pull request, #595: URL: https://github.com/apache/flink-kubernetes-operator/pull/595 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [flink-kubernetes-operator] gyfora merged pull request #594: [FLINK-32002] Autoscaler default config improvements

2023-05-12 Thread via GitHub
gyfora merged PR #594: URL: https://github.com/apache/flink-kubernetes-operator/pull/594 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Closed] (FLINK-28203) Mark all bundled dependencies as optional

2023-05-12 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-28203. Resolution: Fixed master: edf5666224f12e4b345ecafc6ae2fe5e3ecea393

[jira] [Closed] (FLINK-28016) Support Maven 3.3+

2023-05-12 Thread Chesnay Schepler (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chesnay Schepler closed FLINK-28016. Resolution: Fixed master: f0d01903aaa517af9c1be26b1244a778189dce65 > Support Maven 3.3+

[GitHub] [flink] zentol merged pull request #21349: [FLINK-28203] Support Maven 3.3+

2023-05-12 Thread via GitHub
zentol merged PR #21349: URL: https://github.com/apache/flink/pull/21349 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink-kubernetes-operator] gyfora opened a new pull request, #594: [FLINK-32002] Autoscaler default config improvements

2023-05-12 Thread via GitHub
gyfora opened a new pull request, #594: URL: https://github.com/apache/flink-kubernetes-operator/pull/594 Some further minor improvements to the autoscaler default config: - Turn off ineffective scaling detection by default as it probed to be a little unstable - Set a large

[jira] [Commented] (FLINK-31706) The default source parallelism should be the same as execution's default parallelism under adaptive batch scheduler

2023-05-12 Thread clownxc (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17722171#comment-17722171 ] clownxc commented on FLINK-31706: - (y)(y):D Thank you for your reply, I see [~wanglijie]  > The default

[jira] [Closed] (FLINK-32067) When no pod template configured, an invalid null pod template is configured

2023-05-12 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora closed FLINK-32067. -- Fix Version/s: kubernetes-operator-1.6.0 Resolution: Fixed main:

[jira] [Updated] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scaling down with unaligned checkpoints

2023-05-12 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Piotr Nowojski updated FLINK-31963: --- Affects Version/s: 1.15.4 1.16.1 1.18.0 >

[jira] [Assigned] (FLINK-32068) flink-connector-jdbc support clickhouse

2023-05-12 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martijn Visser reassigned FLINK-32068: -- Assignee: leishuiyu > flink-connector-jdbc support clickhouse >

[jira] [Commented] (FLINK-32068) flink-connector-jdbc support clickhouse

2023-05-12 Thread Martijn Visser (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17722142#comment-17722142 ] Martijn Visser commented on FLINK-32068: [~leishuiyu] Sure. I've assigned the ticket to you. >

[jira] [Closed] (FLINK-31717) Unit tests running with local kube config

2023-05-12 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora closed FLINK-31717. -- Resolution: Fixed merged to main e399c9bbd37d2dca352d973de01be0cb403fec55 > Unit tests running with

[GitHub] [flink-kubernetes-operator] gyfora merged pull request #587: [FLINK-31717] Fix unit tests using local kube config

2023-05-12 Thread via GitHub
gyfora merged PR #587: URL: https://github.com/apache/flink-kubernetes-operator/pull/587 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Comment Edited] (FLINK-32065) Got NoSuchFileException when initialize source function.

2023-05-12 Thread Spongebob (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17722121#comment-17722121 ] Spongebob edited comment on FLINK-32065 at 5/12/23 11:15 AM: - Hi

[jira] [Commented] (FLINK-32065) Got NoSuchFileException when initialize source function.

2023-05-12 Thread Spongebob (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17722121#comment-17722121 ] Spongebob commented on FLINK-32065: --- Hi [~Thesharing] Does it likelihood due to the incorrect starting

[jira] [Commented] (FLINK-31963) java.lang.ArrayIndexOutOfBoundsException when scaling down with unaligned checkpoints

2023-05-12 Thread Stefan Richter (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17722120#comment-17722120 ] Stefan Richter commented on FLINK-31963: Seems that this is similar to the problem described in

[GitHub] [flink-web] echauchot commented on pull request #643: Add blog article: Howto test a batch source with the new Source framework

2023-05-12 Thread via GitHub
echauchot commented on PR #643: URL: https://github.com/apache/flink-web/pull/643#issuecomment-1545554335 @zentol Thanks for your review (once again). I addressed all your comments PTAL -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [flink-web] echauchot commented on pull request #643: Add blog article: Howto test a batch source with the new Source framework

2023-05-12 Thread via GitHub
echauchot commented on PR #643: URL: https://github.com/apache/flink-web/pull/643#issuecomment-1545544022 > > I took a quick look over it. I feel especially for the IT case it would be nice to first provide an overview over the differnet parts that make up a test "There's a test framework;

[jira] [Commented] (FLINK-32068) flink-connector-jdbc support clickhouse

2023-05-12 Thread leishuiyu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17722107#comment-17722107 ] leishuiyu commented on FLINK-32068: --- This function can be implemented by me as a PR ? >

[jira] [Created] (FLINK-32068) flink-connector-jdbc support clickhouse

2023-05-12 Thread leishuiyu (Jira)
leishuiyu created FLINK-32068: - Summary: flink-connector-jdbc support clickhouse Key: FLINK-32068 URL: https://issues.apache.org/jira/browse/FLINK-32068 Project: Flink Issue Type: New Feature

[jira] [Commented] (FLINK-31966) Flink Kubernetes operator lacks TLS support

2023-05-12 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-31966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17722104#comment-17722104 ] Gyula Fora commented on FLINK-31966: [~adrianalexvasiliu] new configuration changes do not usually

[GitHub] [flink] godfreyhe commented on a diff in pull request #22492: [FLINK-31950][table-planner] Introduce StateMetadata and StateMetadataJson SerDe

2023-05-12 Thread via GitHub
godfreyhe commented on code in PR #22492: URL: https://github.com/apache/flink/pull/22492#discussion_r1192099873 ## flink-table/flink-table-planner/src/main/java/org/apache/flink/table/planner/plan/nodes/exec/ExecNodeConfig.java: ## @@ -55,7 +55,7 @@ private ExecNodeConfig(

[jira] [Commented] (FLINK-32065) Got NoSuchFileException when initialize source function.

2023-05-12 Thread Zhilong Hong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17722100#comment-17722100 ] Zhilong Hong commented on FLINK-32065: -- It's hard to investigate the root cause with the limited

[GitHub] [flink-web] echauchot commented on a diff in pull request #643: Add blog article: Howto test a batch source with the new Source framework

2023-05-12 Thread via GitHub
echauchot commented on code in PR #643: URL: https://github.com/apache/flink-web/pull/643#discussion_r1192171185 ## docs/content/posts/howto-test-batch-source.md: ## @@ -0,0 +1,202 @@ +--- +title: "Howto test a batch source with the new Source framework" +date:

[GitHub] [flink] gaborgsomogyi commented on pull request #22550: [FLINK-31609][yarn][test] Extend log whitelist for expected AMRM heartbeat interrupt

2023-05-12 Thread via GitHub
gaborgsomogyi commented on PR #22550: URL: https://github.com/apache/flink/pull/22550#issuecomment-1545492583 The change itself looks good, could you plz show which test failed and how? (some log) -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [flink-web] echauchot commented on a diff in pull request #643: Add blog article: Howto test a batch source with the new Source framework

2023-05-12 Thread via GitHub
echauchot commented on code in PR #643: URL: https://github.com/apache/flink-web/pull/643#discussion_r1192167315 ## docs/content/posts/howto-test-batch-source.md: ## @@ -0,0 +1,202 @@ +--- +title: "Howto test a batch source with the new Source framework" +date:

[GitHub] [flink-web] echauchot commented on a diff in pull request #643: Add blog article: Howto test a batch source with the new Source framework

2023-05-12 Thread via GitHub
echauchot commented on code in PR #643: URL: https://github.com/apache/flink-web/pull/643#discussion_r1192162301 ## docs/content/posts/howto-test-batch-source.md: ## @@ -0,0 +1,202 @@ +--- +title: "Howto test a batch source with the new Source framework" +date:

[GitHub] [flink-web] echauchot commented on a diff in pull request #643: Add blog article: Howto test a batch source with the new Source framework

2023-05-12 Thread via GitHub
echauchot commented on code in PR #643: URL: https://github.com/apache/flink-web/pull/643#discussion_r1192157171 ## docs/content/posts/howto-test-batch-source.md: ## @@ -0,0 +1,202 @@ +--- +title: "Howto test a batch source with the new Source framework" +date:

[GitHub] [flink-web] echauchot commented on a diff in pull request #643: Add blog article: Howto test a batch source with the new Source framework

2023-05-12 Thread via GitHub
echauchot commented on code in PR #643: URL: https://github.com/apache/flink-web/pull/643#discussion_r1192157171 ## docs/content/posts/howto-test-batch-source.md: ## @@ -0,0 +1,202 @@ +--- +title: "Howto test a batch source with the new Source framework" +date:

[GitHub] [flink] zhuzhurk commented on a diff in pull request #22506: [FLINK-31890][runtime] Introduce SchedulerBase per-task failure enrichment/labeling

2023-05-12 Thread via GitHub
zhuzhurk commented on code in PR #22506: URL: https://github.com/apache/flink/pull/22506#discussion_r1192155460 ## flink-core/src/main/java/org/apache/flink/util/concurrent/FutureUtils.java: ## @@ -1289,4 +1293,59 @@ public static CompletableFuture switchExecutor(

[jira] [Updated] (FLINK-32067) When no pod template configured, an invalid null pod template is configured

2023-05-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-32067: --- Labels: pull-request-available (was: ) > When no pod template configured, an invalid null

[GitHub] [flink-kubernetes-operator] gyfora opened a new pull request, #592: [FLINK-32067] Do not configure invalid null podTemplate

2023-05-12 Thread via GitHub
gyfora opened a new pull request, #592: URL: https://github.com/apache/flink-kubernetes-operator/pull/592 ## What is the purpose of the change Recent changes broke the podTemplate configuration logic when no pod template or ephemeral storage is configured resulting in an invalid null

[jira] [Commented] (FLINK-32065) Got NoSuchFileException when initialize source function.

2023-05-12 Thread Spongebob (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17722094#comment-17722094 ] Spongebob commented on FLINK-32065: --- Hi, [~Thesharing] , may be I could provide these logs for you.

[jira] [Updated] (FLINK-32065) Got NoSuchFileException when initialize source function.

2023-05-12 Thread Spongebob (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Spongebob updated FLINK-32065: -- Attachment: image-2023-05-12-17-37-09-002.png > Got NoSuchFileException when initialize source

[jira] [Created] (FLINK-32067) When no pod template configured, an invalid null pod template is configured

2023-05-12 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-32067: -- Summary: When no pod template configured, an invalid null pod template is configured Key: FLINK-32067 URL: https://issues.apache.org/jira/browse/FLINK-32067 Project:

[GitHub] [flink-connector-elasticsearch] complone commented on pull request #62: [FLINK-25568] Support Elasticsearch Source Connector

2023-05-12 Thread via GitHub
complone commented on PR #62: URL: https://github.com/apache/flink-connector-elasticsearch/pull/62#issuecomment-1545440640 > Support for FilterPushDown, ProjectPushDown, and LimitPushDown to optimize query performance. Have these functions been implemented? I don't seem to have seen this

[jira] [Commented] (FLINK-32063) AWS CI mvn compile fails to cast objects to parent type.

2023-05-12 Thread Ahmed Hamdy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17722072#comment-17722072 ] Ahmed Hamdy commented on FLINK-32063: - So apparently the CI patches the changes to main before

[jira] [Updated] (FLINK-32060) Migrate subclasses of BatchAbstractTestBase in table and other modules to JUnit5

2023-05-12 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-32060: --- Labels: pull-request-available (was: ) > Migrate subclasses of BatchAbstractTestBase in

[GitHub] [flink-web] echauchot commented on a diff in pull request #643: Add blog article: Howto test a batch source with the new Source framework

2023-05-12 Thread via GitHub
echauchot commented on code in PR #643: URL: https://github.com/apache/flink-web/pull/643#discussion_r1192083594 ## docs/content/posts/howto-test-batch-source.md: ## @@ -0,0 +1,202 @@ +--- +title: "Howto test a batch source with the new Source framework" +date:

[GitHub] [flink] reswqa opened a new pull request, #22574: [FLINK-32060][test] Migrate subclasses of BatchAbstractTestBase in table and other modules to JUnit5

2023-05-12 Thread via GitHub
reswqa opened a new pull request, #22574: URL: https://github.com/apache/flink/pull/22574 ## What is the purpose of the change *Migrate subclasses of BatchAbstractTestBase in table and other modules to JUnit5* ## Brief change log - *Migrate subclasses of

[jira] [Commented] (FLINK-32065) Got NoSuchFileException when initialize source function.

2023-05-12 Thread Zhilong Hong (Jira)
[ https://issues.apache.org/jira/browse/FLINK-32065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17722070#comment-17722070 ] Zhilong Hong commented on FLINK-32065: -- Hi, [~SpongebobZ] Would you please upload the full log of

  1   2   >