[jira] [Created] (FLINK-29647) report stackoverflow when using kryo

2022-10-14 Thread Gao Fei (Jira)
Gao Fei created FLINK-29647: --- Summary: report stackoverflow when using kryo Key: FLINK-29647 URL: https://issues.apache.org/jira/browse/FLINK-29647 Project: Flink Issue Type: Bug

[GitHub] [flink-kubernetes-operator] sap1ens commented on a diff in pull request #403: [FLINK-29633] Pass fromSavepoint argument

2022-10-14 Thread GitBox
sap1ens commented on code in PR #403: URL: https://github.com/apache/flink-kubernetes-operator/pull/403#discussion_r996211925 ## flink-kubernetes-standalone/src/test/java/org/apache/flink/kubernetes/operator/kubeclient/decorators/CmdStandaloneJobManagerDecoratorTest.java: ##

[GitHub] [flink-kubernetes-operator] sap1ens commented on pull request #403: [FLINK-29633] Pass fromSavepoint argument

2022-10-14 Thread GitBox
sap1ens commented on PR #403: URL: https://github.com/apache/flink-kubernetes-operator/pull/403#issuecomment-1279584573 > I agree, it would be nice to have comprehensive tests that actually test the allowNonRestoredState logic. On the other hand if we simply enable that flag on existing

[GitHub] [flink-kubernetes-operator] gyfora commented on a diff in pull request #403: [FLINK-29633] Pass fromSavepoint argument

2022-10-14 Thread GitBox
gyfora commented on code in PR #403: URL: https://github.com/apache/flink-kubernetes-operator/pull/403#discussion_r996141173 ## flink-kubernetes-standalone/src/test/java/org/apache/flink/kubernetes/operator/kubeclient/decorators/CmdStandaloneJobManagerDecoratorTest.java: ## @@

[GitHub] [flink-kubernetes-operator] gyfora commented on pull request #403: [FLINK-29633] Pass fromSavepoint argument

2022-10-14 Thread GitBox
gyfora commented on PR #403: URL: https://github.com/apache/flink-kubernetes-operator/pull/403#issuecomment-127956 > > We should think of a way to test these in a reliable way. Testing the parameters is not enough as might not be understood by the JM as you pointed out. > > Maybe

[GitHub] [flink-kubernetes-operator] sap1ens commented on pull request #403: [FLINK-29633] Pass fromSavepoint argument

2022-10-14 Thread GitBox
sap1ens commented on PR #403: URL: https://github.com/apache/flink-kubernetes-operator/pull/403#issuecomment-1279307886 > We should think of a way to test these in a reliable way. Testing the parameters is not enough as might not be understood by the JM as you pointed out. > >

[jira] [Commented] (FLINK-20350) Incompatible Connectors due to Guava conflict

2022-10-14 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617883#comment-17617883 ] Danny Cranmer commented on FLINK-20350: --- [~samrat007] yes please do, I will assign to you. Thanks!

[jira] [Assigned] (FLINK-20350) Incompatible Connectors due to Guava conflict

2022-10-14 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer reassigned FLINK-20350: - Assignee: Samrat Deb > Incompatible Connectors due to Guava conflict >

[jira] [Commented] (FLINK-20350) Incompatible Connectors due to Guava conflict

2022-10-14 Thread Samrat Deb (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617877#comment-17617877 ] Samrat Deb commented on FLINK-20350: [~danny.cranmer] can i pick this task and try to fix it ?  

[GitHub] [flink] Samrat002 commented on pull request #20937: [FLINK-29478][flink-connector/hive] Flink connector hive upgrade to 3.1.3

2022-10-14 Thread GitBox
Samrat002 commented on PR #20937: URL: https://github.com/apache/flink/pull/20937#issuecomment-1279234327 @dannycranmer I removed `org.apache.hadoop:hadoop-mapreduce-client-core:3.1.0` from `NOTICE`. > Regarding "The bundled Apache Hive org.apache.hive:hive-exec dependency"

[jira] [Commented] (FLINK-12010) Kinesis Producer problems on Alpine Linux image

2022-10-14 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617844#comment-17617844 ] Danny Cranmer commented on FLINK-12010: --- We introduced a new Sink in Flink 1.15 that does not use

[jira] [Resolved] (FLINK-12010) Kinesis Producer problems on Alpine Linux image

2022-10-14 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-12010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer resolved FLINK-12010. --- Resolution: Won't Do > Kinesis Producer problems on Alpine Linux image >

[jira] [Updated] (FLINK-20350) Incompatible Connectors due to Guava conflict

2022-10-14 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-20350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-20350: -- Summary: Incompatible Connectors due to Guava conflict (was: [Kinesis][GCP PubSub]

[jira] [Resolved] (FLINK-21830) Add support for Session Token with Basic Auth

2022-10-14 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer resolved FLINK-21830. --- Resolution: Won't Do This does not make sense, since session tokens will expire. Resolving

[jira] [Updated] (FLINK-21228) Deadlock in KinesisProducer

2022-10-14 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-21228: -- Summary: Deadlock in KinesisProducer (was: [Kinesis][Producer] Deadlock in KinesisProducer)

[jira] [Updated] (FLINK-21830) Add support for Session Token with Basic Auth

2022-10-14 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-21830: -- Summary: Add support for Session Token with Basic Auth (was: [kinesis][auth] Add support for

[jira] [Resolved] (FLINK-24549) FlinkKinesisConsumer does not work with generic types disabled

2022-10-14 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer resolved FLINK-24549. --- Resolution: Duplicate Resolving as duplicate of FLINK-24943 > FlinkKinesisConsumer does

[jira] [Resolved] (FLINK-23167) Port Kinesis Table API e2e tests to release-1.12 branch

2022-10-14 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer resolved FLINK-23167. --- Resolution: Won't Fix > Port Kinesis Table API e2e tests to release-1.12 branch >

[jira] [Commented] (FLINK-23167) Port Kinesis Table API e2e tests to release-1.12 branch

2022-10-14 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-23167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617841#comment-17617841 ] Danny Cranmer commented on FLINK-23167: --- 1.12 is now out of support, resolving as won't do > Port

[jira] [Updated] (FLINK-24549) FlinkKinesisConsumer does not work with generic types disabled

2022-10-14 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer updated FLINK-24549: -- Fix Version/s: (was: 1.17.0) > FlinkKinesisConsumer does not work with generic types

[jira] [Commented] (FLINK-24913) Upgrade KPL version in flink-connector-kinesis to support ARM

2022-10-14 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617839#comment-17617839 ] Danny Cranmer commented on FLINK-24913: --- Given that we added a new Kinesis Sink in Flink 1.15 that

[jira] [Resolved] (FLINK-24913) Upgrade KPL version in flink-connector-kinesis to support ARM

2022-10-14 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-24913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer resolved FLINK-24913. --- Resolution: Won't Do > Upgrade KPL version in flink-connector-kinesis to support ARM >

[GitHub] [flink] dannycranmer commented on pull request #20257: [FLINK-24943][Connectors / Kinesis] Explicitly create KryoSerializer for SequenceNumber class in Kinesis Consumer

2022-10-14 Thread GitBox
dannycranmer commented on PR #20257: URL: https://github.com/apache/flink/pull/20257#issuecomment-1279205494 @Cyberness please also squash commits and update commit message as per the [contribution

[jira] [Resolved] (FLINK-25729) Replace the deprecated FlinkKinesisConsumer with a Kinesis Consumer based on the AWS SDK for Java 2.x

2022-10-14 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer resolved FLINK-25729. --- Resolution: Duplicate > Replace the deprecated FlinkKinesisConsumer with a Kinesis Consumer

[jira] [Commented] (FLINK-25729) Replace the deprecated FlinkKinesisConsumer with a Kinesis Consumer based on the AWS SDK for Java 2.x

2022-10-14 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-25729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617831#comment-17617831 ] Danny Cranmer commented on FLINK-25729: --- Yes I believe so, resolving this as duplicate > Replace

[GitHub] [flink] zentol commented on a diff in pull request #20757: [FLINK-27919] Add FLIP-27-based source for data generation (FLIP-238)

2022-10-14 Thread GitBox
zentol commented on code in PR #20757: URL: https://github.com/apache/flink/pull/20757#discussion_r995921557 ## flink-core/src/main/java/org/apache/flink/api/connector/source/SourceReaderFactory.java: ## @@ -0,0 +1,39 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[jira] [Commented] (FLINK-26657) Resilient Kinesis consumption

2022-10-14 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617828#comment-17617828 ] Danny Cranmer commented on FLINK-26657: --- Resolving as "won't do" due to inactivity  > Resilient

[jira] [Resolved] (FLINK-26657) Resilient Kinesis consumption

2022-10-14 Thread Danny Cranmer (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Cranmer resolved FLINK-26657. --- Resolution: Won't Do > Resilient Kinesis consumption > - > >

[jira] [Commented] (FLINK-29572) Flink Task Manager skip loopback interface for resource manager registration

2022-10-14 Thread Kevin Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617811#comment-17617811 ] Kevin Li commented on FLINK-29572: -- No, it wouldn't. This problem happens for K8s deployment. For K8s,

[GitHub] [flink] flinkbot commented on pull request #21075: [FLINK-28085][Connector/Pulsar] Close the pending Pulsar transactions before closing pipeline

2022-10-14 Thread GitBox
flinkbot commented on PR #21075: URL: https://github.com/apache/flink/pull/21075#issuecomment-1279137259 ## CI report: * cdc2a58e9c51cd7c6e9293b4cd1418f9ccd5c374 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Updated] (FLINK-26027) Add FLIP-33 metrics to new PulsarSink

2022-10-14 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26027?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufan Sheng updated FLINK-26027: Fix Version/s: 1.17.0 > Add FLIP-33 metrics to new PulsarSink >

[jira] [Updated] (FLINK-29633) Operator doesn't pass initialSavepointPath as fromSavepoint argument

2022-10-14 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora updated FLINK-29633: --- Priority: Critical (was: Major) > Operator doesn't pass initialSavepointPath as fromSavepoint

[GitHub] [flink] syhily opened a new pull request, #21075: [FLINK-28085][Connector/Pulsar] Close the pending Pulsar transactions before closing pipeline

2022-10-14 Thread GitBox
syhily opened a new pull request, #21075: URL: https://github.com/apache/flink/pull/21075 ## What is the purpose of the change PulsarUnorderedSourceReader should close all the pending transaction before shutdown. ## Brief change log 1. Close the finished splits related

[GitHub] [flink] XComp merged pull request #18760: [hotfix][docs] Fix minor grammar and spelling mistakes

2022-10-14 Thread GitBox
XComp merged PR #18760: URL: https://github.com/apache/flink/pull/18760 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink] XComp commented on pull request #18760: [hotfix][docs] Fix minor grammar and spelling mistakes

2022-10-14 Thread GitBox
XComp commented on PR #18760: URL: https://github.com/apache/flink/pull/18760#issuecomment-1279106087 Only documentation was affected. I'm gonna merge right away without waiting for CI. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[jira] [Updated] (FLINK-29646) SQL Gateway should return a simpler error message

2022-10-14 Thread yuanfenghu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuanfenghu updated FLINK-29646: --- Description: sql gateway Should return simpler exception information for example:   If i execute a

[jira] [Updated] (FLINK-29646) SQL Gateway should return a simpler error message

2022-10-14 Thread yuanfenghu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuanfenghu updated FLINK-29646: --- Description: sql gateway should return simpler exception information for example:   If i execute a

[GitHub] [flink] RyanSkraba commented on pull request #18760: [hotfix][docs] Fix minor grammar and spelling mistakes

2022-10-14 Thread GitBox
RyanSkraba commented on PR #18760: URL: https://github.com/apache/flink/pull/18760#issuecomment-1279095126 Rebased, squashed into one commit and fixed merge conflicts. Can you take a look? -- This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Created] (FLINK-29646) SQL Gateway should return a simpler error message

2022-10-14 Thread yuanfenghu (Jira)
yuanfenghu created FLINK-29646: -- Summary: SQL Gateway should return a simpler error message Key: FLINK-29646 URL: https://issues.apache.org/jira/browse/FLINK-29646 Project: Flink Issue Type:

[jira] [Updated] (FLINK-29646) SQL Gateway should return a simpler error message

2022-10-14 Thread yuanfenghu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuanfenghu updated FLINK-29646: --- Description: sql gateway Should return simpler exception information for example:   If i execute a

[GitHub] [flink] flinkbot commented on pull request #21074: [FLINK-28820][Connector/Pulsar] Improve the writing performance for PulsarSink

2022-10-14 Thread GitBox
flinkbot commented on PR #21074: URL: https://github.com/apache/flink/pull/21074#issuecomment-1279082363 ## CI report: * 6004175f2aa10d2d805a3a575e5efa0954482d1d UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Commented] (FLINK-26822) Add Source implementation for Cassandra connector

2022-10-14 Thread Etienne Chauchot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617758#comment-17617758 ] Etienne Chauchot commented on FLINK-26822: -- As promised, I have developed the Cassandra source

[jira] [Updated] (FLINK-28959) 504 gateway timeout when consume large number of topics using TopicPatten

2022-10-14 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufan Sheng updated FLINK-28959: Affects Version/s: (was: 1.14.5) > 504 gateway timeout when consume large number of topics

[jira] [Updated] (FLINK-28959) 504 gateway timeout when consume large number of topics using TopicPatten

2022-10-14 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufan Sheng updated FLINK-28959: Fix Version/s: (was: 1.14.7) > 504 gateway timeout when consume large number of topics using

[GitHub] [flink] flinkbot commented on pull request #21073: [FLINK-26822] Add Source for Cassandra connector

2022-10-14 Thread GitBox
flinkbot commented on PR #21073: URL: https://github.com/apache/flink/pull/21073#issuecomment-1279069831 ## CI report: * 39b9a1b91a23296082e30e64ffeba6a838805952 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] syhily opened a new pull request, #21074: [FLINK-28820][Connector/Pulsar] Improve the writing performance for PulsarSink

2022-10-14 Thread GitBox
syhily opened a new pull request, #21074: URL: https://github.com/apache/flink/pull/21074 ## What is the purpose of the change PulsarSink is slow when we use the `At-Least-Once` or `Exactly-Once`. This is because PulsarSink uses `MallboxExecutor` to write messages. A lot of useless

[jira] [Updated] (FLINK-26822) Add Source implementation for Cassandra connector

2022-10-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-26822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-26822: --- Labels: pull-request-available (was: ) > Add Source implementation for Cassandra connector

[GitHub] [flink] echauchot opened a new pull request, #21073: [FLINK-26822] Add Source for Cassandra connector

2022-10-14 Thread GitBox
echauchot opened a new pull request, #21073: URL: https://github.com/apache/flink/pull/21073 ## What is the purpose of the change Add a flink source for Cassandra database compliant with [FLIP-27](https://cwiki.apache.org/confluence/display/FLINK/FLIP-27%3A+Refactor+Source+Interface)

[GitHub] [flink] flinkbot commented on pull request #21072: [FLINK-28960][Connector/Pulsar] Add jaxb-api back to pulsar-client-all dependencies.

2022-10-14 Thread GitBox
flinkbot commented on PR #21072: URL: https://github.com/apache/flink/pull/21072#issuecomment-1279052707 ## CI report: * 647e279d5e4295d56ecc58184870317a6a67b1db UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] flinkbot commented on pull request #21071: [FLINK-29433][Connector/Pulsar] Support Auth through the builder pattern in Pulsar connector.

2022-10-14 Thread GitBox
flinkbot commented on PR #21071: URL: https://github.com/apache/flink/pull/21071#issuecomment-1279044483 ## CI report: * df6929923a7dbc1d868e7dc5e4533213050378f6 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink] zentol commented on a diff in pull request #20757: [FLINK-27919] Add FLIP-27-based source for data generation (FLIP-238)

2022-10-14 Thread GitBox
zentol commented on code in PR #20757: URL: https://github.com/apache/flink/pull/20757#discussion_r995787574 ## docs/content/docs/connectors/datastream/datagen.md: ## @@ -0,0 +1,115 @@ +--- +title: DataGen +weight: 3 +type: docs +--- + + +# DataGen Connector + +The DataGen

[jira] [Updated] (FLINK-28960) Pulsar throws java.lang.NoClassDefFoundError: javax/xml/bind/annotation/XmlElement

2022-10-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-28960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-28960: --- Labels: pull-request-available (was: ) > Pulsar throws java.lang.NoClassDefFoundError: >

[GitHub] [flink] syhily opened a new pull request, #21072: [FLINK-28960][Connector/Pulsar] Add jaxb-api back to pulsar-client-all dependencies.

2022-10-14 Thread GitBox
syhily opened a new pull request, #21072: URL: https://github.com/apache/flink/pull/21072 ## What is the purpose of the change `pulsar-client-all` requires jaxb-api to serialize some Admin API. We shouldn't exclude it in current dependency list. So we just add it back to

[GitHub] [flink-kubernetes-operator] gyfora commented on pull request #403: [FLINK-29633] Pass fromSavepoint argument

2022-10-14 Thread GitBox
gyfora commented on PR #403: URL: https://github.com/apache/flink-kubernetes-operator/pull/403#issuecomment-1279035826 We should think of a way to test these in a reliable way. Testing the parameters is not enough as might not be understood by the JM as you pointed out. Maybe we

[jira] [Closed] (FLINK-29401) Improve observer structure

2022-10-14 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora closed FLINK-29401. -- Resolution: Fixed merged to main bca630c3a003149683b74a54ccd376f9a9691028 > Improve observer

[GitHub] [flink] flinkbot commented on pull request #21070: [FLINK-29580][Connector/Pulsar] Remove pulsar.consumer.autoUpdatePartitionsIntervalSeconds option.

2022-10-14 Thread GitBox
flinkbot commented on PR #21070: URL: https://github.com/apache/flink/pull/21070#issuecomment-1279033294 ## CI report: * 757289c8fafe5f687f5772b7ce45d4f1cf7e5f55 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[GitHub] [flink-kubernetes-operator] gyfora merged pull request #400: [FLINK-29401] Refactor observer structure

2022-10-14 Thread GitBox
gyfora merged PR #400: URL: https://github.com/apache/flink-kubernetes-operator/pull/400 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Updated] (FLINK-29433) Support Auth through the builder pattern in Pulsar connector

2022-10-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-29433: --- Labels: pull-request-available (was: ) > Support Auth through the builder pattern in

[GitHub] [flink] syhily opened a new pull request, #21071: [FLINK-29433][Connector/Pulsar] Support Auth through the builder pattern in Pulsar connector.

2022-10-14 Thread GitBox
syhily opened a new pull request, #21071: URL: https://github.com/apache/flink/pull/21071 ## What is the purpose of the change Authentication is a common used function in consuming/producing message between Pulsar and Flink. We didn't expose it to Builder method, and use the common

[jira] [Resolved] (FLINK-29512) Align SubtaskCommittableManager checkpointId with CheckpointCommittableManagerImpl checkpointId during recovery

2022-10-14 Thread Fabian Paul (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fabian Paul resolved FLINK-29512. - Fix Version/s: 1.17.0 1.15.3 1.16.1 Resolution:

[jira] [Commented] (FLINK-29512) Align SubtaskCommittableManager checkpointId with CheckpointCommittableManagerImpl checkpointId during recovery

2022-10-14 Thread Fabian Paul (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617734#comment-17617734 ] Fabian Paul commented on FLINK-29512: - Merged into:    master:

[GitHub] [flink] fapaul merged pull request #21063: [BP-1.15][FLINK-29512][streaming] Align the checkpointId of recovered CommittableWithLinages with the CommittableSummary

2022-10-14 Thread GitBox
fapaul merged PR #21063: URL: https://github.com/apache/flink/pull/21063 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink] fapaul merged pull request #21062: [BP-1.16][FLINK-29512][streaming] Align the checkpointId of recovered CommittableWithLinages with the CommittableSummary

2022-10-14 Thread GitBox
fapaul merged PR #21062: URL: https://github.com/apache/flink/pull/21062 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink] fapaul merged pull request #21022: [FLINK-29512][streaming] Align the checkpointId of recovered CommittableWithLinages with the CommittableSummary

2022-10-14 Thread GitBox
fapaul merged PR #21022: URL: https://github.com/apache/flink/pull/21022 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Updated] (FLINK-29433) Support Auth through the builder pattern in Pulsar connector

2022-10-14 Thread Yufan Sheng (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufan Sheng updated FLINK-29433: Affects Version/s: 1.17.0 (was: 1.16.0) > Support Auth through the

[jira] [Updated] (FLINK-29580) pulsar.consumer.autoUpdatePartitionsIntervalSeconds doesn't works and should be removed

2022-10-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-29580: --- Labels: pull-request-available (was: ) >

[GitHub] [flink] syhily opened a new pull request, #21070: [FLINK-29580][Connector/Pulsar] Remove pulsar.consumer.autoUpdatePartitionsIntervalSeconds option.

2022-10-14 Thread GitBox
syhily opened a new pull request, #21070: URL: https://github.com/apache/flink/pull/21070 ## What is the purpose of the change The config option `pulsar.consumer.autoUpdatePartitionsIntervalSeconds` in Pulsar connector is conflict with Flink's split discovery logic and useless. We

[jira] [Updated] (FLINK-29536) Add WATCH_NAMESPACES env var to kubernetes operator

2022-10-14 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora updated FLINK-29536: --- Fix Version/s: (was: kubernetes-operator-1.2.0) > Add WATCH_NAMESPACES env var to kubernetes

[jira] [Closed] (FLINK-29550) example "basic-checkpoint-ha.yaml" not working

2022-10-14 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora closed FLINK-29550. -- Resolution: Cannot Reproduce The examples are mainly designed for minikube, other kubernetes envs may

[jira] [Commented] (FLINK-29566) Reschedule the cleanup logic if cancel job failed

2022-10-14 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617730#comment-17617730 ] Gyula Fora commented on FLINK-29566: I think this improvement makes sense :)  > Reschedule the

[jira] [Updated] (FLINK-29550) example "basic-checkpoint-ha.yaml" not working

2022-10-14 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora updated FLINK-29550: --- Affects Version/s: (was: 1.15.0) > example "basic-checkpoint-ha.yaml" not working >

[jira] [Created] (FLINK-29645) BatchExecutionKeyedStateBackend is using incorrect ExecutionConfig when creating serializer

2022-10-14 Thread Piotr Nowojski (Jira)
Piotr Nowojski created FLINK-29645: -- Summary: BatchExecutionKeyedStateBackend is using incorrect ExecutionConfig when creating serializer Key: FLINK-29645 URL: https://issues.apache.org/jira/browse/FLINK-29645

[jira] [Commented] (FLINK-29634) Support periodic checkpoint triggering

2022-10-14 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617729#comment-17617729 ] Gyula Fora commented on FLINK-29634: I think savepoint history is mostly important so that the

[GitHub] [flink] flinkbot commented on pull request #21069: [FLINK-29613][Connector/Pulsar] Fix wrong batch size assertion.

2022-10-14 Thread GitBox
flinkbot commented on PR #21069: URL: https://github.com/apache/flink/pull/21069#issuecomment-1278989774 ## CI report: * 7d89bb64116b99d895edf1df5cba443715b1f710 UNKNOWN Bot commands The @flinkbot bot supports the following commands: - `@flinkbot run azure`

[jira] [Created] (FLINK-29644) Reference Kubernetes operator from Flink Kubernetes deploy docs

2022-10-14 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-29644: -- Summary: Reference Kubernetes operator from Flink Kubernetes deploy docs Key: FLINK-29644 URL: https://issues.apache.org/jira/browse/FLINK-29644 Project: Flink

[jira] [Updated] (FLINK-29613) Wrong message size assertion in Pulsar's batch message

2022-10-14 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated FLINK-29613: --- Labels: pull-request-available (was: ) > Wrong message size assertion in Pulsar's batch

[GitHub] [flink] syhily opened a new pull request, #21069: [FLINK-29613][Connector/Pulsar] Fix wrong batch size assertion.

2022-10-14 Thread GitBox
syhily opened a new pull request, #21069: URL: https://github.com/apache/flink/pull/21069 ## What is the purpose of the change Pulsar did a wrong batch message size assertion in code. We require every batch message should have size 1. But sometimes the message size could be 0 due to

[jira] [Closed] (FLINK-29632) Support nodeSelector in helm template for flink operator deployment

2022-10-14 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora closed FLINK-29632. -- Fix Version/s: kubernetes-operator-1.3.0 Resolution: Fixed merged to main

[GitHub] [flink-kubernetes-operator] gyfora merged pull request #402: [FLINK-29632] Support nodeSelector in helm template for flink operator deployment

2022-10-14 Thread GitBox
gyfora merged PR #402: URL: https://github.com/apache/flink-kubernetes-operator/pull/402 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink] zentol commented on a diff in pull request #20757: [FLINK-27919] Add FLIP-27-based source for data generation (FLIP-238)

2022-10-14 Thread GitBox
zentol commented on code in PR #20757: URL: https://github.com/apache/flink/pull/20757#discussion_r995726266 ## docs/content/docs/connectors/datastream/datagen.md: ## @@ -0,0 +1,115 @@ +--- +title: DataGen +weight: 3 +type: docs +--- + + +# DataGen Connector + +The DataGen

[jira] [Created] (FLINK-29643) Possible NPE in ApplicationDispatcherBootstrap with failedJob submission and no HA

2022-10-14 Thread Nico Kruber (Jira)
Nico Kruber created FLINK-29643: --- Summary: Possible NPE in ApplicationDispatcherBootstrap with failedJob submission and no HA Key: FLINK-29643 URL: https://issues.apache.org/jira/browse/FLINK-29643

[GitHub] [flink] fapaul commented on pull request #21022: [FLINK-29512][streaming] Align the checkpointId of recovered CommittableWithLinages with the CommittableSummary

2022-10-14 Thread GitBox
fapaul commented on PR #21022: URL: https://github.com/apache/flink/pull/21022#issuecomment-1278933763 @flinkbot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[jira] [Commented] (FLINK-29634) Support periodic checkpoint triggering

2022-10-14 Thread Thomas Weise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617676#comment-17617676 ] Thomas Weise commented on FLINK-29634: -- [~Jiale] that PR it the right place to look at wrt how

[jira] [Commented] (FLINK-13876) Remove ExecutionConfig field from PojoSerializer

2022-10-14 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-13876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617675#comment-17617675 ] Piotr Nowojski commented on FLINK-13876: I'm not sure, but if this is a really issue, that's not

[GitHub] [flink] zentol merged pull request #21057: [hotfix] [docs] correct grammar

2022-10-14 Thread GitBox
zentol merged PR #21057: URL: https://github.com/apache/flink/pull/21057 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [flink] zentol closed pull request #20997: fix(sec): upgrade org.apache.hive:hive-exec to 3.1.3

2022-10-14 Thread GitBox
zentol closed pull request #20997: fix(sec): upgrade org.apache.hive:hive-exec to 3.1.3 URL: https://github.com/apache/flink/pull/20997 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [flink] snuyanzin commented on pull request #21064: [FLINK-29638][connectors][filesystems][formats] Update Jackson-BOM to 2.13.4.2 because of CVE-2022-42003

2022-10-14 Thread GitBox
snuyanzin commented on PR #21064: URL: https://github.com/apache/flink/pull/21064#issuecomment-1278910720 @flinkbot run azure failure seems related to https://issues.apache.org/jira/browse/FLINK-29387 -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [flink] zentol commented on a diff in pull request #21056: [FLINK-29379][datastream] Example of using Configuration to store ExecutionConfig fields

2022-10-14 Thread GitBox
zentol commented on code in PR #21056: URL: https://github.com/apache/flink/pull/21056#discussion_r995678770 ## flink-core/src/main/java/org/apache/flink/api/common/ExecutionConfig.java: ## @@ -148,6 +148,19 @@ public class ExecutionConfig implements Serializable, Archiveable

[GitHub] [flink] afedulov commented on pull request #20757: [FLINK-27919] Add FLIP-27-based source for data generation (FLIP-238)

2022-10-14 Thread GitBox
afedulov commented on PR #20757: URL: https://github.com/apache/flink/pull/20757#issuecomment-1278903252 @zentol I modified the docs according to your proposals, PTAL. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [flink] zentol commented on a diff in pull request #21056: [FLINK-29379][datastream] Example of using Configuration to store ExecutionConfig fields

2022-10-14 Thread GitBox
zentol commented on code in PR #21056: URL: https://github.com/apache/flink/pull/21056#discussion_r995676246 ## flink-core/src/main/java/org/apache/flink/api/common/ExecutionConfig.java: ## @@ -756,7 +811,27 @@ public GlobalJobParameters getGlobalJobParameters() { */

[GitHub] [flink] afedulov commented on a diff in pull request #20757: [FLINK-27919] Add FLIP-27-based source for data generation (FLIP-238)

2022-10-14 Thread GitBox
afedulov commented on code in PR #20757: URL: https://github.com/apache/flink/pull/20757#discussion_r995674703 ## docs/content/docs/connectors/datastream/datagen.md: ## @@ -0,0 +1,115 @@ +--- +title: DataGen +weight: 3 +type: docs +--- + + +# DataGen Connector + +The DataGen

[GitHub] [flink] afedulov commented on a diff in pull request #20757: [FLINK-27919] Add FLIP-27-based source for data generation (FLIP-238)

2022-10-14 Thread GitBox
afedulov commented on code in PR #20757: URL: https://github.com/apache/flink/pull/20757#discussion_r995674573 ## docs/content/docs/connectors/datastream/datagen.md: ## @@ -0,0 +1,115 @@ +--- +title: DataGen +weight: 3 +type: docs +--- + + +# DataGen Connector + +The DataGen

[GitHub] [flink] afedulov commented on a diff in pull request #20757: [FLINK-27919] Add FLIP-27-based source for data generation (FLIP-238)

2022-10-14 Thread GitBox
afedulov commented on code in PR #20757: URL: https://github.com/apache/flink/pull/20757#discussion_r995674275 ## docs/content/docs/connectors/datastream/datagen.md: ## @@ -0,0 +1,115 @@ +--- +title: DataGen +weight: 3 +type: docs +--- + + +# DataGen Connector + +The DataGen

[GitHub] [flink] afedulov commented on a diff in pull request #20757: [FLINK-27919] Add FLIP-27-based source for data generation (FLIP-238)

2022-10-14 Thread GitBox
afedulov commented on code in PR #20757: URL: https://github.com/apache/flink/pull/20757#discussion_r995671986 ## docs/content/docs/connectors/datastream/datagen.md: ## @@ -0,0 +1,115 @@ +--- +title: DataGen +weight: 3 +type: docs +--- + + +# DataGen Connector + +The DataGen

[jira] [Closed] (FLINK-29619) Remove redundant MeterView updater thread from KubernetesClientMetrics

2022-10-14 Thread Gyula Fora (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gyula Fora closed FLINK-29619. -- Resolution: Fixed merged to main f1387f723da3f274bcb3268d401d91042064255d > Remove redundant

[GitHub] [flink] zentol commented on a diff in pull request #20757: [FLINK-27919] Add FLIP-27-based source for data generation (FLIP-238)

2022-10-14 Thread GitBox
zentol commented on code in PR #20757: URL: https://github.com/apache/flink/pull/20757#discussion_r995657759 ## docs/content/docs/connectors/datastream/datagen.md: ## @@ -0,0 +1,115 @@ +--- +title: DataGen +weight: 3 +type: docs +--- + + +# DataGen Connector + +The DataGen

[GitHub] [flink-kubernetes-operator] gyfora merged pull request #401: [FLINK-29619] Remove redundant MeterView updater thread from KubernetesClientMetrics

2022-10-14 Thread GitBox
gyfora merged PR #401: URL: https://github.com/apache/flink-kubernetes-operator/pull/401 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[jira] [Commented] (FLINK-29641) SortMergeResultPartitionReadSchedulerTest.testCreateSubpartitionReader

2022-10-14 Thread Weijie Guo (Jira)
[ https://issues.apache.org/jira/browse/FLINK-29641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17617651#comment-17617651 ] Weijie Guo commented on FLINK-29641: [~mapohl] Thank you for your report and investigation,I will

[GitHub] [flink] klion26 commented on a diff in pull request #21050: [FLINK-29095][state] Improve logging in SharedStateRegistry

2022-10-14 Thread GitBox
klion26 commented on code in PR #21050: URL: https://github.com/apache/flink/pull/21050#discussion_r995430467 ## flink-runtime/src/main/java/org/apache/flink/runtime/state/SharedStateRegistryImpl.java: ## @@ -95,60 +95,78 @@ public StreamStateHandle registerReference(

[GitHub] [flink] afedulov commented on a diff in pull request #20757: [FLINK-27919] Add FLIP-27-based source for data generation (FLIP-238)

2022-10-14 Thread GitBox
afedulov commented on code in PR #20757: URL: https://github.com/apache/flink/pull/20757#discussion_r995629891 ## docs/content/docs/connectors/datastream/datagen.md: ## @@ -0,0 +1,115 @@ +--- +title: DataGen +weight: 3 +type: docs +--- + + +# DataGen Connector + +The DataGen

  1   2   3   >