[jira] [Created] (FLINK-26143) FlinkKafkaProducerITCase.testFlinkKafkaProducerFailBeforeNotify hangs

2022-02-14 Thread Qingsheng Ren (Jira)
Qingsheng Ren created FLINK-26143: - Summary: FlinkKafkaProducerITCase.testFlinkKafkaProducerFailBeforeNotify hangs Key: FLINK-26143 URL: https://issues.apache.org/jira/browse/FLINK-26143 Project:

Re: [DISCUSS] FLIP-212: Introduce Flink Kubernetes Operator

2022-02-14 Thread K Fred
Hi Gyula! I have reviewed the prototype design of flink-kubernetes-operator you submitted, and I have the following questions: 1.Can a Flink Jar package that supports pulling from the sidecar be added to the JobSpec? just like this: > initContainers: > - name: downloader > image:

Re: Flink restarts after hitting outOfMemory

2022-02-14 Thread Caizhi Weng
Hi! Heap memory usage depends heavily on your job and your state backend. Which state backend are you using and if possible could you share your user code or explain what operations your job is doing? Misha Hungyo 于2022年2月14日周一 16:56写道: > Hi, > I have a flink job that runs continuously(the job

[jira] [Created] (FLINK-26141) Support last-state upgrade mode

2022-02-14 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-26141: -- Summary: Support last-state upgrade mode Key: FLINK-26141 URL: https://issues.apache.org/jira/browse/FLINK-26141 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-26142) Integrate flink-kubernetes-operator repo with CI/CD

2022-02-14 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-26142: -- Summary: Integrate flink-kubernetes-operator repo with CI/CD Key: FLINK-26142 URL: https://issues.apache.org/jira/browse/FLINK-26142 Project: Flink Issue Type:

[jira] [Created] (FLINK-26140) Add basic handling mechanism to deal with job upgrade errors

2022-02-14 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-26140: -- Summary: Add basic handling mechanism to deal with job upgrade errors Key: FLINK-26140 URL: https://issues.apache.org/jira/browse/FLINK-26140 Project: Flink

[jira] [Created] (FLINK-26139) Improve JobStatus tracking and handle different job states

2022-02-14 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-26139: -- Summary: Improve JobStatus tracking and handle different job states Key: FLINK-26139 URL: https://issues.apache.org/jira/browse/FLINK-26139 Project: Flink Issue

[jira] [Created] (FLINK-26137) Create webhook REST api test

2022-02-14 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-26137: -- Summary: Create webhook REST api test Key: FLINK-26137 URL: https://issues.apache.org/jira/browse/FLINK-26137 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-26138) Create controller test

2022-02-14 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-26138: -- Summary: Create controller test Key: FLINK-26138 URL: https://issues.apache.org/jira/browse/FLINK-26138 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-26136) Implement shared validation logic for FlinkDeployment objects

2022-02-14 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-26136: -- Summary: Implement shared validation logic for FlinkDeployment objects Key: FLINK-26136 URL: https://issues.apache.org/jira/browse/FLINK-26136 Project: Flink

[jira] [Created] (FLINK-26135) Separate job and deployment errors in FlinkDeployment status

2022-02-14 Thread Gyula Fora (Jira)
Gyula Fora created FLINK-26135: -- Summary: Separate job and deployment errors in FlinkDeployment status Key: FLINK-26135 URL: https://issues.apache.org/jira/browse/FLINK-26135 Project: Flink

[jira] [Created] (FLINK-26134) Document checkpoint/savepoint guarantees

2022-02-14 Thread Anton Kalashnikov (Jira)
Anton Kalashnikov created FLINK-26134: - Summary: Document checkpoint/savepoint guarantees Key: FLINK-26134 URL: https://issues.apache.org/jira/browse/FLINK-26134 Project: Flink Issue

Re: [DISCUSS] FLIP-212: Introduce Flink Kubernetes Operator

2022-02-14 Thread Gyula Fóra
Hi Flink Devs! We would like to present to you the first prototype of the flink-kubernetes-operator that was built based on the FLIP and the discussion on this mail thread. We would also like to call out some design decisions that we have made regarding architecture components that were not

[jira] [Created] (FLINK-26133) Kafka Source Web Deserializer Java Code is Error

2022-02-14 Thread Jira
十二 created FLINK-26133: -- Summary: Kafka Source Web Deserializer Java Code is Error Key: FLINK-26133 URL: https://issues.apache.org/jira/browse/FLINK-26133 Project: Flink Issue Type: Bug

Re: [DISCUSS] FLINK-25927: Make flink-connector-base dependency usage consistent across all connectors

2022-02-14 Thread Alexander Fedulov
Hi, Thomas, Chesnay, thank you for your input. Below I will try to capture two actionable alternatives together with their benefits and downsides: Alternative #1: Package flink-connector-base into flink-dist Downsides: - breaks existing CI/IDE setup that previously neither relied on flink-dist

[jira] [Created] (FLINK-26132) Always serialize anonymous table

2022-02-14 Thread Timo Walther (Jira)
Timo Walther created FLINK-26132: Summary: Always serialize anonymous table Key: FLINK-26132 URL: https://issues.apache.org/jira/browse/FLINK-26132 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-26131) CompiledPlan should implement Executable

2022-02-14 Thread Francesco Guardiani (Jira)
Francesco Guardiani created FLINK-26131: --- Summary: CompiledPlan should implement Executable Key: FLINK-26131 URL: https://issues.apache.org/jira/browse/FLINK-26131 Project: Flink Issue

[jira] [Created] (FLINK-26130) Document why and when user would like to increase network buffer size

2022-02-14 Thread Anton Kalashnikov (Jira)
Anton Kalashnikov created FLINK-26130: - Summary: Document why and when user would like to increase network buffer size Key: FLINK-26130 URL: https://issues.apache.org/jira/browse/FLINK-26130

[jira] [Created] (FLINK-26129) Using fail method instead of kill method when yarn application deployment error occures

2022-02-14 Thread zlzhang0122 (Jira)
zlzhang0122 created FLINK-26129: --- Summary: Using fail method instead of kill method when yarn application deployment error occures Key: FLINK-26129 URL: https://issues.apache.org/jira/browse/FLINK-26129

Re: [ANNOUNCE] Pushing the feature freeze by a couple of days

2022-02-14 Thread Johannes Moser
Dear Apache Flink Community, As the CI seems to be working again we’d suggest the 16th of February end of business CEST. In case you still got any issues and this doesn’t work for you, please let us know. We will have another sync call tomorrow at 9am CET. Feel free to join. Best, Joe > On

[jira] [Created] (FLINK-26128) Improve Table, Expressions and related classes Javadocs/Scaladocs

2022-02-14 Thread Francesco Guardiani (Jira)
Francesco Guardiani created FLINK-26128: --- Summary: Improve Table, Expressions and related classes Javadocs/Scaladocs Key: FLINK-26128 URL: https://issues.apache.org/jira/browse/FLINK-26128

[jira] [Created] (FLINK-26127) Cleanup usage of deprecated table methods in doc

2022-02-14 Thread Francesco Guardiani (Jira)
Francesco Guardiani created FLINK-26127: --- Summary: Cleanup usage of deprecated table methods in doc Key: FLINK-26127 URL: https://issues.apache.org/jira/browse/FLINK-26127 Project: Flink

[jira] [Created] (FLINK-26126) Sink V2 will cause error numRecordsOut metric

2022-02-14 Thread Hang Ruan (Jira)
Hang Ruan created FLINK-26126: - Summary: Sink V2 will cause error numRecordsOut metric Key: FLINK-26126 URL: https://issues.apache.org/jira/browse/FLINK-26126 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-26125) Doc overhaul for the CAST behaviour

2022-02-14 Thread Francesco Guardiani (Jira)
Francesco Guardiani created FLINK-26125: --- Summary: Doc overhaul for the CAST behaviour Key: FLINK-26125 URL: https://issues.apache.org/jira/browse/FLINK-26125 Project: Flink Issue

Re: [hotfix datastream improvement] remove unnecessary condition

2022-02-14 Thread Martijn Visser
Hi, Thanks for opening the ticket and the PR and I'm sorry that you haven't had a review yet. Most of the Flink contributors are currently busy to finish up their contributions for the Flink 1.15 release, which is why a review of your PR is taking longer than expected. Best regards, Martijn On

[jira] [Created] (FLINK-26123) The data of the upsert-kafka source cannot be written to HBase under sql where conditions

2022-02-14 Thread Carl (Jira)
Carl created FLINK-26123: Summary: The data of the upsert-kafka source cannot be written to HBase under sql where conditions Key: FLINK-26123 URL: https://issues.apache.org/jira/browse/FLINK-26123 Project:

[jira] [Created] (FLINK-26124) JobManagerMetricGroup is never actually used

2022-02-14 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-26124: - Summary: JobManagerMetricGroup is never actually used Key: FLINK-26124 URL: https://issues.apache.org/jira/browse/FLINK-26124 Project: Flink Issue Type:

[jira] [Created] (FLINK-26122) JobManagerMetricGroup.addJob returns null when already being closed

2022-02-14 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-26122: - Summary: JobManagerMetricGroup.addJob returns null when already being closed Key: FLINK-26122 URL: https://issues.apache.org/jira/browse/FLINK-26122 Project: Flink

[jira] [Created] (FLINK-26121) ZooKeeperLeaderRetrievalConnectionHandlingTest.testNewLeaderAfterReconnectTriggersListenerNotification failed on azure

2022-02-14 Thread Yun Gao (Jira)
Yun Gao created FLINK-26121: --- Summary: ZooKeeperLeaderRetrievalConnectionHandlingTest.testNewLeaderAfterReconnectTriggersListenerNotification failed on azure Key: FLINK-26121 URL:

[jira] [Created] (FLINK-26120) ZooKeeperCheckpointIDCounterITCase.testConcurrentGetAndIncrement failed on azure

2022-02-14 Thread Yun Gao (Jira)
Yun Gao created FLINK-26120: --- Summary: ZooKeeperCheckpointIDCounterITCase.testConcurrentGetAndIncrement failed on azure Key: FLINK-26120 URL: https://issues.apache.org/jira/browse/FLINK-26120 Project:

[jira] [Created] (FLINK-26119) AsyncSinkWriterStateSerializer needs to be PublicEvolving

2022-02-14 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-26119: --- Summary: AsyncSinkWriterStateSerializer needs to be PublicEvolving Key: FLINK-26119 URL: https://issues.apache.org/jira/browse/FLINK-26119 Project: Flink

[jira] [Created] (FLINK-26118) AsyncSinks do not support downscaling with state

2022-02-14 Thread Fabian Paul (Jira)
Fabian Paul created FLINK-26118: --- Summary: AsyncSinks do not support downscaling with state Key: FLINK-26118 URL: https://issues.apache.org/jira/browse/FLINK-26118 Project: Flink Issue Type:

Re: [DISCUSS] FLINK-25927: Make flink-connector-base dependency usage consistent across all connectors

2022-02-14 Thread Chesnay Schepler
Letting connectors bundle it doesn't necessarily make it harder to achieve; that all depends on how we approach it; e.g., everything that connector-base uses from the core Flink could be required to also be annotated with Public(Evolving). (i.e., treat it as if it were externalized) On

[jira] [Created] (FLINK-26117) JobManagerMetricGroup needs to implement GloballyCleanableResource as well

2022-02-14 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-26117: - Summary: JobManagerMetricGroup needs to implement GloballyCleanableResource as well Key: FLINK-26117 URL: https://issues.apache.org/jira/browse/FLINK-26117

Flink restarts after hitting outOfMemory

2022-02-14 Thread Misha Hungyo
Hi, I have a flink job that runs continuously(the job never goes to* FINISHED* state but is always in *RUNNING* state) and there are stateful operations too. But the states are cleared after the time threshold is hit. Logically, from what I understand, the memory claimed should be cleaned up but

[hotfix datastream improvement] remove unnecessary condition

2022-02-14 Thread 弘树
hi there, I found a problem in IntervalJoinOperator, and I've posted it on https://issues.apache.org/jira/browse/FLINK-25980, this is a small problem that can be fixed quickly, I have submitted PR on GitHub , utl is https://github.com/apache/flink/pull/18647, but I haven't heard back for days, I

[jira] [Created] (FLINK-26116) FLIP-188: Implement Table Store V0.1

2022-02-14 Thread Jingsong Lee (Jira)
Jingsong Lee created FLINK-26116: Summary: FLIP-188: Implement Table Store V0.1 Key: FLINK-26116 URL: https://issues.apache.org/jira/browse/FLINK-26116 Project: Flink Issue Type: New Feature

Re: [DISCUSS] FLIP-212: Introduce Flink Kubernetes Operator

2022-02-14 Thread K Fred
Hi Gyula, Thanks! It's great to see the project getting started and I can't wait to see the PR and start contributing code. Best Wishes! Peng Yuan On Mon, Feb 14, 2022 at 4:14 PM Gyula Fóra wrote: > Hi Peng Yuan! > > The repo is already created: >

Re: [DISCUSS] FLIP-212: Introduce Flink Kubernetes Operator

2022-02-14 Thread Gyula Fóra
Hi Peng Yuan! The repo is already created: https://github.com/apache/flink-kubernetes-operator We will open the PR with the initial prototype later today, stay tuned in this thread! :) Cheers, Gyula On Mon, Feb 14, 2022 at 9:09 AM K Fred wrote: > Hi All, > > Has the project of

[jira] [Created] (FLINK-26115) Multiple Kafka connector tests failed due to The topic metadata failed to propagate to Kafka broker

2022-02-14 Thread Yun Gao (Jira)
Yun Gao created FLINK-26115: --- Summary: Multiple Kafka connector tests failed due to The topic metadata failed to propagate to Kafka broker Key: FLINK-26115 URL: https://issues.apache.org/jira/browse/FLINK-26115

Re: [DISCUSS] FLIP-212: Introduce Flink Kubernetes Operator

2022-02-14 Thread K Fred
Hi All, Has the project of flink-kubernetes-operator been created in github? Peng Yuan On Wed, Feb 9, 2022 at 1:23 AM Gyula Fóra wrote: > I agree with flink-kubernetes-operator as the repo name :) > Don't have any better idea > > Gyula > > On Sat, Feb 5, 2022 at 2:41 AM Thomas Weise wrote: >

[jira] [Created] (FLINK-26114) DefaultScheduler fails fatally in case of an error when shutting down the checkpoint-related resources

2022-02-14 Thread Matthias Pohl (Jira)
Matthias Pohl created FLINK-26114: - Summary: DefaultScheduler fails fatally in case of an error when shutting down the checkpoint-related resources Key: FLINK-26114 URL: