[jira] [Created] (FLINK-26416) Release Testing:

Fabian Paul created FLINK-26416: --- Summary: Release Testing: Key: FLINK-26416 URL: https://issues.apache.org/jira/browse/FLINK-26416 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-26415) Improve view usage in hive dialect

luoyuxia created FLINK-26415: Summary: Improve view usage in hive dialect Key: FLINK-26415 URL: https://issues.apache.org/jira/browse/FLINK-26415 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-26414) Hive dialect supports "Marco"

luoyuxia created FLINK-26414: Summary: Hive dialect supports "Marco" Key: FLINK-26414 URL: https://issues.apache.org/jira/browse/FLINK-26414 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-26413) Hive dialect support "LOAD DATA INPATH"

luoyuxia created FLINK-26413: Summary: Hive dialect support "LOAD DATA INPATH" Key: FLINK-26413 URL: https://issues.apache.org/jira/browse/FLINK-26413 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-26412) Hive dialect supports "CREATE TEMPORARY FUNCTION USING xxx.jar"

luoyuxia created FLINK-26412: Summary: Hive dialect supports "CREATE TEMPORARY FUNCTION USING xxx.jar" Key: FLINK-26412 URL: https://issues.apache.org/jira/browse/FLINK-26412 Project: Flink

Re: Re: Change of focus

Till, thank you for your immense contributions to the project and the community. On Mon, Feb 28, 2022 at 9:16 PM Xintong Song wrote: > Thanks for everything, Till. It has been a great honor working with you. > Good luck with your new chapter~! > > Thank you~ > > Xintong Song > > > > On Tue, Mar

Re: [DISCUSS] Flink Kubernetes Operator controller flow

And just one more thing I forgot to add: The observer does not have to be a dummy monolithic logic. Different job types will have different state machines with different observe requirements and different observer implementations. I think this is complexly normal. The observer can be aware of the

Re: [DISCUSS] Flink Kubernetes Operator controller flow

@Thomas: Thanks for the input! I completely agree with a well principled state machine based approach in the operator would be the best. You are right that the code contains mostly if then else based logic at the moment as it evolved after initial prototype to cover more scenarios. However I

Re: Re: Change of focus

Thanks for everything, Till. It has been a great honor working with you. Good luck with your new chapter~! Thank you~ Xintong Song On Tue, Mar 1, 2022 at 12:33 PM Zhilong Hong wrote: > Thank you for everything, Till! I've learned a lot from you. > > Good luck with your new adventure and the

[jira] [Created] (FLINK-26411) Hive dialect supports CLUSTERED BY/ SORTED BY table

luoyuxia created FLINK-26411: Summary: Hive dialect supports CLUSTERED BY/ SORTED BY table Key: FLINK-26411 URL: https://issues.apache.org/jira/browse/FLINK-26411 Project: Flink Issue Type:

Re: Re: Change of focus

Thank you for everything, Till! I've learned a lot from you. Good luck with your new adventure and the next chapter! Best, Zhilong On Tue, Mar 1, 2022 at 12:08 PM Yun Tang wrote: > Thanks a lot for your efforts and kindness of mentoring contributors in > Apache Flink community, Till! > > Good

[jira] [Created] (FLINK-26410) support hive transform

luoyuxia created FLINK-26410: Summary: support hive transform Key: FLINK-26410 URL: https://issues.apache.org/jira/browse/FLINK-26410 Project: Flink Issue Type: Sub-task Components:

[jira] [Created] (FLINK-26409) Remove meaningless Kafka connector test case KafkaConsumerTestBase.runBrokerFailureTest

Qingsheng Ren created FLINK-26409: - Summary: Remove meaningless Kafka connector test case KafkaConsumerTestBase.runBrokerFailureTest Key: FLINK-26409 URL: https://issues.apache.org/jira/browse/FLINK-26409

Re: Re: Change of focus

Thanks a lot for your efforts and kindness of mentoring contributors in Apache Flink community, Till! Good luck with your new adventure in your new life. Best Yun Tang From: Yuan Mei Sent: Tuesday, March 1, 2022 11:00 To: dev Subject: Re: Re: Change of focus

[jira] [Created] (FLINK-26408) retract a non-existent record in RetractableTopNFunction

Hengyu Dai created FLINK-26408: -- Summary: retract a non-existent record in RetractableTopNFunction Key: FLINK-26408 URL: https://issues.apache.org/jira/browse/FLINK-26408 Project: Flink Issue

Re: Change of focus

Thanks a lot for your great efforts, Till. It's been a pleasure working with you! Good luck! Best, Yangze Guo On Tue, Mar 1, 2022 at 11:40 AM Paul Lam wrote: > > Thanks Till, for everything! I learned a lot from you. Wish lots of joys in > your new journey. > > Best, > Paul Lam > > > 2022年3月1日

Re: Change of focus

Thanks Till, for everything! I learned a lot from you. Wish lots of joys in your new journey. Best, Paul Lam > 2022年3月1日 11:00，Yuan Mei 写道： > > Thanks Till for everything you've done for the community! > Good luck with your new adventure and best wishes to your new life! > > Best Regards, >

[jira] [Created] (FLINK-26407) MetricsAvailabilityITCase.testReporter failed on azure

Yun Gao created FLINK-26407: --- Summary: MetricsAvailabilityITCase.testReporter failed on azure Key: FLINK-26407 URL: https://issues.apache.org/jira/browse/FLINK-26407 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-26406) Significant differences of Fault Tolerance between English and Chinese version

tonny created FLINK-26406: - Summary: Significant differences of Fault Tolerance between English and Chinese version Key: FLINK-26406 URL: https://issues.apache.org/jira/browse/FLINK-26406 Project: Flink

[jira] [Created] (FLINK-26405) Add validation check of num of JM replica

Biao Geng created FLINK-26405: - Summary: Add validation check of num of JM replica Key: FLINK-26405 URL: https://issues.apache.org/jira/browse/FLINK-26405 Project: Flink Issue Type: Improvement

Re: Re: Change of focus

Thanks Till for everything you've done for the community! Good luck with your new adventure and best wishes to your new life! Best Regards, Yuan On Tue, Mar 1, 2022 at 10:35 AM Zhu Zhu wrote: > Thank you for all the efforts and good luck for the new adventure, Till! > > Thanks, > Zhu > > Terry

Re: Re: Change of focus

Thank you for all the efforts and good luck for the new adventure, Till! Thanks, Zhu Terry 于2022年3月1日周二 10:26写道： > Thanks a lot for your efforts! Good Luck! > > Jiangang Liu 于2022年3月1日周二 10:18写道： > > > Thanks for the efforts and help in flink, Till. Good luck! > > > > Best > > Liu Jiangang >

Re: Re: Change of focus

Thanks a lot for your efforts! Good Luck! Jiangang Liu 于2022年3月1日周二 10:18写道： > Thanks for the efforts and help in flink, Till. Good luck! > > Best > Liu Jiangang > > Lijie Wang 于2022年3月1日周二 09:53写道： > > > Thanks for all your efforts Till. Good luck ! > > > > Best, > > Lijie > > > > Yun Gao

Re: Re: Change of focus

Thanks for the efforts and help in flink, Till. Good luck! Best Liu Jiangang Lijie Wang 于2022年3月1日周二 09:53写道： > Thanks for all your efforts Till. Good luck ! > > Best, > Lijie > > Yun Gao 于2022年3月1日周二 01:15写道： > > > Very thanks Till for all the efforts! Good luck for the next chapter~ > > > >

Re: Re: Change of focus

Thanks a lot for your efforts and it is a great experience working with you. Good luck for your new chapter. Best, Yang Lijie Wang 于2022年3月1日周二 09:53写道： > Thanks for all your efforts Till. Good luck ! > > Best, > Lijie > > Yun Gao 于2022年3月1日周二 01:15写道： > > > Very thanks Till for all the

Re: Re: Change of focus

Thanks for all your efforts Till. Good luck ! Best, Lijie Yun Gao 于2022年3月1日周二 01:15写道： > Very thanks Till for all the efforts! Good luck for the next chapter~ > > Best, > Yun > > -- > Sender:Piotr Nowojski > Date:2022/02/28

[jira] [Created] (FLINK-26404) Currently, Flink-ML only supports local file systems

mumu created FLINK-26404: Summary: Currently, Flink-ML only supports local file systems Key: FLINK-26404 URL: https://issues.apache.org/jira/browse/FLINK-26404 Project: Flink Issue Type: Bug

Re: [DISCUSS] Flink Kubernetes Operator controller flow

Thanks for bringing the discussion. It's a good time to revisit this area as the operator implementation becomes more complex. I think the most important part of the design are well defined states and transitions. Unless that can be reasoned about, there will be confusion. For example: 1) For

Re: [DISCUSS] CAST legacy behaviour

+1 Especially as SQL upgrades are right around the corner, it makes sense to get our defaults right. Seth On Mon, Feb 28, 2022 at 7:14 AM Martijn Visser wrote: > +1 for setting this option to disabled by default. I believe failures > should be brought forward as soon as possible, so they can

[jira] [Created] (FLINK-26403) SinkWriter should emit all the pending committables on endOfInput

Yun Gao created FLINK-26403: --- Summary: SinkWriter should emit all the pending committables on endOfInput Key: FLINK-26403 URL: https://issues.apache.org/jira/browse/FLINK-26403 Project: Flink

[jira] [Created] (FLINK-26402) MinioTestContainerTest.testS3EndpointNeedsToBeSpecifiedBeforeInitializingFileSyste failed due to Container startup failed

Yun Gao created FLINK-26402: --- Summary: MinioTestContainerTest.testS3EndpointNeedsToBeSpecifiedBeforeInitializingFileSyste failed due to Container startup failed Key: FLINK-26402 URL:

Re: Re: Change of focus

Very thanks Till for all the efforts! Good luck for the next chapter~ Best, Yun -- Sender:Piotr Nowojski Date:2022/02/28 22:10:46 Recipient:dev Theme:Re: Change of focus Good luck Till and thanks for all of your efforts. Best,

[jira] [Created] (FLINK-26401) improve the compatibility for hive catalogView

zoucao created FLINK-26401: -- Summary: improve the compatibility for hive catalogView Key: FLINK-26401 URL: https://issues.apache.org/jira/browse/FLINK-26401 Project: Flink Issue Type: Improvement

Re: [DISCUSS] Flink Kubernetes Operator controller flow

Hi All! Thank you for the feedback, I agree with what has been proposed to include as much as possible in the actual resource status and make the reconciler completely independent from the observer. @Biao Geng: Validation could depend on the current status (depending on how we implement the

Re: [DISCUSS] Flink Kubernetes Operator controller flow

Hi Gyula, Thanks for the discussion. It also makes senses to me on the separation of 3 components and Yang's proposal. Just 1 follow-up thought after checking your PR: in the reconcile() method of controller, IIUC, the real flow could be

[jira] [Created] (FLINK-26400) Release Testing: Explicit shutdown signalling from TaskManager to JobManager

Niklas Semmler created FLINK-26400: -- Summary: Release Testing: Explicit shutdown signalling from TaskManager to JobManager Key: FLINK-26400 URL: https://issues.apache.org/jira/browse/FLINK-26400

Re: [VOTE] Release 1.14.4, release candidate #1

+1 non-binding - built from source - checked hashes and signatures - started locally and deployed wordcount / stopped with savepoint / restarted - reviewed announcement post Thanks for managing the release! Seth On Fri, Feb 25, 2022 at 7:30 AM Konstantin Knauf wrote: > Hi everyone, > >

[jira] [Created] (FLINK-26399) Make some option of operator configurable

Aitozi created FLINK-26399: -- Summary: Make some option of operator configurable Key: FLINK-26399 URL: https://issues.apache.org/jira/browse/FLINK-26399 Project: Flink Issue Type: Sub-task

Re: Change of focus

Good luck Till and thanks for all of your efforts. Best, Piotrek pon., 28 lut 2022 o 15:06 Aitozi napisał(a): > Good luck with the next chapter, will miss you :) > > Best, > Aitozi > > Jark Wu 于2022年2月28日周一 21:28写道： > > > Thank you Till for every things. It's great to work with you. Good

[jira] [Created] (FLINK-26398) Add documentation for Kinesis Firehose table API.

Ahmed Hamdy created FLINK-26398: --- Summary: Add documentation for Kinesis Firehose table API. Key: FLINK-26398 URL: https://issues.apache.org/jira/browse/FLINK-26398 Project: Flink Issue Type:

[jira] [Created] (FLINK-26397) Chinese Translation - Add documentation for Kinesis firehose Table Api

Ahmed Hamdy created FLINK-26397: --- Summary: Chinese Translation - Add documentation for Kinesis firehose Table Api Key: FLINK-26397 URL: https://issues.apache.org/jira/browse/FLINK-26397 Project: Flink

Re: Change of focus

Good luck with the next chapter, will miss you :) Best, Aitozi Jark Wu 于2022年2月28日周一 21:28写道： > Thank you Till for every things. It's great to work with you. Good luck! > > Best, > Jark > > On Mon, 28 Feb 2022 at 21:26, Márton Balassi > wrote: > > > Thank you, Till. Good luck with the next

[jira] [Created] (FLINK-26396) [Changelog] Upload is not failed even if all attempts timeout

Roman Khachatryan created FLINK-26396: - Summary: [Changelog] Upload is not failed even if all attempts timeout Key: FLINK-26396 URL: https://issues.apache.org/jira/browse/FLINK-26396 Project:

Re: Change of focus

Thank you Till for every things. It's great to work with you. Good luck! Best, Jark On Mon, 28 Feb 2022 at 21:26, Márton Balassi wrote: > Thank you, Till. Good luck with the next chapter. :-) > > On Mon, Feb 28, 2022 at 1:49 PM Flavio Pompermaier > wrote: > > > Good luck for your new

Re: [DISCUSS] Flink Kubernetes Operator controller flow

It is worth looking at the controller code in the spotify operator too: https://github.com/spotify/flink-on-k8s-operator/blob/master/controllers/flinkcluster/flinkcluster_controller.go It is looping in the 'observer phase' until it reaches a stable state, then it performs the necessary changes.

Re: Change of focus

Thank you, Till. Good luck with the next chapter. :-) On Mon, Feb 28, 2022 at 1:49 PM Flavio Pompermaier wrote: > Good luck for your new adventure Till! > > On Mon, Feb 28, 2022 at 12:00 PM Till Rohrmann > wrote: > > > Hi everyone, > > > > I wanted to let you know that I will be less active in

Re: [DISCUSS] CAST legacy behaviour

+1 for setting this option to disabled by default. I believe failures should be brought forward as soon as possible, so they can be fixed as fast as possible. It will also be less confusing for new users. Last but not least, I believe the impact on existing users will be minimal (since it can be

Re: [DISCUSS] Plan to externalize connectors and versioning

Thanks for clarifying my story Konstantin, this was indeed as we discussed. Thanks Chesnay and Thomas for your input too! On Thu, 24 Feb 2022 at 02:43, Thomas Weise wrote: > This plan LGTM. > > Thanks, > Thomas > > On Wed, Feb 23, 2022 at 4:28 AM Chesnay Schepler > wrote: > > > > That sounds

Re: [DISCUSS] Flink Kubernetes Operator controller flow

Hi, Gyula Thanks for driving this discussion. I second Yang Wang's idea that it's better to make the `validator`, `observer` and `reconciler` self-contained. I also prefer to define the `Observer` as an interface and we could define the statuses that `Observer` will expose. It acts like the

Re: Change of focus

Good luck for your new adventure Till! On Mon, Feb 28, 2022 at 12:00 PM Till Rohrmann wrote: > Hi everyone, > > I wanted to let you know that I will be less active in the community > because I’ve decided to start a new chapter in my life. Hence, please don’t > wonder if I might no longer be

[jira] [Created] (FLINK-26395) The description of RAND_INTEGER is wrong in SQL function documents

huweihua created FLINK-26395: Summary: The description of RAND_INTEGER is wrong in SQL function documents Key: FLINK-26395 URL: https://issues.apache.org/jira/browse/FLINK-26395 Project: Flink

Change of focus

Hi everyone, I wanted to let you know that I will be less active in the community because I’ve decided to start a new chapter in my life. Hence, please don’t wonder if I might no longer be very responsive on mails and JIRA issues. It is great being part of such a great community with so many

[jira] [Created] (FLINK-26394) CheckpointCoordinator.isTriggering can not be reset if a checkpoint expires while the checkpointCoordinator task is queuing in the SourceCoordinator executor.

Gen Luo created FLINK-26394: --- Summary: CheckpointCoordinator.isTriggering can not be reset if a checkpoint expires while the checkpointCoordinator task is queuing in the SourceCoordinator executor. Key: FLINK-26394

[jira] [Created] (FLINK-26393) KafkaITCase.testBrokerFailure fails due to a topic isn't cleaned up properly

Matthias Pohl created FLINK-26393: - Summary: KafkaITCase.testBrokerFailure fails due to a topic isn't cleaned up properly Key: FLINK-26393 URL: https://issues.apache.org/jira/browse/FLINK-26393

[jira] [Created] (FLINK-26392) Support externally induced sources in MultipleInputStreamTask

Dawid Wysakowicz created FLINK-26392: Summary: Support externally induced sources in MultipleInputStreamTask Key: FLINK-26392 URL: https://issues.apache.org/jira/browse/FLINK-26392 Project: Flink

[jira] [Created] (FLINK-26391) Release Testing: Application Mode recovery does not re-trigger a job which failed during cleanup (FLINK-11813)

Matthias Pohl created FLINK-26391: - Summary: Release Testing: Application Mode recovery does not re-trigger a job which failed during cleanup (FLINK-11813) Key: FLINK-26391 URL:

[jira] [Created] (FLINK-26390) InputStream is not closed at CliClient#executeFile

Sergey Nuyanzin created FLINK-26390: --- Summary: InputStream is not closed at CliClient#executeFile Key: FLINK-26390 URL: https://issues.apache.org/jira/browse/FLINK-26390 Project: Flink

[jira] [Created] (FLINK-26389) Many operators of ”flink-end-to-end-tests“ have been deprecated and need to be updated

ChengyunZhang created FLINK-26389: - Summary: Many operators of ”flink-end-to-end-tests“ have been deprecated and need to be updated Key: FLINK-26389 URL: https://issues.apache.org/jira/browse/FLINK-26389

Re: [DISCUSS] Flink Kubernetes Operator controller flow

Thanks for posting the discussion here. Having the components `validator` `observer` `reconciler` makes lots of sense. And the "Validate -> Observe -> Reconcile" flow seems natural to me. Regarding the implementation in the PR, instead of directly using the observer in the reconciler, I lean to

[jira] [Created] (FLINK-26388) Release Testing: Repeatable Cleanup

Matthias Pohl created FLINK-26388: - Summary: Release Testing: Repeatable Cleanup Key: FLINK-26388 URL: https://issues.apache.org/jira/browse/FLINK-26388 Project: Flink Issue Type: New

[DISCUSS] Flink Kubernetes Operator controller flow

Hi All! I would like to start a discussion thread regarding the structure of the Kubernetes Operator controller