Re: [BULK]Re: [SURVEY] Remove Mesos support

; We at Criteo are active users of the Flink on Mesos resource > management component. We are pretty heavy users of Mesos for scheduling > workloads on our edge datacenters and we do want to continue to be able to > run some of our Flink topologies (to compute machine learning s

[jira] [Created] (FLINK-19793) KafkaTableITCase.testKafkaSourceSinkWithMetadata fails on AZP

Till Rohrmann created FLINK-19793: - Summary: KafkaTableITCase.testKafkaSourceSinkWithMetadata fails on AZP Key: FLINK-19793 URL: https://issues.apache.org/jira/browse/FLINK-19793 Project: Flink

Re: [DISCUSS] Releasing Apache Flink 1.11.3

Thanks for starting this discussion Gordon. There are over 100 issues which are fixed for 1.11.3. Hence +1 for a soonish 1.11.3 release. Thanks for volunteering as our release managers Gordon and Xintong! Cheers, Till On Fri, Oct 23, 2020 at 5:02 PM Tzu-Li (Gordon) Tai wrote: > Hi, > > Xintong

Re: [SURVEY] Remove Mesos support

Thanks for starting this survey Robert! I second Konstantin and Xintong in the sense that our Mesos user's opinions should matter most here. If our community is no longer using the Mesos integration, then I would be +1 for removing it in order to decrease the maintenance burden. Cheers, Till On

[jira] [Created] (FLINK-19785) Upgrade commons-io to 2.7 or newer

Till Rohrmann created FLINK-19785: - Summary: Upgrade commons-io to 2.7 or newer Key: FLINK-19785 URL: https://issues.apache.org/jira/browse/FLINK-19785 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-19784) Upgrade okhttp to 3.13.0 or newer

Till Rohrmann created FLINK-19784: - Summary: Upgrade okhttp to 3.13.0 or newer Key: FLINK-19784 URL: https://issues.apache.org/jira/browse/FLINK-19784 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-19783) Upgrade mesos to 1.7 or newer

Till Rohrmann created FLINK-19783: - Summary: Upgrade mesos to 1.7 or newer Key: FLINK-19783 URL: https://issues.apache.org/jira/browse/FLINK-19783 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-19782) Upgrade antlr to 4.7.1 or newer

Till Rohrmann created FLINK-19782: - Summary: Upgrade antlr to 4.7.1 or newer Key: FLINK-19782 URL: https://issues.apache.org/jira/browse/FLINK-19782 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-19781) Upgrade commons_codec to 1.13 or newer

Till Rohrmann created FLINK-19781: - Summary: Upgrade commons_codec to 1.13 or newer Key: FLINK-19781 URL: https://issues.apache.org/jira/browse/FLINK-19781 Project: Flink Issue Type: Task

Re: [VOTE] NEW FLIP-102: Add More Metrics to TaskManager

Thanks for reviving this Flip Yadong! The changes look good to me and the new memory UI looks awesome :-) I think the reason why the REST issues are closed is because they are already done. In that sense some of the work already finished. +1 for adopting this FLIP and moving forward with

Re: Resuming Savepoint issue with upgraded Flink version 1.11.2

Hi Partha, have you set explicit operator uids [1]? This is usually recommended in order to ensure that Flink can match operator state across re-submissions in particular when doing job upgrades. If you haven't set the uids explicitly, then Flink will generate them automatically. It could be the

Re: [DISCUSS][docker] Adopt Jemalloc as default memory allocator for debian based Flink docker image

and suggest @Yun to conclude the discussion directly if there are > no objections. > > Thanks. > > Best Regards, > Yu > > > On Fri, 16 Oct 2020 at 23:16, Till Rohrmann wrote: > > > +1 for making it configurable in the same Docker image. > > > > Cheer

Re: [REMINDER] Please only merge pull requests when CI is green and help keep our CI stable

Thanks for the reminder Robert. I think you are completely right. Since we are getting closer to the feature freeze and therefore also the testing period, having green builds and only merging PRs where we are sure that CI passes will decrease the likelihood of introducing new bugs and, hence, it

Re: [DISCUSS][docker] Adopt Jemalloc as default memory allocator for debian based Flink docker image

+1 for making it configurable in the same Docker image. Cheers, Till On Fri, Oct 16, 2020 at 12:56 PM Chesnay Schepler wrote: > If it is possible to support both allocators in a single image then we > should definitely go with that option. > > On 10/16/2020 12:21 PM, Yun Tang wrote: > > Thanks

Re: [DISCUSS] FLIP-148: Introduce Sort-Merge Based Blocking Shuffle to Flink

aImLyFafqncmA7l3Zowb8vovv6Dy9VhO3TlAtjNqoV-W > >eet > the needs of most users. > > Best, > Yingjie > > Till Rohrmann 于2020年10月15日周四 下午3:57写道： > > > Hi Yingjie, > > > > thanks for proposing the sort-merge based blocking shuffle. I like the > > proposal an

Re: [DISCUSS] FLIP-148: Introduce Sort-Merge Based Blocking Shuffle to Flink

Hi Yingjie, thanks for proposing the sort-merge based blocking shuffle. I like the proposal and it does not seem to change the internals of Flink. Instead it is an extension of existing interfaces which makes it a non-invasive addition. Do you have any numbers comparing the performance of the

Re: [DISCUSS] FLIP-147: Support Checkpoints After Tasks Finished

Thanks for starting this discussion Yun Gao, I have three comments/questions: 1) When restarting all tasks independent of the status at checkpoint time (finished, running, scheduled), we might allocate more resources than we actually need to run the remaining job. From a scheduling perspective

[jira] [Created] (FLINK-19556) YarnResourceManagerDriver.getPendingRequestsAndCheckConsistency only returns container requests for first matching equivalent resource

Till Rohrmann created FLINK-19556: - Summary: YarnResourceManagerDriver.getPendingRequestsAndCheckConsistency only returns container requests for first matching equivalent resource Key: FLINK-19556 URL: https

[jira] [Created] (FLINK-19555) Remove runAsyncWithoutFencing from MesosResourceManager

Till Rohrmann created FLINK-19555: - Summary: Remove runAsyncWithoutFencing from MesosResourceManager Key: FLINK-19555 URL: https://issues.apache.org/jira/browse/FLINK-19555 Project: Flink

Re: autoCommit for postgres jdbc streaming in Table/SQL API

tests and documentation updated. > > > > Dylan > > > > *From: *Dylan Forciea > *Date: *Wednesday, October 7, 2020 at 11:47 AM > *To: *Till Rohrmann , dev > *Cc: *Shengkai Fang , "u...@flink.apache.org" < > u...@flink.apache.org>, "j...@

Re: autoCommit for postgres jdbc streaming in Table/SQL API

Hi Dylan, thanks for reaching out to the Flink community and excuse our late response. I am not an expert for the Table API and its JDBC connector but what you describe sounds like a missing feature. Also given that FLINK-12198 enabled this feature for the JDBCInputFormat indicates that we might

Re: IllegalStateException from incompatible state type - better exception type?

Hi Hwanju, thanks for starting this discussion. I pretty much like the idea to be able to distinguish between user code faults and framework faults. This also helps in deciding on the recovery action to take. Hence, I would be +1 for using certain exceptions consistently in order to indicate the

Re: [ANNOUNCE] Apache flink-shaded 12.0 released

Thanks for being our release manager Robert and thanks to everyone who contributed to the flink-shaded 12.0 release! Cheers, Till On Tue, Oct 6, 2020 at 2:59 PM Robert Metzger wrote: > Hi all! > > The Apache Flink community is very happy to announce the release of Apache > Flink-shaded 12.0 >

Re: Dynamic Scaling: State Sharding

Hi Mazen, Flink does not support automatic scaling yet. Hence, the recommended way is to monitor a Flink job and to trigger rescaling by stopping the job with a savepoint and then to resume it with the adjusted parallelism. The community is working on auto scaling but there is no concrete date

Re: [ANNOUNCE] New PMC member: Zhu Zhu

Congrats and welcome Zhu Zhu! Cheers, Till On Mon, Oct 5, 2020 at 7:32 AM Robert Metzger wrote: > Hi all! > > I'm very happy to announce that Zhu Zhu has joined the Flink PMC! > > Zhu is helping the community a lot with creating and validating releases, > contributing to FLIP discussions and

Re: [VOTE] FLIP-144: Native Kubernetes HA for Flink

+1 (binding) Cheers, Till On Fri, Oct 2, 2020 at 3:13 AM Yang Wang wrote: > Hi, all > > > After the discussion in [1], I would like to open a voting thread for > FLIP-144 [2], > which proposes to add a new native Kubernetes HA service. > > > The vote will be open until October 6th (72h +

Re: [DISCUSS] FLIP-144: Native Kubernetes HA for Flink

run-application/force-delete-stateful-set-pod/#force-deletion > > > Best, > Yang > > Till Rohrmann 于2020年9月30日周三 下午11:57写道： > >> Thanks for the clarifications Yang Wang. >> >> 2. Keeping the HA information relevant for a component (Dispatcher, >> JobManager,

Re: [DISCUSS] FLIP-144: Native Kubernetes HA for Flink

三 下午3:57写道： > >> Thanks till and tison for your comments. >> >> @Till Rohrmann >> 1. I am afraid we could not do this if we are going to use fabric8 >> Kubernetes client SDK for the leader election. The official Kubernetes Java >> client[1] also could not su

Re: [DISCUSS] Release flink-shaded 12.0

Thanks for volunteering as our release manager Robert! Cheers, Till On Tue, Sep 29, 2020 at 7:36 PM Robert Metzger wrote: > It seems that we have consensus to create a flink-shaded release. > > I'll soon propose a RC. > > On Fri, Sep 25, 2020 at 9:11 AM Konstantin Knauf > wrote: > > > +1 > >

Re: [VOTE] FLIP-142: Disentangle StateBackends from Checkpointing

+1 (binding) Cheers, Till On Tue, Sep 29, 2020 at 5:04 PM Kostas Kloudas wrote: > +1 (binding) > > Kostas > > On Tue, Sep 29, 2020 at 4:57 PM Yu Li wrote: > > > > +1 (binding) > > > > Thanks all for the patience of answering / addressing my questions in the > > discussion thread. > > > > Best

Re: [DISCUSS] FLIP-144: Native Kubernetes HA for Flink

e functionality of StatefulSet > proposal, that's why I prefer the former. > > > [1]. > https://github.com/fabric8io/kubernetes-client/blob/6d83d41d50941bf8f2d4e0c859951eb10f617df6/kubernetes-client/src/main/java/io/fabric8/kubernetes/client/extended/leaderelection/LeaderElector.java#L70

Re: [DISCUSS] FLIP-144: Native Kubernetes HA for Flink

Thanks for creating this FLIP Yang Wang. I believe that many of our users will like a ZooKeeper-less HA setup. +1 for not separating the leader information and the leader election if possible. Maybe it is even possible that the contender writes his leader information directly when trying to

Re: [DISCUSS] Releasing Flink 1.11.2

ou, Brian 于2020年9月3日周四 上午11:21写道： > >> > >>> Hi, > >>> > >>> Thanks Becket for addressing the issue. FLINK-18641 is now a blocker > for > >>> Pravega connector integration, hope we can have it included in 1.11.2 > >>> release

[VOTE] FLIP-138: Declarative Resource Management

Hi devs, I'd like to start a voting thread on FLIP-138 [1], which proposes to make the slot protocol declarative. The proposal has been discussed in [2]. The vote will be open for at least 72h + weekends. Hence, it can be closed on September 9, unless there is an objection or not enough votes.

Re: [DISCUSS] FLIP-138: Declarative Resource management

a vote for this FLIP soon. Cheers, Till On Mon, Aug 31, 2020 at 11:53 AM Zhu Zhu wrote: > Thanks for the clarification @Till Rohrmann > > >> # Implications for the scheduling > Agreed that it turned out to be different execution strategies for batch > jobs. > We can

Re: [VOTE] FLIP-141: Intra-Slot Managed Memory Sharing

Hi Xintong, thanks for starting the vote. +1 for the proposal given that we find a proper name for the different memory consumers (specifically the batch/RocksDB consumer) and their corresponding weights. Cheers, Till On Thu, Sep 3, 2020 at 12:43 PM Xintong Song wrote: > Hi devs, > > I'd

Re: [DISCUSS] FLIP-141: Intra-Slot Managed Memory Sharing

ze') separately, > > > >> which > > > >>>> practically means any combination of rocksdb and python memory > > sizes. > > > >> If > > > >>> we > > > >>>> switch to non-configurable weights, that will be a regre

Re: [DISCUSS] Releasing Flink 1.11.2

Thanks a lot for starting this discussion Zhu Zhu and for volunteering as the release manager. Big +1 for creating the next 1.11 bug fix release. I think we already collected quite a bit of fixes which our users will benefit from. For the pending fixes, I would suggest setting a soft deadline

Re: [DISCUSS] FLIP-141: Intra-Slot Managed Memory Sharing

Thanks for creating this FLIP Xintong. I agree with the previous comments that the memory configuration should be as easy as possible. Every new knob has the potential to confuse users and/or allows him to shoot himself in the foot. Consequently, I am +1 for the first proposal in the FLIP since

Re: Flink Speedcenter worker machine replaced

Thanks for letting the community know Roman! Cheers, Till On Tue, Sep 1, 2020 at 10:57 AM Khachatryan Roman < khachatryan.ro...@gmail.com> wrote: > Hello, > > Yesterday the machine executing Flink benchmarks was replaced due to > hardware problems. > The HW configuration is different, so the

Re: [DISCUSS] FLIP-138: Declarative Resource management

Thanks for creating this FLIP @Chesnay and the good input @Xintong and @Zhu Zhu. Let me try to add some comments concerning your questions: # FLIP-56 I think there is nothing fundamentally contradicting FLIP-56 in the FLIP for declarative resource management. As Chesnay said, we have to keep

Re: [ANNOUNCE] New PMC member: Dian Fu

Congrats, Dian! Cheers, Till On Fri, Aug 28, 2020 at 8:33 AM Wei Zhong wrote: > Congratulations Dian! > > > 在 2020年8月28日，14:29，Jingsong Li 写道： > > > > Congratulations , Dian! > > > > Best, Jingsong > > > > On Fri, Aug 28, 2020 at 11:06 AM Walter Peng > wrote: > >

Re: [ANNOUNCE] Introducing the GSoD 2020 Participants.

Welcome Muhammad and Kartik! Thanks a lot for helping us with improving Flink's documentation. Cheers, Till On Wed, Aug 26, 2020 at 7:32 PM Konstantin Knauf wrote: > Welcome Kartik & Muhammad! Looking very much forward to your contributions > :) > > On Wed, Aug 26, 2020 at 5:52 PM Kartik Khare

Re: [ANNOUNCE] Apache Flink 1.10.2 released

Great news. Thanks a lot for being our release manager Zhu Zhu and to all others who have contributed to the release! Cheers, Till On Tue, Aug 25, 2020 at 5:37 AM Zhu Zhu wrote: > The Apache Flink community is very happy to announce the release of > Apache Flink 1.10.2, which is the first

Re: How jobmanager and task manager communicates with each other ?

Hi Sidhant, the cluster components use tcp to communicate with each other. If you are not using Flink's HA services, then the TaskManager nodes need to be configured with the JobManager's address to connect to them. If you are using HA services, then the service discovery happens through the HA

Re: OutOfMemoryError: Metaspace on Batch Task When Write into Clickhouse

The heap dump did not show anything too suspicious. The only thing I noticed is that there are 13 ChildFirstClassLoaders whereas there are only 6 Task instances in the heap dump. Are you running all 13 tasks on the same TaskExecutor? Cheers, Till On Mon, Aug 24, 2020 at 2:01 PM Till Rohrmann

Re: OutOfMemoryError: Metaspace on Batch Task When Write into Clickhouse

, 2020 at 1:49 PM Till Rohrmann wrote: > Hi, > > could you share with us the Flink cluster logs? This would help answering > a lot of questions around your setup and the Flink version you are using. > Thanks a lot! > > Cheers, > Till > > On Mon, Aug 24, 2020 at 1

Re: OutOfMemoryError: Metaspace on Batch Task When Write into Clickhouse

Hi, could you share with us the Flink cluster logs? This would help answering a lot of questions around your setup and the Flink version you are using. Thanks a lot! Cheers, Till On Mon, Aug 24, 2020 at 10:48 AM 耿延杰 wrote: > Still failed after every 12 tasks. > And the exception stack of

Re: OutOfMemoryError: Metaspace on Batch Task When Write into Clickhouse

Hi, thanks for reaching out to the community. Could you share a bit more details about the cluster setup (session cluster, per-job cluster deployment), Flink version and maybe also share the logs with us? Sharing your user code and the libraries you are using can also be helpful in figuring out

Re: [VOTE] Release 1.10.2, release candidate #2

+1 (binding) - verified checksums and signatures - verified that dependency changes are reflected in NOTICE/LICENSE files - built Flink with Scala 2.12 support from sources - Started cluster and ran example jobs, no suspicious log output Cheers, Till On Mon, Aug 17, 2020 at 4:21 PM Jeff Zhang

Re: Re: [DISCUSS] Removing deprecated methods from DataStream API

Having looked at the proposed set of methods to remove I've noticed that some of them are actually annotated with @Public. According to our stability guarantees, only major releases (1.0, 2.0, etc.) can break APIs with this annotation. Hence, I believe that we cannot simply remove them unless the

Re: [DISCUSS] Planning Flink 1.12

Hi Rodrigo, FLINK-10407 has not been up to date with the actual progress on the feature. We will update it soon. I think that the community won't actively work on FLINK-12002 in this release. However, we will work on FLINK-16430 [1] and once this is done continue with the clean up of the legacy

Re: [VOTE] Release 1.10.2, release candidate #1

FLINK-18902 and FLINK-18646 have been merged into the release-1.10 branch. >From my side you are good to go to create the next RC now. Cheers, Till On Wed, Aug 12, 2020 at 7:03 PM Zhu Zhu wrote: > Thank you all for the efforts verifying the RC. And thanks @Till Rohrmann > for the in

[jira] [Created] (FLINK-18935) CompletedOperationCache accepts new operations after closeAsync has been called

Till Rohrmann created FLINK-18935: - Summary: CompletedOperationCache accepts new operations after closeAsync has been called Key: FLINK-18935 URL: https://issues.apache.org/jira/browse/FLINK-18935

Re: [VOTE] Release 1.10.2, release candidate #1

I've opened a PR for FLINK-18902 [1]. [1] https://github.com/apache/flink/pull/13131 Cheers, Till On Wed, Aug 12, 2020 at 3:02 PM Till Rohrmann wrote: > Another problem occurred recently [1]. I think we need to fix this problem > before releasing Flink 1.10.2. I will work on it. > &g

Re: [VOTE] Release 1.10.2, release candidate #1

Another problem occurred recently [1]. I think we need to fix this problem before releasing Flink 1.10.2. I will work on it. [1] https://issues.apache.org/jira/browse/FLINK-18902 Cheers, Till On Wed, Aug 12, 2020 at 2:35 PM Till Rohrmann wrote: > -1 (binding), see below for the explanat

Re: [DISCUSS] Retrieve savepoint location after suspension of jobclusters

Thanks for the logs Fabian. It is indeed a problem we introduced recently. I've created a JIRA issue to fix the problem [1]. This fix will also be included in the Flink 1.10.2 release. [1] https://issues.apache.org/jira/browse/FLINK-18902 Cheers, Till On Wed, Aug 12, 2020 at 2:30 PM Fabian Paul

[jira] [Created] (FLINK-18902) Cannot serve results of asynchronous REST operations in per-job mode

Till Rohrmann created FLINK-18902: - Summary: Cannot serve results of asynchronous REST operations in per-job mode Key: FLINK-18902 URL: https://issues.apache.org/jira/browse/FLINK-18902 Project

Re: [VOTE] Release 1.10.2, release candidate #1

-1 (binding), see below for the explanation. - verified checksums and signatures - verified that dependency changes are reflected in NOTICE/LICENSE files - built Flink with Scala 2.12 support from sources - Started cluster and ran example jobs, no suspicious log output I noticed that Flink

Re: [ANNOUNCE] New Flink Committer: David Anderson

Congratulations, David! Cheers, Till On Wed, Aug 12, 2020 at 9:57 AM Dian Fu wrote: > Congrats David! > > Regards, > Dian > > > 在 2020年8月12日，下午3:50，Robert Metzger 写道： > > > > Hi everyone, > > > > On behalf of the PMC, I'm very happy to announce David Anderson as a new > > Apache > > Flink

Re: [DISCUSS] Retrieve savepoint location after suspension of jobclusters

This sounds like a bug in Flink. Could you share the logs of the cluster (ideally with TRACE log level) with us? Cheers, Till On Tue, Aug 11, 2020 at 9:49 AM Fabian Paul wrote: > Hi Till, > > The problem is reproducible with a basic shell script doing the following > operations. > > 1. Post

Re: Flink cluster deployment strategy

Hi Sidhant, I am not an expert on AWS services but I believe that EMR might be a bit easier to start with since AWS EMR comes with Flink support out of the box [1]. On ECS I believe that you would have to set up the containers yourself. Another interesting deployment option could be to use

Re: [DISCUSS] Retrieve savepoint location after suspension of jobclusters

Hi Fabian, could explain a bit how you are cancelling a job with savepoint and then try to retrieve the savepoint path? When running Flink in per-job mode, the system should not shut down if you have an asynchronous operation running whose result you have not yet queried. I believe that this

Re: Adding a new "Docker Images" component to Jira

+1 for unifying Deployment / Docker, Dockerfiles and Release System / Docker into Docker. Cheers, Till On Fri, Aug 7, 2020 at 12:18 PM Robert Metzger wrote: > Hi all, > > we now have 3 components containing the word "docker": > - Deployment / Docker > < >

Re: [DISCUSS] Releasing Flink 1.10.2

Thanks for kicking this discussion off Zhu Zhu. +1 for the 1.10.2 release. Also thanks for volunteering as the release manager! Cheers, Till On Thu, Aug 6, 2020 at 1:26 PM Zhu Zhu wrote: > Hi All, > > It has been more than 2 months since we released Flink 1.10.1. We already > have more than 60

[jira] [Created] (FLINK-18832) BoundedBlockingSubpartition does not work with StreamTask

Till Rohrmann created FLINK-18832: - Summary: BoundedBlockingSubpartition does not work with StreamTask Key: FLINK-18832 URL: https://issues.apache.org/jira/browse/FLINK-18832 Project: Flink

Re: [DISCUSS] Planning Flink 1.12

> > feature request the community is well-aware of. Till has posted > > > > "Reactive-scaling mode" as a feature he's working on for the 1.12 > > > release. > > > > This work will introduce the basic building blocks and partial > support > > > for

Re: Error with Flink-Gelly, lastJobExecutionResult is null

Hi Xia Rui, thanks for reporting this issue. I think FLINK-15116 [1] caused the regression. The problem is indeed that we no longer set the lastJobExecutionResult when using the ContextEnvironment. The problem has not surfaced since with other ExecutionEnvironments, we still set the field

Re: [DISCUSS] StreamingFileSink: parallelizing active buckets checkpointing?

Hi Paul, looking briefly at the code, it should be possible to execute the snapshot procedure for every Bucket in snapshotActiveBuckets in parallel and to wait for the result in the very same method. I've also pulled in Klou who implemented this feature and who might give a more profound

[jira] [Created] (FLINK-18783) Load AkkaRpcService through separate class loader

Till Rohrmann created FLINK-18783: - Summary: Load AkkaRpcService through separate class loader Key: FLINK-18783 URL: https://issues.apache.org/jira/browse/FLINK-18783 Project: Flink Issue

Re: [DISCUSS] FLIP-131: Consolidate the user-facing Dataflow SDKs/APIs (and deprecate the DataSet API)

+1 for this effort. Great to see that we are making progress towards our goal of a truly unified batch and stream processing engine. Cheers, Till On Thu, Jul 30, 2020 at 2:28 PM Kurt Young wrote: > +1, looking forward to the follow up FLIPs. > > Best, > Kurt > > > On Thu, Jul 30, 2020 at 6:40

[jira] [Created] (FLINK-18772) Hide submit job web ui elements when running in per-job/application mode

Till Rohrmann created FLINK-18772: - Summary: Hide submit job web ui elements when running in per-job/application mode Key: FLINK-18772 URL: https://issues.apache.org/jira/browse/FLINK-18772 Project

[jira] [Created] (FLINK-18710) ResourceProfileInfo is not serializable

Till Rohrmann created FLINK-18710: - Summary: ResourceProfileInfo is not serializable Key: FLINK-18710 URL: https://issues.apache.org/jira/browse/FLINK-18710 Project: Flink Issue Type: Bug

Re: [DISCUSS] Planning Flink 1.12

Thanks for being our release managers for the 1.12 release Dian & Robert! Here are some features I would like to work on for this release: # Features ## Finishing pipelined region scheduling ( https://issues.apache.org/jira/browse/FLINK-16430) With the pipelined region scheduler we want to

[jira] [Created] (FLINK-18677) ZooKeeperLeaderRetrievalService does not invalidate leader in case of SUSPENDED connection

Till Rohrmann created FLINK-18677: - Summary: ZooKeeperLeaderRetrievalService does not invalidate leader in case of SUSPENDED connection Key: FLINK-18677 URL: https://issues.apache.org/jira/browse/FLINK-18677

Re: [ANNOUNCE] Apache Flink 1.11.1 released

Thanks for being the release manager for the 1.11.1 release, Dian. Thanks a lot to everyone who contributed to this release. Cheers, Till On Wed, Jul 22, 2020 at 11:38 AM Hequn Cheng wrote: > Thanks Dian for the great work and thanks to everyone who makes this > release possible! > > Best,

Re: [REMINDER] Use 'starter' labels for Jira issues where it makes sense

Thanks for the reminder Andrey. This is important for helping new contributors to find their way around in the Flink project. Cheers, Till On Mon, Jul 20, 2020 at 5:30 PM Aljoscha Krettek wrote: > Yes, thanks Andrey! That's a good reminder for everyone. :-) > > On 20.07.20 16:02, Andrey

Re: [ANNOUNCE] New PMC member: Piotr Nowojski

Congrats, Piotr! Cheers, Till On Thu, Jul 9, 2020 at 4:15 AM Xingcan Cui wrote: > Congratulations, Piotr! > > Best, Xingcan > > On Wed, Jul 8, 2020, 21:53 Yang Wang wrote: > > > Congratulations Piotr! > > > > > > Best, > > Yang > > > > Dan Zou 于2020年7月8日周三 下午10:36写道： > > > > >

Re: [ANNOUNCE] Apache Flink 1.11.0 released

Thanks a lot for being our release managers Zhijiang and Piotr and thanks to everyone who helped making this release possible. Cheers, Till On Wed, Jul 8, 2020 at 10:59 AM godfrey he wrote: > Congratulations! > > Thanks Zhijiang and Piotr for the great work, and thanks everyone for > their

Re: [VOTE] Release 1.11.0, release candidate #4

; > Subject:Re: [VOTE] Release 1.11.0, release candidate #4 > > > > Hi Till, > > > > Yes, we don't have the setting in flink-conf.yaml. > > > > Generally, we carry forward the existing configuration and any change to > > default configuration values wou

Re: [VOTE] Release 1.11.0, release candidate #4

I've opened a PR for fixing the NOTICE file problems [1]. [1] https://github.com/apache/flink/pull/12811 Cheers, Till On Thu, Jul 2, 2020 at 6:23 PM Till Rohrmann wrote: > - verified checksums and signature > - built Flink from source release with Scala 2.12 > - Executed some exa

Re: [VOTE] Release 1.11.0, release candidate #4

gt;> > > > >>> > > Thanks for the efficient feedback. > >>> > > > >>> > > Regarding the suggestion of adding the release notes document, I > >> agree > >>> > > with your point. Maybe we should adjust

Re: [VOTE] Release 1.11.0, release candidate #4

ry forward the existing configuration and any change > to > > > default configuration values would impact the upgrade. > > > > > > Yes, since it is an incompatible change I would state it in the release > > > notes. > > > > > > Thanks, >

Re: [VOTE] Release 1.11.0, release candidate #4

Hi Thomas, just to confirm: When starting the image in local mode, then you don't have any of the JobManager memory configuration settings configured in the effective flink-conf.yaml, right? Does this mean that you have explicitly removed `jobmanager.heap.size: 1024m` from the default

Re: [ANNOUNCE] Apache Flink 1.11.0, release candidate #2

Thanks for testing the RC and the feedback Thomas. The problem with the taskmanager options is that the old (taskmanager.initial-registration-pause) and new options (cluster.registration.initial-timeout) don't have the same type. The old options have not been used for a long time (since version

[jira] [Created] (FLINK-18426) Incompatible deprecated key type for registration cluster options

Till Rohrmann created FLINK-18426: - Summary: Incompatible deprecated key type for registration cluster options Key: FLINK-18426 URL: https://issues.apache.org/jira/browse/FLINK-18426 Project: Flink

[jira] [Created] (FLINK-18407) NPE in SlotPoolImpl.maybeRemapOrphanedAllocation if no pending request is registered

Till Rohrmann created FLINK-18407: - Summary: NPE in SlotPoolImpl.maybeRemapOrphanedAllocation if no pending request is registered Key: FLINK-18407 URL: https://issues.apache.org/jira/browse/FLINK-18407

[jira] [Created] (FLINK-18406) Annotate DualKeyLinkedMap with @Nullable annotation

Till Rohrmann created FLINK-18406: - Summary: Annotate DualKeyLinkedMap with @Nullable annotation Key: FLINK-18406 URL: https://issues.apache.org/jira/browse/FLINK-18406 Project: Flink Issue

Re: Any good comparison on FSM of Flink vs Akka?

Hi Rohit, image attachments are filtered out and not visible to others. Hence, I would suggest that you upload the image and then share the link. Maybe you can share a bit more details about the use case and your current analysis of the problem. Cheers, Till On Wed, Jun 17, 2020 at 12:15 PM

Re: [ANNOUNCE] Yu Li is now part of the Flink PMC

Congratulations Yu! Cheers, Till On Wed, Jun 17, 2020 at 7:53 AM Jingsong Li wrote: > Congratulations Yu, well deserved! > > Best, > Jingsong > > On Wed, Jun 17, 2020 at 1:42 PM Yuan Mei wrote: > >> Congrats, Yu! >> >> GXGX & well deserved!! >> >> Best Regards, >> >> Yuan >> >> On Wed, Jun

Re: Rest handler redirect problem

Thanks for reporting this issue Lucent. One way to solve it would be to reintroduce the RedirectHandler and allow the user to choose between forwarding to the leader as it is right now in Flink 1.10 and using redirects as it was the case in the past. If I remember correctly, then redirects also

Re: Flink 1.10 with GCS for checkpoints

Hi Ramya, it looks as if Flink cannot find the Hadoop dependencies. Could you make sure that you start Flink with HADOOP_CLASSPATH defined or pointing it to the Hadoop conf directory via HADOOP_CONF_DIR. See this link [1] for more information on how to add Hadoop support. [1]

[jira] [Created] (FLINK-18293) TaskExecutor offering non empty slots can lead to resource violation

Till Rohrmann created FLINK-18293: - Summary: TaskExecutor offering non empty slots can lead to resource violation Key: FLINK-18293 URL: https://issues.apache.org/jira/browse/FLINK-18293 Project

Re: Moving in and Modify Dependency Source

Hi Austin, usually if source code is multi licensed then this means that the user can choose the license under which he wants it to use. In our case it would be the Apache License version 2. But you should check the license text to make sure that this has not been forbidden explicitly. When

Re: Flink on Kubes -- issues

Hi Ramya, it looks as if you should give your Flink pods and also the Flink process a bit more memory as the process fails with an out of memory error. You could also try Flink's latest version which comes with native Kubernetes support. Cheers, Till On Tue, Jun 9, 2020 at 8:45 AM Ramya

Re: [ANNOUNCE] New Flink Committer: Benchao Li

Congratulations! Cheers, Till On Tue, Jun 9, 2020 at 11:19 AM Yang Wang wrote: > Congratulations! > > Best, > Yang > > Yu Li 于2020年6月9日周二 下午5:11写道： > > > Congratulations, Benchao! > > > > Best Regards, > > Yu > > > > > > On Tue, 9 Jun 2020 at 17:05, Yuan Mei wrote: > > > > > Congrats! > > >

Re: [ANNOUNCE] New Apache Flink Committer - Xintong Song

Congratulations! Cheers, Till On Fri, Jun 5, 2020 at 10:00 AM Dawid Wysakowicz wrote: > Congratulations! > > Best, > > Dawid > > On 05/06/2020 09:10, tison wrote: > > Congrats, Xintong! > > > > Best, > > tison. > > > > > > Jark Wu 于2020年6月5日周五 下午3:00写道： > > > >> Congratulations Xintong! > >>

[jira] [Created] (FLINK-18129) Unhandled exception stack trace from DispatcherRestEndpoint when deploying Kubernetes session cluster

Till Rohrmann created FLINK-18129: - Summary: Unhandled exception stack trace from DispatcherRestEndpoint when deploying Kubernetes session cluster Key: FLINK-18129 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Created] (FLINK-18121) Support creating Docker image from local Flink distribution

Till Rohrmann created FLINK-18121: - Summary: Support creating Docker image from local Flink distribution Key: FLINK-18121 URL: https://issues.apache.org/jira/browse/FLINK-18121 Project: Flink

Re: [ANNOUNCE] Apache Flink-shaded 11.0 released

Thanks for creating the latest flink-shaded release Chesnay! Cheers, Till On Sun, May 31, 2020 at 1:25 PM Chesnay Schepler wrote: > The Apache Flink community is very happy to announce the release of > Apache Flink-shaded 11.0. > > The flink-shaded project contains a number of shaded

<    3   4   5   6   7   8   9   10   11   12   >