Re: Which mode to choose flink on Yarn.

That mainly depends on how much parallelism of your job. The main bottleneck of job manager usually because it is busy to handle rpc requests and gc. At most time you can set larger jm memory to address it by pass `-jm 4096` to `yarn-session.sh start`. Best, tison. weilongxing 于2018年9月20日周四 下午

Re: Which mode to choose flink on Yarn.

Hi weilong, As vino said, the main advantage of per job mode is that it provides job-level isolation, and that of session mode is that it set up a persistent session and accept job, which means the overhead of resource request/setup would loose. In addition, per job mode calculate resource that th

Re: Question about akka configuration for FLIP-6

Hi Gray, Thanks for your useful information! Here I wonder if the following configs still valid on FLIP-6 mode. 1. akka.transport.heartbeat.interval 2. akka.transport.heartbeat.pause It seems they are different from HeartbeatServices and possibly still valid. Best, tison. Gary Yao 于2018年9月10

Re: How to customize schedule mode and result partition type?

Sorry to attach this message here, but if someone see this email please reply an ack. Without any reply I wonder if this email has been received by someone in the mail list. Best, tison.

How to customize schedule mode and result partition type?

Hi all, Here I prefer to forcing a task running in LAZY_FROM_SOURCE schedule mode with all ResultPartitionType be BLOCKING. But I cannot find options to config that in StreamExecutionEnvironment, thus using below as a workaround, quite triky. inal StreamExecutionEnvironment env = StreamExecution

Re: Setting Flink Monitoring API Port on YARN Cluster

Hi Austin, `rest.port` is the latest config option to configure "The port that the server listens on / the client connects to.", with deprecated key `web.port` which is with deprecated key `jobmanager.web.port`, so it is enough to config `rest.port` only (at least for 1.6). However, in your case t

How to simulate a blocking (sink) node?

Hi all, Recently I want to write a test in a batch case that some of tasks are FINISHED. I try to write a finite SourceFunction and a (expected) blocking SinkFunction. But the job FINISHED. This surprises me. Why could the Sink FINISHED in such a case? The job and log are attached. Best, tison.

Does Flink plan to support JDK 9 recently?

Hi, Recently I see a PR mentions "for jdk9 compatibility", and I wonder if Flink considered to support JDK9 recently? If so, what is the plan? Best, tison.

Re: Why is flink master bump version to 1.7?

>> I guess this was a mistake that will be fixed soon. Till (in CC) forked >> off the release-1.6 branch yesterday? >> >> Regards, >> Timo >> >> Am 17.07.18 um 04:00 schrieb 陈梓立: >> >> Hi, >> >> I see no 1.6 branch or tag. What's the reason we skip 1.6 and now >> 1.7-SNAPSHOT? or there is a 1.6 I miss. >> >> Best, >> tison >> >> >> >>

Why is flink master bump version to 1.7?

Hi, I see no 1.6 branch or tag. What's the reason we skip 1.6 and now 1.7-SNAPSHOT? or there is a 1.6 I miss. Best, tison

Why FoldFunction deprecated?

I just write a code snip like ``` .fold(new Tuple2<>("", 0L), new FoldFunction>() { @Override public Tuple2 fold(Tuple2 acc, WikipediaEditEvent event) { acc.f0 = event.getUser(); acc.f1 += event.getByteDiff();

A trivial update on README

Hi guys, Recently I push a PR on apache/flink repo(https://github.com/ apache/flink/pull/5924), it's about a trivial update on README.md, raising once I surprisingly failed to build using Java 9. It is good that someone just tell me that it is meaningless so that I could close it, but no replies,