flink-s3-fs-hadoop retry configuration

2020-05-01 Thread Jeff Henrikson
Hello Flink users, I could use help with three related questions: 1) How can I observe retries in the flink-s3-fs-hadoop connector? 2) How can I tell if flink-s3-fs-hadoop is actually managing to pick up the hadoop configuration I have provided, as opposed to some separate default

RE: History Server Not Showing Any Jobs - File Not Found?

2020-05-01 Thread Hailu, Andreas
Hi Chesnay, yes - they were created using Flink 1.9.1 as we've only just started to archive them in the past couple weeks. Could you clarify on how you want to try local filesystem archives? As in changing jobmanager.archive.fs.dir and historyserver.web.tmpdir to the same local directory? //

Benchmark for Stateful Functions

2020-05-01 Thread Omid Bakhshandeh
Hi, I was wondering if there is any place that has information about Stateful Functions performance (e.g. throughput, delay of messaging)? Best, -- --- Omid

Re: upgrade flink from 1.9.1 to 1.10.0 on EMR

2020-05-01 Thread aj
Hi Yang, I am attaching the logs for your reference, please help me what i am doing wrong. Thanks, Anuj On Wed, Apr 29, 2020 at 9:06 AM Yang Wang wrote: > Hi Anuj, > > I think the exception you come across still because the hadoop version > is 2.4.1. I have checked the hadoop code, the code

Flink: For terabytes of keyed state.

2020-05-01 Thread Gowri Sundaram
Hello all, We have read in multiple sources that Flink has been used for use cases with terabytes of application state. We are considering using Flink for a similar use case

flink sql 处理时间 时区问题

2020-05-01 Thread hb
``` 代码 val env = StreamExecutionEnvironment.getExecutionEnvironment val settings: EnvironmentSettings = EnvironmentSettings.newInstance().useBlinkPlanner().inStreamingMode().build() val tEnv: StreamTableEnvironment = StreamTableEnvironment.create(env, settings) val t2 =

How to list timers registered in timer service?

2020-05-01 Thread Lasse Nedergaard
Hi. I have a case where I want to have one timer for each key. I can see my state is slowly growing for this operator and as my key is more or less constant so I want to investigate what happens. I looked at state processor api but I can’t see any functionality to read the timers registered