Re: Timeout when using RockDB to handle large state in a stream app

2020-07-11 Thread Congxian Qiu
jects/flink/flink-docs-stable/ops/config.html#taskmanager-memory-managed-fraction > > [3] > https://ci.apache.org/projects/flink/flink-docs-stable/ops/config.html#taskmanager-memory-managed-size > > > > Best, > > Yun Tang > > > > > > > > __________

Re: Timeout when using RockDB to handle large state in a stream app

2020-07-07 Thread Felipe Gutierrez
t; [3] > https://ci.apache.org/projects/flink/flink-docs-stable/ops/config.html#taskmanager-memory-managed-size > > Best, > Yun Tang > > > > > From: Felipe Gutierrez > Sent: Monday, July 6, 2020 19:17 > To: Yun Tang > Cc: Ori Po

Re: Timeout when using RockDB to handle large state in a stream app

2020-07-07 Thread Yun Tang
From: Felipe Gutierrez Sent: Monday, July 6, 2020 19:17 To: Yun Tang Cc: Ori Popowski ; user Subject: Re: Timeout when using RockDB to handle large state in a stream app Hi all, I tested the two TPC-H query 03 [1] and 10 [2] using Datastream API on the cluster

Re: Timeout when using RockDB to handle large state in a stream app

2020-07-06 Thread Felipe Gutierrez
> Best > > Yun Tang > > > > From: Felipe Gutierrez > > Sent: Tuesday, June 30, 2020 17:46 > > To: Yun Tang > > Cc: Ori Popowski ; user > > Subject: Re: Timeout when using RockDB to handle large state in a stream app >

Re: Timeout when using RockDB to handle large state in a stream app

2020-07-03 Thread Felipe Gutierrez
__ > From: Felipe Gutierrez > Sent: Tuesday, June 30, 2020 17:46 > To: Yun Tang > Cc: Ori Popowski ; user > Subject: Re: Timeout when using RockDB to handle large state in a stream app > > Hi, > > I reduced the size of the tables that I am loading on a L

Re: Timeout when using RockDB to handle large state in a stream app

2020-07-03 Thread Yun Tang
From: Felipe Gutierrez Sent: Tuesday, June 30, 2020 17:46 To: Yun Tang Cc: Ori Popowski ; user Subject: Re: Timeout when using RockDB to handle large state in a stream app Hi, I reduced the size of the tables that I am loading on a ListState and the query worked. One

Re: Timeout when using RockDB to handle large state in a stream app

2020-06-30 Thread Felipe Gutierrez
see > anything weird. > > [1] > https://ci.apache.org/projects/flink/flink-docs-stable/ops/config.html#heartbeat-timeout > > Best > Yun Tang > > > From: Ori Popowski > Sent: Monday, June 29, 2020 17:44 > Cc: user > Subject

Re: Timeout when using RockDB to handle large state in a stream app

2020-06-30 Thread Yun Tang
Popowski Sent: Monday, June 29, 2020 17:44 Cc: user Subject: Re: Timeout when using RockDB to handle large state in a stream app Hi there, I'm currently experiencing the exact same issue. http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Heartbeat-of-TaskManager-timed-out

Re: Timeout when using RockDB to handle large state in a stream app

2020-06-29 Thread Ori Popowski
Hi there, I'm currently experiencing the exact same issue. http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Heartbeat-of-TaskManager-timed-out-td36228.html I've found out that GC is causing the problem, but I still haven't managed to solve this. On Mon, Jun 29, 2020 at

Timeout when using RockDB to handle large state in a stream app

2020-06-29 Thread Felipe Gutierrez
Hi community, I am trying to run a stream application with large state in a standalone flink cluster [3]. I configured the RocksDB state backend and I increased the memory of the Job Manager and Task Manager. However, I am still getting the timeout message "java.util.concurrent.TimeoutException: