RE: Direct buffer memory in job with hbase client

2021-12-17 Thread Anton
Looks like I set wrong parameter. Is should have been taskmanager.memory.task.off-heap.size. From: Anton [mailto:anton...@yandex.ru] Sent: Friday, December 17, 2021 10:12 PM To: 'Xintong Song' Cc: 'user' Subject: RE: Direct buffer memory in job with hbase client H

RE: Direct buffer memory in job with hbase client

2021-12-17 Thread Anton
com] Sent: Wednesday, December 15, 2021 12:17 PM To: Anton Cc: user Subject: Re: Direct buffer memory in job with hbase client Hi Anton, You may want to try increasing the task off-heap memory, as your tasks are using hbase client which needs off-heap (direct) memory. The default task off-heap m

Re: Direct buffer memory in job with hbase client

2021-12-15 Thread Xintong Song
Hi Anton, You may want to try increasing the task off-heap memory, as your tasks are using hbase client which needs off-heap (direct) memory. The default task off-heap memory is 0 because most tasks do not use off-heap memory. Unfortunately, I cannot advise on how much task off-heap memory your j

Direct buffer memory in job with hbase client

2021-12-14 Thread Anton
Hi, from time to time my job is stopping to process messages with warn message listed below. Tried to increase jobmanager.memory.process.size and taskmanager.memory.process.size but it didn't help. What else can I try? "Framework Off-heap" is 128mb now as seen is task manager dashboard and Task Of