Re: [External Sender] Debugging "Container is running beyond physical memory limits" on YARN for a long running streaming job

2020-10-04 Thread Shubham Kumar
ely kill the container when that happens. > > 2. Be sure to leave enough for the JVM "off-heap" area: GC + code cache + > thread stacks + other Java internal resources end up there. > > -K > > On Sat, Sep 19, 2020 at 12:09 PM Shubham Kumar > wrote: > >> He

Re: Debugging "Container is running beyond physical memory limits" on YARN for a long running streaming job

2020-09-22 Thread Shubham Kumar
emory usage, but NOT ALL of them. The community is working on > a new set of metrics and Web UI for the task manager memory tuning. > > Thank you~ > > Xintong Song > > > > On Sun, Sep 20, 2020 at 12:10 AM Shubham Kumar > wrote: > >> Hey everyone, >> >>

Re: Publishing Sink Task watermarks outside flink

2020-05-03 Thread Shubham Kumar
users to know till what timestamp is sink complete and can have simpler solutions. Thanks Shubham On Wed, Apr 29, 2020 at 3:27 AM Shubham Kumar wrote: > Hi Timo, > > Yeah, I got the idea of getting access to timers through process function > and had the same result which you explaine

Re: Publishing Sink Task watermarks outside flink

2020-04-28 Thread Shubham Kumar
mark. > > I hope this helps. > > Regards, > Timo > > On 28.04.20 13:07, Shubham Kumar wrote: > > Hi everyone, > > > > I have a flink application having kafka sources which calculates some > > stats based on it and pushes it to JDBC. Now, I

Publishing Sink Task watermarks outside flink

2020-04-28 Thread Shubham Kumar
then? Please share any pointers or relevant solution to tackle this. -- Thanks & Regards Shubham Kumar