Hi,
Can you maybe show us what is inside of one of the directory instance?
Furthermore, your TM logs show multiple instances of OutOfMemoryErrors, so that
might also be a problem. Also how was the job moved? If a TM is killed, of
course it cannot cleanup. That is why the data goes to tmp dir
Thank you Piotr for the reply! We didn't run this job on the previous
version of Flink. Unfortunately, I don't have a log file from JM only TM
logs.
https://drive.google.com/file/d/14QSVeS4c0EETT6ibK3m_TMgdLUwD6H1m/view?usp=sharing
On Wed, Oct 10, 2018 at 10:08 AM Piotr Nowojski
wrote:
> Hi,
>
Hi,
Was this happening in older Flink version? Could you post in what circumstances
the job has been moved to a new TM (full job manager logs and task manager logs
would be helpful)? I’m suspecting that those leftover files might have
something to do with local recovery.
Piotrek
> On 9 Oct
After digging more in the log, I think it's more a bug. I've greped a log
by job id and found under normal circumstances TM supposed to delete
flink-io files. For some reason, it doesn't delete files that were listed
above.
2018-10-08 22:10:25,865 INFO
