GitHub user swaroopchenchu added a comment to the discussion: Ephemeral local storage usage exceeds the total limit, Apache hop Pod Crashing
> Unless your failed cases are writing to the local storage, and have a massive > amount of those, there is nothing in this pipeline that is writing to disk. > We only have a couple of transforms that will use disk space during > processing the main culprit usually is the "Sort Rows" transform. > > I would also take a look at the failed cases field definition. If you have > string fields with max length (2GB) you could be writing unessesary white > spacing to disk causing it to fill up. I do see three fields have bigger size, but failed cases are small in number while pipeline running before pod got evicted. <img width="788" height="499" alt="image" src="https://github.com/user-attachments/assets/bf49fce3-f553-445d-b9f2-8bc0897d228b"; /> <img width="512" height="160" alt="image" src="https://github.com/user-attachments/assets/73e21537-ac5c-4006-a1f2-4f4a7325cfc1"; /> GitHub link: https://github.com/apache/hop/discussions/6429#discussioncomment-15547966 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
