GitHub user vkydhyani added a comment to the discussion: [Bug]: Java heap Space issue
> What is the file size of your CSV files? **It has 4 csv files, and the size > is also too small. But the number of columns are too much. can this cause any > issues.** <img width="397" height="92" alt="Image" src="https://github.com/user-attachments/assets/746999aa-677c-4345-b0e4-3ee02c59475f"; /> The blocking transforms require all of your data to be buffered in memory before you can write it out to your Excel sheets. **I am blocking the transform before i read the CSV file for below streams.** You have 32GB of memory in your machine, but Hop only grabs 2GB by default. Try changing the `-Xmx` parameter in `hop-gui.bat`, set it to for example 8GB. **I have already tried it, and using "set HOP_OPTIONS=-Xmx8192m" currently.** If that doesn't work, splitting up your pipeline to load on CSV file into one Excel sheet at a time will eliminate the need for the blocking transforms. You could do this in a single pipeline with a parameter with CSV file to read, there probably isn't any need to create multiple pipelines. You would need 4 different runs instead of a single one, but won't necessarily had a huge impact on your total throughput time. **I want to avoid multiple pipeline creation for this small task. Will metadata injection help in this scenario?** GitHub link: https://github.com/apache/hop/discussions/5827#discussioncomment-14683939 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
