We fixed the hudi memory leak by patching parquet 1.12 and rely on gradle to 
overwrite the transitive dependencies of parquet with that latest version.

I would say an entry in the hudi FAQ on this issue would be great, since hard 
to spot, and marked as fixed on spark side.

Also we didn't notice the issue on EMR and had issue when we migrated on 
kubernetes, which did not help to identify the zstd leak.

Reply via email to