Hi, I bumped into this change on the parquet-mr project and was wondering about the impact on flushing more often in the case more writers are being created. I am assuming that column blocks won't be as full therefore adding some disk seeks possibly, less efficient compression... Sure this is all better than OOM though I just would like to understand the trade-offs in your experience.
Thanks,
