wiedld commented on PR #17943: URL: https://github.com/apache/datafusion/pull/17943#issuecomment-3377837213
> Thanks @wiedld my question similar to @2010YOUY01 how to use the lineage, it sounds very interesting The lineage is created by using child reservations. I made an example commit here, using the parallel parquet writing: https://github.com/apache/datafusion/pull/17943/commits/3bc68207d921f00986759cfe893d5597058e3bef That is why in the following commit, when I switch to using the reservation stacktrace (based on lineage) for the OOM error reporting (a.k.a. `TrackConsumersPool::report_top`), we have the expanded OOM error trace for the parallel parquet writing: https://github.com/apache/datafusion/pull/17943/commits/c7e869fcf673c4d51027ab766acd3be42d8785fb -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
