kevinjqliu commented on PR #1443: URL: https://github.com/apache/datafusion-python/pull/1443#issuecomment-4128102625
Claude on why `profile.release.package.substrait` might not work: """ That's a reasonable idea but it won't help with your specific OOM. The problem is that with lto = true (fat LTO), all crates get merged into a single IR blob inside rustc for the final optimization pass — the per-package opt-level and codegen-units overrides apply during the initial compilation of each crate, but by the time the LTO link step runs, rustc is holding everything together regardless. """ The priority order that minimizes artifact impact: * More swap — zero artifact impact, just survival insurance * mold linker — zero artifact impact, just more memory-efficient linking (trying this out https://github.com/kevinjqliu/datafusion-python/actions/runs/23552615526) * Set release option (lto = "thin") -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
