GitHub user andygrove closed the discussion with a comment: Native OOM on Large-Scale Joins and Distinct/Deduplication Operations
Memory management was overhauled in 1.1.0 (should release next week) and observability was also added. I recommend trying again with that release. Thanks. GitHub link: https://github.com/apache/datafusion-comet/discussions/5001#discussioncomment-18747964 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
