djouallah opened a new issue, #157: URL: https://github.com/apache/arrow-datafusion-python/issues/157
**Describe the bug** try a sort and export a parquet file using Colab generate an Out of memory error **To Reproduce** ``` !curl -L 'https://drive.google.com/uc?export=download&id=18gv0Yd_a-Zc7CSolol8qeYVAAzSthnSN&confirm=t' > lineitem.parquet from datafusion import SessionContext ctx = SessionContext() ctx.register_parquet('lineitem', 'lineitem.parquet') df = ctx.sql("select * from lineitem order by l_shipdate") df.write_parquet("lineitem_Datafusion.parquet") ``` **Expected behavior** I expected to use only the available memory here is the link comparing the same using Polars and DuckDB -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
