Re: [I] [Python][Parquet] Errno 14 Error reading bytes from file with `pyarrow.parquet.ParquetFile()`, but consistently succeeds on second try [arrow]

Thu, 01 Oct 2026 09:11:20 -0700 


rok commented on issue #51674:
URL: https://github.com/apache/arrow/issues/51674#issuecomment-5935446578

   This is likely due to Beegfs allocation memory differently than pyarrow.
   
   Another suggestion from my 🤖 :
   > Could you run your failing snippet again on /globalscratch, this time with 
Arrow's system memory allocator:
   > 
   > ARROW_DEFAULT_MEMORY_POOL=system python your_script.py
   > 
   > To confirm the setting took effect, add 
print(pyarrow.default_memory_pool().backend_name) at the top of the script. It 
should print system. Does it still fail with Errno 14?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to