pitrou commented on PR #13662: URL: https://github.com/apache/arrow/pull/13662#issuecomment-1217718562
> With option2: ./direct & python script.py, the write itself takes 12s and the script takes 30s on my machine. > With option4: ./fadvise & python script.py, the write itself takes 25s and the script takes 40s on my machine, with it using up all free memory. Thanks for the results :-) Can you just describe the system you measured this on? > However I think a write size of around 1MB is maybe representative of what currently happens in Arrow, e.g. with the Parquet writer. Yeah, probably. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
