westonpace commented on issue #36587: URL: https://github.com/apache/arrow/issues/36587#issuecomment-1629124730
S3 performance will depend of your connection to the S3 servers. Are you running this test on a local device? Or on an EC2 server? If it's a local device then what kind of connection do you have to the internet? 970 seconds for 500MB of data is very slow. This is less than 0.1Mbps so any decent connection should be faster than this. If you set the environment variable `AWS_EC2_METADATA_DISABLED` (e.g. `export AWS_EC2_METADATA_DISABLED=true`) does it have any affect on performance? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
