helmiazizm commented on issue #3888:
URL: https://github.com/apache/arrow-rs/issues/3888#issuecomment-2509034618
> What have you tried? It should just be a case of overriding the endpoint
and providing valid credentials
I tried using polars.scan_csv function which uses object_store parameters.
Here's how my code look like:
```
import polars as pl
storage_option = {
"endpoint": "https://s3.oss-region-endpoint.aliyuncs.com";,
"access_key_id": "myosskeyid",
"secret_access_key": "myosskeysecret",
"virtual_hosted_style_request": "true"
}
table_path = "s3://mybucket/my/path/to/file.csv"
pl.scan_csv(
table_path, storage_options=storage_option
).collect()
```
Assigning virtual hosted style request false returns 403 forbidden error,
and assigning it to true returns 404 not found: no body. I assumed that
assigning virtual hosted style to true actually enables me to authenticate, but
the config still made a mistake on creating the URL for the object. Should have
something to do with the OSS signature, but I don't know which other keys
[here](https://docs.rs/object_store/latest/object_store/aws/enum.AmazonS3ConfigKey.html)
should I tweak.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
