JasperSch commented on issue #11934:
URL: https://github.com/apache/arrow/issues/11934#issuecomment-1009089876
@paleolimbot
Ran into some issues in installing minio, but eventually managed to set it
up in a docker container.
Two problems I ran into:
- `some_subdir` was not accepted as bucket name
- had to use `minio.s3::save_object` since I could not get
`aws.s3::save_object` to work.
The example below should be very close to what you proposed.
```
devtools::install_github("nagdevAmruthnath/minio.s3")
# make sure we can connect
s3_uri <-
"s3://minioadmin:minioadmin@?scheme=http&endpoint_override=localhost%3A9000"
bucket <- arrow::s3_bucket(s3_uri)
bucket$ls("bucket")
# > [1] "bucket/test"
# write a dataset to minio
data <- data.frame(x = letters[1:5])
arrow::write_dataset(
dataset = data,
path = bucket$path("bucket/test")
)
Sys.setenv("AWS_ACCESS_KEY_ID" = "minioadmin", # enter your credentials
"AWS_SECRET_ACCESS_KEY" = "minioadmin", # enter your credentials
"AWS_DEFAULT_REGION" = "eu-west-1",
"AWS_S3_ENDPOINT" = "localhost:9000")
minio.s3::save_object(
object = "test/part-0.parquet",
bucket = "bucket",
file = "test",
use_https = F
)
# Error: 'PAR124L
# ' does not exist in current working directory
```
So, in your example, I think you could you try running:
```
minio.s3::save_object(
object = "test/part-0.parquet",
bucket = "some_subdir",
file = "test",
use_https = F
)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
