kyle-mccarthy opened a new issue, #4292:
URL: https://github.com/apache/opendal/issues/4292
We recently started seeing errors complaining about a minimum chunk size
while uploading files to GCS. I would link to the GCS documentation, but I
can't find where the minimum chunk size is specifically stated.
```
Unexpected (permanent) at Writer::write => Invalid request. The number of
bytes uploaded is required to be equal or greater than 262144, except for the
final request (it's recommended to be the exact multiple of 262144). The
received request contained 22918 bytes, which does not meet this requirement.
Context:
uri:
https://storage.googleapis.com/upload/storage/v1/b/thebucket/o?uploadType=resumable&name=the-file.xlsx&upload_id=[..]
response: Parts { status: 400, version: HTTP/1.1, headers:
{"content-type": "text/plain; charset=utf-8", "x-guploader-uploadid": "[..]",
"content-length": "261", "date": "Wed, 28 Feb 2024 18:57:30 GMT", "server":
"UploadServer"} }
service: gcs
path: the-file.xlsx
write_buf: 65536
Backtrace:
0: opendal::services::gcs::error::parse_error::{{closure}}
1: <opendal::services::gcs::writer::GcsWriter as
opendal::raw::oio::write::range_write::RangeWrite>::write_range::{{closure}}
2:
opendal::raw::oio::write::range_write::WriteRangeFuture::new::{{closure}}
3: <opendal::raw::futures_util::ConcurrentFutures<F> as
futures_core::stream::Stream>::poll_next
4: <opendal::raw::oio::write::range_write::RangeWriter<W> as
opendal::raw::oio::write::api::Write>::poll_write
5: <opendal::layers::error_context::ErrorContextWrapper<T> as
opendal::raw::oio::write::api::Write>::poll_write
6: <opendal::layers::complete::CompleteWriter<W> as
opendal::raw::oio::write::api::Write>::poll_write
7: <opendal::layers::retry::RetryWrapper<R,I> as
opendal::raw::oio::write::api::Write>::poll_write
8: <opendal::layers::timeout::TimeoutWrapper<R> as
opendal::raw::oio::write::api::Write>::poll_write
9: <opendal::layers::tracing::TracingWrapper<R> as
opendal::raw::oio::write::api::Write>::poll_write
10: <opendal::layers::metrics::MetricWrapper<R> as
opendal::raw::oio::write::api::Write>::poll_write
...
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@opendal.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
