nkemnitz commented on issue #774:
URL:
https://github.com/apache/arrow-rs-object-store/issues/774#issuecomment-4798427021
Some additional findings:
*
`GoogleCloudStorageBuilder::new().with_bucket_name("neuroglancer-public-data").with_skip_signature(true)`
fails the same way, which hopefully makes reproducibility easier
* There is a second failure mode for the decompressive transcoding :
`MissingEtag`. Similar to the `Content-Length`, if the server sends
decompressed content (because the client didn't set "Accept-Encoding: gzip", it
can't write any useful information into these response headers. You'll only get
the _compressed_ objects information in `x-goog-hash` and
`x-goog-stored-content-length`
And to clarify:
* `Accept-Encoding; gzip` does not fix the missing Content-Length issue for
large files requested with HTTP1.1 - those might still get streamed
(`Transfer-Encoding: chunked`), which forbids `Content-Length`
* `.with_http2_only()` + `Accept-Encoding: gzip` works, but is slower
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
