tustvold commented on PR #4876: URL: https://github.com/apache/arrow-rs/pull/4876#issuecomment-1749129998
> In IOx terms, the router will have something that can produce signed urls (configured using the code in clap_blocks, https://github.com/influxdata/influxdb_iox/pull/8927) and will pass that full URL to a bulk import tool This looks sensible to me :+1: > So I think the ObjectStore trait will need methods like fn put_presigned(&self, location: &Url, bytes: Bytes) and fn get_presigned(&self, location: &Url), and these should be on the trait so that the adapters like LimitStore and ThrottledStore can support them as well. > that will also have an object store configured using the code in clap_blocks (that currently returns an Arc<DynObjectStore> which is a LimitStore wrapping an AmazonS3 in this case) so that we don't have to reimplement all those settings and code handling the upload request The upload request is a simple PUT request with the object payload as the body. I'm not sure I follow why this would benefit from being ObjectStore-ified? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
