kevinjqliu commented on issue #695: URL: https://github.com/apache/arrow-rs-object-store/issues/695#issuecomment-4300609376
Thanks for the repro and pointers. I was able to confirm this locally with a OneLake environment. This appears to be an API parity issue on the OneLake API side. We'll investigate and fix it. In the meantime, I think we should address the regression for OneLake users. I like @tustvold's suggestion; we can: 1. Add a config option to disable `startFrom` 2. Automatically disable `startFrom` for OneLake endpoints I'm happy to put up a fix for both. Once `startFrom` is fixed/supported in OneLake, we can revisit and re-enable the optimization. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
