matthewmturner commented on PR #13424: URL: https://github.com/apache/datafusion/pull/13424#issuecomment-2494530521
> Ok, I am pretty happy with where this PR is now. It shows the entire process running end to end, with the `DedicatedExecutor` and running always on the dedicated executor > > > > Things it needs to sort out: > > 1. Wrapping requests like `ObjectStore::list` and `ObjectStore::get` so they run on the dedicated executor as well > > 2. Cleaning up the code structure, start getting it ready to merge Can you expand on point 1? My naive expectation was that all network io went through the main runtime. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
