PhVHoang commented on issue #1319: URL: https://github.com/apache/datafusion-ballista/issues/1319#issuecomment-3714018778
Yes, that’s exactly what I meant when I mentioned TaskGroup as well. I brought it up because it was discussed in the related issue (#660). I agree that having a separate IoExecutor for I/O-heavy workloads makes sense, and the same rationale applies to the Arrow Flight server. Happy to work on the IoExecutor implementation and explore how best to integrate it for shuffle I/O (and potentially Flight as well), if that direction aligns with your expectations. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
