zuston opened a new issue, #172: URL: https://github.com/apache/incubator-uniffle/issues/172
### Motivation When uniffle shuffle servers are co-located with Yarn nodemanagers, we could use the short-circuit read to improve performance and reduce the overhead. ### How to do There are two options to solve this 1. Directly read shuffle-data files by client side. 2. Use the domain socket. #### Option 1 - Directly read This is the fastest way, but the local-files' read permission should be open for client side. This maybe have security problem. #### Option2 - Domain socket This way could be avoid security problem, but will be slower than above. And its implementation will be complex. ### Conclusion In my opinion, above two ways could be all supported in uniffle, which could be as different policies for users to choose. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@uniffle.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
