dongjoon-hyun commented on pull request #35922: URL: https://github.com/apache/spark/pull/35922#issuecomment-1076927078
To reviewers. It was intentional not to expose this module into the Apache Spark release artifacts. While I've been helping this SPIP, there were many issues in Volcano library and volcano module until the last day of branch cut. The module and cones are re-designed to isolate each custom scheduler from the others. This is still in an experiment stage and I believe we need more time in this area. AFAIK, we couldn't add `Yunikorn` due to the lack of community bandwidth. Hence, we should not include this into binary artifacts in Apache Spark 3.3. After stabilizing more, we can add it at Apache Spark 3.4 officially. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
