Yikun edited a comment on pull request #35422: URL: https://github.com/apache/spark/pull/35422#issuecomment-1036035298
> Ur, it seems to fail. @dongjoon-hyun yep, there are some failure on arm deploy, but will adress soon by cc @william-wang https://github.com/volcano-sh/volcano/issues/2010 > Do you think we can verify the further volcano scheduler features like the following? Yep, most of them are configuration introduce and testing work, below cases will be added in integration test and added in Spark 3.3, I'm working these: 1. [SPARK-38187](https://issues.apache.org/jira/browse/SPARK-38187): Resource reservation (it should be a separte PR with `minCPU/minMemory` introduced + integration test), driver and executor all started or nothing started, it is also often misunderstood as `gang`. 2. [SPARK-38188](https://issues.apache.org/jira/browse/SPARK-38188): Queue scheduling (a separte PR with `queue` introduced + integration test) 3. [SPARK-38189](https://issues.apache.org/jira/browse/SPARK-38189): Preemption scheduling (a separte PR with `priorityClass` introduced + integration test) 4. [SPARK-38190](https://issues.apache.org/jira/browse/SPARK-38190): Fair-share scheduling (a separte PR with integration test) (later: I also updated the corresponding jira) The `topology`, `reclaim`, `backfill` scheduling will also supports in theory, but the integration test would be low priority in Spark 3.3, because from the actual use of spark on k8s, these scenarios are slightly less used, but I could try to validate if have time. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
