tgravescs commented on issue #26284: [SPARK-29415][Core]Stage Level Sched: Add base ResourceProfile and Request classes URL: https://github.com/apache/spark/pull/26284#issuecomment-548900890 @squito @holdenk I wrote up a usecase with details on what happens internal to Spark in the SPI appendices/api design doc attached to https://issues.apache.org/jira/browse/SPARK-27495 Direct link: https://docs.google.com/document/d/1HT0K7QYmy_k2rVNptq3gtFDxG5pkcyiSKIiptBqOo-A/edit See the bottom section: Detailed use case example. I'm hoping it covers both an example of how the API is used with further explanation as well as what components in Spark internals are used and why. it is a lot of text, but hopefully helps, if not or you want more details in certain areas please let me know.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
