ahshahid commented on PR #53773: URL: https://github.com/apache/spark/pull/53773#issuecomment-3745805432
@holdenk We had implemented something similar for workday few years back... The idea was to firdt allow complete collpase of projects, and then expand the collapsed projects in a controlled manner to ensure that repeat calculations are evaluated only once and available as an attribute in the expanded project tree. Something similar to this, I believe is happening in master now... but the main difference we did was that these expanded projects were treated as a group of nodes, on which all other rules would get applied only once and in next iterations, these blocks would be skipped. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
