DaveDeCaprio commented on issue #23169: [SPARK-26103][SQL] Limit the length of debug strings for query plans URL: https://github.com/apache/spark/pull/23169#issuecomment-451675930 @MaxGekk and @hvanhovell - I have added a config parameter here to limit the overall length of the query plans. I could refactor this change so it works with the new StringConcat class. Even with efficient memory allocation, some plans are just too big to keep around in memory for the UI. We have 200Mb+ plans.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
