ulysses-you commented on pull request #31817: URL: https://github.com/apache/spark/pull/31817#issuecomment-797858608
Seems there is no easy way to distinguish if the stats of current plan is visit based on the default sizeInBytes. Another thought, maybe we can make the default sizeInBytes as `Option` instead of `Long.MaxValue` since there is no meaning to estimate stats based on the `Long.MaxValue` for most plan. And for some independent e.g. `Limit`, we could leave it. I'm worried that might introduce many changes but just for such minor issue, close this now. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
