cloud-fan commented on pull request #31284: URL: https://github.com/apache/spark/pull/31284#issuecomment-771758206
@tgravescs The disk space is already wasted by parquet files, since people store small decimals as INT64. For in-memory computing, the common practice is to prefer performance over space. Storing as INT64 in-memory is also consistent with the on-disk format. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
