bjornjorgensen commented on PR #36583: URL: https://github.com/apache/spark/pull/36583#issuecomment-1129337164
> Interesting note: JSON does not distinguish between NULL values and the absence of values. Therefore inserting NULL and then selecting back the same column yields the default value (if any), since the insert did not change any storage. > Is this [[[SPARK-38067](https://issues.apache.org/jira/browse/SPARK-38067)][PYTHON] Preserve None values when saved to JSON](https://github.com/apache/spark/commit/66b9087233bc0cb90cf3af07ec34ba74b9c32d5b) the same case? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
