emkornfield commented on pull request #12706: URL: https://github.com/apache/arrow/pull/12706#issuecomment-1086357554
> @pitrou @emkornfield am I understanding this right? It seems we either need to write out the values of child arrays behind null slots, or fill in some value on read? Yes, if it required will need to make sure the children are not null. I'm not surprised feather works because that is just serialized the record batch in place. Parquet only stores non-null values. Probably the element of least surprise here would be to only fill values for non-nullable columns (and leave existing behavior in for nullable). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
