lidavidm commented on PR #37202: URL: https://github.com/apache/arrow/pull/37202#issuecomment-1680894084
> Other implementations may also not like receiving such data over IPC or the C Data Interface. Practically I think implementations are not great about using the nullability flag, instead relying mostly on the physical presence of nulls, but this is a chicken-and-egg issue. > If a field is not nullable, then ideally it shouldn't have any nulls even if it is shadowed by an all-nulls parent array. This sounds reasonable, but we should clarify this more generally? It sounds like we aren't precise enough with that field nullability means for the physical data. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
