alamb commented on issue #9380: URL: https://github.com/apache/arrow-rs/issues/9380#issuecomment-3881067584
What should happen if the CSV reader subsequently encounters a row with a null in a field it determined to be non nullable? If we inferred Non nullable i think it would error So by inferring Nullable the CSV writer is being tolerant of more inputs and will error on fewer of them We could add some flag to change this behavior if it was warranted Another alternative would be for your application to review the data that was parsed and if there are no nulls ajust the schema accordingly -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
