GitHub user Smotrov closed a discussion: Infer schema for NDJSON
I have a data in NDJSON format. The thing is some fields there are optional and populated when needed. As I understand, DF is using the first row only by default to infer schema. Than when it see that certain fields are missing in som of the next rows it shows an error `Fail to merge schema field 'my_fieldname' because the from data_type ... does not equal ...`. So is it possible to specify N rows which should be used to infer schema? GitHub link: https://github.com/apache/datafusion/discussions/10900 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
