n3world commented on pull request #10649: URL: https://github.com/apache/arrow/pull/10649#issuecomment-873265917
> LGTM. Are you needing this for streaming execution? I think the new streaming reader won't quite work with this fix since it infers schema on the first block of data. However, it shouldn't be too much work to change that to "first block that has actual data". I'd be happy to do that (probably in a follow-up PR). That is an unfortunate limitation of the current streaming reader too. I was thinking it would be nice to have this work for all the readers but haven't created a ticket. If you don't mind doing that after your current PR is in that would be great but if you don't have time I could take a swing at it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
