houqp commented on pull request #9537: URL: https://github.com/apache/arrow/pull/9537#issuecomment-782926404
@alamb good call, I only assumed that logically makes sense, but never checked to see if it's actually implemented in datafusion myself. I have pushed a commit to check for fields count in the `contains` method for now. My original use-case was mainly to use a schema with extra metadata for a memtable, which is the case for if schema and record batches are created from our parquet crate. I am a fan of your SchemaAdapterStream implementation, looks like it would be useful to include the core of that logic in datafusion as well. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
