findepi commented on issue #6736: URL: https://github.com/apache/arrow-rs/issues/6736#issuecomment-2870058192
> [@findepi](https://github.com/findepi) -- I heard today you may be working on variant support as well. I wonder if you have any thoughts about the above plan (or perhaps already have it implemented and would be willing to share 😆 ) ~SDF~ dbt indeed has an internal Variant implementation. I would need to ensure there would be openness to contribute, but I the code wouldn't be directly usable: - the implementation is aligned with Snowflake VARIANT semantics - no Parquet-level logic, just in-memory implementation. It's just a binary for storage. In particular no cdisaggregated columns. - the implementation is pragmatic, but not necessarily well designed -- just a binary blob with Protobof encoded data. Flatbuffers could be more efficient from UDFs perspective @alamb if this would be nonetheless somehow useful, lemme know and I can do the clearance. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
