rtyler commented on issue #3949: URL: https://github.com/apache/arrow-rs/issues/3949#issuecomment-1484170281
> the code is very hard to maintain and reason about, in particular the way it handles nested types is very convolute Yes I would agree with that assessment :laughing: > creating `RecordBatch` from statically typed rows is something I have been playing around with, would this work for your use-case, or are the types not known at compile time? Yes the data is more or less known ahead of time. The work that I am doing is similar to what [kafka-delta-ingest](https://github.com/delta-io/kafka-delta-ingest) does, which is converting JSON data into Delta formatted data. In my cases I want to deserialize into structs with Serde in order to perform some operations with the data. If I have a path to re-use serde's `Value` type which is shared between `serde_json` and `serde_yaml` (and others) then I can use that as my "intermediary" format for deserializing known typed data _before_ converting that into a `RecordBatch` for writing out to Delta. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
