adriangb commented on issue #7715:
URL: https://github.com/apache/arrow-rs/issues/7715#issuecomment-3029329963

   > So maybe we need a "shred" kernel that takes a StructArray in with a 
shredding specification and produces a StructArray out with the appropriate 
fields added 🤔
   
   I think this would be great. I'd also consider a kernel to go directly from 
json -> shredded if that's significantly cheaper computationally.
   
   One thing to consider is how we're going to define the shredding strategy: 
first encountered keys, a fixed list of keys, most frequent keys, largest keys 
by size, ... I think there's a lot of possible strategies!
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to