alamb opened a new issue, #8082:
URL: https://github.com/apache/arrow-rs/issues/8082

   **Is your feature request related to a problem or challenge? Please describe 
what you are trying to do.**
   - part of https://github.com/apache/arrow-rs/issues/6736
   
   We introduced the basic `variant_get` kernel in and now we need to expand 
its feature set
   - https://github.com/apache/arrow-rs/pull/8021
   
   In particular, Shredded Arrays (VariantList) are described here:
   * [Representing Variant In Arrow Proposal: "Shredding an 
Array"](https://docs.google.com/document/d/1pw0AWoMQY3SjD7R4LgbPvMjG_xSCtXp3rZHkVp9jpZ4/edit?tab=t.0#heading=h.z9168wdrn689)
   *  [Variant 
Shredding::Arrays](https://github.com/apache/parquet-format/blob/master/VariantShredding.md#arrays)
   
   
   **Describe the solution you'd like**
   I would like `variant_get` to support shredded arrays, along with being able 
to extract elements from them. 
   
   So roughly that means
   ```rust
   // get the variant as a ListArray
   variant_get(array, Field::new(List...)))
   // get the shredded variant as a non shredded variant (convert to 
Variant::List)
   variant_get(array)
   ```
   
   **Describe alternatives you've considered**
   1. Add a test that manually constructs a shredded variant array (follow the 
example in the arrow proposal)
   2. Add a test that tries to get that array as a variant and as a ListArray
   3. Implement the code
   
   **Additional context**
   Reference
   - [Variant 
Spec](https://github.com/apache/parquet-format/blob/master/VariantEncoding.md#encoding-types)
   - [Variant Shredding 
Spec](https://github.com/apache/parquet-format/blob/master/VariantShredding.md#value-shredding)
   - [Representing Variant In Arrow 
Proposal](https://docs.google.com/document/d/1pw0AWoMQY3SjD7R4LgbPvMjG_xSCtXp3rZHkVp9jpZ4)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to