llama90 opened a new issue, #38490:
URL: https://github.com/apache/arrow/issues/38490

   ### Describe the enhancement requested
   
   To support join operations for the `DictionaryType`, sorting operations of 
indices related to the `DictionaryType` in a `ChunkedArray` is required (This 
applies to `ChunkedArray`, `RecordBatch`, and `Table` alike).
   
   From a data structure perspective, the support for the `DictionaryType` 
within `Array` and `ChunkedArray`, as well as between `RecordBatch` and 
`Table`, appeared to be similar.
   
   For instance, based on the sorting of `Array` and `RecordBatch`, there's a 
need to merge the sorted data structures for `ChunkedArray` and `Table` 
respectively.
   
   Sorting for the `DictionaryType` within `Array` is already supported, so 
sorting for `ChunkedArray` is needed. In this context, I've observed that 
sorting for the `DictionaryType` internally takes place based on the `Rank` of 
the dictionaries.
   
   In any case, before supporting the `DictionaryType` for `ChunkedArray` based 
on the algorithm for the `DictionaryType` in `Array`, it seems necessary to 
pave the way. Given the similarities, this would then allow for support in 
`RecordBatch` and `Table`. I've created a separate issue for this.
   
   
   ### Component(s)
   
   C++


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to