Am Freitag, dem 03.06.2022 um 09:32 -0700 schrieb Micah Kornfield: > > > > Thinking about compatibility with existing software, RLE could > > possibly > > even made an Extension Type that follows the layout of a struct of > > int32 and the encoded value type. I'm wondering wether this would > > be > > better for compatibility. > > > I might be misunderstanding this proposal, but I don't think this > works. Wouldn't the structs with RLE have different row lengths then > any > Array in the same record/batch and table? I think this means that > validation would fail on them.
I think you understood it corrently. I'm not really familar with validation of arrow and didn't think of that problem. Best, Tobias >