[
https://issues.apache.org/jira/browse/ARROW-18326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17634436#comment-17634436
]
Matthew Topol commented on ARROW-18326:
---------------------------------------
The issue was with your test. For dictionary deltas to be emitted, the
dictionary in the subsequent records you write *must* be an extension of the
previous dictionary that was written. The way you were creating the records you
were creating them with two *entirely different* dictionaries. This can't work
with deltas because the indices would be incorrect and can only work by doing
dictionary replacement.
I merged my previous change in
https://issues.apache.org/jira/browse/ARROW-18317 and rebased, then updated
your test. If you could give me permissions to write to your fork, i'll push
the branch. (You probably should have made a new branch to merge for the PR
rather than using master on your fork :) )
> [Go] Add option to support dictionary deltas with IPC
> -----------------------------------------------------
>
> Key: ARROW-18326
> URL: https://issues.apache.org/jira/browse/ARROW-18326
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Go
> Affects Versions: 10.0.0
> Reporter: Laurent Querel
> Assignee: Laurent Querel
> Priority: Major
> Labels: pull-request-available
> Fix For: 10.0.1
>
> Time Spent: 20m
> Remaining Estimate: 0h
>
> Currently, the {{emitDictDeltas}} member of the {{ipc.Writer}} type is not
> exposed. This PR will add a new {{ipc.Option}} that sets it to true.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
