[
https://issues.apache.org/jira/browse/ARROW-1727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16222825#comment-16222825
]
ASF GitHub Bot commented on ARROW-1727:
---------------------------------------
TheNeuralBit commented on a change in pull request #1257: ARROW-1727: [Format]
Expand Arrow streaming format to permit deltas / additions to existing
dictionaries
URL: https://github.com/apache/arrow/pull/1257#discussion_r147516370
##########
File path: format/IPC.md
##########
@@ -189,6 +197,10 @@ in the schema, so that dictionaries can even be used for
multiple fields. See
the [Physical Layout][4] document for more about the semantics of
dictionary-encoded data.
+The dictionary `isDelta` flag allows dictionary batches to be modified
mid-stream.
+A dictionary batch with `isDelta` set indicates that its vector should be
+concatenated with those of any previous batches with the same `id`.
Review comment:
Would something like the example in my initial email work?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> [Format] Expand Arrow streaming format to permit new dictionaries and deltas
> / additions to existing dictionaries
> -----------------------------------------------------------------------------------------------------------------
>
> Key: ARROW-1727
> URL: https://issues.apache.org/jira/browse/ARROW-1727
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Format
> Reporter: Wes McKinney
> Assignee: Brian Hulette
> Labels: pull-request-available
> Fix For: 0.8.0
>
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
