dmbates commented on issue #360: URL: https://github.com/apache/arrow-julia/issues/360#issuecomment-1311998860
I see that the Arrow Columnar Format section of the Arrow docs explicitly says that duplicates and null values are allowed in the dictionary but the null count is always the number of nulls in the index array. Because the index of any null in the dictionary is replaced by null in the index array, nulls in the dictionary are never referenced by an index. It seems that it would be more effective to adopt the Python convention and remove the null from the dictionary after propagating it to the index array. The current result is not "wrong" according to the Format description but it is awkward. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
