Prasanth J created HIVE-6711: -------------------------------- Summary: ORC maps uses getMapSize() from MapOI which is unreliable Key: HIVE-6711 URL: https://issues.apache.org/jira/browse/HIVE-6711 Project: Hive Issue Type: Bug Affects Versions: 0.12.0, 0.11.0, 0.13.0 Reporter: Prasanth J Assignee: Prasanth J Fix For: 0.13.0, 0.14.0
HIVE-6707 had issues with map size. getMapSize() of LazyMap and LazyBinaryMap does not deserialize the keys and count the number of unique keys. Since getMapSize() may return non-distinct count of keys, the length of maps stored using ORC's map tree writer will not be in sync with actual map size. As a result of this RLE reader will try to read beyond the disk range expecting more map entries and will throw exception. -- This message was sent by Atlassian JIRA (v6.2#6252)