Jim Apple has posted comments on this change. Change subject: IMPALA-2840: Don't store table location in partition location ......................................................................
Patch Set 2: (1 comment) http://gerrit.cloudera.org:8080/#/c/2355/2//COMMIT_MSG Commit Message: Line 9: For a table with location "ABC", most partitions will have locations : like "ABC/DEF=2". The "ABC" part of the location does not need to be : stored in Catalog for each partition; we can compress it down to one : bit in the common case. > Some other ways we could get compression: Dimitris and I chatted out-of-band and decided to try the following approach, in order: 1. In this patch, keep the basic design for compression. 2. In a follow-up patch, fix the TODO by eliding partition column names and values. 3. For users who need many partitions with locations not prefixed by the table location, investigate a partition location compression scheme where the is_prefix_ is not a boolean, but an index into a hash table of previously seen prefixes. -- To view, visit http://gerrit.cloudera.org:8080/2355 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-MessageType: comment Gerrit-Change-Id: I8c67b6ce0f83de2f5277a528a9ce67e47d638adb Gerrit-PatchSet: 2 Gerrit-Project: Impala Gerrit-Branch: cdh5-trunk Gerrit-Owner: Jim Apple <[email protected]> Gerrit-Reviewer: Dimitris Tsirogiannis <[email protected]> Gerrit-Reviewer: Jim Apple <[email protected]> Gerrit-Reviewer: Marcel Kornacker <[email protected]> Gerrit-HasComments: Yes
