Hey Impala devs, Over the past 3 weeks I have been investigating various issues with Impala's treatment of metadata. Based on data from a number of user deployments, and after discussing the issues with a number of Impala contributors and committers, I've come up with a proposal for a new design. I've also developed a prototype to show that the approach is workable and is likely to achieve its goals.
Rather than describe the design in duplicate, I've written up a proposal document here: https://docs.google.com/document/d/1WcUQ7nC3fzLFtZLofzO6kvWdGHFaaqh97fC_PvqVGCk/edit?ts=5b04a6b8# Please take a look and provide any input, questions, or concerns. Additionally, if any users on this list have experienced metadata-related problems in the past and would be willing to assist in testing or contribute workloads, please feel free to respond to me either on or off list. Thanks Todd
