ORC ACID is more of a Hive feature than an ORC feature. Regretfully it's not defined in a engine agnostic way. Would be great to make the ACID layout part of the file format definition or as a generic container definition or an extension to the Hive table format, so it would be easier to use across tools. It's especially troubling that ACID is on by default in HDP 3.X for Hive 3.1. Makes it very hard to read Hive generated ORC files unless the table is created as an external table instead of a managed table.
-Shant On Mon, Jan 28, 2019 at 11:06 PM Jacques Nadeau <[email protected]> wrote: > How much of the Acid functionality of Orc is actually in the Orc project? > The website seems to suggest it is core to Orc but a quick glance at the > code and it seems like really the code is mostly elsewhere? > > Thanks > Jacques >
