electrum commented on issue #166: Update Hive Metastore tables for Spark URL: https://github.com/apache/incubator-iceberg/pull/166#issuecomment-486059290 @manishmalhotrawork The Presto Hive connector uses the Hive 3.x libraries, mainly to have access to the latest Parquet version, but that's an internal implementation detail. Today, Presto works with Hive 1.x and 2.x, and we have no plans to drop support for older versions. Presto does not yet support Hive 3.x due to backwards incompatible changes around transactional tables, bucketing, security, and timestamps. It seems that Hive 3.x is actually incompatible with every other tool in the ecosystem, including over Hive versions. Spark support seems to be implemented by running the queries in HiveServer2 (rather than native Spark). One of the reasons why we (Presto developers and community) are so excited about Iceberg is that it frees users from the unwritten convention for Hive tables and provides a strong specification that all the tools in the ecosystem can implement. I'm also personally excited about the ability to replace the metastore with DynamoDB or similar, allowing users to run queries over data stored in cloud object stores without any additional dependencies.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
