Re: Proposal: File based metastore

2018-01-30 Thread Ryan Blue
Thanks, Owen. I agree, Iceberg addresses a lot of the problems that you're hitting here. It doesn't quite go as far as moving all metadata into the file system. You can do that in HDFS and implementations that support atomic rename, but not in S3 (Iceberg has an implementation of the HDFS one

Re: Proposal: File based metastore

2018-01-30 Thread Elliot West
Hi Ryan, Is Hive support on the iceberg roadmap? Presumably its MetastoreClientFactory and storage API provide an integration point? Or is there perhaps some architectural detail that makes this impractical? I’m thinking not just of the ability to support Hive, but also the range of tooling that

Re: Proposal: File based metastore

2018-01-30 Thread Edward Capriolo
On Tue, Jan 30, 2018 at 1:16 PM, Ryan Blue wrote: > Thanks, Owen. > > I agree, Iceberg addresses a lot of the problems that you're hitting here. > It doesn't quite go as far as moving all metadata into the file system. You > can do that in HDFS and implementations that support

Hiveserver2 - Beeline How to enable progress bar (Tez)

2018-01-30 Thread Shankar Mane
May i know, how to enable Tez progress bar in beeline ? I am using Tez has a execution engine. I have followed some steps but failed. steps are: set hive.async.log.enable=false set hive.server2.in.place.progress=true Env Details: RHEL hive 2.3.2 hadoop 2.9.0 Tez 0.9.1 Apache Distribution Also