Re: NPE when reading Parquet using Hive on Tez

2016-02-02 Thread Gopal Vijayaraghavan
> I dug a little deeper and it appears that the configuration property >"columns.types", which is used >org.apache.hadoop.hive.ql.io.parquet.read.DataWritableReadSupport.init(), > is not being set. When I manually set that property in hive, your >example works fine. Good to know more about the NPE

Re: NPE when reading Parquet using Hive on Tez

2016-02-02 Thread Adam Hunt
HI Gopal, With the release of 0.8.2, I thought I would give tez another shot. Unfortunately, I got the same NPE. I dug a little deeper and it appears that the configuration property "columns.types", which is used org.apache.hadoop.hive.ql.io.parquet.read.DataWritableReadSupport.init(), is not bein

Re: NPE when reading Parquet using Hive on Tez

2016-01-05 Thread Adam Hunt
Hi Gopal, Spark does offer dynamic allocation, but it doesn't always work as advertised. My experience with Tez has been more in line with my expectations. I'll bring up my issues with Spark on that list. I tried your example and got the same NPE. It might be a mapr-hive issue. Thanks for your he

Re: NPE when reading Parquet using Hive on Tez

2016-01-04 Thread Gopal Vijayaraghavan
> select count(*) from alexa_parquet; > Caused by: java.lang.NullPointerException >at >org.apache.hadoop.hive.serde2.typeinfo.TypeInfoUtils$TypeInfoParser.tokeni >ze(TypeInfoUtils.java:274) >at >org.apache.hadoop.hive.serde2.typeinfo.TypeInfoUtils$TypeInfoParser. >(TypeInfoUtils.java:29

NPE when reading Parquet using Hive on Tez

2016-01-04 Thread Adam Hunt
Hi, When I perform any operation on a data set stored in Parquet format using Hive on Tez, I get an NPE (see bottom for stack trace). The same operation works fine on tables stored as text, Avro, ORC and Sequence files. The same query on the parquet tables also works fine if I use Hive on MR. I'm