Re: Problem in reading parquet data from 2 different sources(Hive + Glue) using hive tables

2018-08-30 Thread Anup Tiwari
Hi Thai, Any links or examples for achieving this? Since I do not have much idea of this. On Thu, 30 Aug 2018 20:08 Thai Bui, wrote: > Another option is to implement a custom ParquetInputFormat extending the > current Hive MR Parquet format and handle schema coersion at the input >

Re: Problem in reading parquet data from 2 different sources(Hive + Glue) using hive tables

2018-08-30 Thread Thai Bui
Another option is to implement a custom ParquetInputFormat extending the current Hive MR Parquet format and handle schema coersion at the input split/record reader level. This would be more involving but guarantee to work if you could add auxiliary jars to your Hive cluster. On Wed, Aug 29, 2018