Re: A new external catalog

, -Ameen From: Steve Loughran <ste...@hortonworks.com> Date: Tuesday, February 13, 2018 at 5:01 PM To: "Tayyebi, Ameen" <tayye...@amazon.com> Cc: Apache Spark Dev <dev@spark.apache.org> Subject: Re: A new external catalog On 13 Feb 2018, at 21:20, Tayyebi, Ameen <t

Re: A new external catalog

Thanks a lot Steve. I’ll go through the Jira’s you linked in detail. I took a quick look and am sufficiently scared for now. I had run into that warning from the S3 stream before. Sigh. From: Steve Loughran <ste...@hortonworks.com> Date: Tuesday, February 13, 2018 at 5:01 PM To: "Tay

Re: A new external catalog

; Date: Tuesday, February 13, 2018 at 3:34 PM To: "Tayyebi, Ameen" <tayye...@amazon.com> Cc: Apache Spark Dev <dev@spark.apache.org> Subject: Re: A new external catalog On 13 Feb 2018, at 19:50, Tayyebi, Ameen <tayye...@amazon.com<mailto:tayye...@amazon.com>> wrot

A new external catalog

Hello everyone, For those of you not familiar with AWS Glue Catalog, it’s a Hive Metastore implemented as a web service. The Glue service is composed of different components, but the one I’m interested in is the Catalog. Today, there’s a Hive metastore