Re: [Announce] Hive-MR3: Hive running on top of MR3

Yes, the idea is almost the same -- LLAP daemons can accept tasks from different Tez AMs, whereas MR3 containers can accept tasks from different DAGs. A minor difference is that in the case of MR3, a single shared AM can manage multiple concurrent DAGs. As a result, there is no need to start a new

Re: ALTER TABLE DROP PARTITION not working on S3

¯\_(ツ)_/¯ On 5 April 2018 at 16:02, Richard A. Bross wrote: > I can't duplicate the issue now. Works like it always has . . > > - Original Message - > From: "Furcy Pin" > To: user@hive.apache.org > Sent: Thursday, April 5, 2018 9:57:39 AM >

Re: ALTER TABLE DROP PARTITION not working on S3

I can't duplicate the issue now. Works like it always has . . - Original Message - From: "Furcy Pin" To: user@hive.apache.org Sent: Thursday, April 5, 2018 9:57:39 AM Subject: Re: ALTER TABLE DROP PARTITION not working on S3 Indeed. If I remember correctly, s3

Re: ALTER TABLE DROP PARTITION not working on S3

Indeed. If I remember correctly, s3 does not really have the concept of "folder" like HDFS has, and Hive sort of makes up for it by creating a descriptor file where the partition "folder" is supposed to be. Maybe this is what is missing here. Perhaps you could try doing a "MSCK REPAIR TABLE

Re: ALTER TABLE DROP PARTITION not working on S3

Leaving the column list out, here you go: # Detailed Table Information Database: default Owner: hadoop CreateTime: Thu Apr 05 13:24:33 UTC 2018 LastAccessTime: UNKNOWN

Re: ALTER TABLE DROP PARTITION not working on S3

No definitely internal. It's loaded from an external table. - Original Message - From: "Furcy Pin" To: user@hive.apache.org Sent: Thursday, April 5, 2018 9:21:06 AM Subject: Re: ALTER TABLE DROP PARTITION not working on S3 Hi Richard, could you please check if

Re: ALTER TABLE DROP PARTITION not working on S3

Hi Richard, could you please check if your table is EXTERNAL? You can see it with a "DESCRIBE FORMATTED table_name ;" That's what external tables are for, they don't delete underlying data when you drop them. On 5 April 2018 at 15:18, Richard A. Bross wrote: > I think

Re: ALTER TABLE DROP PARTITION not working on S3

I think that someone put a file in there manually. Would that prevent Hive from dropping the partition. I also did a "drop table" and the s3 object keys persisted. - Original Message - From: "Richard A. Bross" To: user@hive.apache.org Sent: Thursday, April 5,

ALTER TABLE DROP PARTITION not working on S3

Hi, I have a Hive managed table on S3, "api_measurements". I've tried dropping a partition like so: hive> alter table api_measurements drop if exists partition(daydate='2018-04-04', epoch=1522876500); Dropped the partition daydate=2018-04-04/epoch=1522876500 OK Time taken: 2.109 seconds Yet