msck repair table internally

2020-05-27 Thread Souvikk Roy
Hi all, May be it is a common knowledge. Can anyone tell whether "msck repair table" also spawns multiple mappers like entity (or multiple processes) to perform. We have a large external table to migrate from one hive to another, hence we need to create it in the new hive and then repair it.

rename output error during hive query on AWSs3-external table

2020-02-04 Thread Souvikk Roy
Hello, We are using some external tables backed by aws S3. And we are intermittently getting this error, most likely at the last stage of the reduce, I see some similar posts in net but could not find any solution, Is there any way yo solve it: org.apache.hadoop.hive.ql.metadata.HiveException: