exporting and importing a schema/database from Hive Test to Hive DEV

2015-11-11 Thread Ashok Kumar
Hi gurus, What is the easiest way of exporting one database in Hive in Test and importing it to say DEV database in another instance. How metastore at target will handle this please? Thanks 

Re: exporting and importing a schema/database from Hive Test to Hive DEV

2015-11-11 Thread Chetna C
Hi Ashok, You can achieve this by either sharing same metastore between test and dev instance. With isolated access to databases , say test-user and dev-user, where dev-user can access all test databases.Or you can use Hive/LanguageManual+ImportExport

Re: Small files under SequenceFile table partition directories

2015-11-11 Thread Chetna C
You can get rid of processing overhead by using splittable compression for your hive table data, something like 4mc . Or you can use hadoop's getmerge utility to merge small files periodically. Thanks, Chetna Chaudhari On 11 November 2015 at 10:56, reveen joe

Re: Hive Server2 Monitoring

2015-11-11 Thread Szehon Ho
There is ongoing work to add the metrics to HiveServer2 (HIVE-10761), it is in progress for Hive 2.0. This already has some basic metrics like connection and JVM metrics as you mentioned, and we hope to add more soon. Thanks Szehon On Wed, Nov 11, 2015 at 11:43 AM, Udit Mehta

Hive Server2 Monitoring

2015-11-11 Thread Udit Mehta
Hi, I was planning to use the Hive Server2 in production and was wondering how others monitor the Hive Server2 usage. I saw some recent errors related to the PermGen and Heap Space so maybe that could be a start. It would also be useful to detect some unusual activity like a sudden increase in

Re: Hive Server2 Monitoring

2015-11-11 Thread Udit Mehta
Yes thats right. We dont use Cloudera Manager so cannot use that. Increasing the PermGen and Heap space is what I did as well but I still have no insight into what causes it to increase. On Wed, Nov 11, 2015 at 11:23 AM, Personal wrote: > We use Cloudera Manager, but I’m

Re: Hive Server2 Monitoring

2015-11-11 Thread Personal
We use Cloudera Manager, but I’m guessing since you’re asking you don’t use that. We also had an issue with PermGen and Heap Space — the default settings had these very low so we were getting OOM errors for very simple requests.