RE: Need urgent help

2014-07-02 Thread shouvanik.haldar
-rw-r--r-T 1 ipg_intg_user supergroup 621942 2014-05-20 21:33 hdfs://xx.xx.xx.xxx:9000/user/ipg_intg_user/AP/scripts/lib/wsaUtils.jar From: Andre Araujo [mailto:ara...@pythian.com] Sent: Tuesday, July 01, 2014 10:46 PM To: user Subject: Re: Need urgent help What's the result of the

Re: Need urgent help

2014-07-02 Thread shouvanik.haldar
This copy was successful. The file was not corrupted Sent from Samsung Mobile Original message From: Andre Araujo Date:01/07/2014 23:45 (GMT-08:00) To: user Subject: Re: Need urgent help Can you try the following to check if there's any problem with the jar itself? hadoop

Re: Need urgent help

2014-07-02 Thread shouvanik.haldar
Yes. Sent from Samsung Mobile Original message From: Andre Araujo Date:02/07/2014 00:10 (GMT-08:00) To: user Subject: Re: Need urgent help Did you manage to load the jar from the local file? On 2 July 2014 16:57,

Need urgent help

2014-07-01 Thread shouvanik.haldar
Hi, Cannot add a jar to hive classpath. Once I launch HIVE, I type - ADD JAR hdfs://10.37.83.117:9000/user/ipg_intg_user/AP/scripts/lib/wsaUtils.jar; I get the error, Failed to read external resource hdfs://10.37.83.117:9000/user/ipg_intg_user/AP/scripts/lib/wsaUtils.jar Query returned non-zero

Recall: Need urgent help

2014-07-01 Thread shouvanik.haldar
Haldar, Shouvanik would like to recall the message, Need urgent help. This message is for the designated recipient only and may contain privileged, proprietary, or otherwise confidential information. If you have received it in error, please notify the sender

Recall: Need urgent help

2014-07-01 Thread shouvanik.haldar
Haldar, Shouvanik would like to recall the message, Need urgent help. This message is for the designated recipient only and may contain privileged, proprietary, or otherwise confidential information. If you have received it in error, please notify the sender

RE: Need urgent help

2014-07-01 Thread shouvanik.haldar
Can you please elaborate on the permission Hi, Cannot add a jar to hive classpath. Once I launch HIVE, I type - ADD JAR hdfs://xx.xx.xx.xxx:9000/user/ipg_intg_user/AP/scripts/lib/wsaUtils.jar; I get the error, Failed to read external resource

RE: Need urgent help

2014-07-01 Thread shouvanik.haldar
The user has read permission Its rw-r—r— Thanks, Shouvanik From: hadoop hive [mailto:hadooph...@gmail.com] Sent: Tuesday, July 01, 2014 9:45 PM To: user@hive.apache.org Subject: RE: Need urgent help Jar must have read permission by that user. Which you are using to run the jobs. On Jul 2, 2014

Re: Need urgent help

2014-07-01 Thread shouvanik.haldar
Yes Sent from Samsung Mobile Original message From: Abirami V Date:01/07/2014 22:15 (GMT-08:00) To: user@hive.apache.org Subject: Re: Need urgent help Hi, have you add the property in hive( hive.aux.jars.path. The location of the plugin jars that contain implementations

Getting weird error after M/R job completes with status as 100%

2014-06-27 Thread shouvanik.haldar
Hi Nitin, I have a M/R job which gets executed as soon as a hive query runs. This hive query has many complex joins. Both the Map/Reduce jobs complete with status at 100%, after which I get the below error 2014-06-27 23:42:06,396 INFO org.apache.hadoop.hive.ql.exec.Task

Need urgent help on hive query performance

2014-05-30 Thread shouvanik.haldar
Hi, Does anybody help urgently on optimizing hive query performance? I am looking more Hadoop tuning point of view. Currently, small amount of table takes much time to query? We are running EMR cluster with 1 MASTER node, 2 Core Nodes and Task Nodes. Quick help is much appreciated. Thanks,

RE: Need urgent help on hive query performance

2014-05-30 Thread shouvanik.haldar
Pls find the answers From: kulkarni.swar...@gmail.com [mailto:kulkarni.swar...@gmail.com] Sent: Friday, May 30, 2014 3:34 PM To: user@hive.apache.org Subject: Re: Need urgent help on hive query performance I feel it's pretty hard to answer this without understanding the following: 1.

RE: Is there any monitoring tool available for hiveserver2

2014-02-21 Thread shouvanik.haldar
Thanks Biswajit. I will try it and let you know. Thanks, Shouvanik From: Biswajit Nayak [mailto:biswajit.na...@inmobi.com] Sent: Friday, February 21, 2014 2:28 AM To: user@hive.apache.org Subject: Re: Is there any monitoring tool available for hiveserver2 Below is the script that does my

RE: Is there any monitoring tool available for hiveserver2

2014-02-21 Thread shouvanik.haldar
Sure thing. Thanks Biswajit. Thanks, Shouvanik From: Biswajit Nayak [mailto:biswajit.na...@inmobi.com] Sent: Friday, February 21, 2014 9:23 AM To: user@hive.apache.org Subject: RE: Is there any monitoring tool available for hiveserver2 This one is for monitoring of metastore only. It has

Is there any monitoring tool available for hiveserver2

2014-02-20 Thread shouvanik.haldar
Hi, It might happen that hiveserver2 memory gets exhausted. Similarly there would be many other things to monitor for hiveserver2. Is there any monitoring tool available in the market? I am using EMR, for FYI. Thanks, Shouvanik This message is for the

RE: Is there any monitoring tool available for hiveserver2

2014-02-20 Thread shouvanik.haldar
Hi Biswajit, Could you give an idea of how to do it, please? Thanks, Shouvanik From: Biswajit Nayak [mailto:biswajit.na...@inmobi.com] Sent: Thursday, February 20, 2014 8:30 PM To: user@hive.apache.org Subject: Re: Is there any monitoring tool available for hiveserver2 I have built up a

RE: hiveserver2 crashes now and then

2014-02-19 Thread shouvanik.haldar
Hey, Thanks for the reply. But we were looking at options on how to resize the Hadoop_heapsize parameter, so that hiveserver2 don't crash next time? Is there any good write-up on this? Thanks, Shouvanik From: Brad Ruderman [mailto:bruder...@radiumone.com] Sent: Tuesday, February 18, 2014

hiveserver2 crashes now and then

2014-02-18 Thread shouvanik.haldar
Hi, HiveServer2 is getting crashed every now and then, within an interval to 2 days or so. Is this related to memory leak or something? Developers are executing very complex queries which they suspect is causing the problem. Please help. Thanks, Shouvanik

RE: Adding a table in HIVE does not create a table on mysql which is the metastore

2013-12-26 Thread shouvanik.haldar
Hi, I will check and let you know. Thanks, Shouvanik From: zeekvfu [mailto:wzmind...@gmail.com] Sent: Thursday, December 26, 2013 12:46 PM To: user@hive.apache.org Subject: Re: Adding a table in HIVE does not create a table on mysql which is the metastore You can get the table name, using:

RE: Adding a table in HIVE does not create a table on mysql which is the metastore

2013-12-26 Thread shouvanik.haldar
Hi, Which database should I select in MYSQL? I have two databases presently mysql show databases; ++ | Database | ++ | information_schema | | test | ++ 2 rows in set (0.00 sec) And once inside test database, I

RE: Adding a table in HIVE does not create a table on mysql which is the metastore

2013-12-26 Thread shouvanik.haldar
After adding this, do we have to restart mysql / hive? From: Satish Mittal [mailto:satish.mit...@inmobi.com] Sent: Thursday, December 26, 2013 4:41 PM To: user@hive.apache.org Subject: Re: Adding a table in HIVE does not create a table on mysql which is the metastore Can you check the following

Adding a table in HIVE does not create a table on mysql which is the metastore

2013-12-25 Thread shouvanik.haldar
Hi, I am exploring HIVE options on EMR box from Amazon. Once I create a table from HUE(Hadoop User Experience) console, I expect a table to get created on MYSQL as this is the metastore. But I don't find the table inside MYSQL database. Any ideas? Thanks, Shouvanik

Re: Error when issuing select query

2013-11-15 Thread shouvanik.haldar
Below is the message that I get. Sent from Samsung Mobile Original message From: Nitin Pawar Date:15/11/2013 16:30 (GMT+05:30) To: Shouvanik Haldar (Contingent) Cc: user@hive.apache.org Subject: Re: Error when issuing select query what is the error ? On Fri, Nov 15, 2013

Looking for help related to HUE

2013-10-01 Thread shouvanik.haldar
Hi Nitin, Can you please help me with HUE issue. I am not able to create table in HUE using HCatalog? Thanks, Shouvanik This message is for the designated recipient only and may contain privileged, proprietary, or otherwise confidential information. If you

Not able to execute this query

2013-09-30 Thread shouvanik.haldar
When I executing the query to create table in HIVE, I am getting this error. 'NoneType' object has no attribute 'columns' The table script below create external table test1( - ) PARTITIONED BY (col1 timestamp, col2 timestamp) CLUSTERED BY(col1) SORTED BY(col1

RE: Not able to execute this query

2013-09-30 Thread shouvanik.haldar
Hi, Have you used HUE WEB console. Actually I have not used same columns. But, when I give a query, I get that error.! Please help? Thanks, Shouvanik From: Nitin Pawar [mailto:nitinpawar...@gmail.com] Sent: Monday, September 30, 2013 7:34 PM To: user@hive.apache.org Subject: Re: Not able to

RE: Not able to execute this query

2013-09-30 Thread shouvanik.haldar
Hi Nitin, Thanks. That answers my previous query. But, if I add LOCATION '/user/hue/' string below, I get a big fat exception in beeswax. Thanks, Shouvanik From: Nitin Pawar [mailto:nitinpawar...@gmail.com] Sent: Monday, September 30, 2013 8:22 PM To: user@hive.apache.org Subject: Re: Not able

RE: Not able to execute this query

2013-09-30 Thread shouvanik.haldar
Thanks Nitin. I am able to create the table in HUE now. You are right. There was no directory and no permission accordingly. Thanks, Shouvanik From: Nitin Pawar [mailto:nitinpawar...@gmail.com] Sent: Monday, September 30, 2013 9:08 PM To: Haldar, Shouvanik Cc: user@hive.apache.org Subject: Re:

Doing FSCK throws error

2013-09-30 Thread shouvanik.haldar
Hi, On executing MSCK REPAIR TABLE table1, I get the below error. FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask What can possibly be the error. Thanks, Shouvnik This message is for the designated recipient only and may

RE: Doing FSCK throws error

2013-09-30 Thread shouvanik.haldar
The script for this table is add jar json-serde-1.1.3-jar-with-dependencies.jar; list jars; CREATE EXTERNAL TABLE IF NOT EXISTS table1 ( instance_type string, category string, session_id string, nonce string, user_id string, properties arraystructname : string, value : string, instance

User accounts to execute hive queries

2013-09-16 Thread shouvanik.haldar
Hi, Can you please tell me if its possible to execute hive queries as different users? Can we create read-only access for hive? Please help. Thanks Shouvanik Sent from my Windows Phone -Original Message- From: Nitin Pawar nitinpawar...@gmail.com Sent: ‎16-‎09-‎2013 15:57 To:

RE: User accounts to execute hive queries

2013-09-16 Thread shouvanik.haldar
Hi Nitin, Users want to execute hive queries from their user name? Is it possible or they have to do it logged in as hive user? Thanks, Shouvanik -Original Message- From: Haldar, Shouvanik Sent: Monday, September 16, 2013 4:06 PM To: user@hive.apache.org Subject: User accounts to

RE: error executing the tutorial - https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

2013-09-10 Thread shouvanik.haldar
Hi Nitin, PFA hive-site.xml. I wanted to start Hortonworks HIVE. Can you please help. Thanks, Shouvanik From: Nitin Pawar [mailto:nitinpawar...@gmail.com] Sent: Tuesday, September 10, 2013 11:15 AM To: user@hive.apache.org Subject: Re: error executing the tutorial -

RE: error executing the tutorial - https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

2013-09-10 Thread shouvanik.haldar
The values are showing when I run hive set; command. But it's not getting identified. I guess I am not starting HIVE properly. Do you know what are the steps? From: Nitin Pawar [mailto:nitinpawar...@gmail.com] Sent: Tuesday, September 10, 2013 4:04 PM To: user@hive.apache.org Subject: Re: error

RE: error executing the tutorial - https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

2013-09-10 Thread shouvanik.haldar
The issue is if I paste it in core-site.xml of Hadoop on the node in question, then will starting datanode would do only? Actually,. I am a bit confused what all daemons to start. I have a YARN architecture running 1 separate - Resource Manager, 1 NameNode 4 datanodes. From: Nitin Pawar

RE: error executing the tutorial - https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

2013-09-10 Thread shouvanik.haldar
Sorry again. File system will be hadoop Sent from my Windows Phone From: Haldar, Shouvanikmailto:shouvanik.hal...@accenture.com Sent: ‎10-‎09-‎2013 16:59 To: user@hive.apache.orgmailto:user@hive.apache.org Subject: RE: error executing the tutorial -

RE: error executing the tutorial - https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

2013-09-10 Thread shouvanik.haldar
Hi Nitin, Latest update. Am able to start metastore and table getting created. But when I execute the command “hive select * from table_name”, hive compaints Failed with exception java.io.IOException:java.lang.IllegalArgumentException: AWS Access Key ID and Secret Access Key must be specified

RE: error executing the tutorial - https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

2013-09-09 Thread shouvanik.haldar
Hi Nitin, Please help me with the below? Thanks, Shouvanik From: Haldar, Shouvanik Sent: Saturday, September 07, 2013 2:30 AM To: user@hive.apache.org Subject: RE: error executing the tutorial - https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely Hi , I tried to set

RE: error executing the tutorial - https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

2013-09-09 Thread shouvanik.haldar
When I set values inside hive-site.xml test whether values are set by typing hive set; I see that the values are set. Yet, when I run CREATE EXTERNAL TABLE... command, I get the same error FAILED: Error in metadata: MetaException(message:java.lang.IllegalArgumentException: AWS Access Key ID

RE: error executing the tutorial - https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

2013-09-09 Thread shouvanik.haldar
Please help. I am badly stuck on this. Please help. From: Haldar, Shouvanik Sent: Tuesday, September 10, 2013 1:03 AM To: 'user@hive.apache.org' Subject: RE: error executing the tutorial - https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely When I set values inside

RE: error executing the tutorial - https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

2013-09-06 Thread shouvanik.haldar
Hi, Is it possible to permanently set the below parameters? Please help. Thanks, SHouvanik From: Jitendra Yadav [mailto:jeetuyadav200...@gmail.com] Sent: Thursday, September 05, 2013 6:02 PM To: user@hive.apache.org Subject: Re: error executing the tutorial -

RE: error executing the tutorial - https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

2013-09-06 Thread shouvanik.haldar
Hi , I tried to set the parameters inside hive-site.xml on the node from where I am running hive. Even hiveset; command showed me that the parameters were successfully set. Yet, when running hive CREATE EXTERNAL TABLE..., I am getting the following error FAILED: Error in metadata:

RE: error executing the tutorial - https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

2013-09-06 Thread shouvanik.haldar
Hi, Can anybody please reply to this below? I am stuck up very bad. Regards, Shouvanik From: Haldar, Shouvanik Sent: Friday, September 06, 2013 11:22 PM To: user@hive.apache.org Subject: RE: error executing the tutorial -

error executing the tutorial - https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

2013-09-05 Thread shouvanik.haldar
Hi, I am executing the example, but got initial roadblock while trying out Setting up tables (DDL Statements) section. When I executed the command hive create external table kv (key int, values string) location 's3n://data.s3ndemo.hive/kv'; I got the error FAILED: Error in metadata:

RE: error executing the tutorial - https://cwiki.apache.org/confluence/display/Hive/HiveAws+HivingS3nRemotely

2013-09-05 Thread shouvanik.haldar
Hi, Thanks for the reply. I had seen in some posts, that you could mention these keys on the Hive CLI. If things work, then I am later planning to include it in core-site.xml of Hadoop config. Presently, I am not allowed to restart Hadoop services. create external table . LOCATION