I have Hive running with cygwin and windows, you need to apply this
patch though:
https://issues.apache.org/jira/browse/HIVE-344
It will work fine except if you use AUX_PARAMs which I still have to
find the time to fix.
The other options for running on windows are:
* Run a Linux virtual machine (e.g.
http://www.cloudera.com/hadoop-training-virtual-machine)
* Run coLinux (www.colinux.org), which is really like a virtual machine
with linux, but it doesn't require a virtual machine software like
vmware or xen. You will still need to scp the files between the guest
linux machine and the host windows machine, so not as smooth as cygwin.
-- amr
Prasad Chakka wrote:
Hive does not support cygwin but there are developers that are running
on Windows using some other system. Hopefully they will chime in
(cc'ing the apache hive user list).
Do a 'ps --Afw | grep --I hive' to see all the hive processes on your
unix system.
Prasad
------------------------------------------------------------------------
*From: *Haritha Javvadi <[email protected]>
*Date: *Tue, 7 Jul 2009 17:34:28 -0700
*To: *Prasad Chakka <[email protected]>
*Subject: *Re: Regarding Hive
Hey,
OK.got it.Can you suggest me whats the method involved in
killing the process. What should be done to kill the process. I think,
the mistake I have done was: Opened the server through putty,later
hive and was running a query from two tables using join. It was really
slow. So I opened another window of the server and again accessed hive
from that window for another query. This was done on the same server.
Is that the problem. I have one more question. My local machine has
Windows XP OS. I read in some documents that hive does not support
cygwin. Is this information correct.
Haritha
On Tue, Jul 7, 2009 at 5:21 PM, Prasad Chakka <[email protected]>
wrote:
This is from log:
Caused by: java.sql.SQLException: Another instance of Derby may
have already booted the database /var/hive/metastore_db.
So there must be some other derby/hive process on this machine
that has opened this file. You need kill this process or recreate
metadata by deleting /var/hive/metastore_db (you will loose all
the metadata that you have created). You can check the wiki link I
have sent you on how to create a multi-user metastore (either a
derby server or a mysql server).
Prasad
------------------------------------------------------------------------
*From: *Haritha Javvadi <[email protected]
<http://[email protected]> >
*Date: *Tue, 7 Jul 2009 17:18:08 -0700
*To: *Prasad Chakka <[email protected]
<http://[email protected]> >
*Subject: *Re: Regarding Hive
Hey Prasad,
I am sorry for that.I have attached the
hive.log.Please check it out.
Haritha
On Tue, Jul 7, 2009 at 5:13 PM, Prasad Chakka
<[email protected] <http://[email protected]> > wrote:
Logs are not in hdfs but on local file system where you are
executing hive client.
------------------------------------------------------------------------
*From: *Haritha Javvadi <[email protected]
<http://[email protected]>
<http://[email protected]> >
*Date: *Tue, 7 Jul 2009 17:10:16 -0700
*To: *Prasad Chakka <[email protected]
<http://[email protected]> <http://[email protected]> >
*Subject: *Re: Regarding Hive
Hey Prasad,
I tried to get the hive.log but it didnt
show up any hive.log files in hdfs. It showed up the following:
[r...@dev1 hadoop-0.18.3]# bin/hadoop dfs -ls /tmp
Found 10 items
drwxr-xr-x - root supergroup 0 2009-07-07 07:10
/tmp/hadoop-root
drwxrwxr-x - root supergroup 0 2009-07-07 08:26
/tmp/hive-root
drwxrwxr-x - root supergroup 0 2009-07-07 07:49
/tmp/hive-root-1535651133
drwxrwxr-x - root supergroup 0 2009-07-07 07:48
/tmp/hive-root-229422445
drwxrwxr-x - root supergroup 0 2009-07-07 02:57
/tmp/hive-root1354598182
drwxrwxr-x - root supergroup 0 2009-07-07 02:58
/tmp/hive-root1385461273
drwxrwxr-x - root supergroup 0 2009-07-07 07:46
/tmp/hive-root1423264630
drwxrwxr-x - root supergroup 0 2009-07-07 07:45
/tmp/hive-root1752238682
drwxrwxr-x - root supergroup 0 2009-07-07 02:57
/tmp/hive-root1901720011
drwxrwxr-x - root supergroup 0 2009-06-30 05:16
/tmp/root
[r...@dev1 hadoop-0.18.3]# bin/hadoop fs -ls
/user/sjavvadi/hive.log
ls: Cannot access /user/sjavvadi/hive.log: No such file or
directory.
[r...@dev1 hadoop-0.18.3]# bin/hadoop fs -ls
/tmp/sjavvadi/hive.log
ls: Cannot access /tmp/sjavvadi/hive.log: No such file or
directory.
[r...@dev1 hadoop-0.18.3]# bin/hadoop dfs -ls /user
Found 2 items
drwxr-xr-x - root supergroup 0 2009-07-07 08:24
/user/hive
drwxr-xr-x - root supergroup 0 2009-06-30 06:10
/user/root
[r...@dev1 hadoop-0.18.3]# bin/hadoop dfs -ls /user/hive
Found 1 items
drwxrwxr-x - root supergroup 0 2009-07-07 08:24
/user/hive/warehouse
[r...@dev1 hadoop-0.18.3]# bin/hadoop dfs -ls /user/hive/warehouse
Found 1 items
drwxr-xr-x - root supergroup 0 2009-07-07 08:24
/user/hive/warehouse/completions
Here completions is the table I created yesterday. I deleted
all other tables and tried to create new tables but hive
stopped working.
I installed hadoop and hive based on the following link:
http://www.johnandcailin.com/blog/cailin/exploring-apache-log-files-using-hive-and-hadoop
Thank you,
Haritha
On Tue, Jul 7, 2009 at 4:59 PM, Prasad Chakka
<[email protected] <http://[email protected]>
<http://[email protected]> > wrote:
The detailed log will be at /tmp/<user_name>/hive.log and
there should be a detailed stack trace of the exception.
Could you send it to me?
------------------------------------------------------------------------
*From: *Haritha Javvadi <[email protected]
<http://[email protected]>
<http://[email protected]>
<http://[email protected]> >
*Date: *Tue, 7 Jul 2009 16:55:35 -0700
*To: *Prasad Chakka <[email protected]
<http://[email protected]>
<http://[email protected]>
<http://[email protected]> >
*Subject: *Regarding Hive
Hey,
Thanks a lot for the reply. I have
installed hadoop and hive on a my laptop initially. But
since HIVE does not support cygwin and my OS being windows
I had installation problems. Later, I tried to install it
on one of my office server. At present no one is using the
server. It was working perfectly until yesterday night.
The errors it was showing up are as follows when I try to
query tables that were created in hive or any information
about the tables.
[r...@dev1 hive]# bin/hive
Hive history
file=/tmp/root/hive_job_log_root_200907070912_1226843670.txt
hive> create table sample(text string,date_hr string,
accountid int) row format delimited by fields terminated
by '\t';
FAILED: Error in metadata:
javax.jdo.JDOFatalDataStoreException: Failed to start
database 'metastore_db', see the next exception for details.
NestedThrowables:
java.sql.SQLException: Failed to start database
'metastore_db', see the next exception for details.
FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.DDLTask
hive> show tables;
FAILED: Error in metadata:
javax.jdo.JDOFatalDataStoreException: Failed to start
database 'metastore_db', see the next exception for details.
NestedThrowables:
java.sql.SQLException: Failed to start database
'metastore_db', see the next exception for details.
FAILED: Execution Error, return code 1 from
org.apache.hadoop.hive.ql.exec.DDLTask
hive> select * from completions;
FAILED: Error in semantic analysis: Unable to fetch table
completions
Its only me using hive ,there's no one using hive and
hadoop and its installed only on one server. Please can
you help me out. Thanks a lot for your time and concern.
Regards,
Haritha
