Jeremy,
Josh had same problem and we figured out that if you have full hdfs path in
hive.metastore.warehouse.dir then below queries would work. It is bug that the
query isn't working without the full path. I suppose this workaround can be
used for now?
Prasad
hadoop-site.xml
<property>
<name>fs.default.name</name>
<value>hdfs://localhost:9000</value>
</property>
hive-default.xml
<property>
<name>hive.metastore.warehouse.dir</name>
<value>hdfs://localhost:9000/user/hive/warehouse</value>
<description>location of default database for the warehouse</description>
</property>
________________________________
From: Prasad Chakka <pra...@facebook.com>
Date: Wed, 14 Jan 2009 10:01:24 -0800
To: <hive-user@hadoop.apache.org>
Conversation: Can hive load a table from a SequenceFile?
Subject: Re: Can hive load a table from a SequenceFile?
Jeremy, could post the namenode and the metastore.warehouse variables that are
in hadoop-site.xml and hive-default.xml files. I have not seen this problem in
my setup so I want to see why it is different in my set up.
Thanks,
Prasad
________________________________
From: Joydeep Sen Sarma <jssa...@facebook.com>
Reply-To: <hive-user@hadoop.apache.org>
Date: Wed, 14 Jan 2009 09:00:38 -0800
To: <hive-user@hadoop.apache.org>
Subject: RE: Can hive load a table from a SequenceFile?
Hey Jeremy -
Looks like this was more trouble than it should have been. Can u help us by
filing a couple of Jiras on expected behavior:
1. should 'location ..' clause in create table force people to specify uri?
Or should it use fs.default.name from hadoop configuration and tell user that
it's doing so?
2. load data command - should it use scheme/authority of the target table
instead of using the fs.default.name from hadoop config?
Would fixing these issues have helped?
Thanks
Joydeep
________________________________
From: Jeremy Chow [mailto:coderp...@gmail.com]
Sent: Tuesday, January 13, 2009 9:42 PM
To: hive-user@hadoop.apache.org
Subject: Re: Can hive load a table from a SequenceFile?
Hi all,
It seems like a bug of hive. The URI of table is valued by this code in
Hive.java,
table.setDataLocation(new URI(tTable.getSd().getLocation()));
and the tTable.getSd().getLocation() is a string without prefix like "file://"
and "hdfs://" , it will causes that the scheme of URI object be null.
Jeremy
--
My research interests are distributed systems, parallel computing and bytecode
based virtual machine.
http://coderplay.javaeye.com
