This is indeed the same problem stopping me from being able to insert
directly from a custom map/reduce job.
Josh F.
On Jan 13, 2009, at 7:00 PM, Jeremy Chow wrote:
Hi ,
I've rebuild the cluster yesterday, but errors still happened. Then
I scaned the hive.log, and found a error report,
2009-01-14 10:38:42,770 ERROR parse.LoadSemanticAnalyzer
(LoadSemanticAnalyzer.java:applyConstraints(152)) - Move from:
hdfs://test.sqa:9000/user/zhoumin/weblog to: /user/hive/warehouse/
log_data is not valid
By digging into the source code, I found that the value of
fromURI.getScheme(), toURI.getScheme() are "hdfs" and null
respectively.
so, how can I solve it?
On Tue, Jan 13, 2009 at 4:09 PM, Zheng Shao <zsh...@gmail.com> wrote:
The problem is that the specification of file system ("hdfs://master:
9000/") is different as the one specified in hadoop-site.xml.
Can you make sure they match?
Zheng
On Tue, Jan 13, 2009 at 12:04 AM, Jeremy Chow <coderp...@gmail.com>
wrote:
Hi,
this is the result:
$ bin/hadoop dfs -ls /user/zhoumin/log/web_log2009010606
Found 1 items
-rw-r--r-- 3 hadoop supergroup 204198066 2009-01-12 16:36 /user/
zhoumin/log/web_log2009010606
On Tue, Jan 13, 2009 at 3:43 PM, Raghu Murthy <ra...@facebook.com>
wrote:
Can you paste the output of the following command?
$ hadoop dfs -ls /user/zhoumin/log/web_log2009010606
On 1/12/09 11:40 PM, "Jeremy Chow" <coderp...@gmail.com> wrote:
> I've tried it, but failed.
>
> hive> LOAD DATA INPATH 'hdfs://master:9000/user/zhoumin/log/
web_log2009010606'
> OVERWRITE INTO TABLE log_data;
> FAILED: Error in semantic analysis: line 1:18 Path is not legal
> 'hdfs://master:9000/user/zhoumin/log/web_log2009010606': Cannot
load data
> across filesystems, use load data local
> Time taken: 2.641 seconds
>
>
> On Tue, Jan 13, 2009 at 11:04 AM, Joydeep Sen Sarma <jssa...@facebook.com
>
> wrote:
>> Please give a full uri like hdfs://xxx.yyy.zzz:9000/user/S
>>
>>
>>
>> Where xxx.yyy.zzz is the same namenode/hdfs instance where u are
planning to
>> store the hive tables.
>>
>>
>>
>>
>> From: Jeremy Chow [mailto:coderp...@gmail.com]
>> Sent: Monday, January 12, 2009 6:17 PM
>>
>> To: hive-user@hadoop.apache.org
>> Subject: Re: Can hive load a table from a SequenceFile?
>>
>>
>>
>> Hey Joydeep,
>>
>> - load data infile yyy into table xxx
>>
>> hive> LOAD DATA INPATH '/user/zhoumin/log/web_log2009010606'
OVERWRITE INTO
>> TABLE log_data;
>> FAILED: Error in semantic analysis: line 1:18 Path is not legal
>> '/user/zhoumin/log/web_log2009010606': Cannot load data across
filesystems,
>> use load data local
>> Time taken: 0.039 seconds
>>
>> It failed, that file existed in hdfs, but can not be loaded into
hive.
>>
>> --
>> My research interests are distributed systems, parallel computing
and
>> bytecode
>> based virtual machine.
>>
>> http://coderplay.javaeye.com
>
>
--
My research interests are distributed systems, parallel computing
and bytecode based virtual machine.
http://coderplay.javaeye.com
--
Yours,
Zheng
--
My research interests are distributed systems, parallel computing
and bytecode based virtual machine.
http://coderplay.javaeye.com
