Hi ,
I've rebuild the cluster yesterday, but errors still happened. Then I scaned
the hive.log, and found a error report,
2009-01-14 10:38:42,770 ERROR parse.LoadSemanticAnalyzer
(LoadSemanticAnalyzer.java:applyConstraints(152)) - Move from:
hdfs://test.sqa:9000/user/zhoumin/weblog to: /user/hive/warehouse/log_data
is not valid
By digging into the source code, I found that the value of
fromURI.getScheme(), toURI.getScheme() are "hdfs" and null respectively.
so, how can I solve it?
On Tue, Jan 13, 2009 at 4:09 PM, Zheng Shao <zsh...@gmail.com> wrote:
> The problem is that the specification of file system
> ("hdfs://master:9000/") is different as the one specified in
> hadoop-site.xml.
> Can you make sure they match?
>
> Zheng
>
>
> On Tue, Jan 13, 2009 at 12:04 AM, Jeremy Chow <coderp...@gmail.com> wrote:
>
>> Hi,
>> this is the result:
>>
>> $ bin/hadoop dfs -ls /user/zhoumin/log/web_log2009010606
>> Found 1 items
>> -rw-r--r-- 3 hadoop supergroup 204198066 2009-01-12 16:36
>> /user/zhoumin/log/web_log2009010606
>>
>>
>> On Tue, Jan 13, 2009 at 3:43 PM, Raghu Murthy <ra...@facebook.com> wrote:
>>
>>> Can you paste the output of the following command?
>>> $ hadoop dfs -ls /user/zhoumin/log/web_log2009010606
>>>
>>>
>>> On 1/12/09 11:40 PM, "Jeremy Chow" <coderp...@gmail.com> wrote:
>>>
>>> > I've tried it, but failed.
>>> >
>>> > hive> LOAD DATA INPATH
>>> 'hdfs://master:9000/user/zhoumin/log/web_log2009010606'
>>> > OVERWRITE INTO TABLE log_data;
>>> > FAILED: Error in semantic analysis: line 1:18 Path is not legal
>>> > 'hdfs://master:9000/user/zhoumin/log/web_log2009010606': Cannot load
>>> data
>>> > across filesystems, use load data local
>>> > Time taken: 2.641 seconds
>>> >
>>> >
>>> > On Tue, Jan 13, 2009 at 11:04 AM, Joydeep Sen Sarma <
>>> jssa...@facebook.com>
>>> > wrote:
>>> >> Please give a full uri like hdfs://xxx.yyy.zzz:9000/user/S
>>> >>
>>> >>
>>> >>
>>> >> Where xxx.yyy.zzz is the same namenode/hdfs instance where u are
>>> planning to
>>> >> store the hive tables.
>>> >>
>>> >>
>>> >>
>>> >>
>>> >> From: Jeremy Chow [mailto:coderp...@gmail.com]
>>> >> Sent: Monday, January 12, 2009 6:17 PM
>>> >>
>>> >> To: hive-user@hadoop.apache.org
>>> >> Subject: Re: Can hive load a table from a SequenceFile?
>>> >>
>>> >>
>>> >>
>>> >> Hey Joydeep,
>>> >>
>>> >> - load data infile yyy into table xxx
>>> >>
>>> >> hive> LOAD DATA INPATH '/user/zhoumin/log/web_log2009010606' OVERWRITE
>>> INTO
>>> >> TABLE log_data;
>>> >> FAILED: Error in semantic analysis: line 1:18 Path is not legal
>>> >> '/user/zhoumin/log/web_log2009010606': Cannot load data across
>>> filesystems,
>>> >> use load data local
>>> >> Time taken: 0.039 seconds
>>> >>
>>> >> It failed, that file existed in hdfs, but can not be loaded into hive.
>>> >>
>>> >> --
>>> >> My research interests are distributed systems, parallel computing and
>>> >> bytecode
>>> >> based virtual machine.
>>> >>
>>> >> http://coderplay.javaeye.com
>>> >
>>> >
>>>
>>>
>>
>>
>> --
>> My research interests are distributed systems, parallel computing and
>> bytecode based virtual machine.
>>
>> http://coderplay.javaeye.com
>>
>
>
>
> --
> Yours,
> Zheng
>
--
My research interests are distributed systems, parallel computing and
bytecode based virtual machine.
http://coderplay.javaeye.com
