Re: hadoop index org/apache/lucene/store/Directory NoClassDefFoundError

2008-10-10 Thread imcaptor
U must download the lucene binary jar file,and set the jar file in the classpath. chenlbspace 写道: > hi, > > I try to use contrib/index/hadoop-0.17.1-index.jar build lucene index, but > Directory NoClassDefFoundError. > > How solve? Thinks. > > Additional, hadoop run Pseudo-Distributed Mode. and

Re: hadoop index org/apache/lucene/store/Directory NoClassDefFoundError

2008-10-10 Thread imcaptor
The jar file is in the src/contrib/index/lib/lucene-core-2.3.1.jar, u must set the file in classpath. imcaptor 写道: > U must download the lucene binary jar file,and set the jar file in the > classpath. > > chenlbspace 写道: > >> hi, >> >> I try to use contrib/in

Re: hadoop index org/apache/lucene/store/Directory NoClassDefFoundError

2008-10-10 Thread imcaptor
Try do this. In the hadoop path, -bash-3.00$ pwd /data/hadoop/hadoop-0.18.1 cp src/contrib/index/lib/lucene-core-2.3.1.jar lib Then you can run the task. chenlbspace 写道: > hi, > > I try to use contrib/index/hadoop-0.17.1-index.jar build lucene index, but > Directory NoClassDefFoundError. > >

Re: getting HDFS to rack-aware mode

2008-10-14 Thread imcaptor
I get this error: -bash-3.00$ ./bin/hadoop fsck / Exception in thread "main" java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:333) at java.net.PlainSocketImpl.connectToAddress(PlainSoc

Re: getting HDFS to rack-aware mode

2008-10-14 Thread imcaptor
replication: 2.0 Corrupt blocks:0 Missing replicas: 8 (80.0 %) Number of data-nodes: 2 Number of racks: 1 imcaptor 写道: I get this error: -bash-3.00$ ./bin/hadoop fsck / Exception in thread "main" java.net.ConnectException: Connection

Re: Why can't I use hostname in hadoop-site.xml?

2008-10-17 Thread imcaptor
If use change the hostname, you must change /etc/hosts and /etc/sysconfig/network for example: -bash-3.00$ more /etc/hosts # Do not remove the following line, or various programs # that require network functionality will fail. 127.0.0.1 localhost.localdomain localhost 192.168.102.205 hadoop205.te

If I use the third party jar file, where will I put the file?

2008-10-20 Thread imcaptor

Re: how to improve the Hadoop's capability of dealing with small files

2009-05-06 Thread imcaptor
Please try -D dfs.block.size=4096000 The specification must be in bytes. On Tue, May 5, 2009 at 4:47 AM, Christian Ulrik Søttrup wrote: - 隐藏引用文字 - > Hi all, > > I have a job that creates very big local files so i need to split it to as > many mappers as possible. Now the DFS block size I'm > us

any one know how to patch HADOOP-4652-v3.patch RAgzip: multiple map tasks for a large gzipped file

2009-05-11 Thread imcaptor
RAgzip: multiple map tasks for a large gzipped file https://issues.apache.org/jira/browse/HADOOP-4652 Thank you!

Is Mapper's map method thread safe?

2009-05-13 Thread imcaptor
Dear all: Any one knows Is Mapper's map method thread safe? Thank you! imcaptor

Re: Announcing CloudBase-1.3.1 release

2009-06-21 Thread imcaptor
When you use cloudbase, you can create different table for different daily files. For example, your directory will like this. logs /200905 /20090501.log.gz /20090502.log.gz /200906 /20090601.log.gz /20090602.log.gz Y

Re: Hadoop0.20 - Class Not Found exception

2009-06-26 Thread imcaptor
I meet the question also, resolved by transfer a class name to JobConf constructor. If you new the *JobConf,you must transfer a class name to it.* 2009/6/27 Amandeep Khurana > I'm getting the following error while starting a MR job: > > Caused by: java.lang.RuntimeException: java.lang.ClassNo