Hi all: when I try contrib/index this package, I find that it can find the IndexDeletionPolicy in the Lucence jar package, but I am sure that I've copy the lucene jar lib to the hadoop/lib directory.
What I've done is belowed: $ bin/hadoop jar contrib/index/hadoop-0.17.0-dev-index.jar -inputPaths txt -outputPath output1 -indexPath index -conf conf/index-config.xml 08/04/28 09:33:20 INFO main.UpdateIndex: inputPaths = txt 08/04/28 09:33:20 INFO main.UpdateIndex: outputPath = output1 08/04/28 09:33:20 INFO main.UpdateIndex: shards = null 08/04/28 09:33:20 INFO main.UpdateIndex: indexPath = index 08/04/28 09:33:20 INFO main.UpdateIndex: numShards = -1 08/04/28 09:33:20 INFO main.UpdateIndex: numMapTasks= -1 08/04/28 09:33:20 INFO main.UpdateIndex: confPath = conf/index-config.xml 08/04/28 09:33:21 INFO main.UpdateIndex: sea.index.updater = org.apache.hadoop.contrib.index.mapred.IndexUpdater 08/04/28 09:33:21 INFO mapred.IndexUpdater: mapred.input.dir = hdfs://localhost:54310/user/guosj/txt 08/04/28 09:33:21 INFO mapred.IndexUpdater: mapred.output.dir = hdfs://localhost:54310/user/guosj/output1 08/04/28 09:33:21 INFO mapred.IndexUpdater: mapred.map.tasks = 2 08/04/28 09:33:21 INFO mapred.IndexUpdater: mapred.reduce.tasks = 1 08/04/28 09:33:21 INFO mapred.IndexUpdater: 1 shards = [EMAIL PROTECTED]/[EMAIL PROTECTED] 08/04/28 09:33:21 INFO mapred.IndexUpdater: mapred.input.format.class = org.apache.hadoop.contrib.index.example.LineDocInputFormat 08/04/28 09:33:21 WARN fs.FileSystem: "localhost:54310" is a deprecated filesystem name. Use "hdfs://localhost:54310/" instead. 08/04/28 09:33:21 INFO mapred.FileInputFormat: Total input paths to process : 4 08/04/28 09:33:21 INFO mapred.JobClient: Running job: job_200804280859_0004 08/04/28 09:33:22 INFO mapred.JobClient: map 0% reduce 0% 08/04/28 09:33:29 INFO mapred.JobClient: Task Id : task_200804280859_0004_m_000001_0, Status : FAILED java.lang.NoClassDefFoundError: org/apache/lucene/index/IndexDeletionPolicy at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:247) at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:551) at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:569) at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:595) at org.apache.hadoop.mapred.JobConf.getMapOutputValueClass(JobConf.java:577) at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.<init>(MapTask.java:324) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:177) at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:2113) $ ls lib commons-cli-2.0-SNAPSHOT.jar commons-logging-1.0.4.jar jetty-5.1.4.jar junit-3.8.1.jar kfs-0.1.LICENSE.txt servlet-api.jar commons-codec-1.3.jar commons-logging-api-1.0.4.jar jetty-5.1.4.LICENSE.txt junit-3.8.1.LICENSE.txt log4j-1.2.13.jar xmlenc-0.52.jar commons-httpclient-3.0.1.jar jets3t-0.5.0.jar jetty-ext kfs-0.1.jar lucene-core-2.3.1.jar what make me failed? Please let me known:) Thanks in advanced! Best Wishes Samuel Guo
