FYI, the final commit on HADOOP-189 was failing for me in really weird
ways. Compiling hadoop with 1.6.0beta2 looks to be the culprit.
Just starting up daemons in pseudo-distributed mode, usually NameNode
and TaskTracker would fail with exceptions like the following:
060503 180738 12 Client connection to 127.0.0.1:9000 caught:
java.lang.RuntimeException: java.lang.ClassNotFoundException:
[Lorg.apache.hadoop.dfs.Block;
java.lang.RuntimeException: java.lang.ClassNotFoundException:
[Lorg.apache.hadoop.dfs.Block;
at
org.apache.hadoop.io.ObjectWritable.readObject(ObjectWritable.java:177)
at
org.apache.hadoop.io.ObjectWritable.readFields(ObjectWritable.java:60)
at org.apache.hadoop.ipc.Client$Connection.run(Client.java:170)
Or...
060503 175932 Client connection to 127.0.0.1:9001 caught:
java.lang.RuntimeException: java.lang.ClassNotFoundException:
[Ljava.lang.String;
java.lang.RuntimeException: java.lang.ClassNotFoundException:
[Ljava.lang.String;
at
org.apache.hadoop.io.ObjectWritable$NullInstance.readFields(ObjectWritable.java:94)
at
org.apache.hadoop.io.ObjectWritable.readObject(ObjectWritable.java:230)
at
org.apache.hadoop.io.ObjectWritable.readFields(ObjectWritable.java:60)
at org.apache.hadoop.ipc.Client$Connection.run(Client.java:170)
I'd compiled hadoop with beta2 1.6.0:
[bregeon 1506] hadoop > /usr/local/jdk1.6.0/bin/java -version
java version "1.6.0-beta2"
Java(TM) SE Runtime Environment (build 1.6.0-beta2-b76)
Java HotSpot(TM) 64-Bit Server VM (build 1.6.0-beta2-b76, mixed mode)
After recompiling with 1.5.0_06, the above issues went away.
St.Ack
Doug Cutting (JIRA) wrote:
[ http://issues.apache.org/jira/browse/HADOOP-189?page=all ]
Doug Cutting updated HADOOP-189:
--------------------------------
Attachment: local-jar2.patch
Here's a patch I've actually tested!
Add job jar lib, classes, etc. to CLASSPATH when in standalone mode
-------------------------------------------------------------------
Key: HADOOP-189
URL: http://issues.apache.org/jira/browse/HADOOP-189
Project: Hadoop
Type: New Feature
Components: mapred
Reporter: [EMAIL PROTECTED]
Attachments: local-jar.patch, local-jar2.patch
Currently, in standalone mode, hadoop is unable to launch other than the most
basic of job jars where 'basic' is a job jar with nought but class files at top
level of the jar with Main-Class pointing at entry point. If the job jar has
dependencies on jars under the job jar lib or there are job jar plugins in the
classes dir, etc., these dependencies are not loaded and the job fails launch.
