[
https://issues.apache.org/jira/browse/GIRAPH-198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13289293#comment-13289293
]
Andrew Purtell commented on GIRAPH-198:
---------------------------------------
Does this look like HDFS-2739?
Why is the old Hadoop RPC being used instead of the new Netty based RPC? Maybe
it's something simple we are missing like a system property define on the
'hadoop jar' commandline?
> running Giraph trunk on Hadoop 2.0.0-alpha leads to an exception
> ----------------------------------------------------------------
>
> Key: GIRAPH-198
> URL: https://issues.apache.org/jira/browse/GIRAPH-198
> Project: Giraph
> Issue Type: Bug
> Components: mapreduce
> Affects Versions: 0.2.0
> Reporter: Roman Shaposhnik
> Assignee: Jakob Homan
> Fix For: 0.2.0
>
>
> Here's how we compile:
> {noformat}
> $ mvn -Phadoop_trunk -DskipTests -Dhadoop.version=2.0.0-alpha site package
> {noformat}
> Here's how we run:
> {noformat}
> $ export GIRAPH_HOME=/usr/lib/giraph
> $ hadoop jar /usr/lib/giraph/giraph-jar-with-dependencies.jar
> org.apache.giraph.benchmark.PageRankBenchmark -e 1 -s 3 -V 100000 -w 3
> {noformat}
> Here's what we get in the task logs (as a side note -- once 3 of the 8 tasks
> fail that way the entire job hangs forever which could be a bug in and of
> itself):
> {noformat}
> 2012-05-31 10:31:28,518 WARN [main]
> org.apache.hadoop.mapred.YarnChild: Exception running child :
> java.lang.RuntimeException: java.lang.NoSuchFieldException: versionID
> at org.apache.hadoop.ipc.RPC.getProtocolVersion(RPC.java:170)
> at
> org.apache.hadoop.ipc.WritableRpcEngine$Invocation.(WritableRpcEngine.java:110)
> at
> org.apache.hadoop.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:224)
> at $Proxy11.putVertexList(Unknown Source)
> at
> org.apache.giraph.comm.BasicRPCCommunications.sendPartitionReq(BasicRPCCommunications.java:921)
> at
> org.apache.giraph.graph.BspServiceWorker.loadVertices(BspServiceWorker.java:322)
> at
> org.apache.giraph.graph.BspServiceWorker.setup(BspServiceWorker.java:594)
> at org.apache.giraph.graph.GraphMapper.setup(GraphMapper.java:473)
> at org.apache.giraph.graph.GraphMapper.run(GraphMapper.java:645)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:725)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:332)
> at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:152)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1232)
> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:147)
> Caused by: java.lang.NoSuchFieldException: versionID
> at java.lang.Class.getField(Class.java:1520)
> at org.apache.hadoop.ipc.RPC.getProtocolVersion(RPC.java:166)
> ... 15 more
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira