[
https://issues.apache.org/jira/browse/GIRAPH-601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13617717#comment-13617717
]
Eugene Koontz commented on GIRAPH-601:
--------------------------------------
Yes, I think somehow the configuration setting is not being respected even
though I'm seeing "split master/worker = true" in the console output:
{code}
.....
013-03-29 13:47:13,094 INFO security.TokenCache
(TokenCache.java:obtainTokensForNamenodesInternal(125)) - Got dt for
hdfs://ekoontz1:8020; Kind: HDFS_DELEGATION_TOKEN, Service: ha-hdfs:ekoontz1,
Ident: (HDFS_DELEGATION_TOKEN token 17 for ekoontz)
2013-03-29 13:47:13,331 DEBUG bsp.BspInputFormat
(BspInputFormat.java:getMaxTasks(60)) - getMaxTasks: Max workers = 6, split
master/worker = true, total max tasks = 7
2013-03-29 13:47:13,374 INFO mapreduce.JobSubmitter
(JobSubmitter.java:submitJobInternal(369)) - number of splits:7
2013-03-29 13:47:13,388 WARN conf.Configuration
(Configuration.java:warnOnceIfDeprecated(817)) - mapred.jar is deprecated.
Instead, use mapreduce.job.jar
2013-03-29 13:47:13,389 WARN conf.Configuration
(Configuration.java:warnOnceIfDeprecated(817)) - mapred.reduce.tasks is
deprecated. Instead, use mapreduce.job.reduces
2013-03-29 13:47:13,389 WARN conf.Configuration
(Configuration.java:warnOnceIfDeprecated(817)) - mapreduce.map.class is
deprecated. Instead, use mapreduce.job.map.class
2013-03-29 13:47:13,390 WARN conf.Configuration
(Configuration.java:warnOnceIfDeprecated(817)) - mapred.job.name is deprecated.
Instead, use mapreduce.job.name
2013-03-29 13:47:13,390 WARN conf.Configuration
(Configuration.java:warnOnceIfDeprecated(817)) - mapreduce.inputformat.class is
deprecated. Instead, use mapreduce.job.inputformat.class
2013-03-29 13:47:13,390 WARN conf.Configuration
(Configuration.java:warnOnceIfDeprecated(817)) - mapreduce.outputformat.class
is deprecated. Instead, use mapreduce.job.outputformat.class
2013-03-29 13:47:13,390 WARN conf.Configuration
(Configuration.java:warnOnceIfDeprecated(817)) - mapred.map.tasks is
deprecated. Instead, use mapreduce.job.maps
...
{code}
> Exception when running pagerank benchmark: SendVertexRequest cannot be cast
> to MasterRequest
> --------------------------------------------------------------------------------------------
>
> Key: GIRAPH-601
> URL: https://issues.apache.org/jira/browse/GIRAPH-601
> Project: Giraph
> Issue Type: Bug
> Reporter: Eugene Koontz
>
> Building Giraph with:
> {code}
> mvn -DskipTests -Phadoop_2.0.3 clean compile
> {code}
> Running pagerank like this:
> {code}
> $HADOOP_RUNTIME/bin/hadoop jar $JAR \
> org.apache.giraph.benchmark.PageRankBenchmark \
> -e 10 -s 10 -v -V 10 -w 6
> {code}
> I see this in
> /tmp/userlogs/application_1364578380737_0003/container_1364578380737_0003_01_000002/
> :
> {code}
> 2013-03-29 10:58:06,371 DEBUG [org.apache.giraph.master.MasterThread]
> org.apache.giraph.master.BspServiceMaster: barrierOnWorkerList: Got finished
> worker list = [Eugenes-MacBook-Pro.local_1, Eugenes-MacBook-Pro.local_3],
> size = 2, worker list = [Worker(hostname=Eugenes-MacBook-Pro.local,
> MRtaskID=2, port=30002), Worker(hostname=Eugenes-MacBook-Pro.local,
> MRtaskID=1, port=30001), Worker(hostname=Eugenes-MacBook-Pro.local,
> MRtaskID=4, port=30004), Worker(hostname=Eugenes-MacBook-Pro.local,
> MRtaskID=3, port=30003), Worker(hostname=Eugenes-MacBook-Pro.local,
> MRtaskID=5, port=30005), Worker(hostname=Eugenes-MacBook-Pro.local,
> MRtaskID=0, port=30010)], size = 6 from
> /_hadoopBsp/job_1364578380737_0003/_vertexInputSplitDoneDir
> 2013-03-29 10:58:06,373 WARN [netty-server-exec-3]
> org.apache.giraph.comm.netty.handler.RequestServerHandler: exceptionCaught:
> Channel failed with remote address /172.16.175.1:56236
> java.lang.ClassCastException:
> org.apache.giraph.comm.requests.SendVertexRequest cannot be cast to
> org.apache.giraph.comm.requests.MasterRequest
> at
> org.apache.giraph.comm.netty.handler.MasterRequestServerHandler.processRequest(MasterRequestServerHandler.java:27)
> at
> org.apache.giraph.comm.netty.handler.RequestServerHandler.messageReceived(RequestServerHandler.java:106)
> at
> org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:296)
> at
> org.jboss.netty.handler.codec.oneone.OneToOneDecoder.handleUpstream(OneToOneDecoder.java:71)
> at
> org.jboss.netty.handler.execution.ChannelUpstreamEventRunnable.doRun(ChannelUpstreamEventRunnable.java:45)
> at
> org.jboss.netty.handler.execution.ChannelEventRunnable.run(ChannelEventRunnable.java:69)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:895)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:918)
> at java.lang.Thread.run(Thread.java:680)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
