Well you might find it odd (I did, though) but I restarted the
computer, logged in my windows installation to check something, came
back and the problems are fixed. At least the ones I mentioned...!
I now try with the same input and jar with the following configuration
in hama-site.xml:
<configuration>
<property>
<name>bsp.master.address</name>
<value>192.168.1.2:40000</value>
<description>The address of the bsp master server. Either the
literal string "local" or a host:port for distributed mode
</description>
</property>
<property>
<name>hama.zookeeper.quorum</name>
<value>192.168.1.2</value>
<description>Comma separated list of servers in the ZooKeeper Quorum.
For example, "host1.mydomain.com,host2.mydomain.com,host3.mydomain.com".
By default this is set to localhost for local and pseudo-distributed modes
of operation. For a fully-distributed setup, this should be set to a full
list of ZooKeeper quorum servers. If HAMA_MANAGES_ZK is set in hama-env.sh
this is the list of servers which we will start/stop zookeeper on.
</description>
</property>
<property>
<name>fs.default.name</name>
<value>hdfs://192.168.1.2:54310/</value>
<description>
The name of the default file system. Either the literal string
"local" or a host:port for HDFS.
</description>
</property>
</configuration>
Now it starts 2 jobs, even though I have 1 job and the output is just
the start and end messages. All the vertices all loaded correctly but
nothing is printed from the vertices(I have some System.out.prinln in
compute).
I check the tasklogs and they are:
--- From the first job
13/10/19 19:52:58 INFO ipc.Server: Starting Socket Reader #1 for port 42141
13/10/19 19:52:58 INFO ipc.Server: IPC Server Responder: starting
13/10/19 19:52:58 INFO ipc.Server: IPC Server listener on 42141: starting
13/10/19 19:52:58 INFO ipc.Server: IPC Server handler 0 on 42141: starting
13/10/19 19:52:58 INFO message.HadoopMessageManagerImpl: BSPPeer
address:master port:42141
13/10/19 19:52:58 WARN util.NativeCodeLoader: Unable to load
native-hadoop library for your platform... using builtin-java classes
where applicable
13/10/19 19:52:58 WARN snappy.LoadSnappy: Snappy native library not loaded
13/10/19 19:52:58 INFO sync.ZKSyncClient: Initializing ZK Sync Client
13/10/19 19:52:58 INFO sync.ZooKeeperSyncClientImpl: Start connecting
to Zookeeper! At master/192.168.1.2:42141
13/10/19 19:52:59 INFO ipc.Server: Stopping server on 42141
13/10/19 19:52:59 INFO ipc.Server: IPC Server handler 0 on 42141: exiting
13/10/19 19:52:59 INFO ipc.Server: Stopping IPC Server listener on 42141
13/10/19 19:52:59 INFO ipc.Server: Stopping IPC Server Responder
13/10/19 19:52:59 ERROR bsp.BSPTask: Shutting down ping service.
--- And from the second job.
13/10/19 19:53:04 INFO ipc.Server: Starting Socket Reader #1 for port 37447
13/10/19 19:53:04 INFO ipc.Server: IPC Server Responder: starting
13/10/19 19:53:04 INFO ipc.Server: IPC Server listener on 37447: starting
13/10/19 19:53:04 INFO message.HadoopMessageManagerImpl: BSPPeer
address:master port:37447
13/10/19 19:53:04 INFO ipc.Server: IPC Server handler 0 on 37447: starting
13/10/19 19:53:04 INFO sync.ZKSyncClient: Initializing ZK Sync Client
13/10/19 19:53:04 INFO sync.ZooKeeperSyncClientImpl: Start connecting
to Zookeeper! At master/192.168.1.2:37447
13/10/19 19:53:05 INFO graph.GraphJobRunner: 5 vertices are loaded
into master:37447
13/10/19 19:53:05 INFO ipc.Server: Stopping server on 37447
13/10/19 19:53:05 INFO ipc.Server: IPC Server handler 0 on 37447: exiting
13/10/19 19:53:05 INFO ipc.Server: Stopping IPC Server listener on 37447
13/10/19 19:53:05 INFO ipc.Server: Stopping IPC Server Responder
13/10/19 19:53:05 ERROR bsp.BSPTask: Shutting down ping service.
They are the same with different ports.
I think the normal is to start one job :P
Quoting "Edward J. Yoon" <[email protected]>:
Please attach your job configuration, vertex reader and partitioner codes.
On Fri, Oct 18, 2013 at 12:44 AM, <[email protected]> wrote:
Hello there,
i just downloaded the version 0.6.3, did the configurations and wanted to
run my programs. Previously I was using hama 0.6.0. The examples are working
fine but when I give one jar of mine to be run, I have the following issue:
- It starts 2 jobs and after the first is completed without doing anything,
the second hangs and prints this:
attempt_201310172123_0009_000000_0: 13/10/17 21:37:36 INFO ipc.Server:
Starting Socket Reader #1 for port 52820
attempt_201310172123_0009_000000_0: 13/10/17 21:37:36 INFO ipc.Server: IPC
Server Responder: starting
attempt_201310172123_0009_000000_0: 13/10/17 21:37:36 INFO ipc.Server: IPC
Server listener on 52820: starting
attempt_201310172123_0009_000000_0: 13/10/17 21:37:36 INFO ipc.Server: IPC
Server handler 0 on 52820: starting
attempt_201310172123_0009_000000_0: 13/10/17 21:37:36 INFO
message.HadoopMessageManagerImpl: BSPPeer address:master port:52820
attempt_201310172123_0009_000000_0: 13/10/17 21:37:36 INFO
sync.ZKSyncClient: Initializing ZK Sync Client
attempt_201310172123_0009_000000_0: 13/10/17 21:37:36 INFO
sync.ZooKeeperSyncClientImpl: Start connecting to Zookeeper! At
master/192.168.1.2:52820
attempt_201310172123_0009_000000_0: 13/10/17 21:37:37 ERROR bsp.BSPTask:
Error running bsp setup and bsp function.
attempt_201310172123_0009_000000_0: java.lang.NullPointerException
attempt_201310172123_0009_000000_0: at
org.apache.hama.graph.GraphJobRunner.loadVertices(GraphJobRunner.java:430)
attempt_201310172123_0009_000000_0: at
org.apache.hama.graph.GraphJobRunner.setup(GraphJobRunner.java:114)
attempt_201310172123_0009_000000_0: at
org.apache.hama.bsp.BSPTask.runBSP(BSPTask.java:176)
attempt_201310172123_0009_000000_0: at
org.apache.hama.bsp.BSPTask.run(BSPTask.java:146)
attempt_201310172123_0009_000000_0: at
org.apache.hama.bsp.GroomServer$BSPPeerChild.main(GroomServer.java:1246)
attempt_201310172123_0009_000000_0: 13/10/17 21:37:37 INFO ipc.Server:
Stopping server on 52820
attempt_201310172123_0009_000000_0: 13/10/17 21:37:37 INFO ipc.Server: IPC
Server handler 0 on 52820: exiting
attempt_201310172123_0009_000000_0: 13/10/17 21:37:37 INFO ipc.Server:
Stopping IPC Server listener on 52820
attempt_201310172123_0009_000000_0: 13/10/17 21:37:37 INFO ipc.Server:
Stopping IPC Server Responder
attempt_201310172123_0009_000000_0: 13/10/17 21:37:37 ERROR bsp.BSPTask:
Shutting down ping service.
attempt_201310172123_0009_000000_0: 13/10/17 21:37:37 FATAL bsp.GroomServer:
Error running child
attempt_201310172123_0009_000000_0: java.lang.NullPointerException
attempt_201310172123_0009_000000_0: at
org.apache.hama.graph.GraphJobRunner.loadVertices(GraphJobRunner.java:430)
attempt_201310172123_0009_000000_0: at
org.apache.hama.graph.GraphJobRunner.setup(GraphJobRunner.java:114)
attempt_201310172123_0009_000000_0: at
org.apache.hama.bsp.BSPTask.runBSP(BSPTask.java:176)
attempt_201310172123_0009_000000_0: at
org.apache.hama.bsp.BSPTask.run(BSPTask.java:146)
attempt_201310172123_0009_000000_0: at
org.apache.hama.bsp.GroomServer$BSPPeerChild.main(GroomServer.java:1246)
attempt_201310172123_0009_000000_0: java.lang.NullPointerException
attempt_201310172123_0009_000000_0: at
org.apache.hama.graph.GraphJobRunner.loadVertices(GraphJobRunner.java:430)
attempt_201310172123_0009_000000_0: at
org.apache.hama.graph.GraphJobRunner.setup(GraphJobRunner.java:114)
attempt_201310172123_0009_000000_0: at
org.apache.hama.bsp.BSPTask.runBSP(BSPTask.java:176)
attempt_201310172123_0009_000000_0: at
org.apache.hama.bsp.BSPTask.run(BSPTask.java:146)
attempt_201310172123_0009_000000_0: at
org.apache.hama.bsp.GroomServer$BSPPeerChild.main(GroomServer.java:1246)
13/10/17 21:38:44 INFO bsp.BSPJobClient: Job failed.
From what I see, it has to do something either with the setup and bsp
functions or with the reader because there is NullPointerException at
loadVertices.
I don't think it is the first one cause I am using hama Graph.
Any ideas?
Thanks
--
Best Regards, Edward J. Yoon
@eddieyoon
