This is the latest message log where a node is trying to join the other
node which is already running neo4j embedded server...
2014-09-05 08:45:21.895+0000 INFO [org.neo4j]: --- INITIALIZED diagnostics
END ---
2014-09-05 08:45:22.115+0000 INFO [org.neo4j]: Creating new db @
/data/neo4j/lrPhoenix.db/neostore
2014-09-05 08:45:22.228+0000 INFO [org.neo4j]:
[/data/neo4j/lrPhoenix.db/neostore.relationshiptypestore.db.names]
brickCount=0 brickSize=0b mappedMem=0b (storeSize=38b)
2014-09-05 08:45:22.232+0000 INFO [org.neo4j]:
[/data/neo4j/lrPhoenix.db/neostore.relationshiptypestore.db] brickCount=0
brickSize=0b mappedMem=0b (storeSize=0b)
2014-09-05 08:45:22.240+0000 INFO [org.neo4j]:
/data/neo4j/lrPhoenix.db/neostore.relationshiptypestore.db.names hit=0
miss=0 switches=0 ooe=0
2014-09-05 08:45:22.244+0000 INFO [org.neo4j]:
/data/neo4j/lrPhoenix.db/neostore.relationshiptypestore.db hit=0 miss=0
switches=0 ooe=0
2014-09-05 08:45:22.260+0000 INFO [org.neo4j]:
[/data/neo4j/lrPhoenix.db/neostore.labeltokenstore.db.names] brickCount=0
brickSize=0b mappedMem=0b (storeSize=38b)
2014-09-05 08:45:22.261+0000 INFO [org.neo4j]:
[/data/neo4j/lrPhoenix.db/neostore.labeltokenstore.db] brickCount=0
brickSize=0b mappedMem=0b (storeSize=0b)
2014-09-05 08:45:22.263+0000 INFO [org.neo4j]:
/data/neo4j/lrPhoenix.db/neostore.labeltokenstore.db.names hit=0 miss=0
switches=0 ooe=0
2014-09-05 08:45:22.267+0000 INFO [org.neo4j]:
/data/neo4j/lrPhoenix.db/neostore.labeltokenstore.db hit=0 miss=0
switches=0 ooe=0
2014-09-05 08:45:22.279+0000 INFO [org.neo4j]:
[/data/neo4j/lrPhoenix.db/neostore.relationshiptypestore.db.names]
brickCount=0 brickSize=0b mappedMem=0b (storeSize=38b)
2014-09-05 08:45:22.280+0000 INFO [org.neo4j]:
[/data/neo4j/lrPhoenix.db/neostore.relationshiptypestore.db] brickCount=0
brickSize=0b mappedMem=0b (storeSize=0b)
2014-09-05 08:45:22.280+0000 INFO [org.neo4j]:
[/data/neo4j/lrPhoenix.db/neostore.labeltokenstore.db.names] brickCount=0
brickSize=0b mappedMem=0b (storeSize=38b)
2014-09-05 08:45:22.281+0000 INFO [org.neo4j]:
[/data/neo4j/lrPhoenix.db/neostore.labeltokenstore.db] brickCount=0
brickSize=0b mappedMem=0b (storeSize=0b)
2014-09-05 08:45:22.281+0000 INFO [org.neo4j]:
[/data/neo4j/lrPhoenix.db/neostore.propertystore.db.strings] brickCount=0
brickSize=538880b mappedMem=538968064b (storeSize=128b)
2014-09-05 08:45:22.282+0000 INFO [org.neo4j]:
[/data/neo4j/lrPhoenix.db/neostore.propertystore.db.index.keys]
brickCount=0 brickSize=0b mappedMem=0b (storeSize=38b)
2014-09-05 08:45:22.283+0000 INFO [org.neo4j]:
[/data/neo4j/lrPhoenix.db/neostore.propertystore.db.index] brickCount=0
brickSize=0b mappedMem=0b (storeSize=0b)
2014-09-05 08:45:22.284+0000 INFO [org.neo4j]:
[/data/neo4j/lrPhoenix.db/neostore.propertystore.db.arrays] brickCount=0
brickSize=611200b mappedMem=611319808b (storeSize=128b)
2014-09-05 08:45:22.291+0000 INFO [org.neo4j]:
[/data/neo4j/lrPhoenix.db/neostore.propertystore.db] brickCount=0
brickSize=6343848b mappedMem=634388480b (storeSize=0b)
2014-09-05 08:45:22.295+0000 INFO [org.neo4j]:
[/data/neo4j/lrPhoenix.db/neostore.relationshipstore.db] brickCount=0
brickSize=7769916b mappedMem=776994816b (storeSize=0b)
2014-09-05 08:45:22.295+0000 INFO [org.neo4j]:
[/data/neo4j/lrPhoenix.db/neostore.nodestore.db.labels] brickCount=0
brickSize=0b mappedMem=0b (storeSize=68b)
2014-09-05 08:45:22.298+0000 INFO [org.neo4j]:
[/data/neo4j/lrPhoenix.db/neostore.nodestore.db] brickCount=0
brickSize=1761606b mappedMem=176160768b (storeSize=0b)
2014-09-05 08:45:22.307+0000 INFO [org.neo4j]:
[/data/neo4j/lrPhoenix.db/neostore] brickCount=0 brickSize=0b mappedMem=0b
(storeSize=0b)
2014-09-05 08:45:22.323+0000 INFO [org.neo4j]:
/data/neo4j/lrPhoenix.db/neostore.relationshiptypestore.db.names hit=0
miss=0 switches=0 ooe=0
2014-09-05 08:45:22.327+0000 INFO [org.neo4j]:
/data/neo4j/lrPhoenix.db/neostore.relationshiptypestore.db hit=0 miss=0
switches=0 ooe=0
2014-09-05 08:45:22.331+0000 INFO [org.neo4j]:
/data/neo4j/lrPhoenix.db/neostore.labeltokenstore.db.names hit=0 miss=0
switches=0 ooe=0
2014-09-05 08:45:22.335+0000 INFO [org.neo4j]:
/data/neo4j/lrPhoenix.db/neostore.labeltokenstore.db hit=0 miss=0
switches=0 ooe=0
2014-09-05 08:45:22.339+0000 INFO [org.neo4j]:
/data/neo4j/lrPhoenix.db/neostore.propertystore.db.strings hit=0 miss=0
switches=0 ooe=0
2014-09-05 08:45:22.343+0000 INFO [org.neo4j]:
/data/neo4j/lrPhoenix.db/neostore.propertystore.db.index.keys hit=0 miss=0
switches=0 ooe=0
2014-09-05 08:45:22.346+0000 INFO [org.neo4j]:
/data/neo4j/lrPhoenix.db/neostore.propertystore.db.index hit=0 miss=0
switches=0 ooe=0
2014-09-05 08:45:22.353+0000 INFO [org.neo4j]:
/data/neo4j/lrPhoenix.db/neostore.propertystore.db.arrays hit=0 miss=0
switches=0 ooe=0
2014-09-05 08:45:22.357+0000 INFO [org.neo4j]:
/data/neo4j/lrPhoenix.db/neostore.propertystore.db hit=0 miss=0 switches=0
ooe=0
2014-09-05 08:45:22.360+0000 INFO [org.neo4j]:
/data/neo4j/lrPhoenix.db/neostore.relationshipstore.db hit=0 miss=0
switches=0 ooe=0
2014-09-05 08:45:22.364+0000 INFO [org.neo4j]:
/data/neo4j/lrPhoenix.db/neostore.nodestore.db.labels hit=0 miss=0
switches=0 ooe=0
2014-09-05 08:45:22.368+0000 INFO [org.neo4j]:
/data/neo4j/lrPhoenix.db/neostore.nodestore.db hit=0 miss=0 switches=0 ooe=0
2014-09-05 08:45:22.372+0000 INFO [org.neo4j]:
/data/neo4j/lrPhoenix.db/neostore.schemastore.db hit=0 miss=0 switches=0
ooe=0
2014-09-05 08:45:22.383+0000 INFO [org.neo4j]:
/data/neo4j/lrPhoenix.db/neostore hit=0 miss=8 switches=0 ooe=0
2014-09-05 08:45:22.391+0000 INFO [org.neo4j]:
[/data/neo4j/lrPhoenix.db/neostore.relationshiptypestore.db.names]
brickCount=0 brickSize=0b mappedMem=0b (storeSize=38b)
2014-09-05 08:45:22.391+0000 INFO [org.neo4j]:
[/data/neo4j/lrPhoenix.db/neostore.relationshiptypestore.db] brickCount=0
brickSize=0b mappedMem=0b (storeSize=0b)
2014-09-05 08:45:22.392+0000 INFO [org.neo4j]:
[/data/neo4j/lrPhoenix.db/neostore.labeltokenstore.db.names] brickCount=0
brickSize=0b mappedMem=0b (storeSize=38b)
2014-09-05 08:45:22.392+0000 INFO [org.neo4j]:
[/data/neo4j/lrPhoenix.db/neostore.labeltokenstore.db] brickCount=0
brickSize=0b mappedMem=0b (storeSize=0b)
2014-09-05 08:45:22.393+0000 INFO [org.neo4j]:
[/data/neo4j/lrPhoenix.db/neostore.propertystore.db.strings] brickCount=0
brickSize=538880b mappedMem=538968064b (storeSize=128b)
2014-09-05 08:45:22.393+0000 INFO [org.neo4j]:
[/data/neo4j/lrPhoenix.db/neostore.propertystore.db.index.keys]
brickCount=0 brickSize=0b mappedMem=0b (storeSize=38b)
2014-09-05 08:45:22.394+0000 INFO [org.neo4j]:
[/data/neo4j/lrPhoenix.db/neostore.propertystore.db.index] brickCount=0
brickSize=0b mappedMem=0b (storeSize=0b)
2014-09-05 08:45:22.394+0000 INFO [org.neo4j]:
[/data/neo4j/lrPhoenix.db/neostore.propertystore.db.arrays] brickCount=0
brickSize=611200b mappedMem=611319808b (storeSize=128b)
2014-09-05 08:45:22.395+0000 INFO [org.neo4j]:
[/data/neo4j/lrPhoenix.db/neostore.propertystore.db] brickCount=0
brickSize=6343848b mappedMem=634388480b (storeSize=0b)
2014-09-05 08:45:22.407+0000 INFO [org.neo4j]:
[/data/neo4j/lrPhoenix.db/neostore] brickCount=0 brickSize=0b mappedMem=0b
(storeSize=63b)
2014-09-05 08:45:22.584+0000 INFO [org.neo4j]: No lucene scan store index
found, this might just be first use. Preparing to rebuild.
2014-09-05 08:45:22.660+0000 INFO [org.neo4j]: No lucene scan store index
found, this might just be first use. Preparing to rebuild.
2014-09-05 08:45:22.891+0000 INFO [org.neo4j]: Opened logical log
[/data/neo4j/lrPhoenix.db/nioneo_logical.log.1] version=0, lastTxId=1
(clean)
2014-09-05 08:45:22.898+0000 INFO [org.neo4j]: Rebuilding lucene scan
store, this may take a while
2014-09-05 08:45:22.900+0000 INFO [org.neo4j]: Lucene scan store rebuilt
(roughly -1 nodes)
2014-09-05 08:45:22.911+0000 INFO [org.neo4j]: TM new log: tm_tx_log.1
2014-09-05 08:45:22.923+0000 INFO [org.neo4j]: Kernel health set to OK
2014-09-05 08:45:23.113+0000 INFO [org.neo4j]: BackupServer communication
server started and bound to 0.0.0.0/0.0.0.0:6362
2014-09-05 08:45:23.156+0000 INFO [org.neo4j]: Opened logical log
[/data/neo4j/lrPhoenix.db/index/lucene.log.1] version=0, lastTxId=1 (clean)
2014-09-05 08:45:23.186+0000 INFO [org.neo4j]: GC Monitor started.
2014-09-05 08:45:23.234+0000 INFO [org.neo4j]: Listening at:cluster://
0.0.0.0:5001
2014-09-05 08:45:23.254+0000 INFO [org.neo4j]: Attempting to join cluster
of [10.151.25.77:5001, 10.148.102.36:5001]
2014-09-05 08:45:23.334+0000 INFO [org.neo4j]: cluster://0.0.0.0:5001
opened a new channel to /10.148.102.36:5001
2014-09-05 08:45:23.334+0000 INFO [org.neo4j]: cluster://0.0.0.0:5001
opened a new channel to /10.151.25.77:5001
2014-09-05 08:45:23.393+0000 INFO [org.neo4j]: Joining cluster neo4j.ha
2014-09-05 08:45:23.393+0000 INFO [org.neo4j]: 2 joining:Name:neo4j.ha
Nodes:{1=cluster://127.0.0.1:5001} Roles:{coordinator=1}, last delivered:2
2014-09-05 08:45:23.402+0000 INFO [org.neo4j]: Listening at:cluster://
10.151.25.77:5001
2014-09-05 08:45:23.409+0000 INFO [org.neo4j]: cluster://10.151.25.77:5001
opened a new channel to /127.0.0.1:5001
2014-09-05 08:45:53.394+0000 INFO [org.neo4j]: Join timeout for 2/12#
2014-09-05 08:45:53.397+0000 INFO [org.neo4j]: Joining cluster neo4j.ha
2014-09-05 08:45:53.397+0000 INFO [org.neo4j]: 2 joining:Name:neo4j.ha
Nodes:{1=cluster://127.0.0.1:5001} Roles:{coordinator=1}, last delivered:2
2014-09-05 08:46:23.400+0000 INFO [org.neo4j]: Join timeout for 2/12#
2014-09-05 08:46:23.404+0000 INFO [org.neo4j]: Joining cluster neo4j.ha
2014-09-05 08:46:23.404+0000 INFO [org.neo4j]: 2 joining:Name:neo4j.ha
Nodes:{1=cluster://127.0.0.1:5001} Roles:{coordinator=1}, last delivered:2
2014-09-05 08:46:53.407+0000 INFO [org.neo4j]: Join timeout for 2/12#
2014-09-05 08:46:53.410+0000 INFO [org.neo4j]: Joining cluster neo4j.ha
2014-09-05 08:46:53.410+0000 INFO [org.neo4j]: 2 joining:Name:neo4j.ha
Nodes:{1=cluster://127.0.0.1:5001} Roles:{coordinator=1}, last delivered:2
2014-09-05 08:47:23.415+0000 INFO [org.neo4j]: Join timeout for 2/12#
2014-09-05 08:47:23.418+0000 INFO [org.neo4j]: Joining cluster neo4j.ha
2014-09-05 08:47:23.419+0000 INFO [org.neo4j]: 2 joining:Name:neo4j.ha
Nodes:{1=cluster://127.0.0.1:5001} Roles:{coordinator=1}, last delivered:2
PS - I have not set allow_init_cluster parameter on any of the machines.
Thanks,
Kishore
On Wednesday, 3 September 2014 00:10:25 UTC+5:30, Mark Findlater wrote:
>
> Great! That looks quite clear then and points a finger at the network
> setup, what have you tried to debug the issue? Is there anything special
> about your network setup, multiple NICs, firewalls with app based
> permissions, what environment are you running on? Have you run something
> like Wireshark and filtered on port 5001? Are you sure the machines are
> correctly announcing themselves (try adding entries to you hosts files and
> performing name based configuration) You can telnet, if you write a quick
> unit test, can you create your own channel in Java and connect? What do the
> (Neo) logs on 192.168.1.29 contain? Can you share all config files?
>
> I guess that this should also move to SO..
>
> M
>
> On Tuesday, 2 September 2014 18:50:31 UTC+1, Kishore Kumar Garg wrote:
>>
>> It all started from here....
>>
>> 2014-09-01 15:50:11.474+0000 INFO [org.neo4j]: Listening at:cluster://
>> 192.168.1.3:5001
>> 2014-09-01 15:50:11.478+0000 INFO [org.neo4j]: Attempting to join
>> cluster of [192.168.1.3:5001, 192.168.1.29:5001]
>> 2014-09-01 15:50:11.513+0000 INFO [org.neo4j]: cluster://
>> 192.168.1.3:5001 opened a new channel to /192.168.1.3:5001
>> 2014-09-01 15:50:11.570+0000 INFO [org.neo4j]: Listening at:cluster://
>> 192.168.1.3:5001
>> 2014-09-01 15:50:14.498+0000 INFO [org.neo4j]: Client could not connect
>> to /192.168.1.29:5001
>> 2014-09-01 15:50:14.501+0000 ERROR [org.neo4j]: Receive exception: No
>> route to host
>> java.net.NoRouteToHostException: No route to host
>> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>> at
>> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>> at
>> org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:148)
>> at
>> org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:104)
>> at
>> org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:78)
>> at
>> org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312)
>> at
>> org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:41)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>> at java.lang.Thread.run(Thread.java:744)
>> 2014-09-01 15:50:17.498+0000 ERROR [org.neo4j]: Receive exception: No
>> route to host
>> java.net.NoRouteToHostException: No route to host
>> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>> at
>> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>> at
>> org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:148)
>> at
>> org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:104)
>> at
>> org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:78)
>> at
>> org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312)
>> at
>> org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:41)
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>> at java.lang.Thread.run(Thread.java:744)
>> 2014-09-01 15:50:20.498+0000 ERROR [org.neo4j]: Receive exception: No
>> route to host
>> java.net.NoRouteToHostException: No route to host
>> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>> at
>> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>> at
>> org.jboss.netty.channel.socket.nio.NioClientBoss.connect(NioClientBoss.java:148)
>> at
>> org.jboss.netty.channel.socket.nio.NioClientBoss.processSelectedKeys(NioClientBoss.java:104)
>> at
>> org.jboss.netty.channel.socket.nio.NioClientBoss.process(NioClientBoss.java:78)
>> at
>> org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:312)
>> at
>> org.jboss.netty.channel.socket.nio.NioClientBoss.run(NioClientBoss.java:41)
>>
>> However, I was able to telnet 192.168.1.29:5001.
>>
>> On Tuesday, 2 September 2014 23:13:24 UTC+5:30, Kishore Kumar Garg wrote:
>>>
>>> message.log contains this exception multiple times....
>>>
>>> 2014-09-01 20:07:05.853+0000 ERROR [org.neo4j]: Receive exception:
>>> Network is unreachable
>>> java.net.SocketException: Network is unreachable
>>> at sun.nio.ch.Net.connect0(Native Method)
>>> at sun.nio.ch.Net.connect(Net.java:465)
>>> at sun.nio.ch.Net.connect(Net.java:457)
>>> at
>>> sun.nio.ch.SocketChannelImpl.connect(SocketChannelImpl.java:670)
>>> at
>>> org.jboss.netty.channel.socket.nio.NioClientSocketPipelineSink.connect(NioClientSocketPipelineSink.java:106)
>>> at
>>> org.jboss.netty.channel.socket.nio.NioClientSocketPipelineSink.eventSunk(NioClientSocketPipelineSink.java:69)
>>> at
>>> org.jboss.netty.handler.codec.oneone.OneToOneEncoder.handleDownstream(OneToOneEncoder.java:54)
>>> at org.jboss.netty.channel.Channels.connect(Channels.java:634)
>>> at
>>> org.jboss.netty.channel.AbstractChannel.connect(AbstractChannel.java:207)
>>> at
>>> org.jboss.netty.bootstrap.ClientBootstrap.connect(ClientBootstrap.java:229)
>>> at
>>> org.jboss.netty.bootstrap.ClientBootstrap.connect(ClientBootstrap.java:182)
>>> at
>>> org.neo4j.cluster.com.NetworkSender.openChannel(NetworkSender.java:359)
>>> at
>>> org.neo4j.cluster.com.NetworkSender.access$200(NetworkSender.java:72)
>>> at
>>> org.neo4j.cluster.com.NetworkSender$2.run(NetworkSender.java:240)
>>> at
>>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>>> at java.util.concurrent.FutureTask.run(FutureTask.java:262)
>>> at
>>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>>> at
>>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>>> at java.lang.Thread.run(Thread.java:744)
>>>
>>> Port 6001 was open too.
>>>
>>> On Tuesday, 2 September 2014 11:45:50 UTC+5:30, Michael Hunger wrote:
>>>>
>>>> Can you share all you graph.db/messages.log ?
>>>>
>>>>
>>>> Sent from mobile device
>>>>
>>>> Am 01.09.2014 um 16:33 schrieb Kishore Kumar Garg <[email protected]
>>>> >:
>>>>
>>>> Hi,
>>>>
>>>> I am setting up a HA cluster of Neo4J embedded server(with spring big
>>>> data) and Neo4j version is 2.0.3.
>>>> However, it is not getting started though hosts are in same network and
>>>> I am able to telnet on port 5001 on each node.
>>>>
>>>> Please find below the HA properties for each node below:-
>>>>
>>>> Host 1:-
>>>> ------------
>>>> ha.server_id=1
>>>> ha.initial_hosts=192.168.1.3:5001
>>>> org.neo4j.server.database.mode=HA
>>>>
>>>>
>>>> Host 2:-
>>>> ------------
>>>> ha.server_id=2
>>>> ha.initial_hosts=192.168.1.3:5001,192.168.1.4:5001
>>>> org.neo4j.server.database.mode=HA
>>>>
>>>>
>>>> Host 3:-
>>>> ------------
>>>> ha.server_id=3
>>>> ha.initial_hosts=192.168.1.3:5001,192.168.1.4:5001,192.168.1.5:5001
>>>> org.neo4j.server.database.mode=HA
>>>>
>>>> This configuration is not working. Please let me know what is missing
>>>> here.
>>>> Any help is highly appreciated.
>>>>
>>>> Thanks in advance,
>>>> Kishore
>>>>
>>>> --
>>>> You received this message because you are subscribed to the Google
>>>> Groups "Neo4j" group.
>>>> To unsubscribe from this group and stop receiving emails from it, send
>>>> an email to [email protected].
>>>> For more options, visit https://groups.google.com/d/optout.
>>>>
>>>>
--
You received this message because you are subscribed to the Google Groups
"Neo4j" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
For more options, visit https://groups.google.com/d/optout.
