I am trying to setup two orientdb servers on EC2 instances in cluster configuration, and am 95% of the way there except that the nodes don't seem to see each other. I've read every post I could find on the topic, but can't seem to find the issue. I've attached my hazelnuts.xml, as well as the server output at startup for both. The IP for the first server I'm starting is 172.31.38.104 and for the second one is 172-31-42-204 - as you will see the second one actually sees and connects successfully to the first, yet the node doesn't seem to join the cluster.
I'm using the orient db 2.06 AMI. Thanks in advance for the help -- --- You received this message because you are subscribed to the Google Groups "OrientDB" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. For more options, visit https://groups.google.com/d/optout.
hazelcast.xml
Description: XML document
2015-06-17 23:34:38:889 WARNING Not enough physical memory available for
DISKCACHE: 992MB (heap=494MB). Set lower Maximum Heap (-Xmx setting on JVM) and
restart OrientDB. Now running with DISKCACHE=256MB [orientechnologies]
2015-06-17 23:34:38:893 INFO Loading configuration from:
/opt/orientdb/config/orientdb-server-config.xml...
[OServerConfigurationLoaderXml]
2015-06-17 23:34:39:165 INFO OrientDB Server v2.0.6 (build UNKNOWN@r;
2015-03-31 18:22:35+0000) is starting up... [OServer]
2015-06-17 23:34:39:198 INFO Databases directory: /opt/orientdb/databases
[OServer]
2015-06-17 23:34:39:252 INFO Listening binary connections on 0.0.0.0:2424
(protocol v.28, socket=default) [OServerNetworkListener]
2015-06-17 23:34:39:262 INFO Listening http connections on 0.0.0.0:2480
(protocol v.10, socket=default) [OServerNetworkListener]
2015-06-17 23:34:39:291 INFO Installing dynamic plugin
'orientdb-lucene-2.0.6-dist.jar'... [OServerPluginManager]
2015-06-17 23:34:39:426 INFO Lucene index plugin installed and active. Lucene
version: LUCENE_47 [OLuceneIndexPlugin]
2015-06-17 23:34:39:427 INFO Installing dynamic plugin 'studio-2.0.zip'...
[OServerPluginManager]
2015-06-17 23:34:39:449 INFO Installing GREMLIN language v.2.6.0 -
graph.pool.max=50 [OGraphServerHandler]
2015-06-17 23:34:39:483 INFO Starting distributed server 'trustyoo-02'...
[OHazelcastPlugin]
2015-06-17 23:34:39:523 INFO Configuring Hazelcast from
'/opt/orientdb/config/hazelcast.xml'. [FileSystemXmlConfig]
2015-06-17 23:34:39:614 WARNING Name of the hazelcast schema location incorrect
using default [AbstractXmlConfigHelper]
2015-06-17 23:34:39:945 INFO [LOCAL] [orientdb] [3.5] Prefer IPv4 stack is
true. [DefaultAddressPicker]
2015-06-17 23:34:39:954 INFO [LOCAL] [orientdb] [3.5] Picked
Address[172.31.42.204]:2434, using socket
ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=2434], bind any local is true
[DefaultAddressPicker]
2015-06-17 23:34:40:178 INFO [172.31.42.204]:2434 [orientdb] [3.5]
Backpressure is disabled [OperationService]
2015-06-17 23:34:40:193 INFO [172.31.42.204]:2434 [orientdb] [3.5] Starting
with 2 generic operation threads and 2 partition operation threads.
[ClassicOperationExecutor]
2015-06-17 23:34:40:587 INFO [172.31.42.204]:2434 [orientdb] [3.5] Hazelcast
3.5 (20150617 - 4270dc6) starting at Address[172.31.42.204]:2434 [system]
2015-06-17 23:34:40:587 INFO [172.31.42.204]:2434 [orientdb] [3.5] Copyright
(c) 2008-2015, Hazelcast, Inc. All Rights Reserved. [system]
2015-06-17 23:34:40:587 INFO [172.31.42.204]:2434 [orientdb] [3.5] Creating
AWSJoiner [Node]
2015-06-17 23:34:40:591 INFO [172.31.42.204]:2434 [orientdb] [3.5]
Address[172.31.42.204]:2434 is STARTING [LifecycleService]
2015-06-17 23:34:41:488 INFO [172.31.42.204]:2434 [orientdb] [3.5] Connecting
to /172.31.36.3:2434, timeout: 0, bind-any: true [SocketConnector]
2015-06-17 23:34:41:489 INFO [172.31.42.204]:2434 [orientdb] [3.5] Connecting
to /172.31.36.3:2435, timeout: 0, bind-any: true [SocketConnector]
2015-06-17 23:34:41:489 INFO [172.31.42.204]:2434 [orientdb] [3.5] Connecting
to /172.31.36.3:2436, timeout: 0, bind-any: true [SocketConnector]
2015-06-17 23:34:41:502 INFO [172.31.42.204]:2434 [orientdb] [3.5] Connecting
to /172.31.41.199:2435, timeout: 0, bind-any: true [SocketConnector]
2015-06-17 23:34:41:513 INFO [172.31.42.204]:2434 [orientdb] [3.5] Connecting
to /172.31.33.215:2435, timeout: 0, bind-any: true [SocketConnector]
2015-06-17 23:34:41:514 INFO [172.31.42.204]:2434 [orientdb] [3.5] Connecting
to /172.31.38.104:2434, timeout: 0, bind-any: true [SocketConnector]
2015-06-17 23:34:41:525 INFO [172.31.42.204]:2434 [orientdb] [3.5] Connecting
to /172.31.41.199:2436, timeout: 0, bind-any: true [SocketConnector]
2015-06-17 23:34:41:526 INFO [172.31.42.204]:2434 [orientdb] [3.5] Connecting
to /172.31.33.215:2436, timeout: 0, bind-any: true [SocketConnector]
2015-06-17 23:34:41:526 INFO [172.31.42.204]:2434 [orientdb] [3.5] Connecting
to /172.31.41.199:2434, timeout: 0, bind-any: true [SocketConnector]
2015-06-17 23:34:41:527 INFO [172.31.42.204]:2434 [orientdb] [3.5] Connecting
to /172.31.33.215:2434, timeout: 0, bind-any: true [SocketConnector]
2015-06-17 23:34:41:528 INFO [172.31.42.204]:2434 [orientdb] [3.5] Connecting
to /172.31.42.204:2435, timeout: 0, bind-any: true [SocketConnector]
2015-06-17 23:34:41:529 INFO [172.31.42.204]:2434 [orientdb] [3.5] Could not
connect to: /172.31.42.204:2435. Reason: SocketException[Connection refused to
address /172.31.42.204:2435] [SocketConnector]
2015-06-17 23:34:41:529 INFO [172.31.42.204]:2434 [orientdb] [3.5]
Address[172.31.42.204]:2435 is added to the blacklist. [TcpIpJoinerOverAWS]
2015-06-17 23:34:41:530 INFO [172.31.42.204]:2434 [orientdb] [3.5] Connecting
to /172.31.42.204:2436, timeout: 0, bind-any: true [SocketConnector]
2015-06-17 23:34:41:531 INFO [172.31.42.204]:2434 [orientdb] [3.5] Could not
connect to: /172.31.42.204:2436. Reason: SocketException[Connection refused to
address /172.31.42.204:2436] [SocketConnector]
2015-06-17 23:34:41:531 INFO [172.31.42.204]:2434 [orientdb] [3.5]
Address[172.31.42.204]:2436 is added to the blacklist. [TcpIpJoinerOverAWS]
2015-06-17 23:34:41:532 INFO [172.31.42.204]:2434 [orientdb] [3.5] Connecting
to /172.31.38.104:2435, timeout: 0, bind-any: true [SocketConnector]
2015-06-17 23:34:41:533 INFO [172.31.42.204]:2434 [orientdb] [3.5] Connecting
to /172.31.38.104:2436, timeout: 0, bind-any: true [SocketConnector]
2015-06-17 23:34:46:542 INFO [172.31.42.204]:2434 [orientdb] [3.5]
Members [1] {
Member [172.31.42.204]:2434 this
}
[TcpIpJoinerOverAWS]
2015-06-17 23:34:46:595 INFO [172.31.42.204]:2434 [orientdb] [3.5]
Address[172.31.42.204]:2434 is STARTED [LifecycleService]
2015-06-17 23:34:46:682 INFO [172.31.42.204]:2434 [orientdb] [3.5]
Initializing cluster partition table first arrangement...
[InternalPartitionService]
2015-06-17 23:34:46:749 INFO [trustyoo-02] found no previous messages in queue
orientdb.node.trustyoo-02.response [OHazelcastDistributedMessageService]
2015-06-17 23:34:46:762 WARNING [trustyoo-02] updated node status to 'ONLINE'
[OHazelcastPlugin]
2015-06-17 23:34:46:763 INFO Installing Script interpreter. WARN:
authenticated clients can execute any kind of code into the server by using the
following allowed languages: [sql] [OServerSideScriptInterpreter]
2015-06-17 23:34:46:763 INFO OrientDB Server v2.0.6 is active. [OServer]2015-06-17 23:34:11:335 WARNING Not enough physical memory available for
DISKCACHE: 992MB (heap=494MB). Set lower Maximum Heap (-Xmx setting on JVM) and
restart OrientDB. Now running with DISKCACHE=256MB [orientechnologies]
2015-06-17 23:34:11:339 INFO Loading configuration from:
/opt/orientdb/config/orientdb-server-config.xml...
[OServerConfigurationLoaderXml]
2015-06-17 23:34:11:626 INFO OrientDB Server v2.0.6 (build UNKNOWN@r;
2015-03-31 18:22:35+0000) is starting up... [OServer]
2015-06-17 23:34:11:660 INFO Databases directory: /opt/orientdb/databases
[OServer]
2015-06-17 23:34:11:726 INFO Listening binary connections on 0.0.0.0:2424
(protocol v.28, socket=default) [OServerNetworkListener]
2015-06-17 23:34:11:737 INFO Listening http connections on 0.0.0.0:2480
(protocol v.10, socket=default) [OServerNetworkListener]
2015-06-17 23:34:11:766 INFO Installing dynamic plugin
'orientdb-lucene-2.0.6-dist.jar'... [OServerPluginManager]
2015-06-17 23:34:11:913 INFO Lucene index plugin installed and active. Lucene
version: LUCENE_47 [OLuceneIndexPlugin]
2015-06-17 23:34:11:914 INFO Installing dynamic plugin 'studio-2.0.zip'...
[OServerPluginManager]
2015-06-17 23:34:11:925 INFO Installing GREMLIN language v.2.6.0 -
graph.pool.max=50 [OGraphServerHandler]
2015-06-17 23:34:11:978 INFO Starting distributed server 'trustyoo-01'...
[OHazelcastPlugin]
2015-06-17 23:34:12:017 INFO Configuring Hazelcast from
'/opt/orientdb/config/hazelcast.xml'. [FileSystemXmlConfig]
2015-06-17 23:34:12:119 WARNING Name of the hazelcast schema location incorrect
using default [AbstractXmlConfigHelper]
2015-06-17 23:34:12:484 INFO [LOCAL] [orientdb] [3.5] Prefer IPv4 stack is
true. [DefaultAddressPicker]
2015-06-17 23:34:12:491 INFO [LOCAL] [orientdb] [3.5] Picked
Address[172.31.38.104]:2434, using socket
ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=2434], bind any local is true
[DefaultAddressPicker]
2015-06-17 23:34:12:736 INFO [172.31.38.104]:2434 [orientdb] [3.5]
Backpressure is disabled [OperationService]
2015-06-17 23:34:12:751 INFO [172.31.38.104]:2434 [orientdb] [3.5] Starting
with 2 generic operation threads and 2 partition operation threads.
[ClassicOperationExecutor]
2015-06-17 23:34:13:159 INFO [172.31.38.104]:2434 [orientdb] [3.5] Hazelcast
3.5 (20150617 - 4270dc6) starting at Address[172.31.38.104]:2434 [system]
2015-06-17 23:34:13:160 INFO [172.31.38.104]:2434 [orientdb] [3.5] Copyright
(c) 2008-2015, Hazelcast, Inc. All Rights Reserved. [system]
2015-06-17 23:34:13:160 INFO [172.31.38.104]:2434 [orientdb] [3.5] Creating
AWSJoiner [Node]
2015-06-17 23:34:13:164 INFO [172.31.38.104]:2434 [orientdb] [3.5]
Address[172.31.38.104]:2434 is STARTING [LifecycleService]
2015-06-17 23:34:14:113 INFO [172.31.38.104]:2434 [orientdb] [3.5] Connecting
to /172.31.36.3:2434, timeout: 0, bind-any: true [SocketConnector]
2015-06-17 23:34:14:113 INFO [172.31.38.104]:2434 [orientdb] [3.5] Connecting
to /172.31.36.3:2435, timeout: 0, bind-any: true [SocketConnector]
2015-06-17 23:34:14:114 INFO [172.31.38.104]:2434 [orientdb] [3.5] Connecting
to /172.31.36.3:2436, timeout: 0, bind-any: true [SocketConnector]
2015-06-17 23:34:14:126 INFO [172.31.38.104]:2434 [orientdb] [3.5] Connecting
to /172.31.41.199:2435, timeout: 0, bind-any: true [SocketConnector]
2015-06-17 23:34:14:138 INFO [172.31.38.104]:2434 [orientdb] [3.5] Connecting
to /172.31.33.215:2435, timeout: 0, bind-any: true [SocketConnector]
2015-06-17 23:34:14:141 INFO [172.31.38.104]:2434 [orientdb] [3.5] Connecting
to /172.31.41.199:2436, timeout: 0, bind-any: true [SocketConnector]
2015-06-17 23:34:14:153 INFO [172.31.38.104]:2434 [orientdb] [3.5] Connecting
to /172.31.33.215:2436, timeout: 0, bind-any: true [SocketConnector]
2015-06-17 23:34:14:154 INFO [172.31.38.104]:2434 [orientdb] [3.5] Connecting
to /172.31.41.199:2434, timeout: 0, bind-any: true [SocketConnector]
2015-06-17 23:34:14:154 INFO [172.31.38.104]:2434 [orientdb] [3.5] Connecting
to /172.31.33.215:2434, timeout: 0, bind-any: true [SocketConnector]
2015-06-17 23:34:14:155 INFO [172.31.38.104]:2434 [orientdb] [3.5] Connecting
to /172.31.42.204:2435, timeout: 0, bind-any: true [SocketConnector]
2015-06-17 23:34:14:156 INFO [172.31.38.104]:2434 [orientdb] [3.5] Connecting
to /172.31.42.204:2436, timeout: 0, bind-any: true [SocketConnector]
2015-06-17 23:34:14:157 INFO [172.31.38.104]:2434 [orientdb] [3.5] Connecting
to /172.31.42.204:2434, timeout: 0, bind-any: true [SocketConnector]
2015-06-17 23:34:14:158 INFO [172.31.38.104]:2434 [orientdb] [3.5] Connecting
to /172.31.38.104:2435, timeout: 0, bind-any: true [SocketConnector]
2015-06-17 23:34:14:159 INFO [172.31.38.104]:2434 [orientdb] [3.5] Could not
connect to: /172.31.38.104:2435. Reason: SocketException[Connection refused to
address /172.31.38.104:2435] [SocketConnector]
2015-06-17 23:34:14:159 INFO [172.31.38.104]:2434 [orientdb] [3.5]
Address[172.31.38.104]:2435 is added to the blacklist. [TcpIpJoinerOverAWS]
2015-06-17 23:34:14:161 INFO [172.31.38.104]:2434 [orientdb] [3.5] Connecting
to /172.31.38.104:2436, timeout: 0, bind-any: true [SocketConnector]
2015-06-17 23:34:14:163 INFO [172.31.38.104]:2434 [orientdb] [3.5] Could not
connect to: /172.31.38.104:2436. Reason: SocketException[Connection refused to
address /172.31.38.104:2436] [SocketConnector]
2015-06-17 23:34:14:164 INFO [172.31.38.104]:2434 [orientdb] [3.5]
Address[172.31.38.104]:2436 is added to the blacklist. [TcpIpJoinerOverAWS]
2015-06-17 23:34:19:172 INFO [172.31.38.104]:2434 [orientdb] [3.5]
Members [1] {
Member [172.31.38.104]:2434 this
}
[TcpIpJoinerOverAWS]
2015-06-17 23:34:19:204 INFO [172.31.38.104]:2434 [orientdb] [3.5]
Address[172.31.38.104]:2434 is STARTED [LifecycleService]
2015-06-17 23:34:19:281 INFO [172.31.38.104]:2434 [orientdb] [3.5]
Initializing cluster partition table first arrangement...
[InternalPartitionService]
2015-06-17 23:34:19:336 INFO [trustyoo-01] found no previous messages in queue
orientdb.node.trustyoo-01.response [OHazelcastDistributedMessageService]
2015-06-17 23:34:19:339 WARNING [trustyoo-01] opening database 'trustyoo'...
[OHazelcastPlugin]
2015-06-17 23:34:19:340 INFO [trustyoo-01] loaded database configuration from
disk: /opt/orientdb/databases/trustyoo/distributed-config.json
[OHazelcastPlugin]
2015-06-17 23:34:19:350 WARNING [trustyoo-01] updated distributed configuration
for database: trustyoo:
----------
{
"version": 0,
"autoDeploy": true,
"hotAlignment": false,
"executionMode": "asynchronous",
"readQuorum": 1,
"writeQuorum": 2,
"failureAvailableNodesLessQuorum": false,
"readYourWrites": true,"clusters":{
"internal": {
},
"index": {
},
"*": {
"servers": ["trustyoo-01","<NEW_NODE>"]
}
}
}
---------- [OHazelcastPlugin]
2015-06-17 23:34:19:369 WARNING [trustyoo-01] updated distributed configuration
for database: trustyoo:
----------
{
"version": 0,
"autoDeploy": true,
"hotAlignment": false,
"executionMode": "asynchronous",
"readQuorum": 1,
"writeQuorum": 2,
"failureAvailableNodesLessQuorum": false,
"readYourWrites": true,"clusters":{
"internal": {
},
"index": {
},
"*": {
"servers": ["trustyoo-01","<NEW_NODE>"]
}
}
}
---------- [OHazelcastPlugin]
2015-06-17 23:34:19:370 INFO [trustyoo-01] Saving distributed configuration
file for database 'trustyoo' to:
/opt/orientdb/databases/trustyoo/distributed-config.json [OHazelcastPlugin]
2015-06-17 23:34:19:379 INFO [trustyoo-01] found no previous messages in queue
orientdb.node.trustyoo-01.trustyoo.request [OHazelcastDistributedMessageService]
2015-06-17 23:34:19:893 INFO {db=trustyoo} [trustyoo-01] Installing
distributed storage on database 'trustyoo' [ODistributedStorage]
2015-06-17 23:34:19:918 INFO [trustyoo-01] Publishing online status for
database trustyoo-01.trustyoo... [OHazelcastDistributedDatabase]
2015-06-17 23:34:19:933 WARNING [trustyoo-01] updated node status to 'ONLINE'
[OHazelcastPlugin]
2015-06-17 23:34:19:934 INFO Installing Script interpreter. WARN:
authenticated clients can execute any kind of code into the server by using the
following allowed languages: [sql] [OServerSideScriptInterpreter]
2015-06-17 23:34:19:934 INFO OrientDB Server v2.0.6 is active. [OServer]
