Hi Rodrigo, It looks like your system does not have all of the directories that Clearwater expects to exist. In particular, you are missing the folder '/usr/share/clearwater/clearwater-cluster-manager/plugins/', which is normally created when clearwater-cluster-manager is installed.
I suspect that the easiest thing to do to get your Ellis node working might be to save off its configuration (/etc/clearwater/local_config and /etc/clearwater/shared_config), delete the node, and re-install it from scratch. You can then copy on the saved-off config and try uploading it again. If that does not work (or if you are not able to do that) then we will need more details of how you installed your Ellis node. Yours, Chris From: Rodrigo Moreira [mailto:moreir...@outlook.com] Sent: 22 February 2016 22:18 To: Chris Elford <chris.elf...@metaswitch.com> Cc: clearwater@lists.projectclearwater.org Subject: RE: [Clearwater] [Error when i try to upload shared_config] Sure, The Ellis log: cluster-maneger: 22-02-2016 22:13:26.514 UTC INFO utils.py:417 (thread MainThread): Acquired exclusive lock on /var/run/clearwater-cluster-manager.pid.lockfile 22-02-2016 22:13:26.527 UTC ERROR logging_config.py:101 (thread MainThread): Uncaught exception: Exception: OSError Detail: [Errno 2] No such file or directory: '/usr/share/clearwater/clearwater-cluster-manager/plugins/' Traceback: File "/usr/share/clearwater/bin/clearwater-cluster-manager", line 40, in <module> main(sys.argv[1:]) File "build_clustermgr/bdist.linux-x86_64/egg/metaswitch/clearwater/cluster_manager/main.py", line 169, in main etcd_cluster_key=etcd_cluster_key)) File "build_shared/bdist.linux-x86_64/egg/metaswitch/clearwater/etcd_shared/plugin_loader.py", line 47, in load_plugins_in_dir files = os.listdir(dir) config-maneger: 22-02-2016 22:09:21.237 UTC INFO utils.py:417 (thread MainThread): Acquired exclusive lock on /var/run/clearwater-config-manager.pid.lockfile 22-02-2016 22:09:21.238 UTC INFO plugin_loader.py:50 (thread MainThread): Inspecting shared_config_plugin.py 22-02-2016 22:09:21.281 UTC INFO plugin_loader.py:58 (thread MainThread): Loading shared_config_plugin.py 22-02-2016 22:09:21.282 UTC INFO plugin_loader.py:60 (thread MainThread): Loaded shared_config_plugin.py successfully 22-02-2016 22:09:21.314 UTC INFO alarms.py:55 (thread MainThread): Imported /usr/share/clearwater/bin/alarms.py 22-02-2016 22:09:23.418 UTC INFO main.py:136 (thread MainThread): Loaded plugin <shared_config_plugin.SharedConfigPlugin object at 0x7f3324bbe850> 22-02-2016 22:09:31.138 UTC ERROR common_etcd_synchronizer.py:216 (thread SharedConfigPlugin): 10.12.0.70 caught EtcdException('Internal Server Error : None',) when trying to read with index None - pause $ 22-02-2016 22:10:08.493 UTC ERROR common_etcd_synchronizer.py:216 (thread SharedConfigPlugin): 10.12.0.70 caught EtcdException('Internal Server Error : None',) when trying to read with index None - pause $ 22-02-2016 22:10:44.514 UTC ERROR common_etcd_synchronizer.py:216 (thread SharedConfigPlugin): 10.12.0.70 caught EtcdException('Internal Server Error : None',) when trying to read with index None - pause $ 22-02-2016 22:11:20.546 UTC ERROR common_etcd_synchronizer.py:216 (thread SharedConfigPlugin): 10.12.0.70 caught EtcdException('Internal Server Error : None',) when trying to read with index None - pause $ 22-02-2016 22:11:56.578 UTC ERROR common_etcd_synchronizer.py:216 (thread SharedConfigPlugin): 10.12.0.70 caught EtcdException('Internal Server Error : None',) when trying to read with index None - pause $ 22-02-2016 22:12:32.596 UTC ERROR common_etcd_synchronizer.py:216 (thread SharedConfigPlugin): 10.12.0.70 caught EtcdException('Internal Server Error : None',) when trying to read with index None - pause $ 22-02-2016 22:13:08.628 UTC ERROR common_etcd_synchronizer.py:216 (thread SharedConfigPlugin): 10.12.0.70 caught EtcdException('Internal Server Error : None',) when trying to read with index None - pause $ 22-02-2016 22:13:44.654 UTC ERROR common_etcd_synchronizer.py:216 (thread SharedConfigPlugin): 10.12.0.70 caught EtcdException('Internal Server Error : None',) when trying to read with index None - pause $ 22-02-2016 22:14:20.687 UTC ERROR common_etcd_synchronizer.py:216 (thread SharedConfigPlugin): 10.12.0.70 caught EtcdException('Internal Server Error : None',) when trying to read with index None - pause $ 22-02-2016 22:14:56.715 UTC ERROR common_etcd_synchronizer.py:216 (thread SharedConfigPlugin): 10.12.0.70 caught EtcdException('Internal Server Error : None',) when trying to read with index None - pause $ 22-02-2016 22:15:32.740 UTC ERROR common_etcd_synchronizer.py:216 (thread SharedConfigPlugin): 10.12.0.70 caught EtcdException('Internal Server Error : None',) when trying to read with index None - pause $ What's wrong? Thanks. Att., Rodrigo M. + 55 37 - 9 9132-4539 Skype: rodrigo.moreira2007 ________________________________ From: chris.elf...@metaswitch.com<mailto:chris.elf...@metaswitch.com> To: chris.elf...@metaswitch.com<mailto:chris.elf...@metaswitch.com>; moreir...@outlook.com<mailto:moreir...@outlook.com> CC: clearwater@lists.projectclearwater.org<mailto:clearwater@lists.projectclearwater.org> Subject: RE: [Clearwater] [Error when i try to upload shared_config] Date: Mon, 22 Feb 2016 17:29:23 +0000 Sorry, I slipped up there. The etcd logs are in /var/log/clearwater-etcd, /var/log/clearwater-cluster-manager, and /var/log/clearwater-config-manager. Chris From: Clearwater [mailto:clearwater-boun...@lists.projectclearwater.org] On Behalf Of Chris Elford Sent: 22 February 2016 17:25 To: Rodrigo Moreira <moreir...@outlook.com<mailto:moreir...@outlook.com>> Cc: clearwater@lists.projectclearwater.org<mailto:clearwater@lists.projectclearwater.org> Subject: Re: [Clearwater] [Error when i try to upload shared_config] Hi Rodrigo, It looks like your Ellis node is having trouble talking to the etcd cluster and uploading its configuration. Can you please send us the etcd logs from your Ellis node? You can find these at /var/log/ellis. It would also help to know when you attempted to upload shared config - do you have a note of the time at which you ran the command? Yours, Chris From: Clearwater [mailto:clearwater-boun...@lists.projectclearwater.org] On Behalf Of Rodrigo Moreira Sent: 20 February 2016 19:48 To: Eleanor Merry <eleanor.me...@metaswitch.com<mailto:eleanor.me...@metaswitch.com>>; clearwater@lists.projectclearwater.org<mailto:clearwater@lists.projectclearwater.org> Subject: [Clearwater] [Error when i try to upload shared_config] Hi, Could you please tell what happens? Follows logs: BONO: * I can ping sprout.nyc3.example.com on the host bono.nyc3.example.com Log files: 20-02-2016 13:57:21.194 UTC Error connection_pool.cpp:214: Failed to resolve 5054 to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 13:57:21.195 UTC Error connection_pool.cpp:214: Failed to resolve 5054 to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 13:57:21.195 UTC Error connection_pool.cpp:214: Failed to resolve 5054 to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 13:57:21.195 UTC Error connection_pool.cpp:214: Failed to resolve 5054 to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 13:57:21.195 UTC Error connection_pool.cpp:214: Failed to resolve 5054 to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 13:57:21.195 UTC Error connection_pool.cpp:214: Failed to resolve 5054 to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 13:57:21.195 UTC Error connection_pool.cpp:214: Failed to resolve 5054 to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 13:57:21.195 UTC Error connection_pool.cpp:214: Failed to resolve 5054 to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 13:57:21.195 UTC Error connection_pool.cpp:214: Failed to resolve 5054 to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 13:57:21.195 UTC Error connection_pool.cpp:214: Failed to resolve 5054 to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 13:57:21.195 UTC Error connection_pool.cpp:214: Failed to resolve 5054 to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 13:57:21.195 UTC Error connection_pool.cpp:214: Failed to resolve 5054 to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 13:57:21.195 UTC Error connection_pool.cpp:214: Failed to resolve 5054 to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 13:57:21.195 UTC Error connection_pool.cpp:214: Failed to resolve 5054 to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 13:57:21.195 UTC Error connection_pool.cpp:214: Failed to resolve 5054 to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 13:57:21.195 UTC Error connection_pool.cpp:214: Failed to resolve 5054 to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 13:57:21.195 UTC Status bono.cpp:3316: Create list of PBXes 20-02-2016 13:57:21.195 UTC Status pluginloader.cpp:63: Loading plug-ins from /usr/share/clearwater/sprout/plugins 20-02-2016 13:57:21.195 UTC Status pluginloader.cpp:148: Finished loading plug-ins 20-02-2016 13:57:21.197 UTC Warning (Net-SNMP): Warning: Failed to connect to the agentx master agent ([NIL]): 20-02-2016 13:57:36.207 UTC Warning (Net-SNMP): Warning: Failed to connect to the agentx master agent ([NIL]): 20-02-2016 13:57:51.214 UTC Warning (Net-SNMP): Warning: Failed to connect to the agentx master agent ([NIL]): 20-02-2016 13:58:06.228 UTC Warning (Net-SNMP): Warning: Failed to connect to the agentx master agent ([NIL]): 20-02-2016 13:58:21.235 UTC Warning (Net-SNMP): Warning: Failed to connect to the agentx master agent ([NIL]): 20-02-2016 13:58:36.249 UTC Warning (Net-SNMP): Warning: Failed to connect to the agentx master agent ([NIL]): 20-02-2016 13:58:51.263 UTC Warning (Net-SNMP): Warning: Failed to connect to the agentx master agent ([NIL]): 20-02-2016 13:59:06.277 UTC Warning (Net-SNMP): Warning: Failed to connect to the agentx master agent ([NIL]): 20-02-2016 13:59:21.279 UTC Warning (Net-SNMP): Warning: Failed to connect to the agentx master agent ([NIL]): 20-02-2016 13:59:36.294 UTC Warning (Net-SNMP): Warning: Failed to connect to the agentx master agent ([NIL]): 20-02-2016 13:59:51.306 UTC Warning (Net-SNMP): Warning: Failed to connect to the agentx master agent ([NIL]): 20-02-2016 19:17:18.040 UTC Error connection_pool.cpp:214: Failed to resolve sprout.nyc3.example.com to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 19:17:18.040 UTC Error connection_pool.cpp:214: Failed to resolve sprout.nyc3.example.com to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 19:17:18.040 UTC Error connection_pool.cpp:214: Failed to resolve sprout.nyc3.example.com to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 19:17:18.040 UTC Error connection_pool.cpp:214: Failed to resolve sprout.nyc3.example.com to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 19:17:18.040 UTC Error connection_pool.cpp:214: Failed to resolve sprout.nyc3.example.com to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 19:17:18.040 UTC Error connection_pool.cpp:214: Failed to resolve sprout.nyc3.example.com to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 19:17:18.040 UTC Error connection_pool.cpp:214: Failed to resolve sprout.nyc3.example.com to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 19:17:18.040 UTC Error connection_pool.cpp:214: Failed to resolve sprout.nyc3.example.com to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 19:17:18.040 UTC Error connection_pool.cpp:214: Failed to resolve sprout.nyc3.example.com to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 19:17:18.040 UTC Error connection_pool.cpp:214: Failed to resolve sprout.nyc3.example.com to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 19:17:18.040 UTC Error connection_pool.cpp:214: Failed to resolve sprout.nyc3.example.com to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 19:17:18.040 UTC Error connection_pool.cpp:214: Failed to resolve sprout.nyc3.example.com to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 19:17:18.040 UTC Error connection_pool.cpp:214: Failed to resolve sprout.nyc3.example.com to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 19:17:18.040 UTC Error connection_pool.cpp:214: Failed to resolve sprout.nyc3.example.com to an IP address - Not found (PJ_ENOTFOUND) 20-02-2016 19:17:18.040 UTC Error connection_pool.cpp:214: Failed to resolve sprout.nyc3.example.com to an IP address - Not found (PJ_ENOTFOUND) SPROUT: Log files: 20-02-2016 19:19:04.990 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:19:14.962 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:19:25.086 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:19:35.096 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:19:45.181 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:19:55.167 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:20:05.169 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:20:15.221 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:20:25.345 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:20:35.360 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:20:45.342 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:20:55.359 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:21:05.475 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:21:15.465 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:21:25.501 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:21:35.547 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:21:45.606 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:21:55.596 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:22:05.568 UTC 200 GET /ping 0.000000 seconds RALF: Log files: 20-02-2016 19:19:54.153 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:20:04.177 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:20:14.175 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:20:24.216 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:20:34.266 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:20:44.287 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:20:54.368 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:21:04.329 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:21:14.369 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:21:24.370 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:21:34.368 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:21:44.387 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:21:54.468 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:22:04.474 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:22:14.504 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:22:24.550 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:22:34.523 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:22:44.580 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:22:54.561 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:23:04.648 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:23:14.718 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:23:24.648 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:23:34.769 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:23:44.689 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:23:54.762 UTC 200 GET /ping 0.000000 seconds HOMESTEAD: Log files: 20-02-2016 19:25:29.325 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:25:48.561 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:26:11.169 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:26:22.522 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:26:33.317 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:26:43.202 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:26:53.594 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:27:04.931 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:27:14.657 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:27:25.383 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:27:36.587 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:27:46.124 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:27:57.708 UTC 200 GET /ping 0.000000 seconds 20-02-2016 19:28:08.325 UTC 200 GET /ping 0.000000 seconds Process 'ntp_process' Running System 'node-homestead' Running Process 'nginx_process' Running Process 'homestead_process' Running Program 'poll_homestead' Status ok Process 'homestead-prov_process' Running Program 'poll_homestead-prov' Status ok Process 'clearwater_queue_manager' Running Process 'etcd_process' Running Program 'poll_etcd_cluster' Waiting Program 'poll_etcd' Status ok Process 'clearwater_diags_monitor_process' Running Process 'clearwater_config_manager' Running Process 'clearwater_cluster_manager' Running Process 'cassandra_process' Running Program 'poll_cassandra' Status ok Ellis: I can't to upload shared_config when i try to enter line: /usr/share/clearwater/clearwater-config-manager/scripts/upload_shared_config Some errors: root@ellis:/home/ubuntu# /usr/share/clearwater/clearwater-config-manager/scripts/upload_shared_config Upload shared configuration failed to http://10.12.0.66:4000/v2/keys/clearwater/site1/configuration/shared_config % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed 100 684 100 35 100 649 5 108 0:00:07 0:00:06 0:00:01 0 What's going on? Thnaks? Att., Rodrigo M. + 55 37 - 9 9132-4539 Skype: rodrigo.moreira2007
_______________________________________________ Clearwater mailing list Clearwater@lists.projectclearwater.org http://lists.projectclearwater.org/mailman/listinfo/clearwater_lists.projectclearwater.org