Hi, It sounds like you’ve hit https://github.com/Metaswitch/crest/issues/177. Can you please try the upgrade again?
Thanks, Ellie From: Shiva Charan [mailto:[email protected]] Sent: 30 January 2015 08:02 To: Eleanor Merry Subject: Re: [Clearwater] Failed to update the server Hi, while upgrading the homestead role i am getting an error as below, Waiting for Cassandra.........................................................................................................................*** ERROR: Cassandra did not come online! dpkg: error processing homestead-prov (--configure): subprocess installed post-installation script returned error exit status 1 E: Sub-process /usr/bin/dpkg returned an error code (1) Regards, Shiva Charan On Thu, Jan 29, 2015 at 12:36 AM, Eleanor Merry <[email protected]<mailto:[email protected]>> wrote: Hi, This sounds like you’ve got a mix of versions running on your system. In the Ultima release, we added support for separated management and signalling networks (see https://github.com/Metaswitch/clearwater-docs/wiki/Multiple-Network-Support for more details), and as part of that we moved nginx to listen on port 8889. An up-to-date homestead-prov will not try and bind to port 8889. Can you please update your Clearwater deployment (run clearwater-upgrade on each of your nodes)? Ellie From: Shiva Charan [mailto:[email protected]<mailto:[email protected]>] Sent: 28 January 2015 17:02 To: Eleanor Merry Subject: Re: [Clearwater] Failed to update the server Hi Ellie, Thanks for the reply, The process running on port 8889(default port for homestead-prov) is being used by a process called ngnix, I am able to start homestead-prov if I kill ngnix process assuming we need ngnix for the clearwater setup if I start that again it is taking that same port over homestead-prov and monit status shows homestead-prov does not exist and also /etc/init.d/homestead-prov status command shows the homestead is running. The contents of homer log is as shown below. [homer]clearwater4@clearwater:/var/log/homer$ ls homer-0.log homer-err.log homer-err.log.old [homer]clearwater4@clearwater:/var/log/homer$ vi homer-err.log Unhandled error in Deferred: Unhandled Error Traceback (most recent call last): Failure: thrift.transport.TTransport.TTransportException: Connection closed Regards, Shiva On Wed, Jan 28, 2015 at 12:13 AM, Eleanor Merry <[email protected]<mailto:[email protected]>> wrote: Hi Shiva, The homestead-prov logs look like there’s multiple homestead-prov services running, as the service is failing as the needed ports are already in use. Can you check the running processes, and kill every homestead-prov instance? Monit will then start one homestead-prov, which will bind to the correct ports. The last Homer log is on the 21st. Are there any logs in homer-1, or homer-err? Please can you send these across as well? Have you also checked whether cassandra is running reliably on the Homer/Homestead? Ellie From: Shiva Charan [mailto:[email protected]<mailto:[email protected]>] Sent: 27 January 2015 17:44 To: Eleanor Merry Subject: Re: [Clearwater] Failed to update the server Hi, Sorry for the late response, we have a new setup as the earlier one had a hardware issue and we had to start over but now the homer & homestead-prov services aren't running the log files of the same are attached to the mail. Regards, Shiva Charan On Fri, Jan 16, 2015 at 11:16 PM, Eleanor Merry <[email protected]<mailto:[email protected]>> wrote: Hi, Can you try running the requests through curl to see if they connect? From Ellis, run: curl http://192.168.47.132:7888/org.etsi.ngn.simservs/users/sip:6505550005@localdomain/simservs.xml (I assume 192.168.47.132 is your Homer). I’d hope this would return a 404 (as your subscriber hasn’t been created) rather than a timeout. Ellie From: Shiva Charan [mailto:[email protected]<mailto:[email protected]>] Sent: 16 January 2015 04:32 To: Eleanor Merry Subject: Re: [Clearwater] Failed to update the server Hi, Please find the contents of all the homer log file below. [homer]clearwater4@ubuntu:/var/log/homer$ ls homer-0.log homer-1.log homer-err.log homer-err.log.old Homer-err.log [homer]clearwater4@ubuntu:/var/log/homer$ cat homer-err.log /usr/share/clearwater/homer/env/local/lib/python2.7/site-packages/zope.interface-4.1.1-py2.7-linux-x86_64.egg/zope/__init__.py:3: UserWarning: Module twisted was already imported from /usr/share/clearwater/homer/env/local/lib/python2.7/site-packages/Twisted-12.3.0-py2.7-linux-x86_64.egg/twisted/__init__.pyc, but /usr/share/clearwater/homer/env/lib/python2.7/site-packages/cyclone-1.0-py2.7.egg is being added to sys.path import pkg_resources Homer-0.log 2015-01-12 00:50:28,703 I main:118 38024:140452077156096] Going to listen for HTTP on UNIX socket /tmp/.homer-sock-0 2015-01-12 00:56:55,790 I main:118 38943:140282975594240] Going to listen for HTTP on UNIX socket /tmp/.homer-sock-0 2015-01-12 01:04:57,862 I main:118 40382:140319918085888] Going to listen for HTTP on UNIX socket /tmp/.homer-sock-0 2015-01-12 01:45:41,069 I main:118 1839:139899091400448] Going to listen for HTTP on UNIX socket /tmp/.homer-sock-0 2015-01-12 01:45:41,853 I main:118 1877:140706266408704] Going to listen for HTTP on UNIX socket /tmp/.homer-sock-0 2015-01-13 03:53:09,911 UTC INFO main:118 Going to listen for HTTP on UNIX socket /tmp/.homer-sock-0 2015-01-13 08:55:11,316 UTC INFO main:118 Going to listen for HTTP on UNIX socket /tmp/.homer-sock-0 Homer-1.log 2015-01-12 01:45:43,051 I main:145 1842:140430481901312] Going to listen for HTTP on UNIX socket /tmp/.homer-sock-1 2015-01-13 03:53:12,700 UTC INFO main:145 Going to listen for HTTP on UNIX socket /tmp/.homer-sock-1 2015-01-13 08:55:13,449 UTC INFO main:145 Going to listen for HTTP on UNIX socket /tmp/.homer-sock-1 Homer-err.log.old [homer]clearwater4@ubuntu:/var/log/homer$ cat homer-err.log.old /usr/share/clearwater/homer/env/local/lib/python2.7/site-packages/zope.interface-4.1.1-py2.7-linux-x86_64.egg/zope/__init__.py:3: UserWarning: Module twisted was already imported from /usr/share/clearwater/homer/env/local/lib/python2.7/site-packages/Twisted-12.3.0-py2.7-linux-x86_64.egg/twisted/__init__.pyc, but /usr/share/clearwater/homer/env/lib/python2.7/site-packages/cyclone-1.0-py2.7.egg is being added to sys.path import pkg_resources Thanks and regards, Shiva Charan M S On Thu, Jan 15, 2015 at 11:11 PM, Eleanor Merry <[email protected]<mailto:[email protected]>> wrote: Hi, Are there any other Homer logs in /var/log/homer/? It looks like you’ve sent homer-1.log across – was there anything in homer-0.log or homer-err.log? Thanks, Ellie From: Shiva Charan [mailto:[email protected]<mailto:[email protected]>] Sent: 14 January 2015 07:11 To: Eleanor Merry Subject: Re: [Clearwater] Failed to update the server Hi Ellie, I am able to do a telnet <homer ip> 7888 to homer form ellis and the status in telnet command prompt says connected to <homer ip>, and the config file of ellis has the proper address of homer.Is there any other way that i can check if ellis is able to communicate with other nodes? Thanks, Shiva Charan M S On Wed, Jan 14, 2015 at 12:19 AM, Eleanor Merry <[email protected]<mailto:[email protected]>> wrote: Hi Shiva, The Homer log doesn’t have any requests in it – I was expecting to see something like: 2015-01-07 16:58:42,741 UTC INFO base:246 Received request from localhost - PUT http://http_homer/org.etsi.ngn.simservs/users/sip%3A6505550435%40.domain/simservs.xml 2015-01-07 16:58:42,742 UTC INFO xsd:76 Performing XSD validation 2015-01-07 16:58:42,817 UTC INFO base:259 Sending 200 response to localhost for PUT http://http_homer/org.etsi.ngn.simservs/users/sip%3A6505550435%40.domain/simservs.xml Can you confirm that the Ellis has the right address for Homer, and that Homer will accept requests from Ellis on 7888? Thanks, Ellie From: Shiva Charan [mailto:[email protected]<mailto:[email protected]>] Sent: 13 January 2015 09:07 To: Eleanor Merry Subject: Re: [Clearwater] Failed to update the server Hi Ellie, Thank you for replying, I did as you suggested but still the issue with the UI is there I have attached the homer log along with homestead and homestead-prov logs and also the screenshot of the error.Let me know if any other info is needed. Thanks and Regards, Shiva Charan M S On Mon, Jan 12, 2015 at 11:18 PM, Eleanor Merry <[email protected]<mailto:[email protected]>> wrote: Hi, This looks like a problem with your Homer (as the request that times out is http://192.168.47.132:7888/org.etsi.ngn.simservs/users/sip%3A6505550005%40localdomain/simservs.xml, which is to Homer - please see https://github.com/Metaswitch/crest/blob/dev/docs/homer_api.md for the API). Can you check if your Homer is running ('sudo monit status' on the Homer node), and that Cassandra is running reliably on it? If you see that the cassandra process is frequently restarting (which will in turn make Homer unstable) then can you try unmonitoring Homer and Cassandra ('sudo monit unmonitor <homer/cassandra>'), and then stopping Homer and Cassandra ('sudo service <homer/cassandra> stop'). Once the processes have fully stopped, remonitor Cassandra ('sudo monit monitor cassandra'). Once Cassandra is fully up, then remonitor Homer. If this doesn't fix it, then can you please send me the Homer logs (in /var/log/homer/homer*log)? Thanks, Ellie -----Original Message----- From: [email protected]<mailto:[email protected]> [mailto:[email protected]<mailto:[email protected]>] On Behalf Of Shiva Charan Sent: 12 January 2015 11:10 To: [email protected]<mailto:[email protected]> Subject: [Clearwater] Failed to update the server Hi, I have a manual install of clearwater with 6 vm's installed in vmware workstation, all the process are running and when creating the numbers in ellis role it is being created and is being stored in the database but the same is not being relfected in the UI of clearwater when creating numbers from UI I am getting an popup error saying Failed to update the server(see detailed diagnostics in developer console).please refresh the page Ellis log file content: Connect error on fd 23: EHOSTUNREACH 2015-01-12 02:15:49,836 W utils:78 22643:140436183340800] Non-OK HTTP response. HTTPResponse(code=599,request_time=2.89369797706604,buffer=None,_body=None,time_info={},request=<tornado.httpclient.HTTPRequest object at 0x29dde10>,effective_url=' http://192.168.47.132:7888/org.etsi.ngn.simservs/users/sip%3A6505550005%40localdomain/simservs.xml ',headers={},error=HTTPError('HTTP 599: Connection closed',)) 2015-01-12 02:15:49,837 W numbers:212 22643:140436183340800] Failed to back out changes after failure 2015-01-12 02:15:49,841 E web:1447 22643:140436183340800] 502 POST /accounts/ravi.chaudhary%40hp.com/numbers/?cb=13aa686355T1<http://40hp.com/numbers/?cb=13aa686355T1> (0.0.0.0) 6331.74ms 2015-01-12 02:15:49,842 D utils:94 22643:140436183340800] Still expecting 0 callbacks 2015-01-12 02:15:57,972 I web:1447 22643:140436183340800] 200 GET /ping (0.0.0.0) 0.59ms Sprout log file content: 12-01-2015 05:44:43.179 UTC Status bgcfservice.cpp:71: No BGCF configuration (file ./bgcf.json does not exist) 12-01-2015 05:44:43.180 UTC Status pluginloader.cpp:106: Loaded sproutlet bgcf using API version 1 12-01-2015 05:44:43.180 UTC Status pluginloader.cpp:137: Finished loading plug-ins 12-01-2015 05:44:43.199 UTC Status httpstack.cpp:131: Configuring HTTP stack 12-01-2015 05:44:43.199 UTC Status httpstack.cpp:132: Bind address: 192.168.47.130 12-01-2015 05:44:43.199 UTC Status httpstack.cpp:133: Bind port: 9888 12-01-2015 05:44:43.199 UTC Status httpstack.cpp:134: Num threads: 1 please revert back if any input. Thanks and regards, Shiva Charan M S _______________________________________________ Clearwater mailing list [email protected]<mailto:[email protected]> http://lists.projectclearwater.org/listinfo/clearwater _______________________________________________ Clearwater mailing list [email protected] http://lists.projectclearwater.org/listinfo/clearwater
