Hi, Thanks for getting in touch about this.
A potential cause of this could be that there's a race condition on start-up, and the Cassandra process doesn’t get started properly. This then affects the homestead-prov component (causing the 503 overload messages you've seen in the logs), which in turn means that Ellis can't provision subscribers. Can you please check for me: - Is it still broken? If it is just an issue with Cassandra having a slow start then this can be fixed by waiting for 10 minutes or so. - Is Cassandra running correctly? You can check this by running 'monit status', and getting the uptime of the Cassandra process If it is still broken, then can you try stopping and starting the services? You can do this by running the following commands: monit stop ellis monit stop homestead-prov monit stop cassandra monit start cassandra (please then wait for cassandra to have fully restarted) monit start homestead-prov monit start ellis Can you let me know if this fixes it? We'll also look at fixing this properly in the OVF. Thanks! Ellie -----Original Message----- From: [email protected] [mailto:[email protected]] On Behalf Of Baudouin d'Herbais de Thun Sent: 14 October 2014 13:54 To: [email protected] Subject: Re: [Clearwater] ssue with Ellis to create a private identity. Clearwater. Almost Same post was done on Oct 10th.. Re: [Clearwater] configure outbound proxy all in one ofv image <http://lists.projectclearwater.org/mail-archive/msg00972.html> , Regards B. From: Baudouin d'Herbais de Thun <[email protected]> Date: Tuesday 14 October 2014 11:30 To: <[email protected]> Subject: ssue with Ellis to create a private identity. Clearwater. Hi, I have installed Clearwater all in the Box. I have crated a user in « Ellis » and I can log in When logged in, the GUI http asked me to create a new Private Identity. When I click on it, I do have a popup with : « Failed to update the server (see detailed diagnostics in developer console). Please refresh the page. » In the Logs I can see the following at /var/log/ellis while doing a tail -f 2014-10-14 08:21:19,883 D numbers:120 1341:140715832346368] Number allocation API call (PSTN = false) 2014-10-14 08:21:19,884 D numbers:125 1341:140715832346368] Allocating a non-PSTN number 2014-10-14 08:21:19,886 D numbers:139 1341:140715832346368] Fetched 7e5df41b-9614-4a1a-b0c7-ce4f72c2ff17 2014-10-14 08:21:19,888 D numbers:151 1341:140715832346368] Updated the owner 2014-10-14 08:21:19,888 D numbers:129 1341:140715832346368] SIP URI sip:[email protected] 2014-10-14 08:21:19,890 D numbers:158 1341:140715832346368] Populating other servers... 2014-10-14 08:21:19,890 D numbers:169 1341:140715832346368] About to create private ID at Homestead 2014-10-14 08:21:19,891 W homestead:283 1341:140715832346368] Passing SIP password in the clear over http 2014-10-14 08:21:19,894 D numbers:174 1341:140715832346368] Created private ID at Homestead 2014-10-14 08:21:19,894 W homestead:283 1341:140715832346368] Passing SIP password in the clear over http 2014-10-14 08:21:19,898 W utils:78 1341:140715832346368] Non-OK HTTP response. HTTP 503: Service Unavailable 2014-10-14 08:21:19,898 W numbers:196 1341:140715832346368] Failed to update all the backends 2014-10-14 08:21:19,898 W homestead:283 1341:140715832346368] Passing SIP password in the clear over http 2014-10-14 08:21:19,899 D utils:94 1341:140715832346368] Still expecting 2 callbacks 2014-10-14 08:21:19,899 W utils:78 1341:140715832346368] Non-OK HTTP response. HTTP 503: Service Unavailable 2014-10-14 08:21:19,900 D utils:94 1341:140715832346368] Still expecting 1 callbacks 2014-10-14 08:21:19,904 W utils:78 1341:140715832346368] Non-OK HTTP response. HTTPResponse(code=503,request_time=0.00650787353515625,buffer=<_io.BytesIO object at 0x31ba350>,_body=None,time_info={},request=<tornado.httpclient.HTTPReque 0x31ba350>st object at 0x31a8d10>,effective_url='http://10.0.0.183:7888/org.etsi.ngn.simservs/u 0x31a8d10>sers /sip%3A6505550892%40example.com/simservs.xml',headers={'Content-Length': '98', 'Server': 'cyclone/1.0', 'Content-Type': 'application/json', 'Content-Encoding': 'gzip'},error=HTTPError('HTTP 503: Service Unavailable',)) 2014-10-14 08:21:19,904 D utils:94 1341:140715832346368] Still expecting 0 callbacks 2014-10-14 08:21:19,905 W utils:78 1341:140715832346368] Non-OK HTTP response. HTTPResponse(code=503,request_time=0.005930185317993164,buffer=<_io.BytesIO object at 0x31ba170>,_body=None,time_info={},request=<tornado.httpclient.HTTPReque 0x31ba170>st object at 0x31a8950>,effective_url='http://10.0.0.183:8889/public/sip%3A6505550892 0x31a8950>%40e xample.com/associated_private_ids',headers={'Content-Length': '98', 'Server': 'cyclone/1.0', 'Content-Type': 'application/json', 'Content-Encoding': 'gzip'},error=HTTPError('HTTP 503: Service Unavailable',)) 2014-10-14 08:21:19,905 D numbers:254 1341:140715832346368] Failed to retrieve private IDs for a public ID 2014-10-14 08:21:19,905 D numbers:255 1341:140715832346368] Returning sip:[email protected] to the pool 2014-10-14 08:21:19,905 D numbers:88 1341:140715832346368] Removing owner of sip:[email protected] 2014-10-14 08:21:19,909 W numbers:208 1341:140715832346368] Backed out changes after failure 2014-10-14 08:21:19,910 E web:1447 1341:140715832346368] 502 POST /accounts/baudouin.dherbais%40netaxis.be/numbers/?cb=11da823031H4 (10.0.0.173) 27.97ms 2014-10-14 08:21:19,911 D utils:94 1341:140715832346368] Still expecting 0 callbacks ============== I can also see in /var/log/homestead-prov/homestead-prov-0.log Rejecting request because of overload sending 503 response to 10.0.0.183 for GET http://ŠŠ So it looks like a congestion issue. As I am running a VirtualBox entity, what could cause this ??? Kind regards Baudouin d¹Herbais de Thun Netaxis Solutions S.A. Rue Wiertz 33 1050 Bruxelles Belgium http://www.netaxis.be Fixe: +32 (0) 2 626 01 28 Mobile: +32 (0) 477 33 27 35 Fax: +32 (0) 2 640 74 43 Skype: baudouin_cod _______________________________________________ Clearwater mailing list [email protected] http://lists.projectclearwater.org/listinfo/clearwater
