Alex, That's odd.
Please can you check that * sprout is running (on sprout: ps -eaf | grep sprout) * sprout is listening on port 5058 (on sprout: sudo netstat -anp | grep 5058) * bono is trying to connect to the correct hostname (on bono: grep "Creating connection pool to" /var/log/bono/sprout*.txt) * sprout has the correct IP address (on sprout: ip addr show dev eth0) * bono is resolving the hostname to sprout's IP address (on bono: dig +short <hostname>) * sprout's security group is open to bono (check in EC2)? Please let me know what you find. Thanks, Matt From: Alex Interrante [mailto:[email protected]] Sent: 18 June 2013 18:11 To: Matt Williams Cc: [email protected] Subject: Re: [Clearwater] Softphone Registration Error Matt, I changed the logging levels and tried to connect again. However, no new logs were created in the sprout node which lead me to believe that bono is not connecting to sprout. When I checked the bono logs this is what I found in the newest log: 18-06-2013 17:04:01.422 Error pjsip: tcpc0x7f597c00 TCP connect() error: Connection refused [code=120111] 18-06-2013 17:04:01.422 Error pjsip: tcpc0x7f597c00 TCP connect() error: Connection refused [code=120111] 18-06-2013 17:04:01.422 Error pjsip: tcpc0x7f597c00 TCP connect() error: Connection refused [code=120111] 18-06-2013 17:04:01.422 Error pjsip: tcpc0x7f597c00 TCP connect() error: Connection refused [code=120111] etc... for 51 lines. Any ideas about a solution to this? Thanks for your help, Alex On Tue, Jun 18, 2013 at 10:30 AM, Matt Williams <[email protected]<mailto:[email protected]>> wrote: Alex, Thanks for your email - it's good that monit is now reporting the correct status. I think the next step is to look at the SIP flows and bono/sprout processing. The easiest way to do this is to set sprout and bono log level to 5 (as described at https://github.com/Metaswitch/clearwater-docs/wiki/Troubleshooting%20and%20Recovery#sprout), repro the problem and then to gather /var/log/sprout/sprout*.txt from sprout and /var/log/bono/sprout*.txt from bono. This should tell us whether the request is reaching bono, whether it's then reaching sprout and, if it is, why sprout is rejecting it. Thanks, Matt From: Alex Interrante [mailto:[email protected]<mailto:[email protected]>] Sent: 18 June 2013 17:16 To: Matt Williams Cc: [email protected]<mailto:[email protected]> Subject: Re: [Clearwater] Softphone Registration Error Matt, I killed the process and it seemed to fix the problem - I can now see homestead using "sudo monit status". However, I am still unable to connect to the service using a softphone. I have followed all of the instructions here: https://github.com/Metaswitch/clearwater-docs/wiki/Clearwater-Tour for configuring X-Lite and have created a user using ellis. Any suggestions you have would be greatly appreciated. Thanks for your help, Alex On Tue, Jun 18, 2013 at 9:52 AM, Matt Williams <[email protected]<mailto:[email protected]>> wrote: Alex, Thanks! The netstat output shows that something is already listening on port 8888. Please can you run "ps -f 11440" (11440 is the process ID reported from netstat) to find out what it is? My suspicion is that process 11440 will turn out to be another instance of homestead, which would imply that monit has lost track of it. If this is the case, please can you kill process 11440 - hoepfully then monit will successfully restart it. sudo monit status should report on this (although it may take 30s or so for it to realize). Please let me know how you get on. Thanks, Matt From: Alex Interrante [mailto:[email protected]<mailto:[email protected]>] Sent: 18 June 2013 16:46 To: Matt Williams Cc: [email protected]<mailto:[email protected]> Subject: Re: [Clearwater] Softphone Registration Error Matt, Here's the contents of homestead-err.log: Logging to /var/log/homestead/homestead-0.log Logging to /var/log/homestead/homestead-0.log Traceback (most recent call last): File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main "__main__", fname, loader, pkg_name) File "/usr/lib/python2.7/runpy.py", line 72, in _run_code exec code in run_globals File "/usr/share/clearwater/homestead/env/lib/python2.7/site-packages/crest-0.1-py2.7.egg/metaswitch/crest/main.py", line 120, in <module> standalone() File "/usr/share/clearwater/homestead/env/lib/python2.7/site-packages/crest-0.1-py2.7.egg/metaswitch/crest/main.py", line 109, in standalone http_port = reactor.listenTCP(settings.HTTP_PORT, application, interface="0.0.0.0") File "/usr/share/clearwater/homestead/env/local/lib/python2.7/site-packages/Twisted-12.3.0-py2.7-linux-x86_64.egg/twisted/internet/posixbase.py", line 489, in listenTCP p.startListening() File "/usr/share/clearwater/homestead/env/local/lib/python2.7/site-packages/Twisted-12.3.0-py2.7-linux-x86_64.egg/twisted/internet/tcp.py", line 980, in startListening raise CannotListenError(self.interface, self.port, le) twisted.internet.error.CannotListenError: Couldn't listen on 0.0.0.0:8888<http://0.0.0.0:8888>: [Errno 98] Address already in use. And here is what I get when I run "sudo netstat -anp | grep 8888": ep 8888 tcp 0 0 0.0.0.0:8888<http://0.0.0.0:8888> 0.0.0.0:* LISTEN 11440/python Thanks for your help, Alex On Tue, Jun 18, 2013 at 9:36 AM, Matt Williams <[email protected]<mailto:[email protected]>> wrote: Alex, Thanks for your response. Please can you check /var/log/homestead/homestead-err.log too? This should log any actual errors homestead hits. (I should have suggested this before.) I wonder if something else is listening on port 8888. Please can you try running "sudo netstat -anp | grep 8888" to check? Thanks, Matt From: Alex Interrante [mailto:[email protected]<mailto:[email protected]>] Sent: 18 June 2013 15:27 To: Matt Williams Cc: [email protected]<mailto:[email protected]> Subject: Re: [Clearwater] Softphone Registration Error Matt, Thanks again for your help. Here is the output when I run "sudo service homestead start": /usr/share/clearwater/homestead/env/local/lib/python2.7/site-packages/crest-0.1-py2.7.egg/metaswitch/__init__.py:38: UserWarning: Module metaswitch was already imported from /usr/share/clearwater/homestead/env/local/lib/python2.7/site-packages/crest-0.1-py2.7.egg/metaswitch/__init__.pyc, but /usr/share/clearwater/homestead/env/lib/python2.7/site-packages/metaswitchcommon-0.1-py2.7.egg is being added to sys.path import pkg_resources Logging to /var/log/homestead/homestead-0.log When I look in the log file I see a ton of entries every few seconds that look like this: 2013-06-18 14:13:49,442 I main:108 30034:140715420485376] Going to listen for HTTP on port 8888 2013-06-18 14:13:51,099 I main:108 30051:139946963101440] Going to listen for HTTP on port 8888 2013-06-18 14:14:01,493 I main:108 30071:139843468560128] Going to listen for HTTP on port 8888 2013-06-18 14:14:13,198 I main:108 30091:140107171673856] Going to listen for HTTP on port 8888 2013-06-18 14:14:25,171 I main:108 30109:140409025582848] Going to listen for HTTP on port 8888 2013-06-18 14:14:36,868 I main:108 30128:139765255456512] Going to listen for HTTP on port 8888 The interesting thing was that this morning when I ran "sudo monit status" this is what I got on homestead: Process 'homestead' status Execution failed monitoring status Monitored data collected Tue, 18 Jun 2013 14:09:57 However, when I ran "sudo monit start homestead" it changed back to saying that homestead does not exist: Process 'homestead' status Does not exist monitoring status Monitored data collected Tue, 18 Jun 2013 14:26:10 Thanks, Alex On Mon, Jun 17, 2013 at 3:43 PM, Matt Williams <[email protected]<mailto:[email protected]>> wrote: Alex, That's odd - yes, homestead should be marked as "Running" too. Are there any logs in /var/log/homestead/homestead-0.log? Also, can you run "sudo service homestead start" and do you see any error messages if you do? Please let me know. Thanks, Matt From: [email protected]<mailto:[email protected]> [mailto:[email protected]<mailto:[email protected]>] On Behalf Of Alex Interrante Sent: 17 June 2013 19:44 To: [email protected]<mailto:[email protected]> Subject: [Clearwater] Softphone Registration Error Hi, I setup Clearwater using the automated install instructions and it appears to be running correctly. However, when I try to connect a softphone to it using an account registered through Ellis, I am unable to register and consequently cannot make calls. When I run "sudo monit status" in each of the nodes everything seems to be running except for homestead. Here is the output from the monit status command in homestead: Process 'homestead' status Does not exist monitoring status Monitored data collected Mon, 17 Jun 2013 18:40:59 Process 'cassandra' status Running monitoring status Monitored pid 16410 parent pid 16408 uptime 2d 22h 20m children 0 memory kilobytes 1182636 memory kilobytes total 1182636 memory percent 69.8% memory percent total 69.8% cpu percent 0.0% cpu percent total 0.0% port response time 0.000s to localhost:9160 [DEFAULT via TCP] data collected Mon, 17 Jun 2013 18:40:59 System 'system_ec2-23-22-167-235' status Running monitoring status Monitored load average [0.33] [0.32] [0.31] cpu 4.5%us 4.9%sy 0.0%wa memory usage 1269944 kB [75.0%] swap usage 4908 kB [0.5%] data collected Mon, 17 Jun 2013 18:40:59 Should homestead be marked as "Running"? Could this be the source of my connection issues from the softphone? Thanks for your help, Alex _______________________________________________ Clearwater mailing list [email protected]<mailto:[email protected]> http://lists.projectclearwater.org/listinfo/clearwater _______________________________________________ Clearwater mailing list [email protected]<mailto:[email protected]> http://lists.projectclearwater.org/listinfo/clearwater _______________________________________________ Clearwater mailing list [email protected]<mailto:[email protected]> http://lists.projectclearwater.org/listinfo/clearwater _______________________________________________ Clearwater mailing list [email protected]<mailto:[email protected]> http://lists.projectclearwater.org/listinfo/clearwater
_______________________________________________ Clearwater mailing list [email protected] http://lists.projectclearwater.org/listinfo/clearwater
