Matt, I have checked that sprout is running, listening on port 5058, has the correct IP address, and is in a security group open to bono on port 5058. I have also checked that bono is connecting to the correct host name and that host name is resolving to Sprout's IP address. However, after rebooting both sprout and bono the logs look normal and I am no longer getting the same error in the bono logs and it seems that the two are communicating. The issue is - I still cannot get the softphone to connect to the network. I tried setting the log level to 5 on both homestead and homer using /etc/clearwater/user_settings yet I don't see anything new in the logs when I try to connect the softphone - should I? I'm also thinking about rebooting the whole network to see if that makes any difference (the instances haven't ever been rebooted). Will I run into any problems if I just restart individual instances or is there a specific way I should reboot the network? Any ideas you have would be very helpful. Thanks, Alex
On Tue, Jun 18, 2013 at 11:20 AM, Matt Williams < [email protected]> wrote: > Alex,**** > > ** ** > > That's odd.**** > > ** ** > > Please can you check that**** > > **· **sprout is running (on sprout: ps -eaf | grep sprout)**** > > **· **sprout is listening on port 5058 (on sprout: sudo netstat > -anp | grep 5058)**** > > **· **bono is trying to connect to the correct hostname (on bono: > grep "Creating connection pool to" /var/log/bono/sprout*.txt)**** > > **· **sprout has the correct IP address (on sprout: ip addr show > dev eth0)**** > > **· **bono is resolving the hostname to sprout's IP address (on > bono: dig +short <hostname>)**** > > **· **sprout's security group is open to bono (check in EC2)?**** > > ** ** > > Please let me know what you find.**** > > ** ** > > Thanks,**** > > ** ** > > Matt**** > > ** ** > > *From:* Alex Interrante [mailto:[email protected]] > *Sent:* 18 June 2013 18:11 > > *To:* Matt Williams > *Cc:* [email protected] > *Subject:* Re: [Clearwater] Softphone Registration Error**** > > ** ** > > Matt,**** > > I changed the logging levels and tried to connect again. However, no new > logs were created in the sprout node which lead me to believe that bono is > not connecting to sprout. When I checked the bono logs this is what I found > in the newest log: > > 18-06-2013 17:04:01.422 Error pjsip: tcpc0x7f597c00 TCP connect() error: > Connection refused [code=120111] > 18-06-2013 17:04:01.422 Error pjsip: tcpc0x7f597c00 TCP connect() error: > Connection refused [code=120111] > 18-06-2013 17:04:01.422 Error pjsip: tcpc0x7f597c00 TCP connect() error: > Connection refused [code=120111] > 18-06-2013 17:04:01.422 Error pjsip: tcpc0x7f597c00 TCP connect() error: > Connection refused [code=120111]**** > > etc... for 51 lines.**** > > Any ideas about a solution to this? > Thanks for your help,**** > > Alex**** > > ** ** > > ** ** > > ** ** > > On Tue, Jun 18, 2013 at 10:30 AM, Matt Williams < > [email protected]> wrote:**** > > Alex,**** > > **** > > Thanks for your email - it's good that monit is now reporting the correct > status.**** > > **** > > I think the next step is to look at the SIP flows and bono/sprout > processing. The easiest way to do this is to set sprout and bono log level > to 5 (as described at > https://github.com/Metaswitch/clearwater-docs/wiki/Troubleshooting%20and%20Recovery#sprout), > repro the problem and then to gather /var/log/sprout/sprout*.txt from > sprout and /var/log/bono/sprout*.txt from bono. This should tell us > whether the request is reaching bono, whether it's then reaching sprout > and, if it is, why sprout is rejecting it.**** > > **** > > Thanks,**** > > **** > > Matt**** > > **** > > *From:* Alex Interrante [mailto:[email protected]] > *Sent:* 18 June 2013 17:16**** > > > *To:* Matt Williams > *Cc:* [email protected] > *Subject:* Re: [Clearwater] Softphone Registration Error**** > > **** > > Matt,**** > > I killed the process and it seemed to fix the problem - I can now see > homestead using "sudo monit status". However, I am still unable to connect > to the service using a softphone. I have followed all of the instructions > here: https://github.com/Metaswitch/clearwater-docs/wiki/Clearwater-Tourfor > configuring X-Lite and have created a user using ellis. Any suggestions > you have would be greatly appreciated.**** > > Thanks for your help, > Alex**** > > **** > > On Tue, Jun 18, 2013 at 9:52 AM, Matt Williams < > [email protected]> wrote:**** > > Alex,**** > > **** > > Thanks! The netstat output shows that something is already listening on > port 8888. Please can you run "ps -f 11440" (11440 is the process ID > reported from netstat) to find out what it is?**** > > **** > > My suspicion is that process 11440 will turn out to be another instance of > homestead, which would imply that monit has lost track of it. If this is > the case, please can you kill process 11440 - hoepfully then monit will > successfully restart it. sudo monit status should report on this (although > it may take 30s or so for it to realize).**** > > **** > > Please let me know how you get on.**** > > **** > > Thanks,**** > > **** > > Matt**** > > **** > > *From:* Alex Interrante [mailto:[email protected]] > *Sent:* 18 June 2013 16:46**** > > > *To:* Matt Williams > *Cc:* [email protected] > *Subject:* Re: [Clearwater] Softphone Registration Error**** > > **** > > Matt,**** > > Here's the contents of homestead-err.log: > > Logging to /var/log/homestead/homestead-0.log > Logging to /var/log/homestead/homestead-0.log > Traceback (most recent call last): > File "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main > "__main__", fname, loader, pkg_name) > File "/usr/lib/python2.7/runpy.py", line 72, in _run_code > exec code in run_globals > File > "/usr/share/clearwater/homestead/env/lib/python2.7/site-packages/crest-0.1-py2.7.egg/metaswitch/crest/main.py", > line 120, in <module> > standalone() > File > "/usr/share/clearwater/homestead/env/lib/python2.7/site-packages/crest-0.1-py2.7.egg/metaswitch/crest/main.py", > line 109, in standalone > http_port = reactor.listenTCP(settings.HTTP_PORT, application, > interface="0.0.0.0") > File > "/usr/share/clearwater/homestead/env/local/lib/python2.7/site-packages/Twisted-12.3.0-py2.7-linux-x86_64.egg/twisted/internet/posixbase.py", > line 489, in listenTCP > p.startListening() > File > "/usr/share/clearwater/homestead/env/local/lib/python2.7/site-packages/Twisted-12.3.0-py2.7-linux-x86_64.egg/twisted/internet/tcp.py", > line 980, in startListening > raise CannotListenError(self.interface, self.port, le) > twisted.internet.error.CannotListenError: Couldn't listen on 0.0.0.0:8888: > [Errno 98] Address already in use.**** > > **** > > And here is what I get when I run "sudo netstat -anp | grep 8888": > > ep 8888 > tcp 0 0 0.0.0.0:8888 0.0.0.0:* > LISTEN 11440/python**** > > Thanks for your help, > Alex**** > > **** > > **** > > On Tue, Jun 18, 2013 at 9:36 AM, Matt Williams < > [email protected]> wrote:**** > > Alex,**** > > **** > > Thanks for your response.**** > > **** > > Please can you check /var/log/homestead/homestead-err.log too? This > should log any actual errors homestead hits. (I should have suggested this > before.)**** > > **** > > I wonder if something else is listening on port 8888. Please can you try > running "sudo netstat -anp | grep 8888" to check?**** > > **** > > Thanks,**** > > **** > > Matt**** > > **** > > *From:* Alex Interrante [mailto:[email protected]] > *Sent:* 18 June 2013 15:27 > *To:* Matt Williams > *Cc:* [email protected] > *Subject:* Re: [Clearwater] Softphone Registration Error**** > > **** > > Matt,**** > > Thanks again for your help. Here is the output when I run "sudo service > homestead start":**** > > > /usr/share/clearwater/homestead/env/local/lib/python2.7/site-packages/crest-0.1-py2.7.egg/metaswitch/__init__.py:38: > UserWarning: Module metaswitch was already imported from > /usr/share/clearwater/homestead/env/local/lib/python2.7/site-packages/crest-0.1-py2.7.egg/metaswitch/__init__.pyc, > but > /usr/share/clearwater/homestead/env/lib/python2.7/site-packages/metaswitchcommon-0.1-py2.7.egg > is being added to sys.path > import pkg_resources > Logging to /var/log/homestead/homestead-0.log**** > > When I look in the log file I see a ton of entries every few seconds that > look like this:**** > > > 2013-06-18 14:13:49,442 I main:108 30034:140715420485376] Going to listen > for HTTP on port 8888 > 2013-06-18 14:13:51,099 I main:108 30051:139946963101440] Going to listen > for HTTP on port 8888 > 2013-06-18 14:14:01,493 I main:108 30071:139843468560128] Going to listen > for HTTP on port 8888 > 2013-06-18 14:14:13,198 I main:108 30091:140107171673856] Going to listen > for HTTP on port 8888 > 2013-06-18 14:14:25,171 I main:108 30109:140409025582848] Going to listen > for HTTP on port 8888**** > > 2013-06-18 14:14:36,868 I main:108 30128:139765255456512] Going to listen > for HTTP on port 8888**** > > **** > > The interesting thing was that this morning when I ran "sudo monit status" > this is what I got on homestead: > > Process 'homestead' > status Execution failed > monitoring status Monitored > data collected Tue, 18 Jun 2013 14:09:57**** > > However, when I ran "sudo monit start homestead" it changed back to saying > that homestead does not exist: > > Process 'homestead' > status Does not exist > monitoring status Monitored > data collected Tue, 18 Jun 2013 14:26:10**** > > Thanks, > Alex**** > > **** > > **** > > On Mon, Jun 17, 2013 at 3:43 PM, Matt Williams < > [email protected]> wrote:**** > > Alex,**** > > **** > > That's odd - yes, homestead should be marked as "Running" too.**** > > **** > > Are there any logs in /var/log/homestead/homestead-0.log?**** > > **** > > Also, can you run "sudo service homestead start" and do you see any error > messages if you do?**** > > **** > > Please let me know.**** > > **** > > Thanks,**** > > **** > > Matt**** > > **** > > *From:* [email protected] [mailto: > [email protected]] *On Behalf Of *Alex > Interrante > *Sent:* 17 June 2013 19:44 > *To:* [email protected] > *Subject:* [Clearwater] Softphone Registration Error**** > > **** > > Hi,**** > > I setup Clearwater using the automated install instructions and it appears > to be running correctly. However, when I try to connect a softphone to it > using an account registered through Ellis, I am unable to register and > consequently cannot make calls. When I run "sudo monit status" in each of > the nodes everything seems to be running except for homestead. Here is the > output from the monit status command in homestead: > > Process 'homestead' > status Does not exist > monitoring status Monitored > data collected Mon, 17 Jun 2013 18:40:59 > > Process 'cassandra' > status Running > monitoring status Monitored > pid 16410 > parent pid 16408 > uptime 2d 22h 20m > children 0 > memory kilobytes 1182636 > memory kilobytes total 1182636 > memory percent 69.8% > memory percent total 69.8% > cpu percent 0.0% > cpu percent total 0.0% > port response time 0.000s to localhost:9160 [DEFAULT via > TCP] > data collected Mon, 17 Jun 2013 18:40:59 > > System 'system_ec2-23-22-167-235' > status Running > monitoring status Monitored > load average [0.33] [0.32] [0.31] > cpu 4.5%us 4.9%sy 0.0%wa > memory usage 1269944 kB [75.0%] > swap usage 4908 kB [0.5%] > data collected Mon, 17 Jun 2013 18:40:59**** > > **** > > Should homestead be marked as "Running"? Could this be the source of my > connection issues from the softphone?**** > > Thanks for your help,**** > > Alex**** > > > _______________________________________________ > Clearwater mailing list > [email protected] > http://lists.projectclearwater.org/listinfo/clearwater**** > > **** > > > _______________________________________________ > Clearwater mailing list > [email protected] > http://lists.projectclearwater.org/listinfo/clearwater**** > > **** > > > _______________________________________________ > Clearwater mailing list > [email protected] > http://lists.projectclearwater.org/listinfo/clearwater**** > > **** > > > _______________________________________________ > Clearwater mailing list > [email protected] > http://lists.projectclearwater.org/listinfo/clearwater**** > > ** ** > > _______________________________________________ > Clearwater mailing list > [email protected] > http://lists.projectclearwater.org/listinfo/clearwater > >
_______________________________________________ Clearwater mailing list [email protected] http://lists.projectclearwater.org/listinfo/clearwater
