Hi Melcolm,
That's odd. However, this is a code path issue.
Can you get me the print-out for this one:
$ erl -name test -setcookie ClueCon -noinput -eval "io:format(\"~p~n\",
[rpc:call('openacd@`hostname -f`', code, get_path, [])])." -s erlang halt
You should find a line there having the value:
"/lib64/openacd/lib/oacd_freeswitch/ebin"
If not, please send me the entire result.
I wonder if it's only this entry that's affected however.
If it's a test system, you can also *temporarily* symlink ln -s
/lib64/openacd/lib/oacd_freeswitch /usr/lib64/erlang/lib/ . Then service stop
openacd && sleep 10 && service start openacd
* Sorry about the crazy commands to run. Debugging is muuch better with the
version of openacd we're working on. Unfortunately, this isn't making it to 4.6
yet.
Jan Vincent Liwanag
[email protected]
On Dec 4, 2012, at 6:03 PM, Melcon Moraes <[email protected]> wrote:
> Hi Jan,
>
> There are 13, all of them dated of Nov 29th.
>
> Just in case, I have the md5 of them:
>
> bbdce9613bbb37b2374153242d4818ac
> /lib64/openacd/lib/oacd_freeswitch/ebin/freeswitch.beam
> 1e117ece5a1aacfd48569a014f607311
> /lib64/openacd/lib/oacd_freeswitch/ebin/freeswitch_dialer.beam
> 9f0b093f260027bc2557ff544555c123
> /lib64/openacd/lib/oacd_freeswitch/ebin/freeswitch_fetch_handler.beam
> b745e08ec7a620508c244f729cfa0896
> /lib64/openacd/lib/oacd_freeswitch/ebin/freeswitch_media.beam
> 146254f7af7858b16cd8c8077b1d0944
> /lib64/openacd/lib/oacd_freeswitch/ebin/freeswitch_media_manager.beam
> 02b59da4eb81b425193a078d6dea7a60
> /lib64/openacd/lib/oacd_freeswitch/ebin/freeswitch_monitor.beam
> 3dd6ff3d89575e3d9061d89feeadd3d7
> /lib64/openacd/lib/oacd_freeswitch/ebin/freeswitch_ring.beam
> ca6f18730e5a30414aa903d9cde574d8
> /lib64/openacd/lib/oacd_freeswitch/ebin/freeswitch_ring_persistent.beam
> de48d320077e7775fa7b784a7544d58d
> /lib64/openacd/lib/oacd_freeswitch/ebin/freeswitch_ring_transient.beam
> e0fa3fc5e313d8e88d6f119726f9c31f
> /lib64/openacd/lib/oacd_freeswitch/ebin/freeswitch_voicemail.beam
> e331bb9c67eb2463b71b89068a37c0e6
> /lib64/openacd/lib/oacd_freeswitch/ebin/oacd_freeswitch.app
> d4ddd31c3a2b4ad2f8439450344f6366
> /lib64/openacd/lib/oacd_freeswitch/ebin/oacd_freeswitch_app.beam
> 51072b6e123c9aa87fb4ccc143b67b17
> /lib64/openacd/lib/oacd_freeswitch/ebin/oacd_freeswitch_sup.beam
>
>
> -
> MM
>
>
> On Mon, Dec 3, 2012 at 9:47 PM, Jan Vincent Liwanag <[email protected]>
> wrote:
> Hi Melcon,
>
> No need to reformat, just make sure that the latest openacd is installed.
>
> Can yo do this?
>
> $ ls -1 /lib/openacd/lib/oacd_freeswitch/ebin/ | wc -l
> (Or lib64)
>
> There should be 13.
>
> Jan Vincent Liwanag
> [email protected]
>
>
>
> On Dec 4, 2012, at 6:22 AM, Melcon Moraes <[email protected]> wrote:
>
>> Still a no go. That's really odd. I just tried sipxecs-setup --reset-all so
>> I started all the configs from scratch and the full.log shows the following:
>>
>> 19:15:52.597469 [WARNING] <0.147.0>@cpx_supervisor:491 No specs to load for
>> mediamanager_sup
>> 19:15:52.597793 [WARNING] <0.147.0>@cpx_supervisor:491 No specs to load for
>> agent_sup
>> 19:15:52.607104 [WARNING] <0.168.0>@cpx_supervisor:491 No specs to load for
>> agent_connection_sup
>> 19:15:52.630508 [NOTICE] <0.143.0>@cpx:149 Application OpenACD started
>> sucessfully!
>> 19:15:52.685025 [NOTICE] <0.199.0>@agent_web_listener:264 shutdown
>> 19:15:52.695527 [WARNING] <0.158.0>@queue_manager:313 No such queue
>> "default_queue"
>> 19:15:52.700248 [NOTICE] <0.231.0>@queue_manager:109 Updating running queue
>> configuration for "default_queue" at <0.238.0>
>> 19:15:52.700831 [WARNING] <0.237.0>@freeswitch_media_manager:725 Freeswitch
>> node undefined has gone down
>> 19:15:52.715250 [WARNING] <0.231.0>@cpx_supervisor:402 Adding new spec got
>> {atomic,
>> {error,
>> {shutdown,
>> {child,undefined,freeswitch_media_manager,
>> {cpx_middle_supervisor,start_anon,
>> [3,5,
>> {cpx_conf,freeswitch_media_manager,
>> freeswitch_media_manager,start_link,
>> ['[email protected]',
>> [{h323,[]},
>> {iax2,[]},
>> {sip,[]},
>> {dialstring,
>>
>> "{ignore_early_media=true}sofia/example.com/$1;sipx-noroute=VoiceMail;sipx-userforward=false"}]],
>> mediamanager_sup,1354569352}]},
>> temporary,2000,supervisor,
>> [cpx_middle_supervisor]}}}}
>> 19:15:52.715244 [ERROR] <0.294.0> Supervisor Report:
>> [{supervisor,{<0.294.0>,cpx_middle_supervisor}},{errorContext,start_error},{reason,{already_started,<0.237.0>}},{offender,[{pid,undefined},{name,freeswitch_media_manager},{mfargs,{freeswitch_media_manager,start_link,[[email protected],[{h323,[]},{iax2,[]},{sip,[]},{dialstring,"{ignore_early_media=true}sofia/example.com/$1;sipx-noroute=VoiceMail;sipx-userforward=false"}]]}},{restart_type,permanent},{shutdown,2000},{child_type,worker}]}]
>> 19:15:52.716282 [NOTICE] <0.152.0>@cpxlog_file:160 Changed loglevel for
>> logfile "/var/log/openacd/full.log" from notice to notice
>> 19:15:57.703046 [ERROR] <0.258.0> Crash Report:
>> [[{initial_call,{freeswitch_fetch_handler,-start_link/4-fun-0-,[]}},{pid,<0.258.0>},{registered_name,[]},{error_info,{exit,timeout,[{freeswitch_fetch_handler,-start_link/4-fun-0-,4},{proc_lib,init_p,3}]}},{ancestors,[oacd_freeswitch_sup,<0.235.0>]},{messages,[]},{links,[<0.236.0>]},{dictionary,[]},{trap_exit,false},{status,running},{heap_size,233},{stack_size,24},{reductions,89}],[]]
>> 19:15:57.703126 [ERROR] <0.236.0> Supervisor Report:
>> [{supervisor,{local,oacd_freeswitch_sup}},{errorContext,child_terminated},{reason,timeout},{offender,[{pid,<0.258.0>},{name,freeswitch_fetch_handler},{mfargs,{freeswitch_fetch_handler,start_link,[undefined,[{included_applications,[]}],no_sip_auth,[]]}},{restart_type,permanent},{shutdown,1000},{child_type,worker}]}]
>> 19:16:02.704036 [ERROR] <0.297.0> Crash Report:
>> [[{initial_call,{freeswitch_fetch_handler,-start_link/4-fun-0-,[]}},{pid,<0.297.0>},{registered_name,[]},{error_info,{exit,timeout,[{freeswitch_fetch_handler,-start_link/4-fun-0-,4},{proc_lib,init_p,3}]}},{ancestors,[oacd_freeswitch_sup,<0.235.0>]},{messages,[]},{links,[<0.236.0>]},{dictionary,[]},{trap_exit,false},{status,running},{heap_size,233},{stack_size,24},{reductions,89}],[]]
>> 19:16:02.704102 [ERROR] <0.236.0> Supervisor Report:
>> [{supervisor,{local,oacd_freeswitch_sup}},{errorContext,child_terminated},{reason,timeout},{offender,[{pid,<0.297.0>},{name,freeswitch_fetch_handler},{mfargs,{freeswitch_fetch_handler,start_link,[undefined,[{included_applications,[]}],no_sip_auth,[]]}},{restart_type,permanent},{shutdown,1000},{child_type,worker}]}]
>> 19:16:07.705042 [ERROR] <0.298.0> Crash Report:
>> [[{initial_call,{freeswitch_fetch_handler,-start_link/4-fun-0-,[]}},{pid,<0.298.0>},{registered_name,[]},{error_info,{exit,timeout,[{freeswitch_fetch_handler,-start_link/4-fun-0-,4},{proc_lib,init_p,3}]}},{ancestors,[oacd_freeswitch_sup,<0.235.0>]},{messages,[]},{links,[<0.236.0>]},{dictionary,[]},{trap_exit,false},{status,running},{heap_size,233},{stack_size,24},{reductions,89}],[]]
>> 19:16:07.705107 [ERROR] <0.236.0> Supervisor Report:
>> [{supervisor,{local,oacd_freeswitch_sup}},{errorContext,child_terminated},{reason,timeout},{offender,[{pid,<0.298.0>},{name,freeswitch_fetch_handler},{mfargs,{freeswitch_fetch_handler,start_link,[undefined,[{included_applications,[]}],no_sip_auth,[]]}},{restart_type,permanent},{shutdown,1000},{child_type,worker}]}]
>>
>>
>> and the lines with Supervisor Report/Crash Reports fills the rest of the
>> file, at 5 seconds interval. This was the first log when I just added the
>> CallCenter role.
>>
>> Then I started by adding a Client, Line, Agents and nothing gets changed,
>> not even the /etc/sipxpbx/freeswitch/conf/dialplan/sipX_context.xml gets
>> updated with the new line entry.
>>
>> After that, I tried service sipxecs restart, which created the new entry in
>> FS dialplan but the OpenACD still gets the same errors.
>>
>> Then I did a "Send Profiles" in System->Servers and all the configs I have
>> made in sipXconfig were "replicated' to OpenACD. However, the same error
>> messages keeps filling full.log and whenever a call hits the FS dialplan, it
>> gets hangup:
>>
>> 2012-12-03 20:20:00.410965 [DEBUG] mod_erlang_event.c:1468 Creating new
>> listener for session
>> 2012-12-03 20:20:00.410965 [ERR] mod_erlang_event.c:1210 Error connecting to
>> node [email protected] (erl_errno=5, errno=0)!
>> 2012-12-03 20:20:00.410965 [DEBUG] mod_erlang_event.c:1504 exit
>> erlang_outbound_function
>>
>> Next step would be to reformat the entire disk and start a new install. Any
>> other advices or do you need any more info/logs?
>>
>> Thanks
>>
>> -
>> MM
>>
>>
>>
>> On Fri, Nov 30, 2012 at 2:26 PM, Melcon Moraes <[email protected]> wrote:
>> I already restarted many times, rebooted the server as well. Also, if I
>> simply kill the process and wait a little, it will be spanwed back
>> "automagically". The same error still occours. Didn't tried this time, yet,
>> to remove/re-add the call center role or even a sipxecs-setup --reset-all.
>>
>> Let me try the kill/start approach one more time.
>>
>> -
>> MM
>>
>>
>> On Fri, Nov 30, 2012 at 2:13 PM, Jan Vincent Liwanag <[email protected]>
>> wrote:
>> Hi Melcon,
>>
>> Cause for crash report was exactly what was fixed within the new rpm. You
>> have to manually restart openacd for now though. There's a problem with the
>> restart script that needs fixing.
>>
>> $ pkill beam; sleep 10; service openacd start
>>
>> Let me know if this still occurs.
>>
>> Jan Vincent Liwanag
>> [email protected]
>>
>>
>>
>> On Nov 30, 2012, at 9:59 PM, Melcon Moraes <[email protected]> wrote:
>>
>>> Hi Jan,
>>>
>>> What about the Crash Report on full.log? Any ideas on where else should I
>>> be looking?
>>>
>>> As shown by the FS_cli output, I can't connect to the openacd node then
>>> comes the hangup.
>>>
>>> -
>>> MM
>>>
>>>
>>> On Fri, Nov 30, 2012 at 5:25 AM, Jan Vincent Liwanag <[email protected]>
>>> wrote:
>>> Hi Melcon,
>>>
>>> Problem here basically is that openacd didnt restart right during the last
>>> update. You might have to 'pkill beam' for now. Then do a 'service openacd
>>> start'.
>>>
>>> Sent from my iPhone
>>>
>>> On Nov 30, 2012, at 7:52 AM, Melcon Moraes <[email protected]> wrote:
>>>
>>>> Not to me. Not sure if it is related. I have attached full.log in debug.
>>>>
>>>>
>>>> As of now, I have the following installed:
>>>>
>>>> openacd-0.9.5-742.g4c27.x86_64
>>>> sipxopenacd-4.6.0-890.ge4ca9.x86_64
>>>>
>>>>
>>>> FS cli shows the following:
>>>>
>>>> 2012-11-29 21:38:27.151069 [DEBUG] switch_ivr_play_say.c:1678 done playing
>>>> file /var/sipxdata/configserver/phone/acd/audio/welcome-saude.wav
>>>> EXECUTE sofia/example.com/[email protected]
>>>> set(domain_name=example.com)
>>>> 2012-11-29 21:38:27.151069 [DEBUG] mod_dptools.c:1281
>>>> sofia/example.com/[email protected] SET [domain_name]=[example.com]
>>>> EXECUTE sofia/example.com/[email protected]
>>>> erlang_sendmsg(freeswitch_media_manager [email protected] inivr
>>>> dc68ee44-3a7d-11e2-9233-2bb5ec373e80)
>>>> 2012-11-29 21:38:27.151069 [DEBUG] mod_erlang_event.c:1541 Creating new
>>>> listener for sendmsg [email protected]
>>>> EXECUTE sofia/example.com/[email protected]
>>>> erlang(freeswitch_media_manager:! [email protected])
>>>> 2012-11-29 21:38:27.151069 [DEBUG] mod_erlang_event.c:1462 enter
>>>> erlang_outbound_function freeswitch_media_manager:!
>>>> [email protected]
>>>> 2012-11-29 21:38:27.151069 [DEBUG] mod_erlang_event.c:1468 Creating new
>>>> listener for session
>>>> 2012-11-29 21:38:27.151069 [ERR] mod_erlang_event.c:1210 Error connecting
>>>> to node [email protected] (erl_errno=5, errno=0)!
>>>> 2012-11-29 21:38:27.151069 [DEBUG] mod_erlang_event.c:1504 exit
>>>> erlang_outbound_function
>>>> 2012-11-29 21:38:27.151069 [NOTICE] switch_core_state_machine.c:226
>>>> sofia/example.com/[email protected] has executed the last dialplan
>>>> instruction, hanging up.
>>>>
>>>> Also, I have noticed that any changes I have made in the sipXconfig are
>>>> not deployed to openacd or even the dialplan for FS(when you change a
>>>> Line). I managed to get the settings in place by issuing a Send Profiles
>>>> on the server.
>>>>
>>>>
>>>> Thanks
>>>>
>>>> -
>>>> MM
>>>>
>>>>
>>>> On Thu, Nov 29, 2012 at 6:09 PM, Alan Worstell <[email protected]>
>>>> wrote:
>>>> Hello,
>>>> The updates as of today has fixed the issue, and call routing and
>>>> distribution is functioning as intended!
>>>>
>>>> Thanks,
>>>>
>>>> Alan Worstell
>>>> A1 Networks - Systems Administrator
>>>> VTSP, dCAA, LPIC-1, Linux+, CLA, DCTS
>>>> (707)570-2021 x204
>>>> For support issues please email [email protected] or call
>>>> 707-703-1050
>>>>
>>>> On 11/28/12 10:42 PM, Jan Vincent Liwanag wrote:
>>>> > Trevor,
>>>> >
>>>> > Found out what's causing this. Some freeswitch integration files turned
>>>> > out to be missing. Fixing this on the next RPM of openacd.
>>>> >
>>>> > Jan Vincent Liwanag
>>>> > [email protected]
>>>> >
>>>> >
>>>> >
>>>> > On Nov 29, 2012, at 12:19 AM, Alan Worstell <[email protected]>
>>>> > wrote:
>>>> >
>>>> >> On 11/28/12 7:44 AM, Melcon Moraes wrote:
>>>> >>> Do you really have literally {SERVERNAME} on the output or you just
>>>> >>> "masked" the server name? You're supposed to have your FQDN in place.
>>>> >>>
>>>> >>> -
>>>> >>> MM
>>>> >>>
>>>> >> Hello,
>>>> >> This is just the masked FQDN of our server.
>>>> >>
>>>> >> Regards,
>>>> >>
>>>> >> Alan Worstell
>>>> >> A1 Networks - Systems Administrator
>>>> >> VTSP, dCAA, LPIC-1, Linux+, CLA, DCTS
>>>> >> (707)570-2021 x204
>>>> >> For support issues please email [email protected] or call
>>>> >> 707-703-1050
>>>> >>
>>>> >>
>>>> >> _______________________________________________
>>>> >> sipx-users mailing list
>>>> >> [email protected]
>>>> >> List Archive: http://list.sipfoundry.org/archive/sipx-users/
>>>> > _______________________________________________
>>>> > sipx-users mailing list
>>>> > [email protected]
>>>> > List Archive: http://list.sipfoundry.org/archive/sipx-users/
>>>>
>>>> _______________________________________________
>>>> sipx-users mailing list
>>>> [email protected]
>>>> List Archive: http://list.sipfoundry.org/archive/sipx-users/
>>>>
>>>> <full_20121129.log>
>>>> _______________________________________________
>>>> sipx-users mailing list
>>>> [email protected]
>>>> List Archive: http://list.sipfoundry.org/archive/sipx-users/
>>>
>>> _______________________________________________
>>> sipx-users mailing list
>>> [email protected]
>>> List Archive: http://list.sipfoundry.org/archive/sipx-users/
>>>
>>> _______________________________________________
>>> sipx-users mailing list
>>> [email protected]
>>> List Archive: http://list.sipfoundry.org/archive/sipx-users/
>>
>>
>> _______________________________________________
>> sipx-users mailing list
>> [email protected]
>> List Archive: http://list.sipfoundry.org/archive/sipx-users/
>>
>>
>> _______________________________________________
>> sipx-users mailing list
>> [email protected]
>> List Archive: http://list.sipfoundry.org/archive/sipx-users/
>
>
> _______________________________________________
> sipx-users mailing list
> [email protected]
> List Archive: http://list.sipfoundry.org/archive/sipx-users/
>
> _______________________________________________
> sipx-users mailing list
> [email protected]
> List Archive: http://list.sipfoundry.org/archive/sipx-users/
_______________________________________________
sipx-users mailing list
[email protected]
List Archive: http://list.sipfoundry.org/archive/sipx-users/