I recently added to my SIPP automation framework... and integrated two
types of automated authentication of the audio coming back.... the first 1)
is sox stats on the audio and the 2) second is actually transcribing the
audio text on the call to text, and comparing it against the expected
string.
I have more details up on my blog:
http://www.continuous-qa.com/2013/04/automated-verification-of-voip-audio.html
The basic of it, is I use Jenkins to drive two simultaneous jobs:
1. sipp calling a phone number with a known greeting (i.e. "Welcome to Bank
of Brian")
2. a job that stars a shell script.
The shell script runs:
a) tshark to create a packet capture
b) converts the pcap to raw audio
c) uses sox to convert the raw audio to a wav and a flac
d) does analysis/stats on the audio files
e) uses googles transcription api to send the audio file to, and get
back the text response...
f) do an assert to verify the returned text of the audio on the call
(i.e. Welcome to Bank of Brian) matches the expected text.
I think there's a lot of more enhancements that could be added. But it's a
good start I think to pushing this to better automated validation.
If you want to compare tone info, Sox might be able to also do that. That's
outside my needs. There might also be other command line tools that could
be invoked in a the shell script to run more analysis.
On Wed, Mar 20, 2013 at 10:26 PM, Cagri Akalin <caka...@gmail.com> wrote:
> Thats what i want to do.
> Wireshark is the manual method. We need to do auto script and capture
> audio, tone etc. and compare them
> Sent from my iPhone
>
> On 21 Mar 2013, at 02:30, David Luu <manga...@gmail.com> wrote:
>
> Using Wireshark is good approach. Just wondering if anyone has built out
> an automated test solution approach using Wireshark or tshark and related
> tools such that you run sipp, capture the voip audio data, and run it
> against either a compare tool (to compare to known captured/reference audio
> data) or via a tone detector to see if the test tone sent as audio data was
> detected, and all that done via a scripted solution so that it can be run
> unattended and integrated with continuous integration build & test jobs.
> That would be awesome in terms of regression test coverage w/o manual
> intervention except to analyze failures.
>
> On Wed, Mar 20, 2013 at 3:29 PM, Brian Warner <continuou...@gmail.com>wrote:
>
>> So why not have Wireshark running on one box. During the SIPP test have
>> it record the packets. Under Wiresharks VOIP menu you can a) save the
>> packets as well as b) listen to the RTP stream itself (as long as the codec
>> is compatible - like G711, etc.)
>>
>> But the scenario itself should verify it did the SIP handshake as you'll
>> see the response codes like 183, 200, BYE, etc. But if you want the audio
>> to be verified, you could use wireshark on the recipient machine and check
>> the VOIP data during the connection.
>>
>>
>> On Wed, Mar 20, 2013 at 12:25 PM, Cagri Akalin <caka...@gmail.com> wrote:
>>
>>> We can send pcap file with caller side and can we capture rtp and
>>> compare with sender pcap file? Path check means is there any connection
>>> with caller and callee side?
>>> I know tcpdump but it takes whole eth logs. But i need to capture every
>>> connection sperately
>>>
>>> Sent from my iPhone
>>>
>>> On 20 Mar 2013, at 20:44, Rob Day <r...@rkd.me.uk> wrote:
>>>
>>> > On 20 March 2013 18:20, Cagri Akalin <caka...@gmail.com> wrote:
>>> >> Hi all,
>>> >> Is there any way to verify path with sipp?
>>> >
>>> > I'm not quite sure what you mean here - can you give an example?
>>> >
>>> >> We can send rtp with pcap file and can we capture received rtp data
>>> to anywhere in pc?
>>> >> Or is there any idea for that?
>>> >
>>> > SIPp doesn't include that functionality, but you could use tcpdump to
>>> > capture the packets. You could also use rtpdump from
>>> > http://www.cs.columbia.edu/irt/software/rtptools/, though I've never
>>> > tried this.
>>> >
>>> > On 20 March 2013 18:20, Cagri Akalin <caka...@gmail.com> wrote:
>>> >> Hi all,
>>> >> Is there any way to verify path with sipp?
>>> >> We can send rtp with pcap file and can we capture received rtp data
>>> to anywhere in pc?
>>> >> Or is there any idea for that?
>>> >>
>>> >> Cagri AKALIN
>>> >> Test Design Engineer
>>> >>
>>> ------------------------------------------------------------------------------
>>> >> Everyone hates slow websites. So do we.
>>> >> Make your web apps faster with AppDynamics
>>> >> Download AppDynamics Lite for free today:
>>> >> http://p.sf.net/sfu/appdyn_d2d_mar
>>> >> _______________________________________________
>>> >> Sipp-users mailing list
>>> >> Sipp-users@lists.sourceforge.net
>>> >> https://lists.sourceforge.net/lists/listinfo/sipp-users
>>> >
>>> >
>>> >
>>> > --
>>> > Robert K. Day
>>> > robert....@merton.oxon.org
>>>
>>>
>>> ------------------------------------------------------------------------------
>>> Everyone hates slow websites. So do we.
>>> Make your web apps faster with AppDynamics
>>> Download AppDynamics Lite for free today:
>>> http://p.sf.net/sfu/appdyn_d2d_mar
>>> _______________________________________________
>>> Sipp-users mailing list
>>> Sipp-users@lists.sourceforge.net
>>> https://lists.sourceforge.net/lists/listinfo/sipp-users
>>>
>>
>>
>>
>> ------------------------------------------------------------------------------
>> Everyone hates slow websites. So do we.
>> Make your web apps faster with AppDynamics
>> Download AppDynamics Lite for free today:
>> http://p.sf.net/sfu/appdyn_d2d_mar
>> _______________________________________________
>> Sipp-users mailing list
>> Sipp-users@lists.sourceforge.net
>> https://lists.sourceforge.net/lists/listinfo/sipp-users
>>
>>
>
------------------------------------------------------------------------------
Try New Relic Now & We'll Send You this Cool Shirt
New Relic is the only SaaS-based application performance monitoring service
that delivers powerful full stack analytics. Optimize and monitor your
browser, app, & servers with just a few lines of code. Try New Relic
and get this awesome Nerd Life shirt! http://p.sf.net/sfu/newrelic_d2d_apr
_______________________________________________
Sipp-users mailing list
Sipp-users@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/sipp-users
