Re: [asterisk-dev] [Code Review] 4470: Testsuite: Generate UserEvent upon PJsua phones being ready.

2015-03-13 Thread jbigelow
://reviewboard.asterisk.org/r/4470/diff/ Testing --- * Executed each test successfully 50+ times on local system and build agent where the test would sometimes fail. Thanks, jbigelow -- _ -- Bandwidth and Colocation Provided by http://www.api

[asterisk-dev] [Code Review] 4470: Testsuite: Generate UserEvent upon PJsua phones being ready.

2015-03-10 Thread jbigelow
/asterisk/trunk/lib/python/asterisk/phones.py 6506 Diff: https://reviewboard.asterisk.org/r/4470/diff/ Testing --- * Executed each test successfully 50+ times on local system and build agent where the test would sometimes fail. Thanks, jbigelow

Re: [asterisk-dev] [Code Review] 4452: Testsuite: ARI channel subscription tests

2015-03-06 Thread jbigelow
--- * Executed each test successfully 30+ times. * Changed the code to force a failure to ensure tests properly failed. * Review logs to ensure operation is as expected. Thanks, jbigelow -- _ -- Bandwidth and Colocation Provided

Re: [asterisk-dev] [Code Review] 4452: Testsuite: ARI channel subscription tests

2015-03-05 Thread jbigelow
successfully 30+ times. * Changed the code to force a failure to ensure tests properly failed. * Review logs to ensure operation is as expected. Thanks, jbigelow -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com

Re: [asterisk-dev] [Code Review] 4452: Testsuite: ARI channel subscription tests

2015-03-05 Thread jbigelow
using the ua_cfg variable anywhere else that I can tell. I'm using 'ua_cfg' to be able to set max_calls. On March 5, 2015, 1:53 p.m., jbigelow wrote: I see a lot of duplication in the run-test files. I suggest that we refactor and abstract the common pieces of code into a base class

Re: [asterisk-dev] [Code Review] 4452: Testsuite: ARI channel subscription tests

2015-03-05 Thread jbigelow
tests properly failed. * Review logs to ensure operation is as expected. Thanks, jbigelow -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- asterisk-dev mailing list To UNSUBSCRIBE or update options

Re: [asterisk-dev] [Code Review] 4452: Testsuite: ARI channel subscription tests

2015-03-04 Thread jbigelow
tests properly failed. * Review logs to ensure operation is as expected. Thanks, jbigelow -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- asterisk-dev mailing list To UNSUBSCRIBE or update options

Re: [asterisk-dev] [Code Review] 4452: Testsuite: ARI channel subscription tests

2015-03-04 Thread jbigelow
that a no-op? Good question. I used 'tests/rest_api/channels/redirect/nominal/run-test' as a base and I'm not sure why myself. I've removed it though. - jbigelow --- This is an automatically generated e-mail. To reply, visit: https

[asterisk-dev] [Code Review] 4452: Testsuite: ARI channel subscription tests

2015-02-26 Thread jbigelow
operation is as expected. Thanks, jbigelow -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- asterisk-dev mailing list To UNSUBSCRIBE or update options visit: http://lists.digium.com/mailman/listinfo

[asterisk-dev] [Code Review] 4416: Testsuite: Attended transfers from Stasis bridge to Stasis bridge

2015-02-13 Thread jbigelow
, jbigelow -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- asterisk-dev mailing list To UNSUBSCRIBE or update options visit: http://lists.digium.com/mailman/listinfo/asterisk-dev

Re: [asterisk-dev] [Code Review] 4413: Testsuite: Simulate phones and control from YAML.

2015-02-13 Thread jbigelow
pluggable object? jbigelow wrote: If that condition is removed then it will blow up if callback_module callback_method are not defined in YAML and pjsua_mod.PJsua is being used as a test module. If it remains with the same scenario then things won't blow up and no user code is called

Re: [asterisk-dev] [Code Review] 4413: Testsuite: Simulate phones and control from YAML.

2015-02-13 Thread jbigelow
Thanks, jbigelow -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- asterisk-dev mailing list To UNSUBSCRIBE or update options visit: http://lists.digium.com/mailman/listinfo/asterisk-dev

Re: [asterisk-dev] [Code Review] 4413: Testsuite: Simulate phones and control from YAML.

2015-02-13 Thread jbigelow
/11/659ab31f-8401-4f24-be5e-da1db0be3156__test-config.yaml Thanks, jbigelow -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- asterisk-dev mailing list To UNSUBSCRIBE or update options visit: http

Re: [asterisk-dev] [Code Review] 4415: Testsuite: Attended transfers from non-Stasis to a Stasis bridge

2015-02-13 Thread jbigelow
aren't received and actions don't fire. Therefore those events/actions in the YAML haven't been tested. * Executed tests multiple times. * Reviewed logs to ensure the tests were executing as expected. Thanks, jbigelow

Re: [asterisk-dev] [Code Review] 4416: Testsuite: Attended transfers from Stasis bridge to Stasis bridge

2015-02-13 Thread jbigelow
in the YAML haven't been tested. * Executed tests multiple times. * Reviewed logs to ensure the tests were executing as expected. Thanks, jbigelow -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com

Re: [asterisk-dev] [Code Review] 4413: Testsuite: Simulate phones and control from YAML.

2015-02-12 Thread jbigelow
-8401-4f24-be5e-da1db0be3156__test-config.yaml Thanks, jbigelow -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- asterisk-dev mailing list To UNSUBSCRIBE or update options visit: http

Re: [asterisk-dev] [Code Review] 4413: Testsuite: Simulate phones and control from YAML.

2015-02-12 Thread jbigelow
then it will blow up if callback_module callback_method are not defined in YAML and pjsua_mod.PJsua is being used as a test module. If it remains with the same scenario then things won't blow up and no user code is called into(maybe there's a need for that?). Suggestions? - jbigelow

Re: [asterisk-dev] [Code Review] 4413: Testsuite: Simulate phones and control from YAML.

2015-02-12 Thread jbigelow
. * Pylint score of 9.40/10 for phones.py * See attached test-config.yaml for a demonstration. File Attachments Demonstration https://reviewboard.asterisk.org/media/uploaded/files/2015/02/11/659ab31f-8401-4f24-be5e-da1db0be3156__test-config.yaml Thanks, jbigelow

Re: [asterisk-dev] [Code Review] 4408: Testsuite: Add external bridging tests for Stasis (two channel) interactions

2015-02-12 Thread jbigelow
as expected. Thanks, jbigelow -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- asterisk-dev mailing list To UNSUBSCRIBE or update options visit: http://lists.digium.com/mailman/listinfo/asterisk-dev

[asterisk-dev] [Code Review] 4415: Testsuite: Attended transfers from non-Stasis to a Stasis bridge

2015-02-11 Thread jbigelow
events aren't received and actions don't fire. Therefore those events/actions in the YAML haven't been tested. * Executed tests multiple times. * Reviewed logs to ensure the tests were executing as expected. Thanks, jbigelow

Re: [asterisk-dev] [Code Review] 4415: Testsuite: Attended transfers from non-Stasis to a Stasis bridge

2015-02-11 Thread jbigelow
. Therefore those events/actions in the YAML haven't been tested. * Executed tests multiple times. * Reviewed logs to ensure the tests were executing as expected. Thanks, jbigelow -- _ -- Bandwidth and Colocation Provided

[asterisk-dev] [Code Review] 4413: Testsuite: Simulate phones and control from YAML.

2015-02-10 Thread jbigelow
https://reviewboard.asterisk.org/media/uploaded/files/2015/02/11/659ab31f-8401-4f24-be5e-da1db0be3156__test-config.yaml Thanks, jbigelow -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- asterisk-dev

Re: [asterisk-dev] [Code Review] 4413: Testsuite: Simulate phones and control from YAML.

2015-02-10 Thread jbigelow
Demonstration https://reviewboard.asterisk.org/media/uploaded/files/2015/02/11/659ab31f-8401-4f24-be5e-da1db0be3156__test-config.yaml Thanks, jbigelow -- _ -- Bandwidth and Colocation Provided by http

[asterisk-dev] [Code Review] 4408: Testsuite: Add external bridging tests for Stasis (two channel) interactions

2015-02-05 Thread jbigelow
/4408/diff/ Testing --- * Executed each test in a loop of 100 iterations with no failures. * Reviewed logs to ensure the tests were executing as expected. Thanks, jbigelow -- _ -- Bandwidth and Colocation Provided by http

Re: [asterisk-dev] [Code Review] 4330: Testsuite: Add external bridging tests for Stasis bridge (one channel) interactions

2015-01-29 Thread jbigelow
://reviewboard.asterisk.org/r/4330/diff/ Testing --- * Executed each test in a loop of 100 iterations with no failures. * Reviewed logs to ensure the tests were executing as expected. Thanks, jbigelow -- _ -- Bandwidth and Colocation

Re: [asterisk-dev] [Code Review] 4373: Manager Action ModuleLoad gives incorrect response when used to reload modules

2015-01-26 Thread jbigelow
. - jbigelow On Jan. 26, 2015, 2:16 p.m., Jonathan Rose wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviewboard.asterisk.org/r/4373

Re: [asterisk-dev] [Code Review] 4330: Testsuite: Add external bridging tests for Stasis bridge (one channel) interactions

2015-01-14 Thread jbigelow
/ami_bridge/stasis_bridge/configs/ast1 D 6226 6047 kmoore tests/rest_api/external_interaction/ami_bridge/stasis_bridge/configs/ast1/extensions.conf - jbigelow --- This is an automatically generated e-mail. To reply, visit

Re: [asterisk-dev] [Code Review] 4328: res_pjsip: Document transport selection process

2015-01-14 Thread jbigelow
On Jan. 13, 2015, 9:48 a.m., jbigelow wrote: * Under 'URI Parsing' it states: For the purposes of transport selection the transport parameter is examined. I suggest clarifing that the transport parameter being spoke of is the 'transport' parameter for endpoint types in pjsip.conf

[asterisk-dev] [Code Review] 4330: Testsuite: Add external bridging tests for Stasis bridge (one channel) interactions

2015-01-12 Thread jbigelow
the tests were executing as expected. Thanks, jbigelow -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- asterisk-dev mailing list To UNSUBSCRIBE or update options visit: http://lists.digium.com/mailman

Re: [asterisk-dev] [Code Review] 4267: Testsuite: Add blind transfer tests for Stasis application interaction.

2015-01-09 Thread jbigelow
/external_interaction/blind_transfer/call_transfer.py PRE-CREATION Diff: https://reviewboard.asterisk.org/r/4267/diff/ Testing --- * Executed tests multiple times * Reviewed logs to manually verify StasisStart/StasisEnd events occurred. Thanks, jbigelow

Re: [asterisk-dev] [Code Review] 4301: res_pjsip_outbound_registration: Add 'pjsip send register' command and update behavior of 'send unregister'

2015-01-02 Thread jbigelow
vote but I can't speak for what was originally intended. - jbigelow --- This is an automatically generated e-mail. To reply, visit: https://reviewboard.asterisk.org/r/4301/#review14053

Re: [asterisk-dev] [Code Review] 4291: Testsuite: Add external bridging tests for Stasis application interaction - Stasis bridge to non-stasis application.

2014-12-30 Thread jbigelow
Diff: https://reviewboard.asterisk.org/r/4291/diff/ Testing --- * Executed tests multiple times. * Review logs to ensure the tests were executing as expected. Thanks, jbigelow -- _ -- Bandwidth and Colocation Provided

Re: [asterisk-dev] [Code Review] 4267: Testsuite: Add blind transfer tests for Stasis application interaction.

2014-12-30 Thread jbigelow
://reviewboard.asterisk.org/r/4267/diff/ Testing --- * Executed tests multiple times * Reviewed logs to manually verify StasisStart/StasisEnd events occurred. Thanks, jbigelow -- _ -- Bandwidth and Colocation Provided

[asterisk-dev] [Code Review] 4291: Testsuite: Add external bridging tests for Stasis application interaction - Stasis bridge to non-stasis application.

2014-12-22 Thread jbigelow
times. * Review logs to ensure the tests were executing as expected. Thanks, jbigelow -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- asterisk-dev mailing list To UNSUBSCRIBE or update options visit

Re: [asterisk-dev] [Code Review] 4267: Testsuite: Add blind transfer tests for Stasis application interaction.

2014-12-19 Thread jbigelow
/diff/ Testing --- * Executed tests multiple times * Reviewed logs to manually verify StasisStart/StasisEnd events occurred. Thanks, jbigelow -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com

[asterisk-dev] [Code Review] 4267: Testsuite: Add blind transfer tests for Stasis application interaction.

2014-12-15 Thread jbigelow
/tests/rest_api/external_interaction/blind_transfer/blind_transfer.py PRE-CREATION Diff: https://reviewboard.asterisk.org/r/4267/diff/ Testing --- * Executed tests multiple times * Reviewed logs to manually verify StasisStart/StasisEnd events occurred. Thanks, jbigelow

Re: [asterisk-dev] [Code Review] 4156: Test Suite: Allow setting snaplen buffer_size for packet capturing

2014-11-17 Thread jbigelow
buffer successfully. Thanks, jbigelow -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- asterisk-dev mailing list To UNSUBSCRIBE or update options visit: http://lists.digium.com/mailman/listinfo

Re: [asterisk-dev] [Code Review] 4156: Test Suite: Allow setting snaplen buffer_size for packet capturing

2014-11-14 Thread jbigelow
on the function parameters (similar to what you did on PcapFile _init_). I thought of doing it that way while writing it but decided not to so that the defaults are in a single place and to keep things consistent in this area of code. Thoughts? - jbigelow

[asterisk-dev] [Code Review] 4156: Test Suite: Allow setting snaplen buffer_size for packet capturing

2014-11-06 Thread jbigelow
/lib/python/asterisk/pcap.py 5913 Diff: https://reviewboard.asterisk.org/r/4156/diff/ Testing --- Used the options to set a lower snaplen and a higher buffer successfully. Thanks, jbigelow -- _ -- Bandwidth

Re: [asterisk-dev] [Code Review] 3992: res_pjsip_sdp_rtp: Add optimistic SRTP support.

2014-10-29 Thread jbigelow
with possible values of 'yes', 'no', 'attempt'/'try' instead of a new option. If not I suggest renaming the option to something like 'media_encryption_attempt' or 'media_encryption_try'. - jbigelow On Oct. 21, 2014, 8:36 a.m., Joshua Colp wrote

Re: [asterisk-dev] [Code Review] 3992: res_pjsip_sdp_rtp: Add optimistic SRTP support.

2014-10-29 Thread jbigelow
On Oct. 29, 2014, 8:49 a.m., jbigelow wrote: I suggest reusing the 'media_encryption' pjsip.conf option with possible values of 'yes', 'no', 'attempt'/'try' instead of a new option. If not I suggest renaming the option to something like 'media_encryption_attempt

Re: [asterisk-dev] [Code Review] 4077: Test Suite: Unregister registered outbound registrations

2014-10-24 Thread jbigelow
as expected. * Ran test several times without work around for ASTERISK-24414 which frequently failed as expected. Thanks, jbigelow -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- asterisk-dev mailing list

Re: [asterisk-dev] [Code Review] 4080: Test Suite: Fix the 'expected-result' YAML property for test configuration

2014-10-21 Thread jbigelow
/test_config.py 5766 Diff: https://reviewboard.asterisk.org/r/4080/diff/ Testing --- Tested the various scenarios and they all seem to properly work as expected now. Thanks, jbigelow -- _ -- Bandwidth and Colocation

Re: [asterisk-dev] [Code Review] 4080: Test Suite: Fix the 'expected-result' YAML property for test configuration

2014-10-21 Thread jbigelow
On Oct. 16, 2014, 5:29 p.m., Scott Griepentrog wrote: /asterisk/trunk/runtests.py, line 75 https://reviewboard.asterisk.org/r/4080/diff/2/?file=68354#file68354line75 This should include a + \n like line 59 does. jbigelow wrote: Line 59 adds a newline to visually separate

Re: [asterisk-dev] [Code Review] 4080: Test Suite: Fix the 'expected-result' YAML property for test configuration

2014-10-20 Thread jbigelow
the tests output. Line 67 doesn't add a new line to the tests output and I don't believe I should just for this message that I'm appending to the output either. - jbigelow --- This is an automatically generated e-mail. To reply, visit

Re: [asterisk-dev] [Code Review] 4080: Test Suite: Fix the 'expected-result' YAML property for test configuration

2014-10-20 Thread jbigelow
. jbigelow wrote: test_runner.py returns 0 if passed and 1 if failed. So the above suggestion would need to be like so: self.passed = ((not p.returncode and self.test_config.expect_pass) or (p.returncode and not self.test_config.expect_pass)) However it's still

[asterisk-dev] [Code Review] 4080: Test Suite: Fix the 'expected-result' YAML property for test configuration

2014-10-15 Thread jbigelow
--- Tested the various scenarios and they all seem to properly work as expected now. Thanks, jbigelow -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- asterisk-dev mailing list To UNSUBSCRIBE

Re: [asterisk-dev] [Code Review] 4080: Test Suite: Fix the 'expected-result' YAML property for test configuration

2014-10-15 Thread jbigelow
/asterisk/trunk/lib/python/asterisk/test_config.py 5726 Diff: https://reviewboard.asterisk.org/r/4080/diff/ Testing --- Tested the various scenarios and they all seem to properly work as expected now. Thanks, jbigelow

Re: [asterisk-dev] [Code Review] 4080: Test Suite: Fix the 'expected-result' YAML property for test configuration

2014-10-15 Thread jbigelow
of explicitly testing for 0 and not 0 as posted for review: for returncode in (0, 1): ... for expect_pass in (True, False): ... ((returncode == 0 and expect_pass) or (returncode != 0 and not expect_pass)) ... True False False True - jbigelow

[asterisk-dev] [Code Review] 4077: Test Suite: Unregister registered outbound registrations

2014-10-14 Thread jbigelow
from ASTERISK-24411 and work around for ASTERISK-24414) * Ran test several times without patch applied from ASTERISK-24411 which constantly failed as expected. * Ran test several times without work around for ASTERISK-24414 which frequently failed as expected. Thanks, jbigelow

Re: [asterisk-dev] [Code Review] 3348: Test Suite: MWI subscription test for PJSIP

2014-04-16 Thread jbigelow
/trunk/lib/python/asterisk/pjsua_mod.py 4836 Diff: https://reviewboard.asterisk.org/r/3348/diff/ Testing --- * Ensured tests pass on multiple executions * Ensured the testsuite Asterisk logs looked good. Thanks, jbigelow

Re: [asterisk-dev] [Code Review] 3407: Test Suite: Nominal caller initiated blind transfer tests using PJSIP

2014-04-16 Thread jbigelow
test suite Asterisk logs. Thanks, jbigelow -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- asterisk-dev mailing list To UNSUBSCRIBE or update options visit: http://lists.digium.com/mailman

Re: [asterisk-dev] [Code Review] 3444: Testsuite: PJSIP Callee Initiated Nominal Blind Transfers

2014-04-16 Thread jbigelow
/blind_transfer/callee_hold/test-config.yaml https://reviewboard.asterisk.org/r/3444/#comment21405 Should be blind transfers Alice to Charlie. - jbigelow On April 14, 2014, 4:17 p.m., Scott Emidy wrote: --- This is an automatically generated e

Re: [asterisk-dev] [Code Review] 3407: Test Suite: Nominal caller initiated blind transfer tests using PJSIP

2014-04-04 Thread jbigelow
the Referred-By header and commented out the header match for the SIPREFERTOHDR channel variable. This was to mimic a successful pass to validate the test. This was done for each. ** Executed tests in a loop 50+ times to ensure stability. * Reviewed test suite Asterisk logs. Thanks, jbigelow

Re: [asterisk-dev] [Code Review] 3407: Test Suite: Nominal caller initiated blind transfer tests using PJSIP

2014-04-04 Thread jbigelow
in the test description. The test description says that Alice transfers Bob to Charlie, but these comments say that Bob transfers Alice to Charlie. Same applies for the second scenario. I blame my copy paste for not automatically making the changes. :) - jbigelow

[asterisk-dev] [Code Review] 3407: Test Suite: Nominal caller initiated blind transfer tests using PJSIP

2014-03-29 Thread jbigelow
variable. This was to mimic a successful pass to validate the test. This was done for each. ** Executed tests in a loop 50+ times to ensure stability. * Reviewed test suite Asterisk logs. Thanks, jbigelow -- _ -- Bandwidth

Re: [asterisk-dev] [Code Review] 3354: Test Suite: MWI subscribe, re-subscribe, and un-subscribe test for PJSIP

2014-03-24 Thread jbigelow
Diff: https://reviewboard.asterisk.org/r/3354/diff/ Testing --- * Ensured tests pass on multiple executions * Ensured the testsuite Asterisk logs looked good. Thanks, jbigelow -- _ -- Bandwidth and Colocation

Re: [asterisk-dev] [Code Review] 3348: Test Suite: MWI subscription test for PJSIP

2014-03-21 Thread jbigelow
://reviewboard.asterisk.org/r/3348/diff/ Testing --- * Ensured tests pass on multiple executions * Ensured the testsuite Asterisk logs looked good. Thanks, jbigelow -- _ -- Bandwidth and Colocation Provided by http

Re: [asterisk-dev] [Code Review] 3348: Test Suite: MWI subscription test for PJSIP

2014-03-14 Thread jbigelow
/asterisk/pjsua_mod.py 4836 Diff: https://reviewboard.asterisk.org/r/3348/diff/ Testing --- * Ensured tests pass on multiple executions * Ensured the testsuite Asterisk logs looked good. Thanks, jbigelow -- _ -- Bandwidth

[asterisk-dev] [Code Review] 3348: Test Suite: MWI subscription test for PJSIP

2014-03-13 Thread jbigelow
, jbigelow -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- asterisk-dev mailing list To UNSUBSCRIBE or update options visit: http://lists.digium.com/mailman/listinfo/asterisk-dev

Re: [asterisk-dev] [Code Review] 3348: Test Suite: MWI subscription test for PJSIP

2014-03-13 Thread jbigelow
/r/3348/diff/ Testing --- * Ensured tests pass on multiple executions * Ensured the testsuite Asterisk logs looked good. Thanks, jbigelow -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com

Re: [asterisk-dev] [Code Review] 3288: Test Suite: PJSIP presence un-subscribe re-subscribe tests

2014-03-07 Thread jbigelow
/channels/pjsip/mwi/configs/ast1/modules.conf 4799 Diff: https://reviewboard.asterisk.org/r/3288/diff/ Testing --- * Ensured tests pass on multiple executions * Ensured the testsuite Asterisk logs looked good. Thanks, jbigelow

[asterisk-dev] [Code Review] 3288: Test Suite: PJSIP presence un-subscribe re-subscribe tests

2014-03-03 Thread jbigelow
* Ensured the testsuite Asterisk logs looked good. Thanks, jbigelow -- _ -- Bandwidth and Colocation Provided by http://www.api-digital.com -- asterisk-dev mailing list To UNSUBSCRIBE or update options visit: http