Commit Graph

148 Commits

Author SHA1 Message Date
Nanang Izzuddin b1e3966f1e Misc (re #2504): Update pjsua test: registration test sometimes fails when the test script fails to connect fast enough to pjsua via CLI telnet (registration completed before the telnet connection established). 2020-10-24 17:24:50 +07:00
Nanang Izzuddin b23633707c
More CI works (#2376)
* pjsua-test:
  - Update pjsua-test module call: wait ICE update before checking media
  - Attempt to fix all failed tests by sipp module: changed SIPp port from 6000 to 50070 (port used by recvfrom module)
  - Update call module: confirm codec priority after change, fix DTLS-SRTP expect may race with state CONFIRMED
  - Add timeout check in telnet-ing to pjsua
  - ICE nego may race with call state CONFIRMED, so mod call better just sleep instead of expecting 'ICE nego success'.

* Other unit tests:
  - Print stack trace on crash on Linux and DarwinOS via SIGSEGV signal handler.
  - Update resolver test: print log on callback error, replace assertion checks with error return, fix comments, sleep periods, fix received packet count may be > 1 if server ignore the request (for example when the test machine experiencing high CPU load).
  - Update ccpp.yml: add -g for jobs with unit-tests.
  - More lenient on tsx retransmission count check in pjsip-test.
  - Update tsx_uac/s_test.c: allow retransmission timing diff from 150 to 500ms to accommodate possible CPU spike on some test machines.
2020-04-30 11:25:19 +07:00
Nanang Izzuddin 6bbd5ed66a
Update pjsua-test module call to wait for ICE & DTLS-SRTP nego before checking media (#2353) 2020-03-23 15:05:44 +07:00
Nanang Izzuddin 2ea82e9e6c
Attempt to fix intermittent errors in pjsua-test (#2330)
* Update sipp script uas-forked-200.xml to avoid problem due to unpredictable response order
* Fix uac-reinvite-bad-via-branch.xml scenario when pjsua answer is 200
2020-03-19 15:04:27 +07:00
Nanang Izzuddin fedc629c4a
More pjsua-test work: print full log to help investigating any failed test, and other minor updates. (#2322)
* pjsua-test print full test log if test failed
* Update subscription check condition in pjsua presence test
* Update ccpp.yml
2020-03-04 09:11:37 +07:00
Nanang Izzuddin 848ce29fa5
More pjsua-test work: retry telnet on fail and runall.py emits exit/error code (#2320)
More pjsua-test work: run.py retry telnet on fail and runall.py emits exit/error code
2020-03-03 10:17:27 +07:00
Nanang Izzuddin 48a8aebc45
Update python pjsua-test to use telnet CLI (#2309)
* Update pjsua test to use pjsua telnet CLI, configurable via `DEFAULT_TELNET` setting in `inc_cfg.py`, set it to `False` to return to the old behavior using console prompt+stdin/stdout.
* Update pjsua test indentation: replace tab->space.
2020-03-02 09:48:54 +07:00
sauwming 9f208e962c
Add option to disable certain pjsua tests (#2289)
* Add option to disable certain pjsua tests
* install sipp for pjsua test CI
2020-02-27 18:01:37 +08:00
nanangizz 6ea8618d90 Close #2280: delete compare WAV tool in test dir 2020-02-14 16:10:01 +07:00
Nanang Izzuddin 8631ffe736 Fix #2254: Updated SDP encoder of SDES to avoid deactivating/disabling media, it should be done by the parent/SRTP instead.
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@6115 74dad513-b988-da41-8d7b-12977e46ad98
2019-12-04 09:01:19 +00:00
Nanang Izzuddin f55a1e198e Misc (re #2147): Updated automated test configs.
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@6023 74dad513-b988-da41-8d7b-12977e46ad98
2019-06-11 05:24:02 +00:00
Nanang Izzuddin 3aa78d85f3 Re #2135:
- Enabled DTLS in automated tests on desktop platforms.
 - Added some test variants, e.g: 64 bit mobile platforms, video, IPv6, in automated tests.


git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@5859 74dad513-b988-da41-8d7b-12977e46ad98
2018-08-16 02:37:29 +00:00
Nanang Izzuddin 952ddfb355 Re #2096: Answer with one SRTP keying only when offered both (thanks Wei-Wei for the feedback).
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@5855 74dad513-b988-da41-8d7b-12977e46ad98
2018-08-15 02:44:53 +00:00
Nanang Izzuddin 4635f7ab51 Close #2135: Update some failing scripts to skip TCP transport in pjsua app instantiation.
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@5844 74dad513-b988-da41-8d7b-12977e46ad98
2018-07-26 03:37:08 +00:00
Nanang Izzuddin 96b5e742e0 Fixed #2066: SDP ignored in 180/183 response without To tag.
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@5700 74dad513-b988-da41-8d7b-12977e46ad98
2017-11-22 02:07:48 +00:00
Riza Sulistyo eb4d878e78 Re #2054: When setting CXXCFLAGS manually, make sure it's applied correctly.
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@5679 74dad513-b988-da41-8d7b-12977e46ad98
2017-11-01 05:23:36 +00:00
Nanang Izzuddin c9ced6eee6 Re #1842: Updated automated test scenarios to invoke 'make distclean' first.
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@5156 74dad513-b988-da41-8d7b-12977e46ad98
2015-08-10 03:47:45 +00:00
Nanang Izzuddin a03da25961 Re #1842: Added automated test scenarios for Android and iOS 64-bit
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@5155 74dad513-b988-da41-8d7b-12977e46ad98
2015-08-10 03:45:02 +00:00
Nanang Izzuddin bcf74d9be6 Re #1864: fixed assert and crash when remote remove and add back media lines in SDP:
- reverted back r5124 (of this ticket) and r4373 (of #1626)
 - applied another fix for #1626 as in described in the ticket desc
 - also fixed a related add/remove media issue:
    - we send an offer with 2 audio and 1 video in SDP
    - remote answers with only 1 audio in SDP
    - when we send a re-offer/re-INVITE, we have 5 media lines in our SDP (3 audio + 2 video, note 1 audio and 1 video are disabled)
    - call settings are actually maintained (2 active audio + 1 active video), just better to avoid the additional disabled media.



git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@5135 74dad513-b988-da41-8d7b-12977e46ad98
2015-07-14 08:38:29 +00:00
Nanang Izzuddin 43a08e39bf Re #1866: Added a test scenario of sending re-invite after a failed SDP negotiation.
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@5130 74dad513-b988-da41-8d7b-12977e46ad98
2015-07-09 12:49:47 +00:00
Nanang Izzuddin b0220a9595 Re #1842: Still on sipp/uac-reinvite-bad-via-branch.xml, fixed missing stuff in retry scenario, e.g: sequence number increment, To tag, wait for old tsx destroy.
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@5072 74dad513-b988-da41-8d7b-12977e46ad98
2015-04-16 04:55:25 +00:00
Nanang Izzuddin c2c2e9a7c5 Re #1842: Workaround for spurious failure in sipp/uac-reinvite-bad-via-branch.xml test, i.e: just retry the scenario. The failure is caused by race between SIPp sending re-INVITE vs transaction immediate termination (by SIP INVITE module when the session reaches CONFIRMED state).
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@5071 74dad513-b988-da41-8d7b-12977e46ad98
2015-04-15 12:55:54 +00:00
Nanang Izzuddin 78555c90ed Re #1842: Minor update on python test to reduce possibility of EADDRINUSE error in running pjsua.
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@5068 74dad513-b988-da41-8d7b-12977e46ad98
2015-04-13 12:31:46 +00:00
Nanang Izzuddin 8d6ca24530 Re #1842:
- Updated python test driver run.py to perform stdout polling using a dedicated thread, this will increase the robustness of pattern matcing class "Expect" and remove the possibility of stucked pjsua (due to output buffer full when no stdout read polling is done).
 - Also updated other test driver and scenario accordingly.


git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@5067 74dad513-b988-da41-8d7b-12977e46ad98
2015-04-13 12:28:02 +00:00
Nanang Izzuddin 66f7e5611b Re #1842: Fixed build error on cmp_wav tool for python tests due to changed pjmedia format structure in 2.x.
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@5066 74dad513-b988-da41-8d7b-12977e46ad98
2015-04-13 12:16:47 +00:00
Nanang Izzuddin c3246980da Re #1842: Updated pjsua app to avoid stdout buffering, and also adjusted python tests accordingly.
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@5065 74dad513-b988-da41-8d7b-12977e46ad98
2015-04-13 12:14:02 +00:00
Perry Ismangil 7d79751dad Re #1828 Temporary deactivation of failing tests to be examined in detail later on
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@5021 74dad513-b988-da41-8d7b-12977e46ad98
2015-03-24 11:02:29 +00:00
Perry Ismangil 1d2c751d57 Re #1828 Changed unit test expected to 415 to sync with other code changes
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@5020 74dad513-b988-da41-8d7b-12977e46ad98
2015-03-24 09:25:12 +00:00
Perry Ismangil 47f3c13443 Re #1828 disabled pesq tests
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@5013 74dad513-b988-da41-8d7b-12977e46ad98
2015-03-22 08:30:44 +00:00
Nanang Izzuddin 3537c545df Misc (re #1630): Fixed some more typos in the codes.
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@4724 74dad513-b988-da41-8d7b-12977e46ad98
2014-01-31 08:52:09 +00:00
Sauw Ming a74a3fd626 Closed #1696: IP change detection (Contact rewrite method) based on REGISTER final response
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@4586 74dad513-b988-da41-8d7b-12977e46ad98
2013-09-04 10:07:45 +00:00
Benny Prijono 938a804c8e More re #1683: added two SIPP scenarios to simulate IP/port change
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@4547 74dad513-b988-da41-8d7b-12977e46ad98
2013-06-27 10:08:24 +00:00
Sauw Ming 8ba9a4101d Fixed #1626: Assertion when remote sends re-INVITE with less media
Included in the fix is sipp testing scenario.



git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@4373 74dad513-b988-da41-8d7b-12977e46ad98
2013-02-27 06:44:44 +00:00
Nanang Izzuddin 5a4d6ed11b Re #1523: use random port for PJSUA instance(s) and configurable SIPp port.
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@4188 74dad513-b988-da41-8d7b-12977e46ad98
2012-06-29 09:01:17 +00:00
Nanang Izzuddin 29e1bc7d75 Re #1523: sipp output redirection to /dev/null somehow caused sipp unresponsive when the test is run under cdash.
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@4187 74dad513-b988-da41-8d7b-12977e46ad98
2012-06-29 06:41:53 +00:00
Nanang Izzuddin 9df151296a Re #1523: avoid false failure reported by sipp scenario uas-422-then-200-bad-se.xml due to codec mismatch.
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@4184 74dad513-b988-da41-8d7b-12977e46ad98
2012-06-28 10:14:48 +00:00
Nanang Izzuddin 7e18022303 Re #1523:
- runall.py: fix option parser
 - run.py: avoid double newlines in logging
 - mod_sipp.py: redirect sipp output to /dev/null & add sipp error string
 - misc fixes on sipp scenarios, e.g: regex to get via branch, file rename.



git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@4183 74dad513-b988-da41-8d7b-12977e46ad98
2012-06-28 09:16:03 +00:00
Nanang Izzuddin b2c6af2d71 Re #1523: fixed mod_sipp.py problems in executing sipp on unix/mac platforms, i.e: should run on shell and non-background mode.
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@4179 74dad513-b988-da41-8d7b-12977e46ad98
2012-06-26 07:37:48 +00:00
Nanang Izzuddin 7ccbd91805 Re #1523: added sipp scenario for call transfer (attended & unattended).
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@4178 74dad513-b988-da41-8d7b-12977e46ad98
2012-06-26 06:29:53 +00:00
Nanang Izzuddin 3aba980c0e Close #1523:
- updated scenarios to work with mod_sipp.py (adding config .py file, etc)
 - integrated mod_sipp.py to runall.py
 - removed uas.xml, as it is similar to recvfrom\100_simple.py (REGISTER+resp 200)
 - renamed scenarios (to allow running these SIPp scenarios without .py file):
   - prack_fork.xml -> uas-prack_fork.xml
   - inv_401_retry_after_100.xml -> uas-inv_401_retry_after_100.xml




git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@4177 74dad513-b988-da41-8d7b-12977e46ad98
2012-06-26 02:28:59 +00:00
Nanang Izzuddin c5da35f9a5 Re #1523: Initial version of SIPp python test module.
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@4147 74dad513-b988-da41-8d7b-12977e46ad98
2012-05-31 09:51:08 +00:00
Sauw Ming e7dbbc8f30 Re #1395: Backport of PJSIP 1.x branch into PJSIP 2.0 trunk
* Backport of r3557:r3832

TODO: ticket #1268 (Option for automatic/manual sending of RTCP SDES/BYE for the stream) for video stream.



git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@3841 74dad513-b988-da41-8d7b-12977e46ad98
2011-10-24 09:28:13 +00:00
Nanang Izzuddin 26b7d44274 Re #1346 (python test fixes): Disabled (temporarily) {{{scripts-call/150_srtp_2_3.py}}} as this scenario requires SRTP optional-with-duplicated-media (ticket #1267).
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@3717 74dad513-b988-da41-8d7b-12977e46ad98
2011-08-19 12:41:40 +00:00
Nanang Izzuddin bb6f57faca Re #1346 (python test fixes): Updated test scenario that requires pjsua to generate multiple media offer using --extra-audio instead of using --use-srtp=3 (optional-with-duplicated-media).
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@3716 74dad513-b988-da41-8d7b-12977e46ad98
2011-08-19 12:24:48 +00:00
Nanang Izzuddin 33380c5beb Re #1346 (python test fixes): Updated test scenario involving negotiation SRTP-mandatory vs SRTP-disabled or vice-versa, call rejection is using 488 now (was using 406).
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@3713 74dad513-b988-da41-8d7b-12977e46ad98
2011-08-18 18:11:08 +00:00
Nanang Izzuddin a1ae1bdec4 Re #1346 (python test fixes): Updated test scenario involving sending REGISTER to pjsua, now pjsua has simple registrar so registration will be accepted (was rejected).
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@3712 74dad513-b988-da41-8d7b-12977e46ad98
2011-08-18 17:34:29 +00:00
Nanang Izzuddin aa967ad7da Re #1346 (python test fixes): adjust test scenario to follow the new behavior of pjsua in selecting active media from multiple media with same types, i.e: it will select the first media (previously/1.x it will will select the last).
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@3711 74dad513-b988-da41-8d7b-12977e46ad98
2011-08-18 17:31:46 +00:00
Nanang Izzuddin 1f18daa69e Re #1346 (python test fixes): Updated string pattern constants as some pjsua log messages has been changed in 2.0.
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@3710 74dad513-b988-da41-8d7b-12977e46ad98
2011-08-18 17:26:11 +00:00
Benny Prijono c2997e7e85 Dummy checkin for testing the automated testing scripts..
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@3707 74dad513-b988-da41-8d7b-12977e46ad98
2011-08-16 09:17:22 +00:00
Benny Prijono 00d8e84471 Re #1344 (automated test): make sure run_continuous.py returns correct exit code
git-svn-id: https://svn.pjsip.org/repos/pjproject/trunk@3704 74dad513-b988-da41-8d7b-12977e46ad98
2011-08-16 08:27:38 +00:00