thr3ads.net - asterisk users - [asterisk-users] Asterisk Test Suite error [Sep 2012]

If this information is useful, please help other people find it:
Share via:

upendra

2012-Sep-06 07:22 UTC

[asterisk-users] Asterisk Test Suite error

Hi,

i am trying to install the Asterisk test suite on my ubuntu system , i have
followed all the installlation steps as mentioned in the link (
http://blogs.asterisk.org/2010/04/29/installing-the-asterisk-test-suite/) ,
but when i am trying to run the script some of the test cases are PASSED
and most of them are FAILED and SKIPPPED. So please help me out to do the
testing correctly.

The following is the test report i got after running the script.


 === TEST RESULTS ==
PATH: /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin

--> tests/example --- PASSED
--> tests/dynamic-modules --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
--> tests/manager/login --- PASSED
--> tests/manager/action-events-response --- PASSED
--> tests/manager/authlimit --- PASSED
--> tests/manager/authtimeout --- PASSED
--> tests/manager/acl-login --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
--> tests/cdr/console_dial_sip_answer --- PASSED
--> tests/cdr/console_dial_sip_busy --- PASSED
--> tests/cdr/console_dial_sip_congestion --- PASSED
--> tests/cdr/cdr_originate_sip_congestion_log --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
--> tests/cdr/console_dial_sip_transfer --- PASSED
--> tests/cdr/console_fork_after_busy_forward --- PASSED
--> tests/cdr/console_fork_before_dial --- PASSED
--> tests/cdr/cdr_fork_end_time --- PASSED
--> tests/cdr/cdr_unanswered_yes --- PASSED
--> tests/cdr/cdr_accountcode --- PASSED
--> tests/cdr/cdr_userfield --- PASSED
--> tests/cdr/nocdr --- PASSED
--> tests/cdr/blind-transfer-accountcode --- PASSED
--> tests/cdr/originate-cdr-disposition --- PASSED
--> tests/cdr/app_dial_G_flag --- SKIPPED
      --> Dependency: bash -- Met: True
      --> Dependency: asttest -- Met: True
      --> Dependency: SIPp -- Met: True
--> tests/cdr/batch_cdrs --- PASSED
--> tests/dialplan --- PASSED
--> tests/channels/SIP/acl_call --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
--> tests/channels/SIP/options --- PASSED
--> tests/channels/SIP/refer_replaces_to_self --- FAILED
--> tests/channels/SIP/info_dtmf --- PASSED
--> tests/channels/SIP/tcpauthlimit --- PASSED
--> tests/channels/SIP/tcpauthtimeout --- PASSED
--> tests/channels/SIP/sip_outbound_address --- SKIPPED
      --> Dependency: bash -- Met: True
      --> Dependency: asttest -- Met: True
      --> Dependency: SIPp -- Met: False
--> tests/channels/SIP/sip_attended_transfer --- PASSED
--> tests/channels/SIP/sip_attended_transfer_tcp --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
      --> Dependency: pjsua -- Met: True
--> tests/channels/SIP/sip_attended_transfer_v6 --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
      --> Dependency: pjsua -- Met: True
      --> Dependency: ipv6 -- Met: True
      --> Dependency: pjsuav6 -- Met: True
--> tests/channels/SIP/sip_blind_transfer/callee_refer_only --- PASSED
--> tests/channels/SIP/sip_blind_transfer/callee_with_reinvite --- PASSED
--> tests/channels/SIP/sip_blind_transfer/caller_refer_only --- PASSED
--> tests/channels/SIP/sip_blind_transfer/caller_with_reinvite --- PASSED
--> tests/channels/SIP/sip_one_legged_transfer --- PASSED
--> tests/channels/SIP/sip_one_legged_transfer_v6 --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
      --> Dependency: pjsua -- Met: True
      --> Dependency: ipv6 -- Met: True
      --> Dependency: pjsuav6 -- Met: True
--> tests/channels/SIP/sip_register --- PASSED
--> tests/channels/SIP/sip_register_domain_acl --- PASSED
--> tests/channels/SIP/sip_channel_params --- PASSED
--> tests/channels/SIP/sip_tls_call --- FAILED
--> tests/channels/SIP/sip_tls_register --- PASSED
--> tests/channels/SIP/sip_srtp --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
      --> Dependency: res_srtp -- Met: False
--> tests/channels/SIP/noload_res_srtp --- PASSED
--> tests/channels/SIP/noload_res_srtp_attempt_srtp --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
      --> Dependency: res_srtp -- Met: False
--> tests/channels/SIP/secure_bridge_media --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
      --> Dependency: res_srtp -- Met: False
--> tests/channels/SIP/message_disabled --- PASSED
--> tests/channels/SIP/message_unauth --- PASSED
--> tests/channels/SIP/message_unauth_from --- PASSED
--> tests/channels/SIP/message_auth --- PASSED
--> tests/channels/SIP/message_auth_cust_hdr --- PASSED
--> tests/channels/SIP/message_send_ami --- SKIPPED
      --> Dependency: SIPp -- Met: True
--> tests/channels/SIP/message_from_call --- PASSED
--> tests/channels/SIP/message_mark_all_outbound --- SKIPPED
      --> Dependency: SIPp -- Met: True
--> tests/channels/SIP/handle_response_address_incomplete --- PASSED
--> tests/channels/SIP/realtime_sipregs --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
      --> Dependency: res_config_sqlite -- Met: False
--> tests/channels/SIP/realtime_nosipregs --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
      --> Dependency: res_config_sqlite -- Met: False
--> tests/channels/SIP/SDP_offer_answer --- PASSED
--> tests/channels/SIP/SDP_attribute_passthrough --- SKIPPED
      --> Dependency: SIPp -- Met: True
--> tests/channels/SIP/nat_supertest --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
--> tests/channels/SIP/pcap_demo --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: construct -- Met: False
      --> Dependency: pcap -- Met: True
--> tests/channels/SIP/sip_hold --- PASSED
--> tests/channels/SIP/header_parsing --- PASSED
--> tests/channels/SIP/use_contact_from_200 --- PASSED
--> tests/channels/SIP/generic_ccss --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
--> tests/channels/SIP/sip_custom_presence/nominal_state_change --- SKIPPED
      --> Dependency: sipp -- Met: True
--> tests/channels/SIP/sip_custom_presence/multiple_state_change --- SKIPPED
      --> Dependency: sipp -- Met: True
--> tests/channels/SIP/sip_custom_presence/resubscribe --- SKIPPED
      --> Dependency: sipp -- Met: True
--> tests/channels/SIP/sip_custom_presence/non_digium_state_change ---
SKIPPED
      --> Dependency: sipp -- Met: True
--> tests/channels/SIP/custom_info --- FAILED
--> tests/channels/SIP/hangupcause --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
--> tests/channels/SIP/sip_cause --- PASSED
--> tests/channels/SIP/invite_no_totag --- PASSED
--> tests/channels/SIP/sip2cause --- PASSED
--> tests/channels/SIP/sip_outbound_proxy --- PASSED
--> tests/channels/SIP/subscribe --- PASSED
--> tests/channels/SIP/rfc2833_dtmf_detect --- SKIPPED
      --> Dependency: bash -- Met: True
      --> Dependency: asttest -- Met: True
      --> Dependency: SIPp -- Met: False
--> tests/channels/iax2/basic-call --- PASSED
--> tests/channels/iax2/hangupcause --- SKIPPED
      --> Dependency: starpy -- Met: True
      --> Dependency: chan_iax2 -- Met: True
--> tests/channels/iax2/acl_call --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
--> tests/udptl --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
      --> Dependency: fax -- Met: False
--> tests/udptl_v6 --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
      --> Dependency: fax -- Met: False
      --> Dependency: ipv6 -- Met: True
--> tests/feature_blonde_transfer --- PASSED
--> tests/feature_attended_transfer --- PASSED
--> tests/blind-transfer-parkingtimeout --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
--> tests/one-step-parking --- PASSED
--> tests/callparking --- PASSED
--> tests/callparking_retrieval --- SKIPPED
--> tests/masquerade --- FAILED
--> tests/fastagi/connect --- PASSED
--> tests/fastagi/channel-status --- PASSED
--> tests/fastagi/hangup --- PASSED
--> tests/fastagi/stream-file --- PASSED
--> tests/fastagi/control-stream-file --- PASSED
--> tests/fastagi/database --- PASSED
--> tests/fastagi/execute --- PASSED
--> tests/fastagi/get-data --- PASSED
--> tests/fastagi/record-file --- PASSED
--> tests/fastagi/say-alpha --- PASSED
--> tests/fastagi/say-date --- PASSED
--> tests/fastagi/say-datetime --- PASSED
--> tests/fastagi/say-time --- PASSED
--> tests/fastagi/say-digits --- PASSED
--> tests/fastagi/say-number --- PASSED
--> tests/fastagi/say-phonetic --- PASSED
--> tests/agi/exit_status --- SKIPPED
--> tests/pbx/call-files --- PASSED
--> tests/pbx/pbx_lua_goto --- PASSED
--> tests/pbx/pbx_lua_background --- PASSED
--> tests/predial --- SKIPPED
      --> Dependency: app_dial -- Met: True
      --> Dependency: app_followme -- Met: True
--> tests/hangup/handlers --- SKIPPED
      --> Dependency: app_dial -- Met: True
--> tests/hangup/handlers_endbeforehexten --- SKIPPED
      --> Dependency: app_dial -- Met: True
--> tests/fax/local_channel_t38_queryoption --- SKIPPED
      --> Dependency: bash -- Met: True
      --> Dependency: asttest -- Met: True
      --> Dependency: fax -- Met: False
--> tests/fax/gateway_g711_t38 --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
      --> Dependency: fax -- Met: False
--> tests/fax/gateway_t38_g711 --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
      --> Dependency: fax -- Met: False
--> tests/fax/gateway_no_t38 --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
      --> Dependency: fax -- Met: False
--> tests/fax/gateway_native_t38 --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
      --> Dependency: fax -- Met: False
--> tests/fax/gateway_native_t38_ced --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
      --> Dependency: fax -- Met: False
--> tests/fax/gateway_mix1 --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
      --> Dependency: fax -- Met: False
--> tests/fax/gateway_mix2 --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
      --> Dependency: fax -- Met: False
--> tests/fax/gateway_mix3 --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
      --> Dependency: fax -- Met: False
--> tests/fax/gateway_mix4 --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
      --> Dependency: fax -- Met: False
--> tests/fax/gateway_timeout1 --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
      --> Dependency: fax -- Met: False
--> tests/fax/gateway_timeout2 --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
      --> Dependency: fax -- Met: False
--> tests/fax/gateway_timeout3 --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
      --> Dependency: fax -- Met: False
--> tests/fax/gateway_timeout4 --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
      --> Dependency: fax -- Met: False
--> tests/fax/gateway_timeout5 --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
      --> Dependency: fax -- Met: False
--> tests/apps/directory_operator_exit --- PASSED
--> tests/apps/directory_context_operator_exit --- PASSED
--> tests/apps/directory_attendant_exit --- PASSED
--> tests/apps/bridge/bridge_baseline --- PASSED
--> tests/apps/bridge/bridge_transfer_callee --- SKIPPED
--> tests/apps/voicemail/leave_voicemail_nominal --- FAILED
--> tests/apps/voicemail/leave_voicemail_contexts --- FAILED
--> tests/apps/voicemail/leave_voicemail_priority --- FAILED
--> tests/apps/voicemail/leave_voicemail_forwarding --- FAILED
--> tests/apps/voicemail/leave_voicemail_forwarding_auto_urgent --- FAILED
--> tests/apps/voicemail/leave_voicemail_external_notification --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
      --> Dependency: app_voicemail -- Met: True
      --> Dependency: app_senddtmf -- Met: True
--> tests/apps/voicemail/func_vmcount --- PASSED
--> tests/apps/voicemail/authenticate_nominal --- FAILED
--> tests/apps/voicemail/authenticate_invalid_mailbox --- PASSED
--> tests/apps/voicemail/authenticate_invalid_password --- PASSED
--> tests/apps/voicemail/authenticate_extensions --- PASSED
--> tests/apps/voicemail/check_voicemail_nominal --- FAILED
--> tests/apps/voicemail/check_voicemail_envelope --- FAILED
--> tests/apps/voicemail/check_voicemail_delete --- FAILED
--> tests/apps/voicemail/check_voicemail_new_user --- FAILED
--> tests/apps/voicemail/check_voicemail_new_user_hangup --- FAILED
--> tests/apps/voicemail/check_voicemail_options_record_busy --- FAILED
--> tests/apps/voicemail/check_voicemail_options_record_unavail --- FAILED
--> tests/apps/voicemail/check_voicemail_options_record_name --- FAILED
--> tests/apps/voicemail/check_voicemail_options_record_temp --- FAILED
--> tests/apps/voicemail/check_voicemail_options_change_password --- FAILED
--> tests/apps/voicemail/check_voicemail_forward --- FAILED
--> tests/apps/voicemail/check_voicemail_forward_hangup --- FAILED
--> tests/apps/voicemail/check_voicemail_forward_with_prepend --- FAILED
--> tests/apps/voicemail/check_voicemail_callback --- FAILED
--> tests/apps/voicemail/check_voicemail_dialout --- FAILED
--> tests/apps/voicemail/check_voicemail_reply --- FAILED
--> tests/apps/voicemail/check_voicemail_while_leaving_msg --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
      --> Dependency: app_voicemail -- Met: True
      --> Dependency: app_senddtmf -- Met: True
      --> Dependency: app_playback -- Met: True
--> tests/apps/voicemail/play_message --- PASSED
--> tests/apps/incomplete/sip_incomplete --- PASSED
--> tests/apps/confbridge/confbridge_nominal --- FAILED
--> tests/apps/confbridge/confbridge_recording --- FAILED
--> tests/apps/page --- PASSED
--> tests/apps/chanspy/chanspy_barge --- PASSED
--> tests/apps/chanspy/chanspy_w_mixmonitor --- PASSED
--> tests/apps/queues/queue_baseline --- PASSED
--> tests/apps/queues/queue_transfer_callee --- SKIPPED
      --> Dependency: app_queue -- Met: True
--> tests/apps/queues/position_priority_maxlen --- PASSED
--> tests/apps/queues/set_penalty --- PASSED
--> tests/apps/directed_pickup --- PASSED
--> tests/apps/mixmonitor --- PASSED
--> tests/apps/mixmonitor_audiohook_inherit --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
--> tests/funcs/func_jitterbuffer --- PASSED
--> tests/connected_line/macro --- PASSED
--> tests/connected_line/subroutine --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
--> tests/redirecting/macro --- PASSED
--> tests/redirecting/subroutine --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True
--> tests/cause_answered_elsewhere --- SKIPPED
      --> Dependency: twisted -- Met: True
      --> Dependency: starpy -- Met: True

* give suggestions .

Thanks and regards
Upendra
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.digium.com/pipermail/asterisk-users/attachments/20120906/c350819e/attachment.htm>

Matthew Jordan

2012-Sep-06 13:11 UTC

head link

[asterisk-users] Asterisk Test Suite error

----- Original Message ----- 
> From: "upendra" <uppi.me at gmail.com>
> To: "Asterisk Users Mailing List - Non-Commercial Discussion"
> <asterisk-users at lists.digium.com>
> Sent: Thursday, September 6, 2012 2:22:24 AM
> Subject: [asterisk-users] Asterisk Test Suite error
> Hi,
> i am trying to install the Asterisk test suite on my ubuntu system ,
> i have followed all the installlation steps as mentioned in the link
> (
> http://blogs.asterisk.org/2010/04/29/installing-the-asterisk-test-suite/
> ) , but when i am trying to run the script some of the test cases
> are PASSED and most of them are FAILED and SKIPPPED. So please help
> me out to do the testing correctly.
> The following is the test report i got after running the script.
<snip>


There is newer documentation on the Asterisk wiki:

https://wiki.asterisk.org/wiki/display/AST/Asterisk+Test+Suite+Documentation

There are pages that describe how to install and run the Test Suite under that
page.

Skipped tests happen when you are missing a dependency that the test needs to
run.  If you look at a verbose report for each test (which should also be output
when the test run finishes), it should tell you what dependency was missing.

Most of your failed tests appear to be those that require the TEST_FRAMEWORK
compile time option in Asterisk.  You can enable that in menuselect when you
have configured Asterisk with --enable-dev-mode.

Those tests *should* have picked up the fact that the TEST_FRAMEWORK wasn't
enabled and should have been skipped (so long as the Asterisk directory that
the Test Suite is sitting in has that option enabled in its build options),
but there is a known bug with those test's YAML configuration that is
preventing
them from picking up the TEST_FRAMEWORK flag.  Until we can get that cleaned up,
enabling the TEST_FRAMEWORK flag should resolve that problem.

--
Matthew Jordan
Digium, Inc. | Engineering Manager
445 Jan Davis Drive NW - Huntsville, AL 35806 - USA
Check us out at: http://digium.com & http://asterisk.org

Possibly Parallel Threads

Search for more apparently analagous threads

asterisk users - Sep 2012 - Asterisk Test Suite error

[asterisk-users] Asterisk Test Suite error

[asterisk-users] Asterisk Test Suite error

Possibly Parallel Threads