scripted_tests.cfg #1

  • //
  • guest/
  • perforce_software/
  • sdp/
  • dev/
  • test/
  • bsw/
  • scripted_tests.cfg
  • View
  • Commits
  • Open Download .zip Download (1 KB)
# Test Data File for Scripted Tests.
#
# Each test is a one-line entry of the form:
#
# <TestScript>|<ExitCode>|[<Host>:]<TestLog>|<ExpectedStringRegex>|<Comments>
# 
# Where:
# <TestScript> is a script to call. It can setup arbitrarily sophisticated
# tests. The script should one parameter, a test id, and display "Test $TestID"
# in the output.
#
# <ExitCode> is the expected exit code, which must be a whole number (integer 0 or
# greater). If the actual test exist code is not match, the test is deemed to have
# failed.  A special value of 'U' meaning Undefined can be supplied rather than a
# whole number to indicate that any exit code is accepted.  (The test may still fail
# depending on the <Output>
#
# <TestLog> Specify the absolute path to the log containing the expected string,
# or the special value 'output' to scan the output of the command rather than
# a log file. The <TestLost> can also be of the form <Host>:<Log> to indicate
# the expected string should be checked on the specified host. For example,
# a value of syd-helix-04:/p4/1/logs/recreate_offline_db.og will check that
# log on the syd-helix-04 host.
#
# <ExpectedStringRegex> is a string of text expected of the executed command in
# either the output or a given logfile. The string can be a regular expression.
#
# <Comments> are short comments for the human reviewer of the test, describing what
# is expected in the output, what is being tested, etc.

test_1-recover_correct_ckp.sh|0|/tmp/scripted_test_1.log|OK|Test
# Change User Description Committed
#17 32100 C. Thomas Tyler In p4verify.sh, adjusted exit code for '-h/-man' opertions to 2 rather than 1.

Added tests for p4verify.sh to cli_tests.cfg.

Updated scan for unreported errors in 'r' script to ignore known-harmless text
chunks like 'LOGGING:', 'NOTIFICATIONS:', and 'TIMING:'.

Fixed typo in comment in scripted_tests.cfg.
#16 31992 C. Thomas Tyler Added test for db swap with partitioned clients.
#15 31986 C. Thomas Tyler Enhanced test definition.
#14 31984 C. Thomas Tyler Added test for refresh_P4ROOT_from_offline_db.sh basic functionality.
#13 31433 C. Thomas Tyler Further refined test expectations.
#12 31432 C. Thomas Tyler Adapted tests to handle more '-v track=-1' in backup_functions.sh.
#11 31075 C. Thomas Tyler Corrected host name in test data.
#10 31043 C. Thomas Tyler Add scripted test for live checkpoint off commit (i.e.
on edge, standby).
#9 30747 C. Thomas Tyler Added Test Group concept to run_cli_tests.sh, with same meaning and
usage as in run_scripted_tests.sh. The goal is to allow running
a defined subset of tests.
#8 30742 C. Thomas Tyler Added support for specifying exit code as 'N' for non-zero.
#7 30677 C. Thomas Tyler Added 13 tests for load_checkpoint.sh.
Added 'TestGroup' field to scripted_testse.cfg.
#6 30650 C. Thomas Tyler Adapted scripted tests to tweaks in expected script output.
#5 30649 C. Thomas Tyler Added more tests for recover_edge.sh and related scripts, and improved
auditability the first test script for recover_edge.sh.
#4 30643 C. Thomas Tyler Added tests for recover_edge.sh.
#3 30626 C. Thomas Tyler Refined test harness logic and added more tests.
#2 30623 C. Thomas Tyler Added feature for scripted test to run addtional checks from an earlier
execution of a script.

Added more tests.
#1 30622 C. Thomas Tyler Added files for initial SDP BSW test suite.