# Test Data File for Scripted Tests. # # Each test is a one-line entry of the form: # # <TestScript>|<ExitCode>|[<Host>:]<TestLog>|<ExpectedStringRegex>|<Comments> # # Where: # <TestScript> is a script to call. It can setup arbitrarily sophisticated # tests. The script should accept a single parameter, a numeric TestID, and display # "Test $TestID" in the output. The value of TestScript should be of the form # test_script-<TestDesc>.sh, where <TestDesc> should contain letters, numbers, and # underscores, but not dash characters, e.g. test_script-recover_correct_ckp.sh. # # The <TestScript> value can also be the special value 'no_script', meaning that no # test script is executed. This allows additional checks in logs to be done based # on the execution of the most recent executed test. # # <ExitCode> is the expected exit code, which must be a whole number (integer 0 or # greater). If the actual test exist code is not match, the test is deemed to have # failed. A special value of 'U' meaning Undefined can be supplied rather than a # whole number to indicate that any exit code is accepted. (The test may still fail # depending on the <Output> checks). # # If <TestScript> is set to 'no_script', the exit code is ignored, so fill a '-' # in for the <ExitCode> field. # # <TestLog> Specify the absolute path to the log containing the expected string, # or the special value 'output' to scan the output of the command rather than # a log file. The <TestLost> can also be of the form <Host>:<Log> to indicate # the expected string should be checked on the specified host. For example, # a value of syd-helix-04:/p4/1/logs/recreate_offline_db.og will check that # log on the syd-helix-04 host. # # The special value 'output' cannot be used if TestScript is set to 'no_script'. # # <ExpectedStringRegex> is a string of text expected of the executed command in # either the output or a given logfile. The string can be a regular expression. # # <Comments> are short comments for the human reviewer of the test, describing what # is expected in the output, what is being tested, etc. test_script-recover_correct_ckp_1.sh|0|/p4/1/logs/checkpoint.log|^Recovering from /p4/1/checkpoints/p4_1.ckp.*.gz|Serial checkpoint on commit. no_script|-|/p4/1/logs/checkpoint.log|^End p4_1 Checkpoint|Checkpoint OK
# | Change | User | Description | Committed | |
---|---|---|---|---|---|
#11 | 31075 | C. Thomas Tyler | Corrected host name in test data. | ||
#10 | 31043 | C. Thomas Tyler |
Add scripted test for live checkpoint off commit (i.e. on edge, standby). |
||
#9 | 30747 | C. Thomas Tyler |
Added Test Group concept to run_cli_tests.sh, with same meaning and usage as in run_scripted_tests.sh. The goal is to allow running a defined subset of tests. |
||
#8 | 30742 | C. Thomas Tyler | Added support for specifying exit code as 'N' for non-zero. | ||
#7 | 30677 | C. Thomas Tyler |
Added 13 tests for load_checkpoint.sh. Added 'TestGroup' field to scripted_testse.cfg. |
||
#6 | 30650 | C. Thomas Tyler | Adapted scripted tests to tweaks in expected script output. | ||
#5 | 30649 | C. Thomas Tyler |
Added more tests for recover_edge.sh and related scripts, and improved auditability the first test script for recover_edge.sh. |
||
#4 | 30643 | C. Thomas Tyler | Added tests for recover_edge.sh. | ||
#3 | 30626 | C. Thomas Tyler | Refined test harness logic and added more tests. | ||
#2 | 30623 | C. Thomas Tyler |
Added feature for scripted test to run addtional checks from an earlier execution of a script. Added more tests. |
||
#1 | 30622 | C. Thomas Tyler | Added files for initial SDP BSW test suite. |