test_log2sql.py #21

  • //
  • guest/
  • perforce_software/
  • utils/
  • log_analyzer/
  • psla/
  • test_log2sql.py
  • Commits
# Change User Description Committed
#21 25220 Robert Cowham Moved project files to new location: //guest/perforce_software/log-analyzer/psla/...
Required by Swarm project structure for workshop.
#20 24991 Robert Cowham Add tests for all TableUse values.
Fix 'locks acquired by blocking after' processing
#19 24674 Robert Cowham handle [] in api names
#18 24641 Robert Cowham Explicit sql column testing
#17 24639 sgcommon Correct usage and rpc tracking values.

Per the schema for the process table, the values were being written in
the wrong order. They are now written in the correct order making queries
return the expected results for usage and rpc track values.

Test data updated accordingly.
#16 24323 Robert Cowham Test for dm-CommitSubmit entries
#15 24288 Robert Cowham Note some new log entries for remote depots for tests etc
#14 24256 Robert Cowham Make sure columns are correct
#13 24171 Robert Cowham Remove what may be invalid data so we can ignore it.
#12 24169 Robert Cowham More replica pull tweaks
#11 24168 Robert Cowham Process edge server log pull records
Some tweaks to tests required.
#10 23934 Robert Cowham Clean database and auto-create on log upload
#9 23923 Robert Cowham Added tests for compressed files gzip and zip.
Fix for python2
#8 23920 Robert Cowham Handle multiple log files
#7 23897 Robert Cowham Handle remote journal pulls.
Increase size of process key in case of duplicates
#6 23803 Robert Cowham Trim newlines - unfortunately all md5s different in tests!
#5 23802 Robert Cowham Handle trigger lapse output when track=1
tableUse has extra field: triggerLapse
#4 23799 Robert Cowham Default tests to python3
#3 23798 Robert Cowham Added explanatory comments.
Minor refactoring
#2 23785 Robert Cowham Tweak interface
Remove unused module
#1 23765 Robert Cowham Moved things down one level to psla dir to make it easier to see what belongs
//guest/perforce_software/utils/log_analyzer/test_log2sql.py
#3 23720 Robert Cowham Fix failing tests due to NULL values and .p4ignore
#2 23636 Robert Cowham Merge in latests changes to log2sql.py
- much faster
- better at detecting completed commands and out of order vtrack
- full test harness
#1 23635 Robert Cowham Branch in tests
//guest/robert_cowham/perforce/utils/log_analysis/test_log2sql.py
#19 21796 Robert Cowham Handle rmt-FileFetch records which may be duplicates as they don't have 'completed' entries.
#18 21712 Robert Cowham Check for correct line number when looking to update for track entries
#17 21708 Robert Cowham Tweak parameters to improve error messages.
Make output to stdout optional
#16 21705 Robert Cowham Minor refactoring for clarity.
Process all completed records as we go.
#15 21704 Robert Cowham A couple more tests for log formats.
#14 21703 Robert Cowham Fix failing python3 test
Add new test to ignore error blocks
#13 21702 Robert Cowham Rework algorithm to process blocks at a time, and to avoid the SQL update statements.
Risk of increased memory vs improved speed.
#12 21697 Robert Cowham Parse rcpSnd/rpcRcv and add to database.
#11 21696 Robert Cowham Test for client/locks entry
#10 21694 Robert Cowham Handle null values properly
#9 21660 Robert Cowham Handle utf8 in python2 strings
#8 21656 Robert Cowham Avoid SQL quoting issues with alternative insert statement.
#7 21643 Robert Cowham Handle git-fusion entries (strip the json) - for --sql option
#6 21402 Robert Cowham Filter out swarm commands
Test for db content in a basic fashion.
#5 21396 Robert Cowham Test for update rows.
#4 21393 Robert Cowham Add a swarm test - large record.
Improve performance by skipping easy matches early.
#3 21374 Robert Cowham Write to sqllite db
#2 21368 Robert Cowham Make tests work under python3
#1 21367 Robert Cowham Restructured for unit tests, and first unit tests.