Test run statistics for test runs on https://github.com/curl/curl

Report generated Thu, 12 Dec 2024 18:28:59 +0000 covering runs over the past 30 days.

Days of stats: 30
Most recent run: Thu, 12 Dec 2024 17:06:02 +0000
Oldest run used: Tue, 12 Nov 2024 20:03:50 +0000
Number of git commits tested: 93
Number of unique configured test jobs: 137
Test runs: 10710
Runs per day: 357.0
Runs by test result: 10710 (100%)

success: 10540 (98%)
failure: 146 (1.4%)
truncated: 24 (0.22%)

Tests run: 14731666
Tests executed per day: 491055.5
Tests considered: 15458599 (100%)

PASS: 14714915 (95%)
FAIL: 218 (0.0014%)
SKIP: 726933 (4.7%)
FAILIGNORE: 13656 (0.088%)
UNKNOWN: 2877 (0.019%)

Total clock time spent running tests: 12061698 sec. (140 days)
Time spent running tests per day: 402057 sec./day (4.7 days/day)
Average time spent running each test: 0.819 sec./test
Longest test runs:

curl: 3674 sec.
pytest: 166 sec.

Shortest test runs:

curl: 16 sec.
pytest: 90 sec.

Average test runs:

curl: 232 sec.
pytest: 117 sec.

Most number of unique tests attempted in one run by test format:

curl: 1689
pytest: 605

Average number of tests attempted in one run by test format:

curl: 1502.9
pytest: 504.5

Runs by CI system: 10710 (100%)

circle: 540 (5.0%)
curlauto: 682 (6.4%)
gha: 9488 (89%)

Runs by build system: 10710 (100%)

automake: 6967 (65%)
cmake/make: 238 (2.2%)
cmake/msbuild: 483 (4.5%)
cmake/ninja: 3022 (28%)

Runs by test format: 10710 (100%)

curl: 9343 (87%)
pytest: 1367 (13%)

Runs by test mode: 9343 (100%)

normal: 9013 (96%)
torture: 330 (3.5%)

Runs by operating systems: 10710 (100%)

aix: 2 (0.019%)
cygwin: 82 (0.77%)
darwin: 2788 (26%)
freebsd: 83 (0.77%)
linux: 5815 (54%)
msys: 1102 (10%)
netbsd: 112 (1.0%)
openbsd: 82 (0.77%)
solaris: 644 (6.0%)