Test run statistics for test runs on https://github.com/curl/curl

Report generated Wed, 11 Sep 2024 00:21:58 +0000 covering runs over the past 30 days.

Days of stats: 30
Most recent run: Tue, 10 Sep 2024 22:04:08 +0000
Oldest run used: Mon, 12 Aug 2024 01:20:00 +0000
Number of git commits tested: 236
Test runs: 25240
Runs per day: 841.3
Runs by test result: 25240 (100%)

success: 23862 (95%)
failure: 1160 (4.6%)
truncated: 218 (0.86%)

Tests run: 33613921
Tests executed per day: 1120464.0
Tests considered: 35262440 (100%)

PASS: 33571420 (95%)
FAIL: 1317 (0.0037%)
SKIP: 1648519 (4.7%)
FAILIGNORE: 31247 (0.089%)
UNKNOWN: 9937 (0.028%)

Tests runs that were aborted: 218 (0.864%)
Total clock time spent running tests: 23769024 sec. (275 days)
Time spent running tests per day: 792301 sec./day (9.2 days/day)
Time spent running per test: 0.707 sec./test
Longest test runs:

curl: 3333 sec.
pytest: 243 sec.

Shortest test runs:

curl: 47 sec.
pytest: 72 sec.

Average test runs:

curl: 538 sec.
pytest: 143 sec.

Most number of unique tests attempted in one run by test format:

curl: 1669
pytest: 520

Average number of tests attempted in one run by test format:

curl: 1435.6
pytest: 368.0

Number of unique configured test jobs: 152
Runs by CI system: 25240 (100%)

azure: 3104 (12%)
circle: 1392 (5.5%)
curlauto: 1103 (4.4%)
gha: 19641 (78%)

Runs by build system: 22281 (100%)

automake: 17137 (77%)
cmake/make: 3902 (18%)
cmake/msbuild: 1228 (5.5%)
cmake/ninja: 14 (0.063%)

Runs by test format: 25240 (100%)

curl: 22785 (90%)
pytest: 2455 (9.7%)

Runs by test mode: 22785 (100%)

normal: 21780 (96%)
torture: 1005 (4.4%)

Runs by operating systems: 25240 (100%)

aix: 4 (0.016%)
cygwin: 209 (0.83%)
darwin: 6060 (24%)
freebsd: 209 (0.83%)
linux: 12533 (50%)
msys: 4551 (18%)
netbsd: 239 (0.95%)
openbsd: 209 (0.83%)
solaris: 1226 (4.9%)