Test run statistics for test runs on https://github.com/curl/curl

Report generated Wed, 22 Jan 2025 00:24:07 +0000 covering runs over the past 30 days.

Days of stats: 30
Most recent run: Tue, 21 Jan 2025 23:46:16 +0000
Oldest run used: Mon, 23 Dec 2024 02:20:00 +0000
Number of git commits tested: 183
Number of unique configured test jobs: 153
Test runs: 20265
Runs per day: 675.5
Runs by test result: 20265 (100%)

success: 20013 (99%)
failure: 230 (1.1%)
truncated: 22 (0.11%)

Tests run: 28317197
Tests executed per day: 943906.5
Tests considered: 29673600 (100%)

PASS: 28286726 (95%)
FAIL: 272 (0.00092%)
SKIP: 1356403 (4.6%)
FAILIGNORE: 26248 (0.088%)
UNKNOWN: 3951 (0.013%)

Total clock time spent running tests: 23074598 sec. (267 days)
Time spent running tests per day: 769153 sec./day (8.9 days/day)
Average time spent running each test: 0.815 sec./test
Longest test runs:

curl: 4654 sec.
pytest: 174 sec.

Shortest test runs:

curl: 16 sec.
pytest: 92 sec.

Average test runs:

curl: 204 sec.
pytest: 119 sec.

Most number of unique tests attempted in one run by test format:

curl: 1711
pytest: 614

Average number of tests attempted in one run by test format:

curl: 1525.3
pytest: 514.2

Runs by CI system: 20265 (100%)

circle: 1074 (5.3%)
curlauto: 891 (4.4%)
gha: 18300 (90%)

Runs by build system: 20265 (100%)

automake: 12689 (63%)
cmake/make: 447 (2.2%)
cmake/msbuild: 900 (4.4%)
cmake/ninja: 6229 (31%)

Runs by test format: 20265 (100%)

curl: 17701 (87%)
pytest: 2564 (13%)

Runs by test mode: 17701 (100%)

normal: 17091 (97%)
torture: 610 (3.4%)

Runs by operating systems: 20265 (100%)

cygwin: 153 (0.75%)
darwin: 5809 (29%)
freebsd: 153 (0.75%)
linux: 10874 (54%)
msys: 1992 (9.8%)
netbsd: 182 (0.90%)
openbsd: 152 (0.75%)
solaris: 950 (4.7%)