Test run statistics for test runs on https://github.com/curl/curl

Report generated Thu, 23 Jan 2025 12:17:33 +0000 covering runs over the past 30 days.

Days of stats: 30
Most recent run: Thu, 23 Jan 2025 05:53:44 +0000
Oldest run used: Tue, 24 Dec 2024 12:29:28 +0000
Number of git commits tested: 171
Number of unique configured test jobs: 153
Test runs: 19033
Runs per day: 634.4
Runs by test result: 19033 (100%)

success: 18785 (99%)
failure: 225 (1.2%)
truncated: 23 (0.12%)

Tests run: 26611534
Tests executed per day: 887051.1
Tests considered: 27885633 (100%)

PASS: 26582679 (95%)
FAIL: 266 (0.00095%)
SKIP: 1274099 (4.6%)
FAILIGNORE: 24765 (0.089%)
UNKNOWN: 3824 (0.014%)

Total clock time spent running tests: 21691138 sec. (251 days)
Time spent running tests per day: 723038 sec./day (8.4 days/day)
Average time spent running each test: 0.815 sec./test
Longest test runs:

curl: 4654 sec.
pytest: 174 sec.

Shortest test runs:

curl: 16 sec.
pytest: 92 sec.

Average test runs:

curl: 209 sec.
pytest: 119 sec.

Most number of unique tests attempted in one run by test format:

curl: 1711
pytest: 614

Average number of tests attempted in one run by test format:

curl: 1526.1
pytest: 514.8

Runs by CI system: 19033 (100%)

circle: 1002 (5.3%)
curlauto: 909 (4.8%)
gha: 17122 (90%)

Runs by build system: 19033 (100%)

automake: 11951 (63%)
cmake/make: 417 (2.2%)
cmake/msbuild: 843 (4.4%)
cmake/ninja: 5822 (31%)

Runs by test format: 19033 (100%)

curl: 16626 (87%)
pytest: 2407 (13%)

Runs by test mode: 16626 (100%)

normal: 16056 (97%)
torture: 570 (3.4%)

Runs by operating systems: 19033 (100%)

cygwin: 143 (0.75%)
darwin: 5429 (29%)
freebsd: 143 (0.75%)
linux: 10181 (53%)
msys: 1869 (9.8%)
netbsd: 172 (0.90%)
openbsd: 142 (0.75%)
solaris: 954 (5.0%)