Engineering Council Test Reliability Report

Executive Snapshot

5

Daily Runs

1/5

Daily Green

19m 21s

Avg Daily Runtime

13

Smoke Attempts

11/13

Smoke Green

3m 14s

Avg Smoke Runtime

2m 56s

Median Smoke Time

0

Current Green Streak

Council Narrative

Daily suite reliability finished strong: the last 0 daily runs were all green.
In the last 10 daily runs, total test volume grew from 1,189 to 1,189.
Library has the highest strict failure ratio at 1.40%, while Billing has the broadest non-pass footprint at 0.00% and showed up in 0 failed runs.
The average daily-suite runtime, measured from GitLab start and finish timestamps, was 19m 21s.
Smoke runs stayed fast when healthy: average duration was 3m 14s and the median passing run was 2m 56s.
Smoke-suite breakdown in this window: Frontend 5/7, University 6/6.
2 production pipelines clearly recovered on rerun after an initial smoke failure: 149634, 149671.

Category Failure Ratios

How computed

Failure Ratio = failed test executions divided by total test executions in the selected timeframe.

Non-pass Ratio = (failed + pending + skipped) test executions divided by total test executions in the selected timeframe.

Example: a 1.75% Billing failure ratio means 1.75% of all Billing test executions in this period ended in failed. A 1.35% Library non-pass ratio means 1.35% of all Library test executions in this period ended in failed, pending, or skipped.

How computed

Failure Ratio = failed test executions divided by total test executions in the selected timeframe.

Non-pass Ratio = (failed + pending + skipped) test executions divided by total test executions in the selected timeframe.

Example: a 1.75% Billing failure ratio means 1.75% of all Billing test executions in this period ended in failed. A 1.35% Library non-pass ratio means 1.35% of all Library test executions in this period ended in failed, pending, or skipped.

Category Aggregate Table

How computed

Failure Ratio = failed test executions divided by total test executions in the selected timeframe.

Non-pass Ratio = (failed + pending + skipped) test executions divided by total test executions in the selected timeframe.

Example: a 1.75% Billing failure ratio means 1.75% of all Billing test executions in this period ended in failed. A 1.35% Library non-pass ratio means 1.35% of all Library test executions in this period ended in failed, pending, or skipped.

How computed

Failure Ratio = failed test executions divided by total test executions in the selected timeframe.

Non-pass Ratio = (failed + pending + skipped) test executions divided by total test executions in the selected timeframe.

Example: a 1.75% Billing failure ratio means 1.75% of all Billing test executions in this period ended in failed. A 1.35% Library non-pass ratio means 1.35% of all Library test executions in this period ended in failed, pending, or skipped.

Category	Total	Failed	Failure Ratio	Non-pass Ratio	Runs With Failures
Billing	540	0	0.00%	0.00%	0
Web	3715	0	0.00%	0.00%	0
Frontend	1260	4	0.32%	0.32%	3
Library	430	6	1.40%	1.40%	3

Billing

Pend 0Skip 0Runs 0

0

0.00%

540

Web

Pend 0Skip 0Runs 0

0

0.00%

3715

Frontend

Pend 0Skip 0Runs 3

4

0.32%

1260

Library

Pend 0Skip 0Runs 3

6

1.40%

430

Recent Runs

Recent Daily Suite Runs

Date	Pipeline	Status	Summary
2026-03-23 18:23	149694	FAILED	Total 1189 \| Passed 1185 \| Failed 4
2026-03-24 18:22	149866	FAILED	Total 1189 \| Passed 1186 \| Failed 3
2026-03-25 18:22	150059	FAILED	Total 1189 \| Passed 1187 \| Failed 2
2026-03-26 18:22	150180	PASSED	Total 1189 \| Passed 1189 \| Failed 0
2026-03-27 18:22	150328	FAILED	Total 1189 \| Passed 1188 \| Failed 1

2026-03-23 18:23Pipeline 149694

FAILED

T 1189 | P 1185 | F 4 | Pend 0

2026-03-24 18:22Pipeline 149866

FAILED

T 1189 | P 1186 | F 3 | Pend 0

2026-03-25 18:22Pipeline 150059

FAILED

T 1189 | P 1187 | F 2 | Pend 0

2026-03-26 18:22Pipeline 150180

PASSED

T 1189 | P 1189 | F 0 | Pend 0

2026-03-27 18:22Pipeline 150328

FAILED

T 1189 | P 1188 | F 1 | Pend 0

Recent Smoke Attempts

Date	Suite	Pipeline	Status	Passed	Failed	Duration
2026-03-23 12:20	Frontend	149520 job	PASSED	110	0	3m 08s
2026-03-23 15:20	University	149634 job	PASSED	10	0	2m 09s
2026-03-23 15:25	Frontend	149634 job	FAILED	103	7	5m 41s
2026-03-23 16:25	University	149671 job	PASSED	10	0	2m 17s
2026-03-23 16:31	Frontend	149671 job	FAILED	103	7	5m 57s
2026-03-23 17:03	University	149684 job	PASSED	10	0	2m 33s
2026-03-23 17:05	Frontend	149684 job	PASSED	110	0	3m 03s
2026-03-24 20:52	University	149788 job	PASSED	10	0	2m 56s
2026-03-24 20:53	Frontend	149788 job	PASSED	110	0	3m 10s
2026-03-25 12:14	University	149902 job	PASSED	10	0	2m 23s
2026-03-25 12:16	Frontend	149902 job	PASSED	110	0	3m 05s
2026-03-27 14:33	University	150306 job	PASSED	10	0	2m 23s
2026-03-27 14:35	Frontend	150306 job	PASSED	110	0	3m 15s

2026-03-23 12:20Frontend | Pipeline 149520 job

PASSED

P 110 | F 0 | 3m 08s

2026-03-23 15:20University | Pipeline 149634 job

PASSED

P 10 | F 0 | 2m 09s

2026-03-23 15:25Frontend | Pipeline 149634 job

FAILED

P 103 | F 7 | 5m 41s

2026-03-23 16:25University | Pipeline 149671 job

PASSED

P 10 | F 0 | 2m 17s

2026-03-23 16:31Frontend | Pipeline 149671 job

FAILED

P 103 | F 7 | 5m 57s

2026-03-23 17:03University | Pipeline 149684 job

PASSED

P 10 | F 0 | 2m 33s

2026-03-23 17:05Frontend | Pipeline 149684 job

PASSED

P 110 | F 0 | 3m 03s

2026-03-24 20:52University | Pipeline 149788 job

PASSED

P 10 | F 0 | 2m 56s

2026-03-24 20:53Frontend | Pipeline 149788 job

PASSED

P 110 | F 0 | 3m 10s

2026-03-25 12:14University | Pipeline 149902 job

PASSED

P 10 | F 0 | 2m 23s

2026-03-25 12:16Frontend | Pipeline 149902 job

PASSED

P 110 | F 0 | 3m 05s

2026-03-27 14:33University | Pipeline 150306 job

PASSED

P 10 | F 0 | 2m 23s

2026-03-27 14:35Frontend | Pipeline 150306 job

PASSED

P 110 | F 0 | 3m 15s

Smoke Suite Breakdown

Suite	Attempts	Passed	Failed	Incomplete	Avg Runtime	Median Passing Runtime	Pipelines
Frontend	7	5	2	0	3m 54s	3m 08s	7
University	6	6	0	0	2m 27s	2m 23s	6

FrontendAttempts 7 | Passed 5 | Failed 2

Incomplete 0 | Avg 3m 54s | Median pass 3m 08s | Pipelines 7

UniversityAttempts 6 | Passed 6 | Failed 0

Incomplete 0 | Avg 2m 27s | Median pass 2m 23s | Pipelines 6