Quick Notes97 words
Monitoring pipeline health — quick notes
Pipeline health — quick notes
| Metric | Definition/report purpose |
|---|---|
| Failure rate | Failed runs ÷ total runs over time |
| Duration | Successful/partially successful completion time by day and percentile |
| Flaky test rate | Inconsistent tests reported as a count/rate across runs |
- A fail-then-pass system-detection rerun can mark a test flaky.
- Whether flaky failures affect the summary/pipeline result is configurable.
- Trends reveal recurring patterns; an individual run still supports local diagnosis.
Sources: https://learn.microsoft.com/en-us/credentials/certifications/resources/study-guides/az-400 · https://learn.microsoft.com/en-us/azure/devops/report/powerbi/sample-pipelines-pass-rate-trend · https://learn.microsoft.com/en-us/azure/devops/report/powerbi/sample-pipelines-allpipelines · https://learn.microsoft.com/en-us/azure/devops/report/powerbi/sample-pipelines-duration-trend · https://learn.microsoft.com/en-us/azure/devops/pipelines/test/flaky-test-management · https://learn.microsoft.com/en-us/azure/devops/report/powerbi/sample-test-analytics-flaky-tests · https://learn.microsoft.com/en-us/azure/devops/report/dashboards/configure-test-results-trend