CI failure and flaky test summary

Analyzes your CI pipeline history to identify recurring failures and flaky tests. Ranks them by frequency and impact, and suggests targeted fixes so your team can focus on the worst offenders.

How to use this template

  1. 1Click "Use this template" or create a new automation in Ona
  2. 2Set your trigger (manual, scheduled, or event-based)
  3. 3Copy each step below into the automation builder
  4. 4Customize the prompts for your specific use case

What this does

  • Categorize failures as consistent, flaky, or infra
  • Rank failures by frequency
  • Identify flaky tests with flake rates
  • Suggest top fixes ranked by impact

Workflow

Trigger

Daily schedule

Runs at 9 AM on weekdays.

Prompt

Analyze CI runs

Check workflow runs from the past 7 days. Categorize failures as consistent, flaky, or infrastructure-related.

Prompt

Generate CI health report

Produce a summary with pass rate, top failures ranked by frequency, flaky tests with flake rate, and top 3 suggested fixes ranked by impact.

More automations to explore.

Ready to try a template?

Start building with a free Ona account.

Copied to clipboard!

This website uses cookies to enhance the user experience. Read our cookie policy for more info.