Automations/Testing/CI failure and flaky test summary

CI failure and flaky test summary

Summarizes CI failures and flaky tests, ranks by frequency, and suggests fixes.

Use this template

How to use this template

  1. 1Click "Use this template" or create a new automation in Ona
  2. 2Set your trigger (manual, scheduled, or event-based)
  3. 3Copy each step below into the automation builder
  4. 4Customize the prompts for your specific use case

What this does

  • Categorize failures as consistent, flaky, or infra
  • Rank failures by frequency
  • Identify flaky tests with flake rates
  • Suggest top fixes ranked by impact

Workflow

Trigger

Daily schedule

Runs at 9 AM on weekdays.

Prompt

Analyze CI runs

Check workflow runs from the past 7 days. Categorize failures as consistent, flaky, or infrastructure-related.

Prompt

Generate CI health report

Produce a summary with pass rate, top failures ranked by frequency, flaky tests with flake rate, and top 3 suggested fixes ranked by impact.

More automations that supercharge your development workflow with Ona.

Start shipping with Ona

No commitment. No setup. Just start.

Copied to clipboard!

This website uses cookies to enhance the user experience. Read our cookie policy for more info.