flaky-smoke-tests

Installation
SKILL.md

Diagnosing Flaky Smoke Tests

Use this skill for failures from the Azure DevOps Flaky Smoke Tests pipeline:

  • Organization: https://dev.azure.com/monacotools
  • Project: Monaco
  • Definition ID: 700
  • Pipeline YAML: build/azure-pipelines/product-smoke-flaky.yml
  • Scheduled runs: twice daily on main

The pipeline builds VS Code from source and runs the complete Electron smoke suite once per entry in the iterations parameter. Each platform runs its iterations sequentially in one job. The exception is Windows unit and integration tests, which are each split into two parallel jobs: WindowsSmokeFlakyUnit_odd / WindowsSmokeFlakyIntegration_odd run the odd iterations and WindowsSmokeFlakyUnit_even / WindowsSmokeFlakyIntegration_even run the even ones. Each shard has its own artifacts (logs-windows-x64-<unit|integration>-<odd|even>-<attempt>) and its own Slack tally line.

Important Pipeline Behavior

Installs
50
GitHub Stars
194.3K
First Seen
Jul 17, 2026