How It Works
From install to first review in under 5 minutes. No pipeline changes, no webhook configuration, no CI/CD modifications.
// GETTING STARTED
Up and running in minutes
Install the Extension
Install ADO Pilot from the Azure DevOps Marketplace. One click, no pipeline changes required.
Configure Your Organization
Set your review preferences, file exclusion patterns, and choose which repositories to enable.
Create a Pull Request
When a PR is created or updated, a service hook automatically triggers an AI review.
Get AI-Powered Feedback
ADO Pilot posts inline comments on specific lines and a status check — visible directly in your PR.
Install the Extension
Install ADO Pilot from the Azure DevOps Marketplace. One click, no pipeline changes required.
Configure Your Organization
Set your review preferences, file exclusion patterns, and choose which repositories to enable.
Create a Pull Request
When a PR is created or updated, a service hook automatically triggers an AI review.
Get AI-Powered Feedback
ADO Pilot posts inline comments on specific lines and a status check — visible directly in your PR.
Under the hood
A closer look at the technical architecture behind ADO Pilot.
Service Hook Integration
When ADO Pilot is installed, it registers a service hook for git.pullrequest.created and git.pullrequest.updated events. When a PR is created or updated, Azure DevOps fires an HTTP POST to our backend — no pipeline YAML changes needed.
Secure Processing
Incoming webhook payloads are authenticated and validated at our secure gateway, then handed off to our asynchronous review queue. Reviews are processed reliably and independently, so a spike in one organization never affects another.
Editorial AI Review
ADO Pilot fetches the PR diff via the Azure DevOps REST API and runs it through Anthropic's Claude. Claude drafts findings, then audits its own draft — flagging overreach and dropping comments it can't defend — so only high-signal feedback makes it to your PR.
Results Posted to Your PR
Review comments are posted as inline threads on specific files and lines using the PR Threads API. A status check (genre: adopilot) is posted using the PR Status API, which you can configure as a required branch policy.