π Review pull requests for bugs and policy
Stack β Trigger: GitHub webhook β agent API / schedule Β· Models: Claude 4.8 + GPT-4o (cross-check) Β· Tools: GitHub API Β· Mode: verify panel + constraints Β· Output: inline PR review comments
Who itβs for β teams where reviews are the bottleneck and the easy stuff eats reviewer time. What it does β reads a PR diff, flags likely bugs, missing tests, and policy violations (secrets, banned dependencies), and leaves inline comments β so a human reviewer starts from a triaged list instead of a blank diff.
Build it
- Connect GitHub (REST/GraphQL via Connect API, or
@octokit/restas an SDK tool) for PR, diff, and review-comment access. - Create the agent with the instruction: review this diff for correctness, test coverage, and policy; comment inline; do not approve or merge.
- Encode policy as constraints β flag any committed secret; block new dependencies outside the allowlist; require tests for new endpoints.
- Add a verify panel β a second-vendor model re-checks each flagged issue so the bot doesnβt spam false positives; only findings both models keep get posted.
- Post the review β the agent leaves inline comments and a summary via the GitHub tools; it never approves.
- Trigger it β a GitHub webhook calls the agent API on
pull_request.opened/synchronize, or run it on a schedule over open PRs.
Make it yours
- Add a repo-context tool so it reasons about the surrounding code, not just the diff.
- Gate merges by requiring the botβs summary to show zero policy violations.
- Run the multi-vendor coding fleet to fix what the review finds.
Uses β DevOps Β· GitHub Β· Verification Β· Constraints