John Sabo
← All work

Outbound automation with quality gates

Outreach Campaign Engine Running daily

internal pipeline

The pipeline that does the prospecting work. It scores leads, drafts outreach with AI and puts every draft in front of a panel of four model judges before anything sends.

What it is

It runs daily. Leads get scored for fit, drafted outreach goes through a quality panel, sending is paced. Replies or bounces suppress the contact automatically. The contact universe holds 460,000 businesses.

The interesting part is the gate. Every message is judged by four model reviewers on different lenses before it can send. The models themselves are A/B tested on copy quality with blinded panels. The system is as careful about what it says as who it says it to.

The pipeline: eight stages, a four-judge gate and the brakes
The pipeline: eight stages, a four-judge gate and the brakes
The pipeline: eight stages, a four-judge gate and the brakes

Under the hood

What was hard

Making the automation trustworthy. Sending is easy. Sending 1,200 messages a day that a human would have written, without burning a domain or annoying the wrong person, is a quality-control problem. The judge panel and the circuit breaker are the answer: the system proves its work before the send. It stops itself on evidence of harm.

460K
contacts
1,200
sends/day
4
judges per message

Stack

Python PostgreSQL LLM panels ElasticEmail OnePageCRM A/B testing

Working on something like this?

One sentence about the problem is enough.

john@johnsabo.org