Self-hosted rotating proxy infrastructure

What it is

Scraping and automation need connections that do not all come from one address. This platform finds open proxies across the web, validates them and serves them behind one local endpoint with routing that keeps each target on a stable exit.

It started as a tool for my own pipelines and became infrastructure: health checking, TLS interception detection, provider auditing and an operations scoreboard for 2,631 sources of varying quality.

Under the hood

• Collection at scale: 721,000 proxies harvested from 2,631 documented sources, cataloged with tiered quality rankings.
• Eleven protocol validations per candidate, including CONNECT ports and TLS behavior, before anything enters the pool.
• Site-affinity routing: one target keeps one exit for the life of a session, which is what stateful scraping actually needs.
• TLS and MITM detection so a tampered connection never silently rewrites traffic.
• A companion tester for SOCKS4/5, HTTP and HTTPS with GeoIP, plus provider audit scorecards from real traffic.
• Runs as a managed service with Redis state, Docker packaging and health checks.

Why build it

Rented proxy services charge per request and rate-limit exactly when you need volume. The open proxy world is enormous but mostly junk. The platform is the filter between those two facts: harvest everything, prove what works and serve only what survives.

Stack