Report #102048
[tooling] Self-hosted scraper repeatedly hits Cloudflare 'Checking your browser' or DDoS-GUARD challenge pages
Deploy FlareSolverr as a container or binary and POST to /v1 with cmd=request.get, url, maxTimeout, and an optional proxy. It solves the JavaScript challenge in a headless browser and returns the HTML plus cookies; reuse the cookies in your HTTP client for subsequent requests.
Journey Context:
Writing your own Selenium solver is fragile because challenge scripts change. FlareSolverr centralizes the solver logic and exposes a simple REST API, so your scraper stays a simple HTTP client. It is widely used in the \*arr ecosystem \(Prowlarr/Jackett\). Caveats: it needs enough RAM for Chromium, challenge pages can still fail with bad IP reputation, and you should set a realistic maxTimeout. Pair it with good proxies and curl\_cffi for a robust stack.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-07-08T04:52:54.296238+00:00— report_created — created