Playwright Scraper with Proxies + Anti-Bot
Resilient scraper with browser pool, proxy rotation, captcha handling, and structured output.
Resilient scraper with browser pool, proxy rotation, captcha handling, and structured output.
You are a world-class senior engineer with 20+ years of production experience. You have shipped systems used by millions of users worldwide. You write clean, scalable, secure, production-ready code with zero placeholders. You build production scrapers that survive months without breaking. Build a COMPLETE Playwright scraper. Interview me first: 1. Target sites and pages to scrape 2. Output schema (JSON / SQL / Parquet) 3. Frequency? (one-off, hourly, daily, on-demand API) 4. Proxy strategy? (residential, datacenter, rotating) 5. Anti-bot challenges expected? (Cloudflare, Datadome, captcha) 6. Need login or session reuse? 7. Storage destination? (S3, Postgres, BigQuery) 8. Rate limit and politeness rules 9. Failure handling (retries, alerting, screenshots on error) 10. Deploy target? (Render, Fly, AWS Batch, browserless) STACK: TypeScript, Playwright with persistent contexts, browser pool, proxy chain manager, BullMQ for job queue, Sentry, S3-compatible storage. AFTER MY ANSWERS: A. Show me a PROJECT PLAN: stack, file tree, data models, key flows, dependencies. B. Ask: "Does this look correct? Anything to add or change?" C. After I confirm, generate the COMPLETE project — every file in full, no TODOs, no placeholders, no shortcuts. Include configs, env examples, README, and run instructions. D. Add error handling, input validation, logging, and a sane test setup where applicable. E. Output files one at a time with clear file path headers so I can copy each into my IDE.
Copy the prompt above → open ChatGPT, Claude, Gemini, Copilot or DeepSeek → paste → the AI will interview you about your project, then build complete production-ready code.
The Playwright Scraper with Proxies + Anti-Bot is a battle-tested mega prompt designed for the Web Scraper stack. Instead of dumping a vague request into ChatGPT or Claude, this prompt turns the AI into a senior engineer that interviews you first, confirms an architecture plan, and only then writes the full project — files, folders, configs and all. The result is production-ready code you can drop straight into a real build, not a half-finished snippet you still have to glue together.
You can paste this prompt into ChatGPT, Claude, Gemini, Copilot, DeepSeek, Mistral Le Chat or any modern reasoning model. It is written to be model-agnostic and stack-aware, so the AI adapts its output to your specific requirements rather than forcing a one-size-fits-all template on your project.
Most developers write prompts like "build me a automation app" and get back generic, half-broken boilerplate. The Playwright Scraper with Proxies + Anti-Bot works better for three concrete reasons:
Yes. Every prompt on AI Prompts Lib is 100% free, no signup or paywall. Copy it, paste into your AI of choice, and start building. We do not log your inputs or your generated code.
This prompt is tuned for any modern large-context model: Claude 4 / 4.5 Sonnet, ChatGPT-5 / GPT-4 Turbo, Gemini 2.5 Pro, DeepSeek V3 and Copilot Chat. For very large projects we recommend Claude or Gemini because of their larger output windows.
Absolutely. Treat the prompt as a starting template — add your brand voice, swap the tech stack hints, or pin specific libraries you already use. The interview + plan + build structure is the magic, not the exact wording.
Paste the error message back into the same chat and say "fix this and re-emit the affected files in full". Because the prompt forces complete file output, the fix slots straight back into your project without manual stitching.