--- title: "n8n Web Scraping - JS Rendering, Proxies, AI Extraction" description: "Scrape any website in n8n with the official WebScraping.AI node: JavaScript rendering, rotating proxies, and AI extraction — no brittle CSS selectors." url: https://webscraping.ai/integrations/n8n markdown_index: https://webscraping.ai/llms.txt --- N8N INTEGRATION # Web Scraping in n8n That Doesn't Get Blocked The official WebScraping.AI community node adds JavaScript rendering, rotating proxies, and AI-powered extraction to your n8n workflows — everything the built-in HTTP Request node can't do. [Start Free Trial](https://webscraping.ai/auth/sign_up)[Node on GitHub](https://github.com/webscraping-ai/webscraping-ai-n8n) 2,000 free API credits · No credit card required ## Why the HTTP Request node hits a wall n8n's built-in HTTP Request and HTML nodes are perfect for APIs and simple pages. Real-world websites fight back. #### No JavaScript rendering The HTTP Request node fetches raw HTML. On React/Vue/Angular sites and anything with lazy loading, the data you want isn't in the response at all. #### 403s and Cloudflare walls Datacenter IPs — including n8n Cloud's shared ones — get challenged or blocked outright by Cloudflare, DataDome, and friends. #### IP bans at scale Loop over a few hundred URLs from one IP and rate limiting kicks in. Building proxy rotation inside n8n is a project of its own. The WebScraping.AI node moves all of that behind one node: headless Chromium rendering, rotating datacenter/residential/stealth proxies, and retries — **you only pay for successful requests**. ## Two ways to set it up Use the community node for the full experience, or plain HTTP Request if you can't install nodes. ### AThe official community node 1 In n8n, open **Settings → Community Nodes → Install** and enter: n8n-nodes-webscraping-ai 2 Create a **"WebScraping.AI API"** credential with the API key from your [dashboard](https://webscraping.ai/dashboard). 3 Add the **WebScraping.AI node** to a workflow and pick an operation. ###### Node operations AI QuestionAI Extract FieldsGet HTMLGet TextGet Selected HTMLGet Multiple SelectionsSearch (SERP)Get Structured DataGet Account Info Every page operation supports JS rendering, proxy type & country, device emulation, custom headers, timeouts, and `wait_for` selectors. **Search (SERP)** takes a query instead of a URL and returns parsed Google results (`organic_results`, `related_searches`, `pagination`) with Country, Language, and Page options — a flat 15 credits per search. **Get Structured Data** takes the URL of a page on a supported site (e.g. a YouTube video, TikTok profile, X post, LinkedIn company, Instagram reel or Reddit thread) and returns it as JSON, with its own Country and YouTube transcript options instead of the page options above — 15 credits per page (50 for Reddit); unsupported URLs aren't charged, pages that parse empty or no longer exist are. ### BNo install: the HTTP Request node On n8n Cloud plans where community nodes aren't available, point the built-in HTTP Request node at the API directly: ``` Method: GET URL: https://api.webscraping.ai/html Query parameters: api_key = YOUR_API_KEY url = https://example.com js = true proxy = residential country = us ``` Swap `/html` for `/text` (clean text), `/ai/question` (+ `question` param), or `/ai/fields` (+ `fields`) — same parameters everywhere. [Full API reference](https://webscraping.ai/docs). ## Skip the CSS selectors entirely Most n8n scraping guides end with an HTML node full of selectors that break on the next redesign. The **AI Question** and **AI Extract Fields** operations read the rendered page with an LLM instead — describe what you want in plain language and get clean JSON into the next node. **No selector maintenance** — extraction survives layout changes. **Structured output** — field names you choose, ready for Sheets, Airtable, or a database node. **Same node handles any site** — one workflow scrapes many sources. ``` // AI Extract Fields operation URL: https://competitor.com/product/123 Fields: { "name": "Product name", "price": "Current price with currency", "stock": "In stock? true/false" } // Output (ready for the next node) { "name": "Acme Widget Pro", "price": "$49.00", "stock": "true" } ``` ## Workflow recipes The four patterns behind most n8n scraping workflows ##### Price monitoring Check competitor prices on a schedule and alert the team when they move. ScheduleAI FieldsIF changedSlack ##### Scrape → LLM → Sheets Pull page text, summarize or classify it with your LLM node, log the result. URLsGet TextOpenAI/ClaudeSheets ##### Lead generation Extract company and contact details from directory listings into your CRM. Listing URLsAI FieldsDedupCRM ##### Listings aggregator Collect jobs, properties, or products from several sites into one database. Loop ItemsAI FieldsPostgres ## Troubleshooting n8n scraping The fixes for the errors every n8n scraper hits 403 Forbidden or Cloudflare challenge page The target is blocking datacenter IPs. Set **Proxy Type to Residential** (10–25 credits/request) in the node's proxy settings. Failed attempts aren't billed, so switching costs nothing. The data is missing from the response The page renders client-side. Make sure **Enable JavaScript** is on (it is by default), and set **Wait For Selector** to an element that appears once content loads — e.g. `.price`. Timeouts on slow pages Raise the node's **Timeout** (up to 30,000 ms) and the **JavaScript Timeout** for heavy single-page apps. Only the first URL gets scraped n8n passes items one at a time — put a **Loop Over Items** node before the WebScraping.AI node, or feed it a list and let it iterate item-by-item. Hitting concurrency limits Plans include a concurrency cap (2 on free accounts). Add a small **Wait** node in the loop or upgrade the plan for parallel workflows. ## Frequently asked questions Does the WebScraping.AI node work on n8n Cloud? Community node availability on n8n Cloud depends on your plan and n8n's verification rules. If you can't install community nodes, the built-in HTTP Request node works with the same API — set the URL to https://api.webscraping.ai/html with api\_key, url, js, and proxy query parameters. Can n8n scrape JavaScript-heavy websites with this integration? Yes. Every operation can render pages in headless Chromium before returning content, with a configurable JS timeout and wait\_for selector — this is exactly what n8n's built-in HTTP Request node can't do. How do I avoid getting blocked while scraping in n8n? Route requests through the node's proxy settings: rotating datacenter proxies for easy targets, residential (10–25 credits) for protected ones, and stealth (50 credits) for the hardest sites. IP rotation, retries, and browser fingerprinting are handled by the API, and failed requests are free. What does scraping in n8n cost with WebScraping.AI? Plans start at $29/mo for 250,000 credits; a plain request is 1 credit, JS rendering 5, residential proxies 10–25, AI extraction adds 5, a Google search via Search (SERP) is a flat 15, and Get Structured Data is 15 per page (50 for Reddit). A free account includes 2,000 credits per month — enough to build and test workflows before paying anything. Can I extract structured data without writing CSS selectors? Yes — the AI Extract Fields operation takes plain-language field descriptions and returns JSON, and AI Question answers free-form questions about a page. Selector-based operations (Get Selected HTML) are also available when you want exact control. Can I scrape pages behind a login with n8n? Only in a limited way — you can pass session cookies via custom headers, but there's no interactive login flow. For fully interactive multi-step sessions you'd need a browser automation tool instead. ## Related integrations [MCP Server](https://webscraping.ai/integrations/mcp-server): Give Claude, Cursor, and other AI assistants web scraping tools. [All integrations](https://webscraping.ai/integrations): Zapier, Make, Pipedream, Activepieces, and more. [Price monitoring](https://webscraping.ai/use-cases/price-monitoring): The most common n8n scraping workflow, in depth. ## Add reliable scraping to your n8n workflows Get started with 2,000 free API credits. No credit card required. [Start Free Trial](https://webscraping.ai/auth/sign_up)[View API Documentation](https://webscraping.ai/docs)