DecodoQuick start guideWeb Scraping API

Get Started With Web Scraping API

Collect HTML, JSON, CSV, or Markdown data at scale with our universal scraper – built to handle blocks, bypass CAPTCHAs, and manage proxies for you. Learn to use Web Scraping API with our quick start guide.

Get scraping API

14-day money-back option

200

requests per second

100+

ready-made templates

99.99%

success rate

195+

locations worldwide

Free

starter plan

Concentric colored semicircular arcs nesting into a pointed teardrop shape on a white background

What is Web Scraping API?

Our Web Scraping API is an all-in-one data collection solution for eCommerce marketplaces, search engine results pages, social media platforms, and various other websites. It combines a vast pool of proxies, an advanced web scraper, and a data parser.

Most popular Web Scraping API use cases

Choose your target and gather data with confidence using our state-of-the-art scraper.

Public data collection

Effortlessly gather real-time public data for analysis or easy integration into your projects.

Travel fare aggregation

Collect relevant pricing data to get the best deals for hotels, flights, and car rentals.

Fraud protection

Detect malicious websites and prevent fraud from global locations by scanning scraped HTML data.

Start for free

How to set up Web Scraping API

Get started with your Web Scraping API configuration by following our guide.

Pricing table showing 'Plans' with $19 highlighted and columns Free $19 $49 $99 $249 $499 $999 $1499 in a compare-plans grid

Choose a subscription

Create an account on the Decodo dashboard.

On the left-side panel, select Scraping APIs menu and choose Pricing.

Select a subscription plan that suits your needs.

Authenticate via username:password or token

If you want to integrate Web Scraping API in your environment, you can copy your credentials on the dashboard.

In the Scraper tab, click your username, password, or authorization token to copy it. Use the buttons to reveal credentials or generate a new password.

Create a request command

In the Scraper tab, you can use the universal Web target to enter any search URL, or select a ready-made scraper template from the menu.

When using the Web target, you can check the Markdown box in the parameters to receive the response in Markdown format.

When using a template, choose a target, then enter the URL or query you want to scrape. If needed, select the relevant parameters. More parameter options are listed in our help documentation.

In the top-right corner, select cURL, Node.js, or Python, and click Copy request in the bottom-right corner to copy the command for use in your environment.

Alternatively, click Send Request to run it directly. Once the task is complete, the response will appear on the screen.

JSON response panel showing "status_code": 200 and "url":"https://ip.smartproxy.com/" in dark Response UI

Copy or download the result

After sending a request in the dashboard, you can copy or download the response in HTML, JSON, or CSV format by clicking the Export in the bottom-right corner.

Blue area chart showing bandwidth spike with tooltip '27 Jan, 2024 Usage: 1713.70 Download: 1208.52 Upload: 505.18' on proxy dashboard

Track scraping usage

To track your scraping API usage, navigate to the Usage statistics tab. There, you’ll find traffic usage details over a selected timeframe.

Easy to integrate scraper

Our Web Scraping API works with all popular programming languages, ensuring a smooth connection to other tools in your business suite.

import requests
  
url = "https://scraper-api.decodo.com/v2/scrape"
  
payload = {
      "url": "https://ip.decodo.com",
      "headless": "html"
}
  
headers = {
    "accept": "application/json",
    "content-type": "application/json",
    "authorization": "Basic [YOUR_BASE64_ENCODED_CREDENTIALS]"
}
  
response = requests.post(url, json=payload, headers=headers)
  
print(response.text)

import requests
  
url = "https://scraper-api.decodo.com/v2/scrape"
  
payload = {
      "url": "https://ip.decodo.com",
      "headless": "html"
}
  
headers = {
    "accept": "application/json",
    "content-type": "application/json",
    "authorization": "Basic [YOUR_BASE64_ENCODED_CREDENTIALS]"
}
  
response = requests.post(url, json=payload, headers=headers)
  
print(response.text)


const scrape = async() => {
  const response = await fetch("https://scraper-api.decodo.com/v2/scrape", {
    method: "POST",
    body: JSON.stringify({
      "url": "https://ip.decodo.com",
      "headless": "html"
    }),
    headers: {
      "Content-Type": "application/json",
      "Authorization": "Basic [YOUR_BASE64_ENCODED_CREDENTIALS]"
    },
  }).catch(error => console.log(error));

  console.log(await response.json())
}

scrape()

curl --request 'POST' \
        --url 'https://scraper-api.decodo.com/v2/scrape' \
        --header 'Accept: application/json' \
        --header 'Authorization: Basic [YOUR_BASE64_ENCODED_CREDENTIALS]' \
        --header 'Content-Type: application/json' \
        --data '
    {
      "url": "https://ip.decodo.com",
      "headless": "html"
    }
'

<?php
$url = "https://scraper-api.decodo.com/v2/scrape";

$payload = json_encode([
    "target" => "universal",
    "url" => "https://ip.decodo.com/",
    "headless" => "html"
]);

$headers = [
    "Accept: application/json",
    "Content-Type: application/json",
    "Authorization: Basic [YOUR_BASE64_ENCODED_CREDENTIALS]"
];

$ch = curl_init($url);
curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
curl_setopt($ch, CURLOPT_POST, true);
curl_setopt($ch, CURLOPT_POSTFIELDS, $payload);
curl_setopt($ch, CURLOPT_HTTPHEADER, $headers);

$response = curl_exec($ch);
if (curl_errno($ch)) {
    echo 'Error:' . curl_error($ch);
}
curl_close($ch);

echo $response;
?>

Free tools, same great user-friendliness

Chrome Browser Extension

Easy-to-use, damn powerful. A proxy wonderland in your browser, accessible in 2 clicks. Free of charge.

Learn more

Firefox Browser Add-on

Easy to set up, even easier to use. The virtual world at your fingertips in 2 clicks. Free of charge.

Learn more

Proxy Checker

Verify your IPs with free Proxy Checker. Quickly & efficiently check your IPs to avoid potential errors.

Learn more

Decodo blog

Most recent

NEW

DATA COLLECTION

Golang Colly: How To Build a Web Scraper in Go

Golang Colly is a fast, callback-driven scraping framework for the Go programming language. It wraps HTTP requests, HTML parsing, rate limiting, and concurrency in a clean API, so you can pull structured data from a website with very little code. This tutorial walks you through building a working Colly scraper from an empty project all the way to proxy rotation.

Kipras Kalzanauskas

Last updated: Jun 10, 2026

15 min read

Equip Yourself With Web Scraping API

Ready-to-use powerful scraping API – only at Decodo.

Get started

14-day money-back option