DecodoQuick start guideWeb Scraping API

Get Started With Web Scraping API

Collect HTML, JSON, or CSV data at scale with our universal scraper – built to handle blocks, bypass CAPTCHAs, and manage proxies for you. Learn to use Web Scraping API with our quick start guide.

Get scraping API

14-day money-back option

What is Web Scraping API?

Our Web Scraping API is an all-in-one data collection solution for eCommerce marketplaces, search engine results pages, social media platforms, and various other websites. It combines a vast pool of proxies, an advanced web scraper, and a data parser.

Most popular Web Scraping API use cases

Choose your target and gather data with confidence using our state-of-the-art scraper.

Public data collection

Effortlessly gather real-time public data for analysis or easy integration into your projects.

Travel fare aggregation

Collect relevant pricing data to get the best deals for hotels, flights, and car rentals.

Fraud protection

Detect malicious websites and prevent fraud from global locations by scanning scraped HTML data.

Start 7-day free trial

Find the right Web Scraping API plan for you

Explore our offering and pick what suits you best – from Core to Advanced solutions – we've got you covered.

Core

Advanced

Success rate

100%

Payment

No. of requests

Advanced geo-targeting

US, CA, GB, DE, FR, NL, JP, RO

Worldwide

Requests per second

30+

Unlimited

Output

HTML

HTML, JSON, CSV

API Playground

Proxy management

Pre-built scraper

Anti-bot bypassing

Task scheduling

Premium proxy pool

Ready-made templates

JavaScript rendering

From $0.08/1k req

From $0.95/1k req

How to set up Web Scraping API

Get started with your Web Scraping API configuration by following our guide.

Choose a subscription

After creating your account, click the Scraping APIs menu and choose Pricing.

Select a subscription plan that suits your needs. Alternatively, start a 7-day free trial.

Authenticate with username:password

In the Scraper tab, click on the username, password, or basic authorization token to copy it. Use the corresponding buttons to reveal your credentials or generate a new password.

Create a request command

In the Scraper tab, you can use the universal target and enter any IP or choose a ready-made scraper template.

When using a ready-made scraper template, select a target and then enter the URL or query you want to scrape. If applicable, choose the relevant parameters. You can find more parameter options in our help documentation.

On the right, you can click on the Copy request button to copy the code in cURL, Node.js, or Python for use in your own environment.

Alternatively, click Send request to send your request directly. Once the task is complete, the response will be displayed on the screen.

Copy or download the result

After sending a request using this scraper feature on the dashboard, you can copy or download the response in HTML, JSON, or CSV.

Track scraping usage

To track your scraping API usage, navigate to the Usage statistics tab. There, you’ll find traffic usage details over a selected timeframe.

Easy to integrate scraper

Our Web Scraping API works with all popular programming languages, ensuring a smooth connection to other tools in your business suite.

import requests
  
url = "https://scraper-api.decodo.com/v2/scrape"
  
payload = {
      "url": "https://ip.decodo.com",
      "headless": "html"
}
  
headers = {
    "accept": "application/json",
    "content-type": "application/json",
    "authorization": "Basic [YOUR_BASE64_ENCODED_CREDENTIALS]"
}
  
response = requests.post(url, json=payload, headers=headers)
  
print(response.text)

import requests
  
url = "https://scraper-api.decodo.com/v2/scrape"
  
payload = {
      "url": "https://ip.decodo.com",
      "headless": "html"
}
  
headers = {
    "accept": "application/json",
    "content-type": "application/json",
    "authorization": "Basic [YOUR_BASE64_ENCODED_CREDENTIALS]"
}
  
response = requests.post(url, json=payload, headers=headers)
  
print(response.text)


const scrape = async() => {
  const response = await fetch("https://scraper-api.decodo.com/v2/scrape", {
    method: "POST",
    body: JSON.stringify({
      "url": "https://ip.decodo.com",
      "headless": "html"
    }),
    headers: {
      "Content-Type": "application/json",
      "Authorization": "Basic [YOUR_BASE64_ENCODED_CREDENTIALS]"
    },
  }).catch(error => console.log(error));

  console.log(await response.json())
}

scrape()

curl --request 'POST' \
        --url 'https://scraper-api.decodo.com/v2/scrape' \
        --header 'Accept: application/json' \
        --header 'Authorization: Basic [YOUR_BASE64_ENCODED_CREDENTIALS]' \
        --header 'Content-Type: application/json' \
        --data '
    {
      "url": "https://ip.decodo.com",
      "headless": "html"
    }
'

<?php
$url = "https://scraper-api.decodo.com/v2/scrape";

$payload = json_encode([
    "target" => "universal",
    "url" => "https://ip.decodo.com/",
    "headless" => "html"
]);

$headers = [
    "Accept: application/json",
    "Content-Type: application/json",
    "Authorization: Basic [YOUR_BASE64_ENCODED_CREDENTIALS]"
];

$ch = curl_init($url);
curl_setopt($ch, CURLOPT_RETURNTRANSFER, true);
curl_setopt($ch, CURLOPT_POST, true);
curl_setopt($ch, CURLOPT_POSTFIELDS, $payload);
curl_setopt($ch, CURLOPT_HTTPHEADER, $headers);

$response = curl_exec($ch);
if (curl_errno($ch)) {
    echo 'Error:' . curl_error($ch);
}
curl_close($ch);

echo $response;
?>

Free tools, same great user-friendliness

X Browser

Juggling multiple profiles has never been easier. Get unique fingerprints and use as many browsers as you need, risk-free!

Learn more

Chrome Browser Extension

Easy-to-use, damn powerful. A proxy wonderland in your browser, accessible in 2 clicks. Free of charge.

Learn more

Firefox Browser Add-on

Easy to set up, even easier to use. The virtual world at your fingertips in 2 clicks. Free of charge.

Learn more

Proxy Checker

Verify your IPs with free Proxy Checker. Quickly & efficiently check your IPs to avoid potential errors.

Learn more

Decodo blog

Most recent

NEWS

Smartproxy is now Decodo – A New Era of Web Data Solutions

Big news! Smartproxy has officially introduced its new name – Decodo, marking the next chapter in our journey to revolutionize proxy and web scraping solutions. While our name has changed, our commitment to delivering cutting-edge tools remains the same.

Vytautas Savickas

Apr 22, 2025

2 min read

Equip Yourself With Web Scraping API

Ready-to-use powerful scraping API – only at Decodo.

Get started

14-day money-back option