Get Started With Web Scraping API

Collect HTML, JSON, CSV, or Markdown data at scale with our universal scraper – built to handle blocks, bypass CAPTCHAs, and manage proxies for you. Learn to use Web Scraping API with our quick start guide.

14-day money-back option

200

requests per second

100+

ready-made templates

99.99%

success rate

195+

locations worldwide

Free

starter plan

What is Web Scraping API?

Our Web Scraping API is an all-in-one data collection solution for eCommerce marketplaces, search engine results pages, social media platforms, and various other websites. It combines a vast pool of proxies, an advanced web scraper, and a data parser.

Public data collection

Effortlessly gather real-time public data for analysis or easy integration into your projects.

Travel fare aggregation

Collect relevant pricing data to get the best deals for hotels, flights, and car rentals.

Fraud protection

Detect malicious websites and prevent fraud from global locations by scanning scraped HTML data.

How to set up Web Scraping API

Get started with your Web Scraping API configuration by following our guide.

Choose a subscription

Create an account on the Decodo dashboard.

On the left-side panel, select Scraping APIs menu and choose Pricing.

Select a subscription plan that suits your needs.

Authenticate via username:password or token

If you want to integrate Web Scraping API in your environment, you can copy your credentials on the dashboard.

In the Scraper tab, click your username, password, or authorization token to copy it. Use the buttons to reveal credentials or generate a new password.

Create a request command

In the Scraper tab, you can use the universal Web target to enter any search URL, or select a ready-made scraper template from the menu.

When using the Web target, you can check the Markdown box in the parameters to receive the response in Markdown format.

When using a template, choose a target, then enter the URL or query you want to scrape. If needed, select the relevant parameters. More parameter options are listed in our help documentation.

In the top-right corner, select cURL, Node.js, or Python, and click Copy request in the bottom-right corner to copy the command for use in your environment.

Alternatively, click Send Request to run it directly. Once the task is complete, the response will appear on the screen.

4-web-Response.png

Copy or download the result

After sending a request in the dashboard, you can copy or download the response in HTML, JSON, or CSV format by clicking the Export in the bottom-right corner.

5-web-Statistics.png

Track scraping usage

To track your scraping API usage, navigate to the Usage statistics tab. There, you’ll find traffic usage details over a selected timeframe.

Easy to integrate scraper

Our Web Scraping API works with all popular programming languages, ensuring a smooth connection to other tools in your business suite.

import requests
url = "https://scraper-api.decodo.com/v2/scrape"
payload = {
"url": "https://ip.decodo.com",
"headless": "html"
}
headers = {
"accept": "application/json",
"content-type": "application/json",
"authorization": "Basic [YOUR_BASE64_ENCODED_CREDENTIALS]"
}
response = requests.post(url, json=payload, headers=headers)
print(response.text)

Free tools, same great user-friendliness

X-Browser-icon

X Browser

Juggling multiple profiles has never been easier. Get unique fingerprints and use as many browsers as you need, risk-free!

Firefox-proxy-extension-tools-icon

Chrome Browser Extension

Easy-to-use, damn powerful. A proxy wonderland in your browser, accessible in 2 clicks. Free of charge.

Firefox Browser Add-on

Easy to set up, even easier to use. The virtual world at your fingertips in 2 clicks. Free of charge.

Proxy-Checker-icon

Proxy Checker

Verify your IPs with free Proxy Checker. Quickly & efficiently check your IPs to avoid potential errors.

Decodo blog

Most recent

NEW
NEWS

A New Chapter for Decodo: Vaidotas Juknys Steps Up as CEO

Decodo has a new CEO. Vaidotas Juknys, previously our Chief Commercial Officer, is stepping up to lead the company forward. Vytautas Savickas, who built Decodo into one of the most recognized names in the proxy and web data collection space, is moving to new ventures. Here’s what this means for our clients, our product, and our future.

Most popular

curl://

How to Send a cURL GET Request

Puppeteer Bypass CAPTCHA

How to Bypass CAPTCHA With Puppeteer: A Step-By-Step Guide

Using Proxies and Scraping Solutions to Monitor Pricing, Trends, and Competitors

Staying Ahead of the Curve: Using Proxies and Scraping Solutions to Monitor Pricing, Trends, and Competitors

Google Sheets Web Scraping An Ultimate Guide for 2024

Google Sheets Web Scraping: An Ultimate Guide for 2026

Equip Yourself With Web Scraping API

Ready-to-use powerful scraping API – only at Decodo.

14-day money-back option

© 2018-2026 decodo.com (formerly smartproxy.com). All Rights Reserved