SERP Scraper API for Google, Bing, and AI Search Results

A SERP scraper API* collects search engine results pages from Google, Bing, and other engines and returns them as structured JSON, HTML, or Markdown data. Decodo's Web Data API covers 6 search engines in 195+ locations, backed by 125M+ IPs.

* This scraper is now a part of Decodo's Web Data API.

100+

eady-made templates

99.99%

success rate

200

requests per second

125M+

IPs worldwide

Up to 10K

free requests

Trusted by:

RTMP.IN logo

What is a scraper API?

A SERP API, or SERP scraper API, is a tool that sends a search query to a search engine and returns the results page as parsed data, so you don't run proxies, browsers, or parsers yourself. At Decodo, SERP scraping is part of Decodo's scraping solutions and runs on the Web Data API – a single API key for search results, single pages, and multi-page crawls.

Diagram showing a web data API process: Request, eCommerce scraper API, and Structured data.

What does it do?

It routes each query through Decodo's 125M+ IP proxy network, sets the country, language, and device you choose, renders JavaScript when a results page needs it, and handles CAPTCHAs and retries. You get organic results, ads, and SERP features back as structured data, and you only pay for successful requests.

DECODO web scraping API dashboard showing data usage statistics and a 'Start scraping' button.

How does it work?

You're just a few minutes away from accessing the SERP data:

1. Create your free Decodo account.

2. Activate a free Web Data API starter plan with up to 10K recurring requests or choose a subscription based on your data needs.

2. Select the /search endpoint.

3. Set your parameters, whether it's location, domain, JavaScript rendering, and output format.

4. Receive data in HTML, Markdown, XHR, plus JSON, CSV, PNG where supported.

5. Need the pages behind the results? Send the ranking URLs to /scrape, or /crawl a whole site, on the same API key

No proxy setup, no scraper maintenance, and no custom app development on your side. Complete code examples in Python, PHP, and Node.js are on GitHub, alongside Postman collections and a quick start guide.

Diagram illustrating various components and types of search engine results pages.

What SERP data can you get?

Depending on the search engine you need data from, your pipelines can be enhanced with a range of data points, including:

  • Organic results: Titles, URLs, snippets, and positions
  • Paid ads: Headlines, URLs, display paths, and descriptions
  • Featured snippets and answer boxes
  • People Also Ask questions and answers
  • Local pack and map listings: Names, addresses, phone numbers, and reviews
  • Google AI Mode answers and summaries
  • Sitelinks and related searches
  • Rich results, such as ratings, prices, and event details
  • Top stories and news results
  • Image and video carousels

Why use Decodo's Web Data API as your SERP scraping API?

It replaces the proxies, browsers, parsers, and extra tools you'd otherwise run for search data. Here's how it compares with building your own scraper or using a search-only API.

Attribute

Decodo Web Data API

Build your own scraper

Search-only APIs

Proxy network

125M+ residential, mobile, ISP, and datacenter IPs

Source and rotate proxies yourself

Varies by provider

CAPTCHAs and blocks

Handled with proxy rotation, browser fingerprinting, and retries

Build and maintain your own handling

Varies by provider

JavaScript rendering

Optional, per request

Run and scale headless browsers yourself

Often not configurable

Search engines

Google, Bing, DuckDuckGo, and Baidu

One parser per engine

Often Google-first

Localization

195+ locations, plus language and device

Country proxies set up by hand

Varies by provider

Pages behind the results

Scrape or crawl ranking pages on the same API key

Build a separate crawler

A second tool and API key

Output formats

HTML, Markdown, XHR, plus JSON, CSV, PNG where supported

Whatever you build

Usually JSON

Billing

Pay only for successful requests

Infrastructure costs whether requests succeed or not

Per search or per plan

Maintenance

Decodo updates templates when SERP layouts change

Fix parsers when SERP layouts change

Handled by the provider

Time to first data

Minutes

Days to weeks

Minutes

Web Data API endpoints for every scraping job

One set of credentials for every endpoint. Authenticate once and call /scrape, /map, /crawl, and /search from the same account.

  • A dark search engine window displays text results on a glowing purple background.

    /scrape

    Get fully parsed SERPs

    Turn any search results page into structured data – organic positions, titles, URLs, and snippets without writing or maintaining a parser.

    • Single-page extraction
    • JS rendering & anti-bot handling built in
    • HTML, JSON, Markdown, or XHR, with CSV and PNG for specific targets
  • Glowing dark UI windows for web browser, shopping cart, and notes on a purple grid background.

    /map

    Discover a ranking site's URLs

    Enter the URL of any site that ranks for your keywords and get its full page list in one request, giving you a clear view of a competitor's content footprint.

    • Up to 147K URLs per call
    • Combines links + sitemap
    • Filter by path or domain


  • A dark code editor displays intricate data structures against a vibrant purple grid background.

    /crawl

    Crawl the sites that rank

    Point it at a top-ranking competitor and scrape up to 10K pages automatically, with every link followed for you – ready for content gap and on-page SEO analysis.

    • Up to 10K pages per crawl
    • Automatic retry with JS rendering on failed pages
    • Markdown or HTML output, with callback support when done
  • Digital interface displaying data visualizations and a URL on a dark purple grid background.

    /search

    Get fast organic Google results

    Pull live organic search results for any keyword to track rankings and SERP changes, giving agents up-to-date search context.

    • Google search results on demand
    • Structured, parsed output
    • Same API key as scrape, map, and crawl

Start with up to 10K monthly requests for free

Get your API key

How much does a SERP scraper API cost?

The SERP scraper API is priced per request, and you only pay for successfully delivered results. Failed or blocked requests don't count toward your bill, so your costs track the eCommerce data you actually receive.

10 req/s

$0

/month

Up to 5K crawls or 10K pages scraped

10 req/s

$19

/month

Up to 19K crawls or 38K pages scraped

25 req/s

$49

/month

Up to 65K crawls or 122K pages scraped

50 req/s

$99

/month

Up to 141K crawls or 330K pages scraped

100 req/s

$249

/month

Up to 383K crawls or 1.2M pages scraped

See full pricing details in the documentation.

With each plan, you access:

JavaScript rendering

99.99% success rate

HTML, Markdown, XHR, plus JSON, CSV, PNG where supported

One-click AI integrations

LLM-ready Markdown format

100+ pre-built templates

Single API key for all endpoints

/scrape, /search, /map, /crawl

24/7 tech support

14-day money-back

SSL Secure Payment

Your information is protected by 256-bit SSL

What makes Decodo's SERP scraping solution different?

Every plan includes the full feature set, and you turn on only what each request needs, so you never pay for features you don't use.

Flexible output format

Choose HTML, LLM-ready Markdown, or XHR, plus parsed JSON, CSV, and PNG where supported.

Featured snippets, PAA, and ads parsed

Store and compare SERP features as separate fields, ready for analysis.

Real-time and asynchronous requests

Fetch results synchronously in the same response, or send a task and collect results when they're ready.

Optional JavaScript rendering

Enable JavaScript rendering only when collecting data from dynamic pages.

125M+ IPs

Route requests through 125M+ IPs with dynamic rotation handled for you.

Browser fingerprinting and CAPTCHA handling

Rely on built-in browser fingerprints and automatic CAPTCHA handling to keep requests succeeding on search engines.

Country, language, and device targeting

Check local rankings across 195+ locations by setting location and domain per request.

Automatic retries on failed requests

Skip paying for failures – failed or blocked requests never count toward your bill.

AI integrations

Give AI agents and no-code workflows live search results through the MCP Server, n8n, OpenClaw, LangChain, and more, without custom glue code.

What are the use cases for SERP scraping?

From rank tracking to AI agents, here's what teams do with search data from the Web Data API.

How do I track keyword rankings across countries and devices?

Pull positions for your keywords by country, language, and device, and see ranking changes without checking results by hand. See SERP monitoring.

How do I monitor competitors' search ads?

Collect ad headlines, landing URLs, and placements for the keywords you bid on, and spot new competitor campaigns early.

How do I give an AI agent live web search?

Call /search from your agent or IDE through the MCP server and get current organic Google results, with no separate search API to integrate.

How do I ground a RAG pipeline in current search results?

Search for a topic, then scrape or crawl the pages that rank into clean Markdown for embedding, all on one API key. See RAG use cases

How do I track brand visibility in Google AI Mode?

Collect AI Mode answers and summaries for your key queries, and see when your brand appears in them.

How do I protect my brand in search results?

Find negative results, impersonating ads, and review snippets that rank for your brand name, and act before they spread.

Send your test request in our Playground or create an account to plug Decodo's Web Data API into your tools.

Try an example

What do customers say about Decodo?

Our 135K+ users value Decodo for its performance, precise targeting, ease of use, and responsive support.

Attentive service

The professional expertise of the Decodo solution has significantly boosted our business growth while enhancing overall efficiency and effectiveness.

Easy to get things done

Decodo provides great service with a simple setup and friendly support team.

A key to our work

Decodo enables us to develop and test applications in varied environments while supporting precise data collection for research and audience profiling.

Decodo-best-usability-award-2025-by-G2

Best Usability 2025

Awarded for the ease of use and fastest time to value for proxy and scraping solutions.

Decodo-Highest-User-Adoption-2025-award-by-G2

Best User Adoption 2025

Praised for the seamless onboarding experience and impactful engagement efforts.

Decodo-best-value-by-Proxyway-2025-award

Best Value 2025

Recognized for the 5th year in a row for top-tier proxy and scraping solutions.

Which other Decodo tools work with search data?

Search results are often the first step. These tools cover the pages, platforms, and AI workflows around them, and most run on the same Web Data API key, so your credits and integrations carry across.

Unable to determine image content.

Google Search scraper

Organic results, ads, and SERP features from Google with a dedicated template. Explore Google Search scraper

A green gradient icon depicting a stylized bug or insect.

Bing scraper

Rankings, snippets, and ads from Bing search. Explore Bing scraper

A green and blue gradient shopping cart icon representing online commerce.

eCommerce scraper

Product, price, and review data from 50+ marketplaces. Explore eCommerce scraping

A vibrant green and blue gradient thumbs-up icon representing approval.

Social media scraper

Get structured data from various community forms and social media platforms. Explore social media scraping

Stylized microchip icon with a green to blue gradient, representing technology or processing.

MCP Server

Connect Claude, ChatGPT, and other LLM agents to live product and price data. Listed in GitHub's MCP Registry. Try MCP Server

Pink icon of a browser window with an unlocked padlock, signifying open access.

Site Unblocker

Proxy-based access to protected stores if you'd rather keep your own scraping code. Explore Site Unblocker

Where can you learn more about SERP scraping?

Most recent

JS logo overlaying a glowing blue code snippet on a dark abstract background

JavaScript Web Scraping Tutorial (2026)

Ever wished you could make the web work for you? JavaScript web scraping allows you to gather valuable information from websites in an automated way, unlocking insights that would be difficult to collect manually. In this guide, you'll learn the key tools, techniques, and best practices to scrape data efficiently, whether you're a beginner or a developer looking to streamline data collection.

Most popular

Residential Proxy VS Datacenter Proxy — monitor icon opposite server stack on dark gradient background

Residential vs. Datacenter Proxies: Which Should You Choose?

Two robots placing glowing stars to form a five-star rating against a brick wall

Manage Your Business Reputation with SERP Scraping API

Browser window showing Google search for 'Data' with Dictionary definition, on dark patterned background with teal bug outline

How to Scrape Google Search Data

Unlocked padlock being cut by dashed diagonal line over a browser search-results window on dark blue background

How to Scrape Google Without Getting Blocked

JSON 'results' with 'status_code': 200 and 'url': 'https://example.com' on scraping UI showing 'Start scraping'

How to Scrape Google AI Mode: Methods, Tools, and Best Practices

Python code: import requests; url = "https://scraper-api.decodo.com/v2/scrape"; 'query': 'shoes' — code panel with search bar

How to Scrape Bing Search with Python

How To Build a Rank Tracker

How To Build a Rank Tracker: Manual Checks, Python Automation, and Modern SERP Tracking

Frequently asked questions

How do I start scraping search results for free?

Sign up for the free Web Data API starter plan through the Decodo dashboard. It includes up to 10K monthly requests, and no credit card is required.

How do I get a refund if a paid plan isn't right for me?

Paid plans come with a 14-day money-back option, and you can cancel anytime. Refund conditions are covered in the billing FAQ.

How does a SERP API work?

You send a query with a location, language, and device, and the API returns the results page as structured data. Behind the scenes, it picks a proxy in that location, loads the page, renders JavaScript if needed, handles CAPTCHAs and retries, and parses organic results, ads, and SERP features into JSON. You can get results in the same response or send an asynchronous task and collect them when they're ready.

How do I scrape Google search results?

Send a keyword to the googlesearch_ template with your location and device, and the API returns the parsed results page. Building your own scraper means handling proxies, JavaScript rendering, CAPTCHAs, and parser updates yourself. For a step-by-step walkthrough, see how to scrape Google search results.

Which search engines can I scrape?

Google, Bing, Yahoo, DuckDuckGo, Baidu, and others. Google has dedicated templates for Search, Ads, AI Mode, Lens, News, Hotels, Jobs, Trends, Play, and Autocomplete. Any other search page works through a URL request.

How do I get localized search results for a specific country?

Set the location and language parameters in your request. Decodo routes the query through IPs in that country, across 195+ locations, so you see the results a local user sees. You can also choose desktop or mobile results.

How do I choose between /scrape and /search for SERP data? [/search]

Use /search when you need fast organic Google results, for example, to give an AI agent live web search. Use /scrape when you need the full results page parsed, including ads, local packs, People Also Ask, and other search engines. Both run on the same API key and account, along with /map and /crawl for discovering and scraping the sites that rank.

Do I still need my own proxies if I use a SERP API?

No. SERP scraping with Decodo's Web Data API includes 125M+ residential, mobile, ISP, and datacenter IPs, with rotation handled for you. If you'd rather keep your own scraping code, Site Unblocker gives you proxy-based access instead.

How does the API handle JavaScript-rendered search results?

Turn on JavaScript rendering for any request, and the API loads the results page in a headless browser before parsing it. You pay the JavaScript rate only on requests where you turn it on. Why this matters now – JavaScript is now required for Google Search.

Which SERP API is best for my project?

The best SERP API reaches the search engines and locations you need, returns the SERP features you use, and bills only for results you get. Look for a large proxy network, JavaScript rendering, parsed templates, and pay-per-success pricing. Decodo's Web Data API covers all four with a 99.99% success rate and 100+ ready-made templates, and connects to AI agents through MCP.

How do I use a SERP API with Python?

Install the official Python SDK with pip install decodo-sdk, or send a POST request with your API key, template, and query using the requests library. Either way, you get the parsed JSON back in the response. Copy a ready-made request from the playground above, or find complete code examples in Python, PHP, and Node.js on GitHub, alongside Postman collections and a quick start guide. Product to confirm the SDK supports Web Data API keys at launch.

Is it legal to scrape search engine results?

Collecting publicly available search results is common for SEO, research, and AI, but legality depends on the data, how it's collected, the search engine's terms, and your jurisdiction. Review your use case with legal counsel, and read is web scraping legal? for the key considerations.

Ready to Start Collecting Search Engine Data?

Get structured Google, Bing, and AI Mode results in 195+ locations, without managing proxies or parsers.

© 2018-2026 decodo.com (formerly smartproxy.com). All Rights Reserved