Free web scraping API Give it a URL. Get back what you need.

A free web scraping API. Any page as HTML, text, markdown or JSON — and for Amazon and a few other sites, an endpoint that already did the parsing. When a site fights back, you ask and I build it.

Get a free key See the site endpoints

50,000 credits a day · no card · HTML · text · markdown · JSON
Stored site answers come back in milliseconds, for 0 credits.
Built and run by one person. Says so.

Try a sample · real responses, replayed

webscrapingapi.dev is a free web scraping API for developers and AI agents. It fetches any public page as HTML, text or markdown, extracts JSON with CSS selectors, reads page metadata, and offers ready-made JSON endpoints for sites it already knows. When a site can't be scraped with a plain request, you ask on the board and an endpoint gets built, or you're told why it can't be.

Sign in, make a key. Google or email. Shown once, starts with wsa_.

Send a URL or an ID. /v1/scrape for any page, /v1/structured/… for a known site.

Use the JSON. 50,000 credits a day, 60 requests a minute, 5 keys. Errors are a code and a sentence.

§ 01 — Site endpoints

Amazon, and the sites people fight with. Already parsed.

One ID in, one JSON out. Same key, one credit, stored and shared so the second person asking pays nothing. Pick a site to see exactly how it's called.

Request another site

NEXT, IF ASKED

eBay itemIMDb titleUSPS tracking[your site]

Amazon product

GET /v1/structured/amazon/product

Title, price, availability, rating, images and the spec table for one product. Same field names as every other shop endpoint, with Amazon-only bits in extra.

Full spec →

Request

curl "https://api.webscrapingapi.dev/v1/structured/amazon/product?asin=B0B44XTV71&tld=com&currency=USD" \
  -H "X-API-Key: wsa_your_key"

Parameters

asinThe 10-character Amazon product id. Required.

tldMarketplace: com, co.uk, de, fr, it, es, ca, co.jp, in, com.au, com.mx, com.br, nl, ae, sa, se, pl. Default com.

currencyISO 4217 code for prices, e.g. USD, EUR, JPY. Default USD.

max_ageAccept a stored copy up to this many seconds old (credits: 0). Defaults to 86400 (24 h); 0 forces a fresh fetch.

Response

{

"site": "amazon",

"action": "product",

"data": {

"product": {

"name": "CUCKOO Twin Pressure Rice Cooker, 12-Cup, White",

"brand": { "name": "CUCKOO", "url": null },

"price": "339.99",

"currency": "USD",

"availability": "InStock",

"aggregateRating": { "ratingValue": "4.4", "reviewCount": 608 },

"images": [ "https://m.media-amazon.com/images/I/…jpg" ],

"features": [ "…", "…" ],

"sku": "B0B44XTV71"

"extra": { "asin": "B0B44XTV71", "tld": "com" }

"source": "cache", "age": 412, "credits": 0

}

Cached 24 h and shared: the first caller pays, everyone after pays 0 until it expires. Currency and language are set by cookie, not by IP. Amazon is reachable only some of the time from cloud IPs; a blocked fetch answers SITE_BLOCKED and is not charged.

YouTube video

GET /v1/structured/youtube/video

Everything on a watch page that is not the player: title, channel, views, likes, length, date, description, thumbnails. No API key from Google needed.

Full spec →

Request

curl "https://api.webscrapingapi.dev/v1/structured/youtube/video?id=dQw4w9WgXcQ" \
  -H "X-API-Key: wsa_your_key"

Parameters

idThe 11-character video id (the v= parameter). Required.

max_ageAccept a stored copy up to this many seconds old (credits: 0). Defaults to 3600 (1 h); 0 forces a fresh fetch.

Response

{

"site": "youtube",

"action": "video",

"data": {

"video": {

"id": "dQw4w9WgXcQ",

"title": "Rick Astley - Never Gonna Give You Up (Official Video) (4K Remaster)",

"channel": { "id": "UCuAXFkgsw1L7xaCfnd5JJOw", "name": "Rick Astley", "url": "http://www.youtube.com/@RickAstleyYT" },

"durationSeconds": 213,

"viewCount": 1818228078,

"likeCount": 19384777,

"publishedAt": "2009-10-24T23:57:33-07:00",

"category": "Music",

"thumbnails": [ { "url": "https://i.ytimg.com/vi/dQw4w9WgXcQ/maxresdefault.jpg", "width": 1280, "height": 720 } ],

"keywords": [ "rick astley", "Never Gonna Give You Up", … ]

}

"source": "live", "age": 0, "credits": 1

}

Cached 1 h. Counts are what the page shows at fetch time. Age-restricted and private videos are not reachable.

App Store app

GET /v1/structured/appstore/app

The App Store listing without the App Store: name, developer, rating and count, price, category, icon, screenshots, OS requirement.

Full spec →

Request

curl "https://api.webscrapingapi.dev/v1/structured/appstore/app?id=284882215&country=us" \
  -H "X-API-Key: wsa_your_key"

Parameters

idThe numeric app id (the id… part of the URL). Required.

countryStorefront country code. Default us.

max_ageAccept a stored copy up to this many seconds old (credits: 0). Defaults to 86400 (24 h); 0 forces a fresh fetch.

Response

{

"site": "appstore",

"action": "app",

"data": {

"app": {

"name": "Facebook",

"platform": "ios",

"id": "284882215",

"developer": { "name": "Meta Platforms, Inc.", "url": "https://apps.apple.com/us/developer/…" },

"category": "Social Networking",

"price": "0", "currency": "USD", "free": true,

"rating": { "value": 4.5, "count": 28420068 },

"icon": "https://is1-ssl.mzstatic.com/image/thumb/…png",

"osRequirement": "Requires iOS 15.1 or later."

}

"source": "live", "age": 0, "credits": 1

}

Cached 24 h. Storefront defaults to us; pass country for another store. Same schema as Google Play, so one client handles both.

Google Play app

GET /v1/structured/googleplay/app

The Play listing as JSON, including the install count band ("1B+") that has no official API. Same schema as the App Store endpoint.

Full spec →

Request

curl "https://api.webscrapingapi.dev/v1/structured/googleplay/app?id=com.spotify.music&hl=en&gl=US" \
  -H "X-API-Key: wsa_your_key"

Parameters

idThe package name (the id= parameter). Required.

hlLanguage, e.g. en, ko. Default en.

glCountry, e.g. US, KR. Default US.

max_ageAccept a stored copy up to this many seconds old (credits: 0). Defaults to 86400 (24 h); 0 forces a fresh fetch.

Response

{

"site": "googleplay",

"action": "app",

"data": {

"app": {

"name": "Spotify: Music and Podcasts",

"platform": "android",

"id": "com.spotify.music",

"developer": { "name": "Spotify AB", "url": "https://www.spotify.com" },

"category": "MUSIC_AND_AUDIO",

"price": "0", "currency": "USD", "free": true,

"rating": { "value": 4.35, "count": 36339801 },

"installs": "1B+",

"contentRating": "Teen",

"updatedAt": "Sep 18, 2026"

}

"source": "live", "age": 0, "credits": 1

}

Cached 24 h. Language defaults to en and country to US; pass hl and gl for others.

Hacker News

GET /v1/structured/hackernews/front

Front page stories in rank order, or one thread with its comments flattened and a depth on each.

Full spec →

Request

curl "https://api.webscrapingapi.dev/v1/structured/hackernews/front?page=1" \
  -H "X-API-Key: wsa_your_key"

Parameters

pagePage number (1-based).

max_ageAccept a stored copy up to this many seconds old (credits: 0). Defaults to 600 (10 min); 0 forces a fresh fetch.

/itemItem thread: A story with its comment thread (flattened, with depth). spec

Response

{

"site": "hackernews",

"action": "front",

"data": {

"count": 30,

"stories": [

{

"rank": 1,

"title": "Samsung is expected to more than double …",

"points": 125,

"commentCount": 84

// 29 more

]

"source": "live", "age": 0, "credits": 1

}

Cached 10 minutes — the front page is about freshness. /item returns the story plus comments[] with depth, so you can rebuild the tree or just read it flat.

Wikipedia

GET /v1/structured/wikipedia/summary

The lead section of an article, its thumbnail and the infobox as key/value pairs, in any language edition.

Full spec →

Request

curl "https://api.webscrapingapi.dev/v1/structured/wikipedia/summary?title=Web%20scraping&lang=en" \
  -H "X-API-Key: wsa_your_key"

Parameters

titleArticle title (spaces or underscores). Required.

langLanguage edition (default en).

max_ageAccept a stored copy up to this many seconds old (credits: 0). Defaults to 604800 (7 days); 0 forces a fresh fetch.

Response

{

"site": "wikipedia",

"action": "summary",

"data": {

"title": "Web scraping",

"lang": "en",

"summary": "Web scraping, web harvesting, or web data extraction is data scraping …",

"paragraphs": [ "…", "…", "…", "…", "…" ],

"infobox": {}

"source": "cache", "age": 3120, "credits": 0

}

Cached 7 days. Reference marks and edit links are stripped; paragraphs come back as plain text ready for a model.

GitHub

GET /v1/structured/github/repo

Stars, forks, watchers, topics, license and description from the public page. No token, no API rate limit.

Full spec →

Request

curl "https://api.webscrapingapi.dev/v1/structured/github/repo?owner=withastro&repo=astro" \
  -H "X-API-Key: wsa_your_key"

Parameters

ownerOwner login. Required.

repoRepository name. Required.

max_ageAccept a stored copy up to this many seconds old (credits: 0). Defaults to 3600 (1 h); 0 forces a fresh fetch.

Response

{

"site": "github",

"action": "repo",

"data": {

"owner": "withastro",

"repo": "astro",

"description": "The web framework for content-driven websites.",

"stars": 62720,

"forks": 3798,

"watchers": 221,

"topics": [ "astro", "blog", "islands", … ],

"license": "Other",

"defaultBranch": "main",

"releaseCount": 3251,

"homepage": "https://astro.build"

"source": "live", "age": 0, "credits": 1

}

Cached 1 hour. Counts are what GitHub renders on the page, so they are as fresh as the page itself. The primary language is no longer in the server-rendered page, so it is usually null.

§ 02 — Everything else, in one screen

Any page. Six ways to ask.

Fetch. HTML, text or markdown with real browser headers. 1 credit.
Render. render=true runs the JavaScript first. 5 credits.
Extract. CSS selectors in, JSON out. Attributes, lists, nested.
Metadata. Title, description, OG, JSON-LD from the head only.
Stored. Site endpoints remember answers and say their age. Repeats cost 0; max_age=0 fetches fresh.
Safe. Private networks blocked, 5 MB cap, 30 s timeout, raw pages never kept.

The complete reference lives in the docs, and a playground in the dashboard once you sign in. This page is the short version.

§ 03 — Requests, live

Can't get through? Ask. It gets built.

Post the site you need. I check it, build an endpoint when it can be done, and say so when it can't. Public or private, free either way. Every request ends as Done or Not possible, and you can see which.

Request a site

Requested Reviewing Building DoneorNot possible

Post the site. URL or pattern, e.g. amazon.com/dp/<asin>. Public or private.

It gets tried. Anti-bot sites may work only some of the time; you get told, not sold.

You get an endpoint. It takes only the part that changes. Private stays private.

StatusRequestResult

No requests yet. The first one starts the queue. Post a site →

Live from the board · public requests only · see all

Which site do you need?Post request

“I kept rewriting the same fetch-and-parse code for side projects, so I built the one I wanted and left it free. It's capped so it can stay that way.”
— Jaeyoung

§ 04 — Plain answers

Four questions people actually ask.

Is it really free?

Yes. 50,000 credits a day per account, no card, no trial that ends. The cap is what keeps it free.

Does it get past anti-bot systems?

Real browser headers and headless Chrome cover most sites. No CAPTCHA solving, no bypass of dedicated bot vendors, and it will not pretend otherwise.

How fresh is a site endpoint's data?

Results are stored and shared; every response says its source and age. A stored answer costs 0 credits. Pass max_age=0 to fetch fresh for 1 credit.

Sync or async?

Synchronous today: the answer comes back in the response, usually within a few seconds. Job ids and webhooks for batches are next, on the same endpoints.

Start with a URL.

Get a free key