Skip to main content
Scrape can answer from a stored copy of a page when one is recent enough. maxAge sets how old that copy may be, minAge and lockdown answer only from stored copies, and storeInCache turns storing off. metadata.cacheState tells you which one you got.

Make a request

Get an API key in the Quickstart. This request asks for a live read, so the page is read as it is now.

Read the response

cacheState is miss, which means the page was read live. This real response is cut after the first paragraph.
A read that came from a stored copy says so, and says when the copy was made.

Options

For a page that changes slowly, send "maxAge": 604800000 to accept a week-old copy.

Reads that are always live

These reads are never answered from a stored copy, and they are not saved as one: a call with headers, location.languages, profile, skipTlsVerification, actions, PDF options in parsers, zeroDataRetention, storeInCache: false, or one of the formats screenshot, rawBase64, audio, video, network, branding and changeTracking.

Read a scrape again

Every scrape keeps its answer for 24 hours under its id. GET /v1/scrape/{id} returns it again. It is free and needs the same API key.
The answer is the original one, word for word, so costUsd still shows what the scrape cost. This read adds nothing to your bill.
  • After 24 hours, the id returns 404 notFound with the message No scrape with that id. Results are kept for 24 hours.
  • A scrape sent with zeroDataRetention is not kept, and neither is an answer larger than 4 MB of text.
  • Only the account that sent a scrape can read it again. A scrape sent without an API key is not kept.

Limits and errors

  • maxAge below 0 or not a whole number returns 400 invalidRequest. A value above 30 days is read as 30 days.
  • minAge or lockdown on a page with no stored copy returns 404 notFound with the message Stophy has no stored copy of that page. Remove minAge or lockdown to read the page live.
  • Without an API key, GET /v1/scrape/{id} returns 401 apiKeyRequired.

Price

$1 per 1,000 pages. A stored copy costs the same as a live read. A page that comes back with a 404 or 410 status, or cannot be read, costs nothing.