maxAge sets how old that copy may be, minAge and lockdown answer only from stored copies, and storeInCache turns storing off. metadata.cacheState tells you which one you got.
Make a request
Get an API key in the Quickstart. This request asks for a live read, so the page is read as it is now.Read the response
cacheState is miss, which means the page was read live. This real response is cut after the first paragraph.
Options
For a page that changes slowly, send
"maxAge": 604800000 to accept a week-old copy.
Reads that are always live
These reads are never answered from a stored copy, and they are not saved as one: a call withheaders, location.languages, profile, skipTlsVerification, actions, PDF options in parsers, zeroDataRetention, storeInCache: false, or one of the formats screenshot, rawBase64, audio, video, network, branding and changeTracking.
Read a scrape again
Every scrape keeps its answer for 24 hours under itsid. GET /v1/scrape/{id} returns it again. It is free and needs the same API key.
costUsd still shows what the scrape cost. This read adds nothing to your bill.
- After 24 hours, the
idreturns404 notFoundwith the messageNo scrape with that id. Results are kept for 24 hours. - A scrape sent with
zeroDataRetentionis not kept, and neither is an answer larger than 4 MB of text. - Only the account that sent a scrape can read it again. A scrape sent without an API key is not kept.
Limits and errors
maxAgebelow 0 or not a whole number returns400 invalidRequest. A value above 30 days is read as 30 days.minAgeorlockdownon a page with no stored copy returns404 notFoundwith the messageStophy has no stored copy of that page. Remove minAge or lockdown to read the page live.- Without an API key,
GET /v1/scrape/{id}returns401 apiKeyRequired.
Price
$1 per 1,000 pages. A stored copy costs the same as a live read. A page that comes back with a 404 or 410 status, or cannot be read, costs nothing.Related
- Change tracking compares a page with your last read.
- Safety uses
lockdownto answer only from stored pages. - Page metadata lists
cacheStateandcachedAt. - Monitors read a page on a schedule.