network returns the JSON responses the page loaded while it rendered. Use it to read the data behind a page that fills itself from an API, without parsing the HTML.
Make a request
Get an API key in the Quickstart. This request reads a search page that loads its results from an API.Read the response
data.network is an array in the order the responses arrived. This real response is cut to two of its three entries, and each body to its first characters. The full second body was 20,927 characters.
Options
Use
waitFor or browser actions when the data loads after a click or a delay.
Limits and errors
- Only
fetchandXMLHttpRequestresponses with a JSON content type are kept. Images, scripts and styles are not. - At most 30 responses are returned. A body larger than 256 KB is left out, and the bodies together are capped at 2 MB.
data.networkDroppedcounts the responses left out. It is left out when no response was dropped. - A page that loads no JSON returns no entries.
- The page is read in a browser and never from a stored copy.
Price
$1 per 1,000 pages, the same as any page.network adds nothing.
Related
- Browser actions click and scroll before the page is read.
- Waiting and rendering lets slow requests finish.
- JSON fills fields from the rendered page.
- Scrape overview lists every format.