Batch scrape
Batch scrape status
Check a batch scrape and read the finished pages. Send one request and get JSON back. Examples in cURL, TypeScript and Python.
GET
Free.
Pages
Poll untilstatus is completed, then call next until it is gone. Each answer holds up to 100 finished pages. A page’s address is in metadata.url. See Page through results.
failed counts the pages that could not be read. errors lists the failed pages in this answer with url, code, message, retryable and at, and error is set only when the whole job failed. For every failed page, call Batch scrape errors.
Authorizations
Bearer authentication header of the form Bearer <token>, where <token> is your auth token.
Path Parameters
Query Parameters
Cut every text value in the response to this many characters. A value that was cut ends with …, and a page whose text was cut has isTruncated set to true. A screenshot is never cut. Leave it out to get the full text.
Required range:
x >= 1Response
The data, and the credits this call used.
Available options:
scraping, completed, failed, cancelled Required range:
-9007199254740991 <= x <= 9007199254740991Required range:
-9007199254740991 <= x <= 9007199254740991Required range:
-9007199254740991 <= x <= 9007199254740991Required range:
-9007199254740991 <= x <= 9007199254740991