Crawl
Describe a crawl
Turn a plain-language crawl request into the options crawl takes, without starting one. Send one request and get JSON back.
POST
Best to see what a crawl would do before starting it. Send the site’s address and what you want, such as only the blog posts from this year. The answer holds the options to pass to crawl. A call that finds nothing to set is free.