Database |> Language |> Keywords |>
CRAWL
You may be interested in not just querying from an individual page (even after specific interactions) but surveying for information available throughout the page’s sitemap; the CRAWL keyword is helpful for that.
CRAWL url
This returns a table containing four columns:
URL- a URL contained in the sitemapTYPE- the expected type of content stored at URLONSITE- whether the link picked up is stored onsite or one step offCRAWLED- whether or not the URL was successfully handled when crawling (applies to onsite links)
Note: For non-enterprise users, the CRAWL is limited to about 50 pages.
