Builder

class Builder

Properties

Link copied to clipboard

The max number of web pages crawled from your source URLs, up to 25,000 pages. If the web pages exceed this limit, the data source sync will fail and no web pages will be ingested.

Link copied to clipboard

The max rate at which pages are crawled, up to 300 per minute per host.