bedrockagent/aws.sdk.kotlin.services.bedrockagent.model/WebCrawlerLimits

WebCrawlerLimits

class WebCrawlerLimits

The rate limits for the URLs that you want to crawl. You should be authorized to crawl the URLs.

Types

Builder

class Builder

Companion

object Companion

Properties

maxPages

val maxPages: Int?

The max number of web pages crawled from your source URLs, up to 25,000 pages. If the web pages exceed this limit, the data source sync will fail and no web pages will be ingested.

rateLimit

val rateLimit: Int?

The max rate at which pages are crawled, up to 300 per minute per host.

Functions

copy

inline fun copy(block: WebCrawlerLimits.Builder.() -> Unit = {}): WebCrawlerLimits

equals

open operator override fun equals(other: Any?): Boolean

hashCode

open override fun hashCode(): Int

toString

open override fun toString(): String