Interface

CrawlerOptions

CrawlerOptions

Options to initialize crawler instance or create new instance.

View Source index.ts, line 106

Members

AttempRule

# attempts Optional

Attempt rule for plugin-retry(default: 0).

View Source index.ts, line 128

number

# concurrency Optional

Set concurrency limit(default:5)

View Source index.ts, line 110

object

# filters Optional

Register filter-functions for plugin-parse.

View Source index.ts, line 122

AgentOptions

# got Optional

Passed to got. See got.

View Source index.ts, line 116