Interface

X

X

Use x to do everything! x is a function to enqueue a Task(or url string in spawner mode) with optional TaskMeta.

 const x = require('crawlx').default;
 const x_my = x.create({concurrency:1});
 x_my({url:"https://www.google.com", parse:"title"})

View Source index.ts, line 17

Members

Agent

# agent

Got agent.

View Source index.ts, line 43

AgentOptions

# agentOptions

Got agent's options

View Source index.ts, line 49

Crawler

# crawler

Access to crawler instance.

View Source index.ts, line 38

function

# create

Create a new instace by merging options.

View Source index.ts, line 33

function

# spawner

Register a spawner

View Source index.ts, line 65

object

# store

Storage object for the crawler.

View Source index.ts, line 54

function

# use

Register a plugin.

View Source index.ts, line 59