Crawler v1.1.2

Crawler.Fetcher.UrlFilter (Crawler v1.1.2) View Source

A placeholder module that lets all URLs pass through.

Link to this section Summary

Functions

filter(url, opts)

Whether to pass through a given URL.

Link to this section Functions

Link to this function

filter(url, opts)

View Source

Whether to pass through a given URL.

  • true for letting the url through
  • false for rejecting the url