Crawler

v0.4.0

Crawler v0.4.0 Crawler.Fetcher.UrlFilter

A placeholder module that lets all URLs pass through.

Link to this section Summary

Functions

filter(url, opts)

Whether to pass through a given URL

Link to this section Functions

Link to this function filter(url, opts)

Whether to pass through a given URL.

  • true for letting the url through
  • false for rejecting the url