Crawler

View Source Crawler.Parser.Spec behaviour (Crawler v1.5.0)

Spec for defining a parser.

Summary

Types

body()
opts()
page()
url()

Callbacks

parse(page)

Types

Link to this type

body()

View Source 
@type body() :: String.t()
Link to this type

opts()

View Source 
@type opts() :: map()
Link to this type

page()

View Source 
@type page() :: %Crawler.Store.Page{
  body: body(),
  opts: opts(),
  processed: term(),
  url: url()
}
Link to this type

url()

View Source 
@type url() :: String.t()

Callbacks

Link to this callback

parse(page)

View Source 
@callback parse(page()) :: {:ok, page()}
@callback parse({:error, term()}) :: :ok