Crawly.Request (Crawly v0.17.0) View Source

t() :: %Crawly.Request{
  headers: [header()],
  middlewares: [atom()],
  options: [option()],
  prev_response: %{},
  retries: non_neg_integer(),
  url: url()
}

url()

Specs

url() :: binary()

Link to this section Functions

new(url, headers \\ [], options \\ [])

Specs

new(url, headers, options) :: request
when url: binary(), headers: [term()], options: [term()], request: t()

Create new Crawly.Request from url, headers and options

new(url, headers, options, middlewares)

Specs

new(url, headers, options, middlewares) :: request
when url: binary(),
     headers: [term()],
     options: [term()],
     middlewares: [term()],
     request: t()

Same as Crawly.Request.new/3 from but allows to specify middlewares as the 4th parameter.