View Source SpiderMan.Component.Downloader (spider_man v0.6.3)

Download request.

Life cycle of request:

  1. insert requests to ets of downloader component.
  2. component's producer get pass out to processes.
  3. processes handle message.
    1. handle by pre pipelines.
    2. call Requester.request/3.
    3. handle by post pipelines.
  4. pass out message.
    1. if success, pass out to Spider component's ets.
    2. if failed, maybe try again.

Summary

Functions

start_link(options)