View Source SpiderMan.Component.Downloader (spider_man v0.6.3)
Download request.
Life cycle of request:
- insert requests to ets of downloader component.
- component's producer get pass out to processes.
- processes handle message.
- handle by pre pipelines.
- call
Requester.request/3
. - handle by post pipelines.
- pass out message.
- if success, pass out to Spider component's ets.
- if failed, maybe try again.