Crawler.Store (Crawler v1.1.2) View Source
An internal data store for information related to each crawl.
Link to this section Summary
Functions
Adds a URL to the registry.
Adds the page data for a URL to the registry.
Finds a stored URL and returns its page data.
Finds a stored URL and returns its page data only if it's processed.
Marks a URL as processed in the registry.
Link to this section Functions
Adds a URL to the registry.
Adds the page data for a URL to the registry.
Finds a stored URL and returns its page data.
Finds a stored URL and returns its page data only if it's processed.
Initialises a new Registry named Crawler.Store.DB.
Marks a URL as processed in the registry.