Module treewalker_scraper

Scrap the page for useful data and links.

Copyright © 2020 Antoine Gagné

This module defines the treewalker_scraper behaviour.
Required callback functions: scrap/3, scrap_links/3.

Authors: Antoine Gagné (gagnantoine@gmail.com).

Description

Scrap the page for useful data and links.

Data Types

content()

content() = treewalker_page:content()

options()

options() = term()

page_data()

page_data() = binary()

url()

url() = treewalker_page:url()

Function Index

scrap/3
scrap_links/3

Function Details

scrap/3

scrap(Url::url(), PageData::page_data(), ScrappingOptions::options()) -> {ok, content()}

scrap_links/3

scrap_links(Url::url(), PageData::page_data(), ScrappingOptions::options()) -> {ok, [url()]} | {error, term()}


Generated by EDoc