scrape v3.1.0 Scrape.Tools.URL

Simple utility functions to extract information from URLs.

Link to this section Summary

Transforms a given url into it's basic form, only including protocol scheme and host, without any other things like path, query or hash.

Checks if a given string actually represents an URL.

Rebase an URL to another root URL, useful for turning relative URLs into absolute ones.

base(url)

base(String.t()) :: String.t()

Transforms a given url into it's basic form, only including protocol scheme and host, without any other things like path, query or hash.

iex> URL.base("https://example.com/path?param=1#search")
"https://example.com"

iex> URL.base("//example.com")
"http://example.com"

is_http?(url)

is_http?(String.t()) :: boolean()

Checks if a given string actually represents an URL.

iex> URL.is_http?("http://example.com")
true

iex> URL.is_http?("example")
false

merge(url, root_url)

merge(nil | String.t(), String.t()) :: nil | String.t()

Rebase an URL to another root URL, useful for turning relative URLs into absolute ones.

iex> URL.merge("/path", "http://example.com")
"http://example.com/path"