View Source GoogleApi.ContentWarehouse.V1.Model.TrawlerPolicyData (google_api_content_warehouse v0.3.0)

Trawler can add a policy label to a FetchReply. The two main cases are: - "spam" label added for specific spammer IPs listed in trawler_site_info, which most crawls auto-reject. - "roboted:useragent" (e.g. "roboted:googlebot") if InfoOnlyUserAgents field is set in FetchParams

Attributes

  • ExtraData (type: integer(), default: nil) - in roboted case, the RobotsInfo
  • Label (type: String.t, default: nil) - "spam" or "roboted:googlebot"

Summary

Types

t()

Functions

decode(value, options)

Unwrap a decoded JSON object into its complex fields.

Types

Link to this type

t()

View Source 
@type t() :: %GoogleApi.ContentWarehouse.V1.Model.TrawlerPolicyData{
  ExtraData: integer() | nil,
  Label: String.t() | nil
}

Functions

Link to this function

decode(value, options)

View Source 
@spec decode(struct(), keyword()) :: struct()

Unwrap a decoded JSON object into its complex fields.