google_api_dataproc

v0.6.0

google_api_dataproc v0.6.0 GoogleApi.Dataproc.V1.Model.PigJob View Source

A Cloud Dataproc job for running Apache Pig (https://pig.apache.org/) queries on YARN.

Attributes

  • continueOnFailure (boolean()): Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries. Defaults to: null.
  • jarFileUris ([String.t]): Optional. HCFS URIs of jar files to add to the CLASSPATH of the Pig Client and Hadoop MapReduce (MR) tasks. Can contain Pig UDFs. Defaults to: null.
  • loggingConfig (LoggingConfig): Optional. The runtime log config for job execution. Defaults to: null.
  • properties (%{optional(String.t) => String.t}): Optional. A mapping of property names to values, used to configure Pig. Properties that conflict with values set by the Cloud Dataproc API may be overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/pig/conf/pig.properties, and classes in user code. Defaults to: null.
  • queryFileUri (String.t): The HCFS URI of the script that contains the Pig queries. Defaults to: null.
  • queryList (QueryList): A list of queries. Defaults to: null.
  • scriptVariables (%{optional(String.t) => String.t}): Optional. Mapping of query variable names to values (equivalent to the Pig command: name=[value]). Defaults to: null.

Link to this section Summary

Types

t()

Functions

decode(value, options)

Unwrap a decoded JSON object into its complex fields.

Link to this section Types

Link to this type

t() View Source 
t() :: %GoogleApi.Dataproc.V1.Model.PigJob{
  continueOnFailure: any(),
  jarFileUris: [any()],
  loggingConfig: GoogleApi.Dataproc.V1.Model.LoggingConfig.t(),
  properties: map(),
  queryFileUri: any(),
  queryList: GoogleApi.Dataproc.V1.Model.QueryList.t(),
  scriptVariables: map()
}

Link to this section Functions

Link to this function

decode(value, options) View Source 
decode(struct(), keyword()) :: struct()

Unwrap a decoded JSON object into its complex fields.