View Source GoogleApi.Dataproc.V1.Model.PigJob (google_api_dataproc v0.54.0)
A Dataproc job for running Apache Pig (https://pig.apache.org/) queries on YARN.
Attributes
-
continueOnFailure
(type:boolean()
, default:nil
) - Optional. Whether to continue executing queries if a query fails. The default value is false. Setting to true can be useful when executing independent parallel queries. -
jarFileUris
(type:list(String.t)
, default:nil
) - Optional. HCFS URIs of jar files to add to the CLASSPATH of the Pig Client and Hadoop MapReduce (MR) tasks. Can contain Pig UDFs. -
loggingConfig
(type:GoogleApi.Dataproc.V1.Model.LoggingConfig.t
, default:nil
) - Optional. The runtime log config for job execution. -
properties
(type:map()
, default:nil
) - Optional. A mapping of property names to values, used to configure Pig. Properties that conflict with values set by the Dataproc API might be overwritten. Can include properties set in /etc/hadoop/conf/*-site.xml, /etc/pig/conf/pig.properties, and classes in user code. -
queryFileUri
(type:String.t
, default:nil
) - The HCFS URI of the script that contains the Pig queries. -
queryList
(type:GoogleApi.Dataproc.V1.Model.QueryList.t
, default:nil
) - A list of queries. -
scriptVariables
(type:map()
, default:nil
) - Optional. Mapping of query variable names to values (equivalent to the Pig command: name=[value]).
Summary
Functions
Unwrap a decoded JSON object into its complex fields.
Types
@type t() :: %GoogleApi.Dataproc.V1.Model.PigJob{ continueOnFailure: boolean() | nil, jarFileUris: [String.t()] | nil, loggingConfig: GoogleApi.Dataproc.V1.Model.LoggingConfig.t() | nil, properties: map() | nil, queryFileUri: String.t() | nil, queryList: GoogleApi.Dataproc.V1.Model.QueryList.t() | nil, scriptVariables: map() | nil }
Functions
Unwrap a decoded JSON object into its complex fields.