google_api_dataproc

v0.6.0

google_api_dataproc v0.6.0 GoogleApi.Dataproc.V1.Model.SparkSqlJob View Source

A Cloud Dataproc job for running Apache Spark SQL (http://spark.apache.org/sql/) queries.

Attributes

  • jarFileUris ([String.t]): Optional. HCFS URIs of jar files to be added to the Spark CLASSPATH. Defaults to: null.
  • loggingConfig (LoggingConfig): Optional. The runtime log config for job execution. Defaults to: null.
  • properties (%{optional(String.t) => String.t}): Optional. A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Cloud Dataproc API may be overwritten. Defaults to: null.
  • queryFileUri (String.t): The HCFS URI of the script that contains SQL queries. Defaults to: null.
  • queryList (QueryList): A list of queries. Defaults to: null.
  • scriptVariables (%{optional(String.t) => String.t}): Optional. Mapping of query variable names to values (equivalent to the Spark SQL command: SET name="value";). Defaults to: null.

Link to this section Summary

Types

t()

Functions

decode(value, options)

Unwrap a decoded JSON object into its complex fields.

Link to this section Types

Link to this type

t() View Source 
t() :: %GoogleApi.Dataproc.V1.Model.SparkSqlJob{
  jarFileUris: [any()],
  loggingConfig: GoogleApi.Dataproc.V1.Model.LoggingConfig.t(),
  properties: map(),
  queryFileUri: any(),
  queryList: GoogleApi.Dataproc.V1.Model.QueryList.t(),
  scriptVariables: map()
}

Link to this section Functions

Link to this function

decode(value, options) View Source 
decode(struct(), keyword()) :: struct()

Unwrap a decoded JSON object into its complex fields.