GoogleApi.Dataproc.V1.Model.OrderedJob (google_api_dataproc v0.48.0) View Source

A job executed by the workflow.

Attributes

  • hadoopJob (type: GoogleApi.Dataproc.V1.Model.HadoopJob.t, default: nil) - Optional. Job is a Hadoop job.
  • hiveJob (type: GoogleApi.Dataproc.V1.Model.HiveJob.t, default: nil) - Optional. Job is a Hive job.
  • labels (type: map(), default: nil) - Optional. The labels to associate with this job.Label keys must be between 1 and 63 characters long, and must conform to the following regular expression: \p{Ll}\p{Lo}{0,62}Label values must be between 1 and 63 characters long, and must conform to the following regular expression: \p{Ll}\p{Lo}\p{N}_-{0,63}No more than 32 labels can be associated with a given job.
  • pigJob (type: GoogleApi.Dataproc.V1.Model.PigJob.t, default: nil) - Optional. Job is a Pig job.
  • prerequisiteStepIds (type: list(String.t), default: nil) - Optional. The optional list of prerequisite job step_ids. If not specified, the job will start at the beginning of workflow.
  • prestoJob (type: GoogleApi.Dataproc.V1.Model.PrestoJob.t, default: nil) - Optional. Job is a Presto job.
  • pysparkJob (type: GoogleApi.Dataproc.V1.Model.PySparkJob.t, default: nil) - Optional. Job is a PySpark job.
  • scheduling (type: GoogleApi.Dataproc.V1.Model.JobScheduling.t, default: nil) - Optional. Job scheduling configuration.
  • sparkJob (type: GoogleApi.Dataproc.V1.Model.SparkJob.t, default: nil) - Optional. Job is a Spark job.
  • sparkRJob (type: GoogleApi.Dataproc.V1.Model.SparkRJob.t, default: nil) - Optional. Job is a SparkR job.
  • sparkSqlJob (type: GoogleApi.Dataproc.V1.Model.SparkSqlJob.t, default: nil) - Optional. Job is a SparkSql job.
  • stepId (type: String.t, default: nil) - Required. The step id. The id must be unique among all jobs within the template.The step id is used as prefix for job id, as job goog-dataproc-workflow-step-id label, and in prerequisiteStepIds field from other steps.The id must contain only letters (a-z, A-Z), numbers (0-9), underscores (_), and hyphens (-). Cannot begin or end with underscore or hyphen. Must consist of between 3 and 50 characters.

Link to this section Summary

Functions

Unwrap a decoded JSON object into its complex fields.

Link to this section Types

Specs

t() :: %GoogleApi.Dataproc.V1.Model.OrderedJob{
  hadoopJob: GoogleApi.Dataproc.V1.Model.HadoopJob.t() | nil,
  hiveJob: GoogleApi.Dataproc.V1.Model.HiveJob.t() | nil,
  labels: map() | nil,
  pigJob: GoogleApi.Dataproc.V1.Model.PigJob.t() | nil,
  prerequisiteStepIds: [String.t()] | nil,
  prestoJob: GoogleApi.Dataproc.V1.Model.PrestoJob.t() | nil,
  pysparkJob: GoogleApi.Dataproc.V1.Model.PySparkJob.t() | nil,
  scheduling: GoogleApi.Dataproc.V1.Model.JobScheduling.t() | nil,
  sparkJob: GoogleApi.Dataproc.V1.Model.SparkJob.t() | nil,
  sparkRJob: GoogleApi.Dataproc.V1.Model.SparkRJob.t() | nil,
  sparkSqlJob: GoogleApi.Dataproc.V1.Model.SparkSqlJob.t() | nil,
  stepId: String.t() | nil
}

Link to this section Functions

Specs

decode(struct(), keyword()) :: struct()

Unwrap a decoded JSON object into its complex fields.