GoogleApi.Dataproc.V1.Model.StageData (google_api_dataproc v0.59.0)

View Source

Data corresponding to a stage.

Attributes

  • accumulatorUpdates (type: list(GoogleApi.Dataproc.V1.Model.AccumulableInfo.t), default: nil) -
  • numActiveTasks (type: integer(), default: nil) -
  • name (type: String.t, default: nil) -
  • rddIds (type: list(String.t), default: nil) -
  • numCompletedIndices (type: integer(), default: nil) -
  • numKilledTasks (type: integer(), default: nil) -
  • completionTime (type: DateTime.t, default: nil) -
  • stageId (type: String.t, default: nil) -
  • firstTaskLaunchedTime (type: DateTime.t, default: nil) -
  • description (type: String.t, default: nil) -
  • numTasks (type: integer(), default: nil) -
  • failureReason (type: String.t, default: nil) -
  • parentStageIds (type: list(String.t), default: nil) -
  • numFailedTasks (type: integer(), default: nil) -
  • peakExecutorMetrics (type: GoogleApi.Dataproc.V1.Model.ExecutorMetrics.t, default: nil) -
  • schedulingPool (type: String.t, default: nil) -
  • resourceProfileId (type: integer(), default: nil) -
  • details (type: String.t, default: nil) -
  • locality (type: map(), default: nil) -
  • tasks (type: %{optional(String.t) => GoogleApi.Dataproc.V1.Model.TaskData.t}, default: nil) -
  • stageMetrics (type: GoogleApi.Dataproc.V1.Model.StageMetrics.t, default: nil) -
  • isShufflePushEnabled (type: boolean(), default: nil) -
  • killedTasksSummary (type: map(), default: nil) -
  • shuffleMergersCount (type: integer(), default: nil) -
  • executorSummary (type: %{optional(String.t) => GoogleApi.Dataproc.V1.Model.ExecutorStageSummary.t}, default: nil) -
  • numCompleteTasks (type: integer(), default: nil) -
  • executorMetricsDistributions (type: GoogleApi.Dataproc.V1.Model.ExecutorMetricsDistributions.t, default: nil) -
  • jobIds (type: list(String.t), default: nil) -
  • taskQuantileMetrics (type: GoogleApi.Dataproc.V1.Model.TaskQuantileMetrics.t, default: nil) - Summary metrics fields. These are included in response only if present in summary_metrics_mask field in request
  • stageAttemptId (type: integer(), default: nil) -
  • status (type: String.t, default: nil) -
  • submissionTime (type: DateTime.t, default: nil) -
  • speculationSummary (type: GoogleApi.Dataproc.V1.Model.SpeculationStageSummary.t, default: nil) -

Summary

Functions

Unwrap a decoded JSON object into its complex fields.

Types

t()

@type t() :: %GoogleApi.Dataproc.V1.Model.StageData{
  accumulatorUpdates: [GoogleApi.Dataproc.V1.Model.AccumulableInfo.t()] | nil,
  completionTime: DateTime.t() | nil,
  description: String.t() | nil,
  details: String.t() | nil,
  executorMetricsDistributions:
    GoogleApi.Dataproc.V1.Model.ExecutorMetricsDistributions.t() | nil,
  executorSummary:
    %{
      optional(String.t()) =>
        GoogleApi.Dataproc.V1.Model.ExecutorStageSummary.t()
    }
    | nil,
  failureReason: String.t() | nil,
  firstTaskLaunchedTime: DateTime.t() | nil,
  isShufflePushEnabled: boolean() | nil,
  jobIds: [String.t()] | nil,
  killedTasksSummary: map() | nil,
  locality: map() | nil,
  name: String.t() | nil,
  numActiveTasks: integer() | nil,
  numCompleteTasks: integer() | nil,
  numCompletedIndices: integer() | nil,
  numFailedTasks: integer() | nil,
  numKilledTasks: integer() | nil,
  numTasks: integer() | nil,
  parentStageIds: [String.t()] | nil,
  peakExecutorMetrics: GoogleApi.Dataproc.V1.Model.ExecutorMetrics.t() | nil,
  rddIds: [String.t()] | nil,
  resourceProfileId: integer() | nil,
  schedulingPool: String.t() | nil,
  shuffleMergersCount: integer() | nil,
  speculationSummary:
    GoogleApi.Dataproc.V1.Model.SpeculationStageSummary.t() | nil,
  stageAttemptId: integer() | nil,
  stageId: String.t() | nil,
  stageMetrics: GoogleApi.Dataproc.V1.Model.StageMetrics.t() | nil,
  status: String.t() | nil,
  submissionTime: DateTime.t() | nil,
  taskQuantileMetrics:
    GoogleApi.Dataproc.V1.Model.TaskQuantileMetrics.t() | nil,
  tasks:
    %{optional(String.t()) => GoogleApi.Dataproc.V1.Model.TaskData.t()} | nil
}

Functions

decode(value, options)

@spec decode(struct(), keyword()) :: struct()

Unwrap a decoded JSON object into its complex fields.