View Source GoogleApi.Dataplex.V1.Model.GoogleCloudDataplexV1MetadataJobImportJobSpec (google_api_dataplex v0.15.0)

Job specification for a metadata import job

Attributes

  • aspectSyncMode (type: String.t, default: nil) - Required. The sync mode for aspects. Only INCREMENTAL mode is supported for aspects. An aspect is modified only if the metadata import file includes a reference to the aspect in the update_mask field and the aspect_keys field.
  • entrySyncMode (type: String.t, default: nil) - Required. The sync mode for entries. Only FULL mode is supported for entries. All entries in the job's scope are modified. If an entry exists in Dataplex but isn't included in the metadata import file, the entry is deleted when you run the metadata job.
  • logLevel (type: String.t, default: nil) - Optional. The level of logs to write to Cloud Logging for this job.Debug-level logs provide highly-detailed information for troubleshooting, but their increased verbosity could incur additional costs (https://cloud.google.com/stackdriver/pricing) that might not be merited for all jobs.If unspecified, defaults to INFO.
  • scope (type: GoogleApi.Dataplex.V1.Model.GoogleCloudDataplexV1MetadataJobImportJobSpecImportJobScope.t, default: nil) - Required. A boundary on the scope of impact that the metadata import job can have.
  • sourceCreateTime (type: DateTime.t, default: nil) - Optional. The time when the process that created the metadata import files began.
  • sourceStorageUri (type: String.t, default: nil) - Optional. The URI of a Cloud Storage bucket or folder (beginning with gs:// and ending with /) that contains the metadata import files for this job.A metadata import file defines the values to set for each of the entries and aspects in a metadata job. For more information about how to create a metadata import file and the file requirements, see Metadata import file (https://cloud.google.com/dataplex/docs/import-metadata#metadata-import-file).You can provide multiple metadata import files in the same metadata job. The bucket or folder must contain at least one metadata import file, in JSON Lines format (either .json or .jsonl file extension).In FULL entry sync mode, don't save the metadata import file in a folder named SOURCE_STORAGE_URI/deletions/.Caution: If the metadata import file contains no data, all entries and aspects that belong to the job's scope are deleted.

Summary

Functions

Unwrap a decoded JSON object into its complex fields.

Types

@type t() ::
  %GoogleApi.Dataplex.V1.Model.GoogleCloudDataplexV1MetadataJobImportJobSpec{
    aspectSyncMode: String.t() | nil,
    entrySyncMode: String.t() | nil,
    logLevel: String.t() | nil,
    scope:
      GoogleApi.Dataplex.V1.Model.GoogleCloudDataplexV1MetadataJobImportJobSpecImportJobScope.t()
      | nil,
    sourceCreateTime: DateTime.t() | nil,
    sourceStorageUri: String.t() | nil
  }

Functions

@spec decode(struct(), keyword()) :: struct()

Unwrap a decoded JSON object into its complex fields.