The cluster config.

Attributes

• configBucket (String.t): Optional. A Google Cloud Storage bucket used to stage job dependencies, config files, and job driver console output. If you do not specify a staging bucket, Cloud Dataproc will determine a Cloud Storage location (US, ASIA, or EU) for your cluster's staging bucket according to the Google Compute Engine zone where your cluster is deployed, and then create and manage this project-level, per-location bucket (see Cloud Dataproc staging bucket). Defaults to: null.
• encryptionConfig (EncryptionConfig): Optional. Encryption settings for the cluster. Defaults to: null.
• gceClusterConfig (GceClusterConfig): Optional. The shared Compute Engine config settings for all instances in a cluster. Defaults to: null.
• initializationActions ([NodeInitializationAction]): Optional. Commands to execute on each node after config is completed. By default, executables are run on master and all worker nodes. You can test a node's role metadata to run an executable on a master or worker node, as shown below using curl (you can also use wget): ROLE=$(curl -H Metadata-Flavor:Google http://metadata/computeMetadata/v1/instance/attributes/dataproc-role) if [[ "${ROLE}" == 'Master' ]]; then ... master specific actions ... else ... worker specific actions ... fi Defaults to: null.
• masterConfig (InstanceGroupConfig): Optional. The Compute Engine config settings for the master instance in a cluster. Defaults to: null.
• secondaryWorkerConfig (InstanceGroupConfig): Optional. The Compute Engine config settings for additional worker instances in a cluster. Defaults to: null.
• softwareConfig (SoftwareConfig): Optional. The config settings for software inside the cluster. Defaults to: null.
• workerConfig (InstanceGroupConfig): Optional. The Compute Engine config settings for worker instances in a cluster. Defaults to: null.