View Source AWS.EMRcontainers (aws-elixir v1.0.4)

Amazon EMR on EKS provides a deployment option for Amazon EMR that allows you to run open-source big data frameworks on Amazon Elastic Kubernetes Service (Amazon EKS).

With this deployment option, you can focus on running analytics workloads while Amazon EMR on EKS builds, configures, and manages containers for open-source applications. For more information about Amazon EMR on EKS concepts and tasks, see What is Amazon EMR on EKS.

Amazon EMR containers is the API name for Amazon EMR on EKS. The emr-containers prefix is used in the following scenarios:

* It is the prefix in the CLI commands for Amazon EMR on EKS. For example, aws emr-containers start-job-run.

* It is the prefix before IAM policy actions for Amazon EMR on EKS. For example, "Action": [ "emr-containers:StartJobRun"]. For more information, see Policy actions for Amazon EMR on EKS.

* It is the prefix used in Amazon EMR on EKS service endpoints. For example, emr-containers.us-east-2.amazonaws.com. For more information, see Amazon EMR on EKSService Endpoints.

Link to this section Summary

Functions

cancel_job_run(client, id, virtual_cluster_id, input, options \\ [])

Cancels a job run.

create_job_template(client, input, options \\ [])

Creates a job template.

create_managed_endpoint(client, virtual_cluster_id, input, options \\ [])

Creates a managed endpoint.

create_security_configuration(client, input, options \\ [])

Creates a security configuration.

create_virtual_cluster(client, input, options \\ [])

Creates a virtual cluster.

delete_job_template(client, id, input, options \\ [])

Deletes a job template.

delete_managed_endpoint(client, id, virtual_cluster_id, input, options \\ [])

Deletes a managed endpoint.

delete_virtual_cluster(client, id, input, options \\ [])

Deletes a virtual cluster.

describe_job_run(client, id, virtual_cluster_id, options \\ [])

Displays detailed information about a job run.

describe_job_template(client, id, options \\ [])

Displays detailed information about a specified job template.

describe_managed_endpoint(client, id, virtual_cluster_id, options \\ [])

Displays detailed information about a managed endpoint.

describe_security_configuration(client, id, options \\ [])

Displays detailed information about a specified security configuration.

describe_virtual_cluster(client, id, options \\ [])

Displays detailed information about a specified virtual cluster.

get_managed_endpoint_session_credentials(client, endpoint_identifier, virtual_cluster_identifier, input, options \\ [])

Generate a session token to connect to a managed endpoint.

list_job_runs(client, virtual_cluster_id, created_after \\ nil, created_before \\ nil, max_results \\ nil, name \\ nil, next_token \\ nil, states \\ nil, options \\ [])

Lists job runs based on a set of parameters.

list_job_templates(client, created_after \\ nil, created_before \\ nil, max_results \\ nil, next_token \\ nil, options \\ [])

Lists job templates based on a set of parameters.

list_managed_endpoints(client, virtual_cluster_id, created_after \\ nil, created_before \\ nil, max_results \\ nil, next_token \\ nil, states \\ nil, types \\ nil, options \\ [])

Lists managed endpoints based on a set of parameters.

list_security_configurations(client, created_after \\ nil, created_before \\ nil, max_results \\ nil, next_token \\ nil, options \\ [])

Lists security configurations based on a set of parameters.

list_tags_for_resource(client, resource_arn, options \\ [])

Lists the tags assigned to the resources.

list_virtual_clusters(client, container_provider_id \\ nil, container_provider_type \\ nil, created_after \\ nil, created_before \\ nil, eks_access_entry_integrated \\ nil, max_results \\ nil, next_token \\ nil, states \\ nil, options \\ [])

Lists information about the specified virtual cluster.

metadata()

start_job_run(client, virtual_cluster_id, input, options \\ [])

Starts a job run.

tag_resource(client, resource_arn, input, options \\ [])

Assigns tags to resources.

untag_resource(client, resource_arn, input, options \\ [])

Removes tags from resources.

Link to this section Functions

cancel_job_run(client, id, virtual_cluster_id, input, options \\ [])

Cancels a job run.

A job run is a unit of work, such as a Spark jar, PySpark script, or SparkSQL query, that you submit to Amazon EMR on EKS.

create_job_template(client, input, options \\ [])

Creates a job template.

Job template stores values of StartJobRun API request in a template and can be used to start a job run. Job template allows two use cases: avoid repeating recurring StartJobRun API request values, enforcing certain values in StartJobRun API request.

create_managed_endpoint(client, virtual_cluster_id, input, options \\ [])

Creates a managed endpoint.

A managed endpoint is a gateway that connects Amazon EMR Studio to Amazon EMR on EKS so that Amazon EMR Studio can communicate with your virtual cluster.

create_security_configuration(client, input, options \\ [])

Creates a security configuration.

Security configurations in Amazon EMR on EKS are templates for different security setups. You can use security configurations to configure the Lake Formation integration setup. You can also create a security configuration to re-use a security setup each time you create a virtual cluster.

create_virtual_cluster(client, input, options \\ [])

Creates a virtual cluster.

Virtual cluster is a managed entity on Amazon EMR on EKS. You can create, describe, list and delete virtual clusters. They do not consume any additional resource in your system. A single virtual cluster maps to a single Kubernetes namespace. Given this relationship, you can model virtual clusters the same way you model Kubernetes namespaces to meet your requirements.

delete_job_template(client, id, input, options \\ [])

Deletes a job template.

delete_managed_endpoint(client, id, virtual_cluster_id, input, options \\ [])

Deletes a managed endpoint.

A managed endpoint is a gateway that connects Amazon EMR Studio to Amazon EMR on EKS so that Amazon EMR Studio can communicate with your virtual cluster.

delete_virtual_cluster(client, id, input, options \\ [])

Deletes a virtual cluster.

describe_job_run(client, id, virtual_cluster_id, options \\ [])

Displays detailed information about a job run.

A job run is a unit of work, such as a Spark jar, PySpark script, or SparkSQL query, that you submit to Amazon EMR on EKS.

describe_job_template(client, id, options \\ [])

Displays detailed information about a specified job template.

describe_managed_endpoint(client, id, virtual_cluster_id, options \\ [])

Displays detailed information about a managed endpoint.

A managed endpoint is a gateway that connects Amazon EMR Studio to Amazon EMR on EKS so that Amazon EMR Studio can communicate with your virtual cluster.

describe_security_configuration(client, id, options \\ [])

Displays detailed information about a specified security configuration.

describe_virtual_cluster(client, id, options \\ [])

Displays detailed information about a specified virtual cluster.

get_managed_endpoint_session_credentials(client, endpoint_identifier, virtual_cluster_identifier, input, options \\ [])

Generate a session token to connect to a managed endpoint.

list_job_runs(client, virtual_cluster_id, created_after \\ nil, created_before \\ nil, max_results \\ nil, name \\ nil, next_token \\ nil, states \\ nil, options \\ [])

Lists job runs based on a set of parameters.

A job run is a unit of work, such as a Spark jar, PySpark script, or SparkSQL query, that you submit to Amazon EMR on EKS.

list_job_templates(client, created_after \\ nil, created_before \\ nil, max_results \\ nil, next_token \\ nil, options \\ [])

Lists job templates based on a set of parameters.

list_managed_endpoints(client, virtual_cluster_id, created_after \\ nil, created_before \\ nil, max_results \\ nil, next_token \\ nil, states \\ nil, types \\ nil, options \\ [])

Lists managed endpoints based on a set of parameters.

A managed endpoint is a gateway that connects Amazon EMR Studio to Amazon EMR on EKS so that Amazon EMR Studio can communicate with your virtual cluster.

list_security_configurations(client, created_after \\ nil, created_before \\ nil, max_results \\ nil, next_token \\ nil, options \\ [])

Lists security configurations based on a set of parameters.

list_tags_for_resource(client, resource_arn, options \\ [])

Lists the tags assigned to the resources.

list_virtual_clusters(client, container_provider_id \\ nil, container_provider_type \\ nil, created_after \\ nil, created_before \\ nil, eks_access_entry_integrated \\ nil, max_results \\ nil, next_token \\ nil, states \\ nil, options \\ [])

Lists information about the specified virtual cluster.

metadata()

start_job_run(client, virtual_cluster_id, input, options \\ [])

Starts a job run.

A job run is a unit of work, such as a Spark jar, PySpark script, or SparkSQL query, that you submit to Amazon EMR on EKS.

tag_resource(client, resource_arn, input, options \\ [])

Assigns tags to resources.

A tag is a label that you assign to an Amazon Web Services resource. Each tag consists of a key and an optional value, both of which you define. Tags enable you to categorize your Amazon Web Services resources by attributes such as purpose, owner, or environment. When you have many resources of the same type, you can quickly identify a specific resource based on the tags you've assigned to it. For example, you can define a set of tags for your Amazon EMR on EKS clusters to help you track each cluster's owner and stack level. We recommend that you devise a consistent set of tag keys for each resource type. You can then search and filter the resources based on the tags that you add.

untag_resource(client, resource_arn, input, options \\ [])

Removes tags from resources.

Settings View Source AWS.EMRcontainers (aws-elixir v1.0.4)

Link to this section Summary

Functions

Link to this section Functions

cancel_job_run(client, id, virtual_cluster_id, input, options \\ [])

create_job_template(client, input, options \\ [])

create_managed_endpoint(client, virtual_cluster_id, input, options \\ [])

create_security_configuration(client, input, options \\ [])

create_virtual_cluster(client, input, options \\ [])

delete_job_template(client, id, input, options \\ [])

delete_managed_endpoint(client, id, virtual_cluster_id, input, options \\ [])

delete_virtual_cluster(client, id, input, options \\ [])

describe_job_run(client, id, virtual_cluster_id, options \\ [])

describe_job_template(client, id, options \\ [])

describe_managed_endpoint(client, id, virtual_cluster_id, options \\ [])

describe_security_configuration(client, id, options \\ [])

describe_virtual_cluster(client, id, options \\ [])

get_managed_endpoint_session_credentials(client, endpoint_identifier, virtual_cluster_identifier, input, options \\ [])

list_job_runs(client, virtual_cluster_id, created_after \\ nil, created_before \\ nil, max_results \\ nil, name \\ nil, next_token \\ nil, states \\ nil, options \\ [])

list_job_templates(client, created_after \\ nil, created_before \\ nil, max_results \\ nil, next_token \\ nil, options \\ [])

list_managed_endpoints(client, virtual_cluster_id, created_after \\ nil, created_before \\ nil, max_results \\ nil, next_token \\ nil, states \\ nil, types \\ nil, options \\ [])

list_security_configurations(client, created_after \\ nil, created_before \\ nil, max_results \\ nil, next_token \\ nil, options \\ [])

list_tags_for_resource(client, resource_arn, options \\ [])

list_virtual_clusters(client, container_provider_id \\ nil, container_provider_type \\ nil, created_after \\ nil, created_before \\ nil, eks_access_entry_integrated \\ nil, max_results \\ nil, next_token \\ nil, states \\ nil, options \\ [])

metadata()

start_job_run(client, virtual_cluster_id, input, options \\ [])

tag_resource(client, resource_arn, input, options \\ [])

untag_resource(client, resource_arn, input, options \\ [])

View Source AWS.EMRcontainers (aws-elixir v1.0.4)