View Source AWS.Batch (aws-elixir v1.0.10)
Batch
Using Batch, you can run batch computing workloads on the Amazon Web Services Cloud.
Batch computing is a common means for developers, scientists, and engineers to access large amounts of compute resources. Batch uses the advantages of the batch computing to remove the undifferentiated heavy lifting of configuring and managing required infrastructure. At the same time, it also adopts a familiar batch computing software approach. You can use Batch to efficiently provision resources, and work toward eliminating capacity constraints, reducing your overall compute costs, and delivering results more quickly.
As a fully managed service, Batch can run batch computing workloads of any scale. Batch automatically provisions compute resources and optimizes workload distribution based on the quantity and scale of your specific workloads. With Batch, there's no need to install or manage batch computing software. This means that you can focus on analyzing results and solving your specific problems instead.
Link to this section Summary
Functions
Cancels a job in an Batch job queue.
Creates an Batch compute environment.
Creates an Batch consumable resource.
Creates an Batch job queue.
Creates an Batch scheduling policy.
Creates a service environment for running service jobs.
Deletes an Batch compute environment.
Deletes the specified consumable resource.
Deletes the specified job queue.
Deletes the specified scheduling policy.
Deletes a Service environment.
Deregisters an Batch job definition.
Describes one or more of your compute environments.
Returns a description of the specified consumable resource.
Describes a list of job definitions.
Describes one or more of your job queues.
Describes a list of Batch jobs.
Describes one or more of your scheduling policies.
Describes one or more of your service environments.
The details of a service job.
Provides a list of the first 100 RUNNABLE jobs associated to a single job
queue.
Returns a list of Batch consumable resources.
Returns a list of Batch jobs.
Returns a list of Batch jobs that require a specific consumable resource.
Returns a list of Batch scheduling policies.
Returns a list of service jobs for a specified job queue.
Lists the tags for an Batch resource.
Registers an Batch job definition.
Submits an Batch job from a job definition.
Submits a service job to a specified job queue to run on SageMaker AI.
Associates the specified tags to a resource with the specified resourceArn.
Terminates a job in a job queue.
Terminates a service job in a job queue.
Deletes specified tags from an Batch resource.
Updates an Batch compute environment.
Updates a consumable resource.
Updates a job queue.
Updates a scheduling policy.
Updates a service environment.
Link to this section Functions
Cancels a job in an Batch job queue.
Jobs that are in a SUBMITTED, PENDING, or RUNNABLE state are cancelled and
the job status is updated to FAILED.
A PENDING job is canceled after all dependency jobs are completed.
Therefore, it may take longer than expected to cancel a job in PENDING
status.
When you try to cancel an array parent job in PENDING, Batch attempts to
cancel all child jobs. The array parent job is canceled when all child jobs are
completed.
Jobs that progressed to the STARTING or
RUNNING state aren't canceled. However, the API operation still succeeds, even
if no job is canceled. These jobs must be terminated with the TerminateJob
operation.
Creates an Batch compute environment.
You can create MANAGED or
UNMANAGED compute environments. MANAGED compute environments can
use Amazon EC2 or Fargate resources. UNMANAGED compute environments can only
use
EC2 resources.
In a managed compute environment, Batch manages the capacity and instance types of the compute resources within the environment. This is based on the compute resource specification that you define or the launch template that you specify when you create the compute environment. Either, you can choose to use EC2 On-Demand Instances and EC2 Spot Instances. Or, you can use Fargate and Fargate Spot capacity in your managed compute environment. You can optionally set a maximum price so that Spot Instances only launch when the Spot Instance price is less than a specified percentage of the On-Demand price.
In an unmanaged compute environment, you can manage your own EC2 compute
resources and
have flexibility with how you configure your compute resources. For example, you
can use
custom AMIs. However, you must verify that each of your AMIs meet the Amazon ECS
container instance
AMI specification. For more information, see container instance AMIs
in the
Amazon Elastic Container Service Developer Guide. After you created your
unmanaged compute environment,
you can use the DescribeComputeEnvironments operation to find the Amazon ECS
cluster that's associated with it. Then, launch your container instances into
that Amazon ECS
cluster. For more information, see Launching an Amazon ECS container instance
in the Amazon Elastic Container Service Developer Guide.
Batch doesn't automatically upgrade the AMIs in a compute environment after it's created. For more information on how to update a compute environment's AMI, see Updating compute environments in the Batch User Guide.
Creates an Batch consumable resource.
Creates an Batch job queue.
When you create a job queue, you associate one or more compute environments to the queue and assign an order of preference for the compute environments.
You also set a priority to the job queue that determines the order that the Batch scheduler places jobs onto its associated compute environments. For example, if a compute environment is associated with more than one job queue, the job queue with a higher priority is given preference for scheduling jobs to that compute environment.
Creates an Batch scheduling policy.
Creates a service environment for running service jobs.
Service environments define capacity limits for specific service types such as SageMaker Training jobs.
Deletes an Batch compute environment.
Before you can delete a compute environment, you must set its state to
DISABLED with the UpdateComputeEnvironment API operation and
disassociate it from any job queues with the UpdateJobQueue API operation.
Compute environments that use Fargate resources must terminate all active jobs
on that
compute environment before deleting the compute environment. If this isn't done,
the compute
environment enters an invalid state.
Deletes the specified consumable resource.
Deletes the specified job queue.
You must first disable submissions for a queue with the
UpdateJobQueue operation. All jobs in the queue are eventually terminated
when you delete a job queue. The jobs are terminated at a rate of about 16 jobs
each
second.
It's not necessary to disassociate compute environments from a queue before
submitting a
DeleteJobQueue request.
Deletes the specified scheduling policy.
You can't delete a scheduling policy that's used in any job queues.
Deletes a Service environment.
Before you can delete a service environment, you must first set its state to
DISABLED with the UpdateServiceEnvironment API operation and disassociate it
from any job queues with the UpdateJobQueue API operation.
Deregisters an Batch job definition.
Job definitions are permanently deleted after 180 days.
Describes one or more of your compute environments.
If you're using an unmanaged compute environment, you can use the
DescribeComputeEnvironment operation to determine the
ecsClusterArn that you launch your Amazon ECS container instances into.
Returns a description of the specified consumable resource.
Describes a list of job definitions.
You can specify a status (such as
ACTIVE) to only return job definitions that match that status.
Describes one or more of your job queues.
Describes a list of Batch jobs.
Describes one or more of your scheduling policies.
Describes one or more of your service environments.
The details of a service job.
Provides a list of the first 100 RUNNABLE jobs associated to a single job
queue.
Returns a list of Batch consumable resources.
Returns a list of Batch jobs.
You must specify only one of the following items:
* A job queue ID to return a list of jobs in that job queue
* A multi-node parallel job ID to return a list of nodes for that job
* An array job ID to return a list of the children for that job
You can filter the results by job status with the jobStatus parameter. If you
don't specify a status, only RUNNING jobs are returned.
Returns a list of Batch jobs that require a specific consumable resource.
Returns a list of Batch scheduling policies.
Returns a list of service jobs for a specified job queue.
Lists the tags for an Batch resource.
Batch resources that support tags are compute environments, jobs, job definitions, job queues, and scheduling policies. ARNs for child jobs of array and multi-node parallel (MNP) jobs aren't supported.
Registers an Batch job definition.
Submits an Batch job from a job definition.
Parameters that are specified during SubmitJob override parameters defined in
the job definition. vCPU and memory
requirements that are specified in the resourceRequirements objects in the job
definition are the exception. They can't be overridden this way using the
memory
and vcpus parameters. Rather, you must specify updates to job definition
parameters in a resourceRequirements object that's included in the
containerOverrides parameter.
Job queues with a scheduling policy are limited to 500 active share identifiers at a time.
Jobs that run on Fargate resources can't be guaranteed to run for more than 14 days. This is because, after 14 days, Fargate resources might become unavailable and job might be terminated.
Submits a service job to a specified job queue to run on SageMaker AI.
A service job is a unit of work that you submit to Batch for execution on SageMaker AI.
Associates the specified tags to a resource with the specified resourceArn.
If existing tags on a resource aren't specified in the request parameters, they aren't changed. When a resource is deleted, the tags that are associated with that resource are deleted as well. Batch resources that support tags are compute environments, jobs, job definitions, job queues, and scheduling policies. ARNs for child jobs of array and multi-node parallel (MNP) jobs aren't supported.
Terminates a job in a job queue.
Jobs that are in the STARTING or
RUNNING state are terminated, which causes them to transition to
FAILED. Jobs that have not progressed to the STARTING state are
cancelled.
Terminates a service job in a job queue.
Deletes specified tags from an Batch resource.
Updates an Batch compute environment.
Updates a consumable resource.
Updates a job queue.
Updates a scheduling policy.
Updates a service environment.
You can update the state of a service environment from ENABLED to DISABLED
to prevent new service jobs from being placed in the service environment.