prefect_aws.batch
¶
Tasks for interacting with AWS Batch
batch_submit
async
¶
Submit a job to the AWS Batch job service.
Parameters:
Name | Type | Description | Default |
---|---|---|---|
job_name |
str
|
The AWS batch job name. |
required |
job_queue |
str
|
Name of the AWS batch job queue. |
required |
job_definition |
str
|
The AWS batch job definition. |
required |
aws_credentials |
AwsCredentials
|
Credentials to use for authentication with AWS. |
required |
**batch_kwargs |
Optional[Dict[str, Any]]
|
Additional keyword arguments to pass to the boto3
|
{}
|
Returns:
Type | Description |
---|---|
str
|
The id corresponding to the job. |
Example
Submits a job to batch.
from prefect import flow
from prefect_aws import AwsCredentials
from prefect_aws.batch import batch_submit
@flow
def example_batch_submit_flow():
aws_credentials = AwsCredentials(
aws_access_key_id="acccess_key_id",
aws_secret_access_key="secret_access_key"
)
job_id = batch_submit(
"job_name",
"job_queue",
"job_definition",
aws_credentials
)
return job_id
example_batch_submit_flow()
Source code in prefect_aws/batch.py
10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 |
|