Awsflow Emr

Awsflow EMR

Manage and inspect EMR clusters, steps, studios, notebook executions, and related configurations.

When to Use This Skill

Use this skill when the user:

• Asks about EMR clusters, Hadoop, or Spark
• Wants to inspect cluster status, steps, or instances
• Needs to view EMR studios or notebook executions
• Asks about release labels, instance types, or security configurations
• Wants to check auto-termination, managed scaling, or session credentials
• Wants to launch or terminate clusters
• Needs to add steps, instance groups, or tags
• Wants to modify cluster settings or scaling policies

Tool: EMRTool

Describe and manage EMR clusters, steps, studios, and configurations. ALWAYS provide params object.

Commands

ListClusters

List EMR clusters with optional state filter.

{ "command": "ListClusters", "params": { "ClusterStates": ["RUNNING", "WAITING"] } }

Parameters:

DescribeCluster

Get detailed information about a cluster.

{ "command": "DescribeCluster", "params": { "ClusterId": "j-1234567890ABC" } }

Parameters:

ListSteps

List steps in a cluster.

{ "command": "ListSteps", "params": { "ClusterId": "j-1234567890ABC", "StepStates": ["FAILED"] } }

Parameters:

DescribeStep

Get details of a specific step.

{ "command": "DescribeStep", "params": { "ClusterId": "j-1234567890ABC", "StepId": "s-ABC123" } }

Parameters:

ListInstances

List EC2 instances in a cluster.

{ "command": "ListInstances", "params": { "ClusterId": "j-1234567890ABC", "InstanceStates": ["RUNNING"] } }

Parameters:

ListInstanceFleets

List instance fleets in a cluster.

{ "command": "ListInstanceFleets", "params": { "ClusterId": "j-1234567890ABC" } }

Parameters:

ListInstanceGroups

List instance groups in a cluster.

{ "command": "ListInstanceGroups", "params": { "ClusterId": "j-1234567890ABC" } }

Parameters:

ListBootstrapActions

List bootstrap actions for a cluster.

{ "command": "ListBootstrapActions", "params": { "ClusterId": "j-1234567890ABC" } }

Parameters:

ListStudios

List EMR studios.

{ "command": "ListStudios", "params": {} }

Parameters:

DescribeStudio

Get details of an EMR studio.

{ "command": "DescribeStudio", "params": { "StudioId": "es-ABC123" } }

Parameters:

ListNotebookExecutions

List notebook executions.

{ "command": "ListNotebookExecutions", "params": {} }

Parameters:

DescribeNotebookExecution

Get details of a notebook execution.

{ "command": "DescribeNotebookExecution", "params": { "NotebookExecutionId": "ex-ABC123" } }

Parameters:

ListReleaseLabels

List available EMR release labels.

{ "command": "ListReleaseLabels", "params": {} }

Parameters:

DescribeReleaseLabel

Get details for a release label.

{ "command": "DescribeReleaseLabel", "params": { "ReleaseLabel": "emr-7.0.0" } }

Parameters:

ListSupportedInstanceTypes

List instance types supported for a release.

{ "command": "ListSupportedInstanceTypes", "params": { "ReleaseLabel": "emr-7.0.0" } }

Parameters:

DescribeSecurityConfiguration

Get a security configuration.

{ "command": "DescribeSecurityConfiguration", "params": { "SecurityConfigurationName": "my-config" } }

Parameters:

Lifecycle and Management Commands

RunJobFlow

Create a new EMR cluster.

{ "command": "RunJobFlow", "params": { "Name": "analytics-cluster", "ReleaseLabel": "emr-7.0.0", "Instances": { "InstanceGroups": [{ "InstanceRole": "MASTER", "InstanceType": "m5.xlarge", "InstanceCount": 1 }] }, "ServiceRole": "EMR_DefaultRole", "JobFlowRole": "EMR_EC2_DefaultRole" } }

AddJobFlowSteps

Add steps to a cluster.

{ "command": "AddJobFlowSteps", "params": { "JobFlowId": "j-1234567890ABC", "Steps": [{ "Name": "spark-step", "ActionOnFailure": "CONTINUE", "HadoopJarStep": { "Jar": "command-runner.jar", "Args": ["spark-submit", "--deploy-mode", "cluster", "s3://bucket/job.py"] } }] } }

ModifyCluster

Modify cluster settings.

{ "command": "ModifyCluster", "params": { "ClusterId": "j-1234567890ABC", "StepConcurrencyLevel": 2 } }

PutAutoScalingPolicy

Configure auto scaling for an instance group.

{ "command": "PutAutoScalingPolicy", "params": { "ClusterId": "j-1234567890ABC", "InstanceGroupId": "ig-ABC123", "AutoScalingPolicy": { "Constraints": { "MinCapacity": 2, "MaxCapacity": 10 }, "Rules": [] } } }

AddTags

Tag a cluster.

{ "command": "AddTags", "params": { "ResourceId": "j-1234567890ABC", "Tags": { "env": "prod" } } }

RemoveTags

Remove tags from a cluster.

{ "command": "RemoveTags", "params": { "ResourceId": "j-1234567890ABC", "TagKeys": ["env"] } }

TerminateJobFlows

Terminate one or more clusters.

{ "command": "TerminateJobFlows", "params": { "JobFlowIds": ["j-1234567890ABC"] } }

ListSecurityConfigurations

List security configurations.

{ "command": "ListSecurityConfigurations", "params": {} }

Parameters:

GetAutoTerminationPolicy

Get auto-termination policy for a cluster.

{ "command": "GetAutoTerminationPolicy", "params": { "ClusterId": "j-1234567890ABC" } }

Parameters:

GetBlockPublicAccessConfiguration

Get block public access configuration.

{ "command": "GetBlockPublicAccessConfiguration", "params": {} }

GetManagedScalingPolicy

Get managed scaling policy for a cluster.

{ "command": "GetManagedScalingPolicy", "params": { "ClusterId": "j-1234567890ABC" } }

Parameters:

GetClusterSessionCredentials

Get session credentials for a cluster.

{ "command": "GetClusterSessionCredentials", "params": { "ClusterId": "j-1234567890ABC", "CredentialType": "UsernamePassword" } }

Parameters:

GetStudioSessionMapping

Get studio session mapping.

{ "command": "GetStudioSessionMapping", "params": { "StudioId": "es-ABC123", "IdentityType": "USER", "IdentityId": "user-123" } }

Parameters:

ListStudioSessionMappings

List studio session mappings.

{ "command": "ListStudioSessionMappings", "params": { "StudioId": "es-ABC123" } }

Parameters:

DescribeJobFlows

Describe job flows (legacy).

{ "command": "DescribeJobFlows", "params": { "JobFlowIds": ["j-ABC123"] } }

Parameters:

DescribePersistentAppUI / GetOnClusterAppUIPresignedURL / GetPersistentAppUIPresignedURL

Application UI commands for Spark History Server, etc.

{ "command": "GetOnClusterAppUIPresignedURL", "params": { "ClusterId": "j-ABC123", "ApplicationId": "app-123" } }

Parameters:

Related Services

• EMR → S3: Clusters use S3 for input/output data (EMRFS), logs, and scripts. Use S3Tool to inspect data
• EMR → EC2: Clusters run on EC2 instances. Use EC2Tool to inspect the underlying instances
• EMR → CloudWatch: Cluster metrics and logs in CloudWatch. Use CloudWatchLogTool to read logs
• EMR → IAM: Clusters use EC2 instance profiles and service roles. Use IAMTool to inspect
• EMR → Glue Data Catalog: EMR can use Glue Data Catalog as Hive metastore. Use GlueTool to query the catalog
• EMR → CloudFormation: EMR clusters managed by CloudFormation stacks