Entities, lookup information, and metrics for AWS API ETL

This topic provides information about the entity relationship, lookup details, and mapping between the AWS metrics and the BMC Helix Continuous Optimization metrics.

You can also collect additional metrics by using this ETL. For more information, see Collecting EC2 instance metrics by using the CloudWatch agent and Collecting data for additional performance and instance type configuration metrics topics.

Note

If there are no metrics available for an entity in the AWS infrastructure, the ETL does not collect any value (including the default value as zero) for that entity. 

Entity list

The AWS API ETL collects the following types of entities:

  • Cloud
  • Auto Scale Group
  • Virtual Machine
  • EBS Volume
  • RDS (Amazon Aurora, MySQL, MariaDB, PostgreSQL, Oracle, and Microsoft SQL Server)
  • Business Service

Entity relationship

The following table explains the relationship between the AWS entities.

Parent entity

Child entity

Description

Display status

Cloud - AWS

(cl:aws)

Virtual Machine - AWS

(gm:aws)


Visible

Cloud - AWS

(cl:aws)

Auto Scale Group - AWS

(asg:aws)


Visible

Virtual Machine - AWS

(gm:aws)

Storage Volume - AWS

(volume:aws)


Visible

Cloud - AWS

(cl:aws)

Storage Volume - AWS

(volume:aws)

The ETL will import volumes when one of these conditions is true:

  • Volume is stand alone.
  • Volume is not flagged to be destroyed after an instance deletion.
  • Volume is related to instances that do not belong to the Auto scaling groups.
  • Volume is related to instances that belong to the static Auto scaling group.
Visible

Auto Scale Group - AWS

(asg:aws)

Virtual Machine - AWS

(gm:aws)

The relationship is true only for the Autoscale Group with a manual scaling policy.

Visible

RDS - AWS

(rds:aws)

Not applicable


Visible
Business serviceVirtual Machine – AWS                  
Visible
Business serviceAuto Scale Group - AWS               
Visible

Lookup information 

The following table explains the lookup fields for AWS entities that you can use to quickly find the required entity.

Entity type

Lookup fields


Strong

Weak

Storage Volume - AWS

AWS_ID

Not applicable

Virtual Machine  - AWS

AWS_ID

Not applicable

Cloud - AWS

AWS_NAME

Not applicable

Auto Scale Group - AWS

AWS_ARN

Not applicable

RDS - AWSAWS_NAMENot applicable
Business Service (svc)APPLICATION_NAMENot applicable

Metric mapping

The following table explains the mapping between the AWS metrics and the BMC Helix Continuous Optimization metrics.

Volume performance metrics

BMC Helix Continuous Optimization metric

Amazon Web Services metricFormula

ST_VOLUME_TRANSFER_READ_BYTE_RATE

VolumeReadBytes

Sum[VolumeReadBytes]÷duration

ST_VOLUME_TRANSFER_WRITE_BYTE_RATE

VolumeWriteBytes

Sum[VolumeWriteBytes]÷duration

ST_VOLUME_TRANSFER_BYTE_RATE

Derived

(Sum[VolumeReadBytes]+Sum[VolumeWriteBytes])÷duration

ST_VOLUME_IO_READ_RATE

VolumeReadOps

Sum[VolumeReadOps]÷duration

ST_VOLUME_IO_WRITE_RATE

VolumeWriteOps

Sum[VolumeWriteOps]÷duration

ST_VOLUME_IO_RATE

Derived

(Sum[VolumeReadOps]+Sum[VolumeWriteOps])÷duration

ST_VOLUME_READ_TIME

VolumeTotalReadTime

Average(VolumeTotalReadTime)

ST_VOLUME_WRITE_TIME

VolumeTotalWriteTime

Average(VolumeTotalWriteTime)

ST_VOLUME_QUEUE_LENGTH

VolumeQueueLength

Average[VolumeQueueLength]

ST_VOLUME_IDLE_PCT

VolumeIdleTime

Sum[VolumeIdleTime]÷duration

ST_VOLUME_IOPS_LIMITIOPSNot applicable
ST_VOLUME_THROUGHPUT_LIMITThroughputNot applicable

Instance and Auto Scale Group performance metrics

BMC Helix Continuous Optimization
metric 

Amazon Web Services metricFormula
CPU_NUMNot applicableNot applicable

CPU_UTIL

CPUUtilization

Average[CPUUtilization]÷100

NET_IN_BYTE_RATE

NetworkIn

Sum[NetworkIn]÷duration

NET_OUT_BYTE_RATE

NetworkOut

Sum[NetworkOut]÷duration

NET_BIT_RATEDerived((NetworkOut+NetworkIn) * 8)÷duration

NET_BYTE_RATE1

Derived

(Sum[NetworkOut]+Sum[NetworkIn])÷duration

DISK_READ_RATE

DiskReadBytes

Sum[DiskReadBytes]÷duration

DISK_WRITE_RATE

DiskWriteBytes

Sum[DiskWriteBytes]÷duration

DISK_TRANSFER_RATE

Derived

(Sum[DiskReadBytes]+Sum[DiskWriteBytes])÷duration

DISK_IO_READ_RATE

DiskReadOps

Sum[DiskReadOps]÷duration

DISK_IO_WRITE_RATE

DiskWriteOps

Sum[DiskWriteOps]/duration

DISK_IO_RATE

Derived

(Sum[DiskReadOps] +Sum[DiskWriteOps])/duration

GM_ON_NUM

(Only for Autoscale)

GroupInServiceInstances

Maximum[GroupInServiceInstances]

TOTAL_REAL_MEMNot applicableNot applicable

1 - Indicates metrics that are set at level 4. These metrics are imported only when the collection level of the ETL is set to ‘Extended’. For information about changing the collection level, see Amazon Web Services - AWS API Extractor.

RDS DB instance configuration metrics

BMC Helix Continuous Optimization
metric 

Amazon Web Services metric

AVAILABILITY_ZONE

Region and Availability Zone

DB_PRODUCT_NAMEDB instance ID
DB_NAMEDB name
DB_PRODUCT_VERSIONEngine version
DB_PRODUCT_TYPEEngine
LOCATION_SITE

Region name

REGION_ID

Region ID

REGION_NAME

Region name

RDS DB instance performance metrics

BMC Helix Continuous Optimization
metric 

Amazon Web Services metricFormula
CPU_UTILCPUUtilization(CPUUtilization)÷100
DB_TOTAL_FREE_SIZE1FreeStorageSpaceNot applicable
DB_SESSIONSDatabaseConnectionsNot applicable
DB_READ_LATENCYReadLatencyNot applicable
DB_WRITE_LATENCYWriteLatencyNot applicable
DISK_IO_READ_RATEReadIOPSNot applicable
DISK_READ_RATEReadThroughputNot applicable
DISK_IO_WRITE_RATEWriteIOPSNot applicable
DISK_WRITE_RATEWriteThroughputNot applicable
MEM_FREEFreeableMemoryNot applicable
SWAP_SPACE_USEDSwapUsageNot applicable
BYDISK_QUEUE_SIZEDiskQueueDepthNot applicable
DB_REPLICA_LAG1ReplicaLagNot applicable
DB_BIN_LOG_USAGE1BinLogDiskUsageNot applicable

1 - Indicates that the metrics are not supported in Amazon Aurora. 

Was this page helpful? Yes No Submitting... Thank you

Comments