Entities, lookup information, and metrics for AWS API ETL
This topic provides information about the entity relationship, lookup details, and mapping between the AWS metrics and the BMC Helix Continuous Optimization metrics.
You can also collect additional metrics by using this ETL. For more information, see Collecting EC2 instance metrics by using the CloudWatch agent and Collecting data for additional performance and instance type configuration metrics topics.
Note
If there are no metrics available for an entity in the AWS infrastructure, the ETL does not collect any value (including the default value as zero) for that entity.
Entity list
The AWS API ETL collects the following types of entities:
- Cloud
- Auto Scale Group
- Virtual Machine
- EBS Volume
- RDS (Amazon Aurora, MySQL, MariaDB, PostgreSQL, Oracle, and Microsoft SQL Server)
- Business Service
Entity relationship
The following table explains the relationship between the AWS entities.
Parent entity | Child entity | Relationship type | Description |
|---|---|---|---|
Cloud - AWS (cl:aws) | Virtual Machine - AWS (gm:aws) | CL_CONTAINS_GM | |
Cloud - AWS (cl:aws) | Auto Scale Group - AWS (asg:aws) | CL_CONTAINS_ASG | |
Virtual Machine - AWS (gm:aws) | Storage Volume - AWS (volume:aws) | GM_USES_VOLUME | |
Cloud - AWS (cl:aws) | Storage Volume - AWS (volume:aws) | CL_CONTAINS_VOLUME | The ETL will import volumes when one of these conditions is true:
|
Auto Scale Group - AWS (asg:aws) | Virtual Machine - AWS (gm:aws) | ASG_CONTAINS_GM | The relationship is true only for the Autoscale Group with a manual scaling policy. |
RDS - AWS (rds:aws) | Not applicable | CL_CONTAINS_RDS | |
| Business service | Virtual Machine – AWS | BS_CONTAINS_GM | |
| Business service | Auto Scale Group - AWS | BS_CONTAINS_ASG |
Lookup information
The following table explains the lookup fields for AWS entities that you can use to quickly find the required entity.
Entity type | Lookup fields | |
|---|---|---|
Strong | Weak | |
Storage Volume - AWS | AWS_ID | Not applicable |
Virtual Machine - AWS | AWS_ID | Not applicable |
Cloud - AWS | AWS_NAME | Not applicable |
Auto Scale Group - AWS | AWS_ARN | Not applicable |
| RDS - AWS | AWS_NAME | Not applicable |
| Business Service (svc) | APPLICATION_NAME | Not applicable |
Metric mapping
The following table explains the mapping between the AWS metrics and the BMC Helix Continuous Optimization metrics.
Volume performance metrics
BMC Helix Continuous Optimization metric | Amazon Web Services metric | Formula |
|---|---|---|
ST_VOLUME_TRANSFER_READ_BYTE_RATE | VolumeReadBytes | Sum[VolumeReadBytes]÷duration |
ST_VOLUME_TRANSFER_WRITE_BYTE_RATE | VolumeWriteBytes | Sum[VolumeWriteBytes]÷duration |
ST_VOLUME_TRANSFER_BYTE_RATE | Derived | (Sum[VolumeReadBytes]+Sum[VolumeWriteBytes])÷duration |
ST_VOLUME_IO_READ_RATE | VolumeReadOps | Sum[VolumeReadOps]÷duration |
ST_VOLUME_IO_WRITE_RATE | VolumeWriteOps | Sum[VolumeWriteOps]÷duration |
ST_VOLUME_IO_RATE | Derived | (Sum[VolumeReadOps]+Sum[VolumeWriteOps])÷duration |
ST_VOLUME_READ_TIME | VolumeTotalReadTime | Average(VolumeTotalReadTime) |
ST_VOLUME_WRITE_TIME | VolumeTotalWriteTime | Average(VolumeTotalWriteTime) |
ST_VOLUME_QUEUE_LENGTH | VolumeQueueLength | Average[VolumeQueueLength] |
ST_VOLUME_IDLE_PCT | VolumeIdleTime | Sum[VolumeIdleTime]÷duration |
| ST_VOLUME_IOPS_LIMIT | IOPS | Not applicable |
| ST_VOLUME_THROUGHPUT_LIMIT | Throughput | Not applicable |
Instance and Auto Scale Group performance metrics
BMC Helix Continuous Optimization | Amazon Web Services metric | Formula |
|---|---|---|
| CPU_NUM | Not applicable | Not applicable |
CPU_UTIL | CPUUtilization | Average[CPUUtilization]÷100 |
NET_IN_BYTE_RATE | NetworkIn | Sum[NetworkIn]÷duration |
NET_OUT_BYTE_RATE | NetworkOut | Sum[NetworkOut]÷duration |
| NET_BIT_RATE | Derived | ((NetworkOut+NetworkIn) * 8)÷duration |
NET_BYTE_RATE1 | Derived | (Sum[NetworkOut]+Sum[NetworkIn])÷duration |
DISK_READ_RATE | DiskReadBytes | Sum[DiskReadBytes]÷duration |
DISK_WRITE_RATE | DiskWriteBytes | Sum[DiskWriteBytes]÷duration |
DISK_TRANSFER_RATE | Derived | (Sum[DiskReadBytes]+Sum[DiskWriteBytes])÷duration |
DISK_IO_READ_RATE | DiskReadOps | Sum[DiskReadOps]÷duration |
DISK_IO_WRITE_RATE | DiskWriteOps | Sum[DiskWriteOps]/duration |
DISK_IO_RATE | Derived | (Sum[DiskReadOps] +Sum[DiskWriteOps])/duration |
GM_ON_NUM (Only for Autoscale) | GroupInServiceInstances | Maximum[GroupInServiceInstances] |
| TOTAL_REAL_MEM | Not applicable | Not applicable |
1 - Indicates metrics that are set at level 4. These metrics are imported only when the collection level of the ETL is set to ‘Extended’. For information about changing the collection level, see Amazon Web Services - AWS API Extractor.
RDS DB instance configuration metrics
BMC Helix Continuous Optimization | Amazon Web Services metric |
|---|---|
AVAILABILITY_ZONE | Region and Availability Zone |
| DB_PRODUCT_NAME | DB instance ID |
| DB_NAME | DB name |
| DB_PRODUCT_VERSION | Engine version |
| DB_PRODUCT_TYPE | Engine |
| LOCATION_SITE | Region name |
| REGION_ID | Region ID |
REGION_NAME | Region name |
RDS DB instance performance metrics
BMC Helix Continuous Optimization | Amazon Web Services metric | Formula |
|---|---|---|
| CPU_UTIL | CPUUtilization | (CPUUtilization)÷100 |
| DB_TOTAL_FREE_SIZE1 | FreeStorageSpace | Not applicable |
| DB_SESSIONS | DatabaseConnections | Not applicable |
| DB_READ_LATENCY | ReadLatency | Not applicable |
| DB_WRITE_LATENCY | WriteLatency | Not applicable |
| DISK_IO_READ_RATE | ReadIOPS | Not applicable |
| DISK_READ_RATE | ReadThroughput | Not applicable |
| DISK_IO_WRITE_RATE | WriteIOPS | Not applicable |
| DISK_WRITE_RATE | WriteThroughput | Not applicable |
| MEM_FREE | FreeableMemory | Not applicable |
| SWAP_SPACE_USED | SwapUsage | Not applicable |
| BYDISK_QUEUE_SIZE | DiskQueueDepth | Not applicable |
| DB_REPLICA_LAG1 | ReplicaLag | Not applicable |
| DB_BIN_LOG_USAGE1 | BinLogDiskUsage | Not applicable |
1 - Indicates that the metrics are not supported in Amazon Aurora.
Comments
Log in or register to comment.