Moviri Integrator for BMC Helix Capacity Optimization - Cloudera
“Moviri Integrator for BMC Helix Continuous Optimization – Cloudera” is an additional component of BMC Helix Continuous Optimization product. It allows extracting data from Cloudera Enterprise, which is Cloudera Hadoop distribution composed of CDH (Cloudera Data Hub) and Cloudera Manager. Relevant capacity metrics are loaded into BMC Helix Continuous Optimization, which provides advanced analytics over the extracted data in the form of an interactive dashboard, the Hadoop View.
The integration supports the extraction of both performance and configuration data across different component of CDH and can be configured via parameters that allow entity filtering and many other settings. Furthermore the connector is able to replicate relationships and logical dependencies among entities such as clusters, resource pools, services and nodes.
The documentation is targeted at BMC Helix Continuous Optimization administrators, in charge of configuring and monitoring the integration between BMC Helix Continuous Optimization and Cloudera.
Requirements
Supported versions of data source software
- Supported Cloudera Data Hub and Cloudera Manager versions: 5.1 to 5.16.1
- The integration supports both Cloudera Manager bundled in Cloudera Enterprise and Cloudera Express products
Supported configurations of data source software
Moviri – Cloudera Extractor requires Cloudera Manager is continuously and correctly monitoring the various entities supported by the integration, full list available below. Any lack in meeting this requirement will cause lack in data coverage.
Datasource Check and Configuration
Preparing to connect to the data source software
The connector included in "Moviri Integrator for BMC Helix Continuous Optimization – Cloudera" use the Cloudera Java API v6 to communicate with Cloudera Manager. This is always enabled and no additional configuration is required.
Please note that only SELECT statements are used by the connector, preventing any accidental change to the environments.
The connector requires a read-only user with permissions on all the clusters that should be accessed.
Connector configuration attributes
The following table shows specific properties of the connector, all the other generic properties are documented here.
Property Name | Value Type | Required? | Default | Description |
Cloudera Manager Connection | ||||
Cloudera Hostname | String | Yes |
| Cloudera hostname |
Cloudera Port | Number | Yes | 7180 | Cloudera connection port |
Spark Hostname | String | No | Spark hostname | |
Spark Port | Number | Yes | 18080 | Spark connection port |
User | String | Yes | Username | |
Password | String | Yes | Password | |
Connection Timeout | Number | No | 20 | Advanced - Connection timeout in seconds |
Use Encryption (TLS) | Boolean | Yes | false | Advanced - Use encryption |
Ignore certificate validation | Boolean | Yes | false | Advanced - Ignore validation of TLS certificate |
Ignore common name validation | Boolean | Yes | false | Advanced - Ignore validation of TLS common name |
Warn if version is unsupported | Boolean | Yes | false | Advanced - Warn in the event the Cloudera Manager version is unsupported |
Data Selection | ||||
Data Granularity | Multiple | Yes | 10 minutes | Granularity of data to be imported, it is possible to choose between
|
Import nodes | Boolean | Yes | yes | Import data at node level |
Import pools | Boolean | Yes | yes | Import data at pool level |
Import hbase | Boolean | Yes | yes | Import data about HBASE service |
Import spark | Boolean | Yes | yes | Import data about Spark service |
Import HDFS usage report | Boolean | Yes | no | Import data about HDFS usage by user (requires cluster admin permission) |
Substitute any dot char in pools names with this char | Char | No | - | Advanced - Because of the dot is a special char for the Loader component, it's suggested to change it |
Time Interval Settings | ||||
Default Last Counter (YYYY-MM-DD HH24:MI:SS Z) | Date | Yes | Default last counter value | |
Relocate data to timezone (e.g. America/New_York, leave empty to use BCO timezone) | String | No | Advanced - Timezone to which relocate any imported sample | |
Limit extraction to date (YYYY-MM-DD HH24:MI:SS) | Date | No |
| Advanced - Maximum date to be considered while extracting data |
Max days to import in a single run (0 for no limit) | Number | No |
| Maximum days to collect in a single ETL run |
Use cluster displayname for lookup instead of cluster name (default) | Boolean | Yes | no | Advanced - Use cluster displayname as internal lookup name - useful to avoid system overwrite in TSCO if different cloudera clusters have the same cluster name and the lookup is shared between their ETL |
Add cluster name to components (cluster:component) as entity name | Boolean | Yes | no | Advanced - Add cluster name as a prefix of all components, useful in case of multiple clusters |
Supported entities
The following entities are supported:
- Hadoop Cluster
- Hadoop Resource Pool
- Hadoop Node
In addition to standard system performance metrics, data related to the following Hadoop specific services is gathered:
- HDFS
- SPARK
- YARN
- HBASE
- MAP REDUCE
Hierarchy
The connector is able to replicate relationships and logical dependencies among these entities. In particular all the available Clusters are attached to the root of the hierarchy and each Cluster contains its own Nodes and Pools.
Services' data is available among the above entities' metrics, according to the following table.
HDFS | YARN | HBASE | MAP REDUCE | SPARK | |
Cluster | X | X | X | X | X |
Pool | X | ||||
Node | X |
Troubleshooting
For ETL troubleshooting, refer to official BMC documentation available here.
Configuration and performance metrics mapping
Cloudera entity | TSCO entity | PERF/CONF | Cloudera metric | TSCO Metric | conversion factor |
---|---|---|---|---|---|
Cluster | Hadoop Cluster | CONF | clusterName | ALIAS_NAME | |
Cluster | Hadoop Cluster | CONF | total_cores_across_hosts | CPU_NUM | |
Cluster | Hadoop Cluster | CONF | version + fullversion | DESCRIPTION | |
Cluster | Hadoop Cluster | CONF | "Cloudera" | HADOOP_DISTRIBUTION | |
Cluster | Hadoop Cluster | CONF | total_swap_total_across_hosts | SWAP_SPACE_TOT | |
Cluster | Hadoop Cluster | CONF | total_capacity_used_across_filesystems /total_capacity_across_filesystems | TOTAL_FS_UTIL | |
Cluster | Hadoop Cluster | CONF | total_physical_memory_total_across_hosts | TOTAL_REAL_MEM | |
Cluster | Hadoop Cluster | PERF | total_load_1_across_hosts | CPU_RUN_QUEUE | |
Cluster | Hadoop Cluster | PERF | (total_cpu_system_rate_across_hosts +total_cpu_user_rate_across_hosts) /total_cores_across_hosts | CPU_UTIL | |
Cluster | Hadoop Cluster | PERF | total_cpu_system_rate_across_hosts/total_cores_across_hosts | CPU_UTIL_SYSTEM | |
Cluster | Hadoop Cluster | PERF | total_cpu_user_rate_across_hosts/total_cores_across_hosts | CPU_UTIL_USER | |
Cluster | Hadoop Cluster | PERF | total_cpu_iowait_rate_across_hosts/total_cores_across_hosts | CPU_UTIL_WAIO | |
Cluster | Hadoop Cluster | PERF | total_physical_memory_cached_across_hosts | MEM_CACHED | |
Cluster | Hadoop Cluster | PERF | total_swap_out_rate_across_hosts | MEM_SWAP_OUT_RATE | |
Cluster | Hadoop Cluster | PERF | total_physical_memory_used_across_hosts | MEM_USED | |
Cluster | Hadoop Cluster | PERF | total_physical_memory_used_across_hosts /total_physical_memory_total_across_hosts | MEM_UTIL | |
Cluster | Hadoop Cluster | PERF | total_physical_memory_cached_across_hosts /total_physical_memory_total_across_hosts | MEM_UTIL_CACHED | |
Cluster | Hadoop Cluster | PERF | total_bytes_receive_rate_across_network_interfaces +total_bytes_transmit_rate_across_network_interfaces | NET_BYTE_RATE | |
Cluster | Hadoop Cluster | PERF | total_swap_free_across_hosts | SWAP_SPACE_FREE | |
Cluster | Hadoop Cluster | PERF | total_swap_used_across_hosts | SWAP_SPACE_USED | |
Cluster | Hadoop Cluster | PERF | total_swap_used_across_hosts/swap_total_across_hosts | SWAP_SPACE_UTIL | |
Cluster | Hadoop Cluster | PERF | total_capacity_across_filesystems+(-1*total_capacity_used_across_filesystems) | TOTAL_FS_FREE | |
Cluster | Hadoop Cluster | PERF | total_capacity_across_filesystems | TOTAL_FS_SIZE | |
Cluster | Hadoop Cluster | PERF | total_capacity_used_across_filesystems | TOTAL_FS_USED | |
HBASE | Hadoop HBASE Service | PERF | total_compaction_queue_size_across_regionservers | COMPACTION_QUEUE_SIZE | |
HBASE | Hadoop HBASE Service | PERF | total_events_critical_rate_across_regionservers | CRIT_EVENT_RATE | |
HBASE | Hadoop HBASE Service | PERF | total_requests_rate_across_regionservers | DISK_IO_RATE | |
HBASE | Hadoop HBASE Service | PERF | total_read_requests_rate_across_regionservers | DISK_IO_READ_RATE | |
HBASE | Hadoop HBASE Service | PERF | total_write_requests_rate_across_regionservers | DISK_IO_WRITE_RATE | |
HBASE | Hadoop HBASE Service | PERF | total_read_bytes_rate_across_regionservers | DISK_READ_RATE | |
HBASE | Hadoop HBASE Service | PERF | total_write_bytes_rate_across_regionservers +total_read_bytes_rate_across_regionservers | DISK_TRANSFER_RATE | |
HBASE | Hadoop HBASE Service | PERF | total_write_bytes_rate_across_regionservers | DISK_WRITE_RATE | |
HBASE | Hadoop HBASE Service | PERF | total_jvm_heap_committed_mb_across_regionservers | HEAPMEM_COMMITTED | 1024*1024 |
HBASE | Hadoop HBASE Service | PERF | total_jvm_max_memory_mb_across_regionservers | HEAPMEM_MAX | 1024*1024 |
HBASE | Hadoop HBASE Service | PERF | total_jvm_heap_used_mb_across_regionservers | HEAPMEM_USED | 1024*1024 |
HBASE | Hadoop HBASE Service | PERF | total_jvm_heap_used_mb_across_regionservers /total_jvm_max_memory_mb_across_regionservers | HEAPMEM_UTIL | |
HBASE | Hadoop HBASE Service | PERF | total_jvm_non_heap_committed_mb_across_regionservers | NONHEAPMEM_COMMITTED | 1024*1024 |
HBASE | Hadoop HBASE Service | PERF | total_jvm_non_heap_used_mb_across_regionservers | NONHEAPMEM_USED | 1024*1024 |
HBASE | Hadoop HBASE Service | PERF | total_stores_across_regionservers | STORE_COUNT | |
HBASE | Hadoop HBASE Service | PERF | total_storefiles_across_regionservers | STOREFILE_COUNT | |
HBASE | Hadoop HBASE Service | PERF | total_storefile_index_size_across_regionservers | STOREFILE_IDX_SIZE | |
HBASE | Hadoop HBASE Service | PERF | total_storefiles_size_across_regionservers | STOREFILE_SIZE | |
HDFS | Hadoop HDFS Resource Manager | PERF | <HDFS usage report> | BYUSER_HDFS_FILE_COUNT | |
HDFS | Hadoop HDFS Resource Manager | PERF | <HDFS usage report> | BYUSER_HDFS_TOTAL_FILE_SIZE | |
HDFS | Hadoop HDFS Resource Manager | PERF | total_bytes_read_rate_across_datanodes | DISK_READ_RATE | |
HDFS | Hadoop HDFS Resource Manager | PERF | total_bytes_written_rate_across_datanodes | DISK_WRITE_RATE | |
HDFS | Hadoop HDFS Resource Manager | PERF | files_total | HDFS_FILES_COUNT | |
HDFS | Hadoop HDFS Resource Manager | PERF | dfs_capacity | HDFS_TOTAL_SIZE | |
HDFS | Hadoop HDFS Resource Manager | PERF | dfs_capacity_used | HDFS_USED_SIZE | |
Cluster | Hadoop Node | CONF | clusterName | CLUSTER_NAME | |
Cluster | Hadoop Node | CONF | "Cloudera" | HADOOP_DISTRIBUTION | |
HOST_JVM | Hadoop Node | CONF | jvm_max_memory_mb | BYVM_HEAPMEM_MAX | 1024*1024 |
HOST_PERF | Hadoop Node | CONF | cores | CPU_NUM | |
HOST_PERF | Hadoop Node | CONF | swap_total | SWAP_SPACE_TOT | |
HOST_PERF | Hadoop Node | CONF | total_capacity_across_filesystems | TOTAL_FS_SIZE | |
HOST_PERF | Hadoop Node | CONF | physical_memory_total | TOTAL_REAL_MEM | |
HOST_PERF | Hadoop Node | CONF | maintenanceMode | MAINTENANCE_MODE | |
HOST_PERF | Hadoop Node | CONF | ipAddress | NET_IP_ADDRESS | |
HOST_PERF | Hadoop Node | CONF | services | HADOOP_COMPONENTS | |
HOST_HDFS | Hadoop Node | PERF | files_total | HDFS_FILES_COUNT | |
HOST_HDFS | Hadoop Node | PERF | dfs_capacity | HDFS_TOTAL_SIZE | |
HOST_HDFS | Hadoop Node | PERF | dfs_capacity_used | HDFS_USED_SIZE | |
HOST_JVM | Hadoop Node | PERF | jvm_gc_rate | BYVM_GC_EVENTS_RATE | |
HOST_JVM | Hadoop Node | PERF | jvm_gc_time_ms_rate | BYVM_GC_TIME_PCT | 0.001 |
HOST_JVM | Hadoop Node | PERF | jvm_heap_committed_mb | BYVM_HEAPMEM_COMMITTED | 1024*1024 |
HOST_JVM | Hadoop Node | PERF | jvm_heap_used_mb | BYVM_HEAPMEM_USED | 1024*1024 |
HOST_PERF | Hadoop Node | PERF | load_1 | CPU_RUN_QUEUE | |
HOST_PERF | Hadoop Node | PERF | (cpu_system_rate+cpu_user_rate) /getHostFact(numCores,1) | CPU_UTIL | |
HOST_PERF | Hadoop Node | PERF | cpu_idle_rate/getHostFact(numCores,1) | CPU_UTIL_IDLE | |
HOST_PERF | Hadoop Node | PERF | cpu_system_rate/getHostFact(numCores,1) | CPU_UTIL_SYSTEM | |
HOST_PERF | Hadoop Node | PERF | cpu_user_rate/getHostFact(numCores,1) | CPU_UTIL_USER | |
HOST_PERF | Hadoop Node | PERF | cpu_iowait_rate/getHostFact(numCores,1) | CPU_UTIL_WAIO | |
HOST_PERF | Hadoop Node | PERF | total_read_bytes_rate_across_disks | DISK_READ_RATE | |
HOST_PERF | Hadoop Node | PERF | total_write_bytes_rate_across_disks | DISK_WRITE_RATE | |
HOST_PERF | Hadoop Node | PERF | physical_memory_cached | MEM_CACHED | |
HOST_PERF | Hadoop Node | PERF | physical_memory_total +(-1*physical_memory_used) | MEM_FREE | |
HOST_PERF | Hadoop Node | PERF | swap_out_rate | MEM_SWAP_OUT_RATE | |
HOST_PERF | Hadoop Node | PERF | physical_memory_used | MEM_USED | |
HOST_PERF | Hadoop Node | PERF | physical_memory_used/physical_memory_total | MEM_UTIL | |
HOST_PERF | Hadoop Node | PERF | physical_memory_cached/physical_memory_total | MEM_UTIL_CACHED | |
HOST_PERF | Hadoop Node | PERF | total_bytes_receive_rate_across_network_interfaces +total_bytes_transmit_rate_across_network_interfaces | NET_BYTE_RATE | |
HOST_PERF | Hadoop Node | PERF | total_bytes_receive_rate_across_network_interfaces | NET_IN_BYTE_RATE | |
HOST_PERF | Hadoop Node | PERF | total_bytes_transmit_rate_across_network_interfaces | NET_OUT_BYTE_RATE | |
HOST_PERF | Hadoop Node | PERF | swap_free | SWAP_SPACE_FREE | |
HOST_PERF | Hadoop Node | PERF | swap_used | SWAP_SPACE_USED | |
HOST_PERF | Hadoop Node | PERF | swap_used/swap_total | SWAP_SPACE_UTIL | |
HOST_PERF | Hadoop Node | PERF | total_capacity_across_filesystems +(-1*total_capacity_used_across_filesystems) | TOTAL_FS_FREE | |
HOST_PERF | Hadoop Node | PERF | total_capacity_used_across_filesystems | TOTAL_FS_USED | |
HOST_PERF | Hadoop Node | PERF | total_capacity_used_across_filesystems /total_capacity_across_filesystems | TOTAL_FS_UTIL | |
YARN_POOL | Hadoop Resource Pool (YARN) | CONF | allocated_vcores_cumulative +available_vcores | CPU_NUM | |
YARN_POOL | Hadoop Resource Pool (YARN) | CONF | allocated_memory_mb_cumulative +available_memory_mb | TOTAL_REAL_MEM | |
YARN_APP | Hadoop Resource Pool (YARN) | PERF | cpu_milliseconds | BYAPP_CPU_TIME | 0.001 |
YARN_APP | Hadoop Resource Pool (YARN) | PERF | application_duration | BYAPP_DURATION | |
YARN_APP | Hadoop Resource Pool (YARN) | PERF | file_bytes_read | BYAPP_FILE_BYTES_READ | |
YARN_APP | Hadoop Resource Pool (YARN) | PERF | file_bytes_written | BYAPP_FILE_BYTES_WRITE | |
YARN_APP | Hadoop Resource Pool (YARN) | PERF | hdfs_bytes_read | BYAPP_HDFS_BYTES_READ | |
YARN_APP | Hadoop Resource Pool (YARN) | PERF | hdfs_bytes_written | BYAPP_HDFS_BYTES_WRITE | |
YARN_APP | Hadoop Resource Pool (YARN) | PERF | map_input_bytes | BYAPP_MAP_IN_BYTES | |
YARN_APP | Hadoop Resource Pool (YARN) | PERF | map_input_records | BYAPP_MAP_IN_RECORDS | |
YARN_APP | Hadoop Resource Pool (YARN) | PERF | map_output_bytes | BYAPP_MAP_OUT_BYTES | |
YARN_APP | Hadoop Resource Pool (YARN) | PERF | map_output_records | BYAPP_MAP_OUT_RECORDS | |
YARN_APP | Hadoop Resource Pool (YARN) | PERF | reduce_input_records | BYAPP_RED_IN_RECORDS | |
YARN_APP | Hadoop Resource Pool (YARN) | PERF | reduce_output_records | BYAPP_RED_OUT_RECORDS | |
YARN_POOL | Hadoop Resource Pool (YARN) | PERF | apps_completed_rate | APP_COMPLETION_RATE | |
YARN_POOL | Hadoop Resource Pool (YARN) | PERF | apps_failed_rate | APP_FAILED_RATE | |
YARN_POOL | Hadoop Resource Pool (YARN) | PERF | yarn_application_file_bytes_read_rate | APP_FILE_READ_RATE | |
YARN_POOL | Hadoop Resource Pool (YARN) | PERF | yarn_application_file_bytes_written_rate | APP_FILE_WRITE_RATE | |
YARN_POOL | Hadoop Resource Pool (YARN) | PERF | yarn_application_hdfs_bytes_read_rate | APP_HDFS_BYTES_READ | |
YARN_POOL | Hadoop Resource Pool (YARN) | PERF | yarn_application_hdfs_bytes_written_rate | APP_HDFS_BYTES_WRITE | |
YARN_POOL | Hadoop Resource Pool (YARN) | PERF | apps_killed_rate | APP_KILLED_RATE | |
YARN_POOL | Hadoop Resource Pool (YARN) | PERF | yarn_application_maps_rate | APP_MAP_LAUNCH_RATE | |
YARN_POOL | Hadoop Resource Pool (YARN) | PERF | apps_pending | APP_PENDING | |
YARN_POOL | Hadoop Resource Pool (YARN) | PERF | yarn_application_reduces_rate | APP_RED_LAUNCH_RATE | |
YARN_POOL | Hadoop Resource Pool (YARN) | PERF | apps_running | APP_RUNNING | |
YARN_POOL | Hadoop Resource Pool (YARN) | PERF | apps_submitted_rate | APP_SUBMITTED_RATE | |
YARN_POOL | Hadoop Resource Pool (YARN) | PERF | allocated_memory_mb | MEM_USED | |
YARN_POOL | Hadoop Resource Pool (YARN) | PERF | allocated_vcores | VCORES_USED | |
YARN_POOL | Hadoop Resource Pool (YARN) | PERF | reserved_vcores | VCORES_RESERVED | |
YARN_POOL | Hadoop Resource Pool (YARN) | PERF | pending_vcores | VCORES_PENDING | |
YARN_POOL | Hadoop Resource Pool (YARN) | PERF | reserved_memory_mb | MEM_RESERVED | 1024*1024 |
YARN_POOL | Hadoop Resource Pool (YARN) | PERF | pending_memory_mb | MEM_PENDING | 1024*1024 |
YARN | Hadoop YARN Resource Manager | CONF | total_allocated_vcores_across_yarn_pools +total_available_vcores_across_yarn_pools | CPU_NUM | |
YARN | Hadoop YARN Resource Manager | CONF | total_allocated_memory_mb_across_yarn_pools +total_available_memory_mb_across_yarn_pools | TOTAL_REAL_MEM | 1024*1024 |
Spark | Hadoop YARN Resource Manager | PERF | totalCores | APP_SPARK_CORES | |
Spark | Hadoop YARN Resource Manager | PERF | diskUsed | APP_SPARK_DISK_BYTES | |
Spark | Hadoop YARN Resource Manager | PERF | totalGCTime | APP_SPARK_GC_TIME | |
Spark | Hadoop YARN Resource Manager | PERF | totalInputBytes | APP_SPARK_INPUT_BYTES | |
Spark | Hadoop YARN Resource Manager | PERF | maxMemory | APP_SPARK_MEM_TOTAL_BYTES | |
Spark | Hadoop YARN Resource Manager | PERF | memoryUsed | APP_SPARK_MEM_USED_BYTES | |
Spark | Hadoop YARN Resource Manager | PERF | rddBlocks | APP_SPARK_RDD_BLOCKS | |
Spark | Hadoop YARN Resource Manager | PERF | totalShuffleRead | APP_SPARK_SHUFFLE_READ_BYTES | |
Spark | Hadoop YARN Resource Manager | PERF | totalShuffleWrite | APP_SPARK_SHUFFLE_WRITE_BYTES | |
Spark | Hadoop YARN Resource Manager | PERF | totalDuration | APP_SPARK_TASK_TIME | |
Spark | Hadoop YARN Resource Manager | PERF | completedTasks | APP_SPARK_TASKS_COMPLETED | |
Spark | Hadoop YARN Resource Manager | PERF | failedTasks | APP_SPARK_TASKS_FAILED | |
Spark | Hadoop YARN Resource Manager | PERF | totalTasks | APP_SPARK_TASKS_TOTAL | |
Spark | Hadoop YARN Resource Manager | PERF | totalCores | BYAPP_SPARK_CORES | |
Spark | Hadoop YARN Resource Manager | PERF | diskUsed | BYAPP_SPARK_DISK_BYTES | |
Spark | Hadoop YARN Resource Manager | PERF | totalGCTime | BYAPP_SPARK_GC_TIME | |
Spark | Hadoop YARN Resource Manager | PERF | totalInputBytes | BYAPP_SPARK_INPUT_BYTES | |
Spark | Hadoop YARN Resource Manager | PERF | maxMemory | BYAPP_SPARK_MEM_TOTAL_BYTES | |
Spark | Hadoop YARN Resource Manager | PERF | memoryUsed | BYAPP_SPARK_MEM_USED_BYTES | |
Spark | Hadoop YARN Resource Manager | PERF | rddBlocks | BYAPP_SPARK_RDD_BLOCKS | |
Spark | Hadoop YARN Resource Manager | PERF | totalShuffleRead | BYAPP_SPARK_SHUFFLE_READ_BYTES | |
Spark | Hadoop YARN Resource Manager | PERF | totalShuffleWrite | BYAPP_SPARK_SHUFFLE_WRITE_BYTES | |
Spark | Hadoop YARN Resource Manager | PERF | totalDuration | BYAPP_SPARK_TASK_TIME | |
Spark | Hadoop YARN Resource Manager | PERF | completedTasks | BYAPP_SPARK_TASKS_COMPLETED | |
Spark | Hadoop YARN Resource Manager | PERF | failedTasks | BYAPP_SPARK_TASKS_FAILED | |
Spark | Hadoop YARN Resource Manager | PERF | totalTasks | BYAPP_SPARK_TASKS_TOTAL | |
YARN | Hadoop YARN Resource Manager | PERF | yarn_application_file_bytes_read_rate | APP_FILE_READ_RATE | |
YARN | Hadoop YARN Resource Manager | PERF | yarn_application_file_bytes_written_rate | APP_FILE_WRITE_RATE | |
YARN | Hadoop YARN Resource Manager | PERF | yarn_application_hdfs_bytes_read_rate | APP_HDFS_BYTES_READ | |
YARN | Hadoop YARN Resource Manager | PERF | yarn_application_hdfs_bytes_written_rate | APP_HDFS_BYTES_WRITE | |
YARN | Hadoop YARN Resource Manager | PERF | yarn_application_maps_rate | APP_MAP_LAUNCH_RATE | |
YARN | Hadoop YARN Resource Manager | PERF | yarn_application_reduces_rate | APP_RED_LAUNCH_RATE | |
YARN | Hadoop YARN Resource Manager | PERF | total_allocated_vcores_across_yarn_pools /(total_allocated_vcores_across_yarn_pools +total_available_vcores_across_yarn_pools) | VCORES_USED | |
YARN | Hadoop YARN Resource Manager | PERF | total_available_memory_mb_across_yarn_pools | MEM_FREE | 1024*1024 |
YARN | Hadoop YARN Resource Manager | PERF | total_allocated_memory_mb_across_yarn_pools | MEM_USED | 1024*1024 |
YARN | Hadoop YARN Resource Manager | PERF | total_allocated_memory_mb_across_yarn_pools /(total_allocated_memory_mb_across_yarn_pools +total_available_memory_mb_across_yarn_pools) | MEM_UTIL | |
YARN_ALL_POOLS | Hadoop YARN Resource Manager | PERF | apps_completed_cumulative_rate | APP_COMPLETION_RATE | |
YARN_ALL_POOLS | Hadoop YARN Resource Manager | PERF | apps_failed_cumulative_rate | APP_FAILED_RATE | |
YARN_ALL_POOLS | Hadoop YARN Resource Manager | PERF | apps_killed_cumulative_rate | APP_KILLED_RATE | |
YARN_ALL_POOLS | Hadoop YARN Resource Manager | PERF | apps_pending_cumulative | APP_PENDING | |
YARN_ALL_POOLS | Hadoop YARN Resource Manager | PERF | apps_running_cumulative | APP_RUNNING | |
YARN_ALL_POOLS | Hadoop YARN Resource Manager | PERF | apps_submitted_cumulative_rate | APP_SUBMITTED_RATE |
Comments
Log in or register to comment.