Moviri Integrator for BMC Helix Capacity Optimization - HP SiteScope
Requirements
Supported versions of data source software
HP SiteScope from version 10.12 (and following minor releases) to version 11.00 (and following minor releases)
Supported configurations of data source software
Moviri Integrator for HP SiteScope supports SiteScope instances configured to export data to an external database. See next section for information about the supported DBMS technologies.
HP SiteScope includes SOAP-based API to manage the configuration of the monitored environment. Access to this API is required too.
Supported DBMS technology for integration
Moviri Integrator for BMC Helix Continuous Optimization – HP SiteScope supports the following DBMS technologies as HP SiteScope export DB:
- MySQL DBMS. MySQL version 5 with the related JDBC connector available on MySQL official website is advised.
- Oracle version 9 or higher, with the related JDBC connector shipped together with BMC Helix Continuous Optimization.
Datasource Check and Configuration
Preparing to connect to datasource software
As a first step, please ensure that the correct version of SiteScope is installed. You can perform this check from the “Help” section of the SiteScope Console:
Set up the DBMS for external logging
In order to enable the external database logging, you have to set up and configure a DBMS. Create a schema and a user with all privileges on it for reading and writing monitoring data.
Preliminary SiteScope checks
To configure your SiteScope instance for external database logging, please ensure the following requirements are respected:
Make sure you have a SiteScope login with necessary privileges to access Infrastructure Preferences inside your SiteScope instance.
- By default, monitoring data are stored into SiteScope<YYYY-MM-DD>.log files under <SiteScope_root_path>\logs directory. Make sure that the date and number format of data is respectively yyyy-MM-dd HH24:mm:ss (e.g. 2012-01-01 00:00:00) and with ‘.’ as decimal separator (e.g. 344.78). If not so, configure appropriately the user locale settings under which SiteScope service runs.
- Make sure to have a SiteScope login to use for web services access.
- Ensure you have an account on the machine where SiteScope is installed with the necessary rights to start and stop SiteScope service.
- Obtain the JDBC connector to use for the connection between your SiteScope instance and the DBMS and SiteScope ETL and the DBMS.
Configuring SiteScope for external database logging
To perform the configuration for external database logging, follow these steps:
- If running, stop SiteScope service.
- Open <SiteScope_root_path>\groups\master.config file (make a backup copy before editing) and search for the following parameters:
- _accessControlled: web services access type
- _logJdbcAutoCommitSiteScopeLog: number of monitors’ runs before collected data are committed to the database
- _logJdbcCreateSiteScopeLog: query for table creation
- _logJdbcInsertSiteScopeLog: insert query
- _logJdbcDriverSiteScopeLog: JDBC driver family
- _logJdbcURLSiteScopeLog: url for DBMS connection
- _logJdbcUserSiteScopeLog: DBMS user
- _logJdbcPasswordSiteScopeLog: encrypted password of DBMS user
Set them as follows:
- Enable the web services access with a SiteScope login authentication
_accessControlled=true
- Commit directly to the database the monitoring results so that SiteScope ETL can read fresh data everytime it runs
_logJdbcAutoCommitSiteScopeLog=1
- Create a table for logging data with an arbitrary number of columns depending on the configuration of the monitored environment. By default, all columns between 1 (datex) and 9 (monitorID) indicate the same properties for all SiteScope monitors. The next columns, from value1 to value10, have values which depend on each monitor and represent the measurements of metrics. Therefore, if necessary, you may need to increase the number of columns of the table to cover all measurements performed by a monitor. By default, the query is configured to store 10 measurements:
_logJdbcCreateSiteScopeLog=CREATE TABLE SiteScopeLog (datex VARCHAR(255), serverName VARCHAR(255), class VARCHAR(255), sample VARCHAR(255), category VARCHAR(255), groupName VARCHAR(255), monitorName VARCHAR(255), status VARCHAR(255), monitorID VARCHAR(255), value1 VARCHAR(255), value2 VARCHAR(255), value3 VARCHAR(255), value4 VARCHAR(255), value5 VARCHAR(255), value6 VARCHAR(255), value7 VARCHAR(255), value8 VARCHAR(255), value9 VARCHAR(255), value10 VARCHAR(255))
If you have a monitor which performs more than 10 measurements and you want to store them in your database, you will need to add the exceeding columns to the query. For example, if you have a monitor with the following measurements in your SiteScope console:
You can read the number of counters (therefore measurements in the database) active and add the exceeding number of columns to the query:
_logJdbcCreateSiteScopeLog=CREATE TABLE SiteScopeLog (datex VARCHAR(255), serverName VARCHAR(255), class VARCHAR(255), sample VARCHAR(255), category VARCHAR(255), groupName VARCHAR(255), monitorName VARCHAR(255), status VARCHAR(255), monitorID VARCHAR(255), value1 VARCHAR(255), value2 VARCHAR(255), value3 VARCHAR(255), value4 VARCHAR(255), value5 VARCHAR(255), value6 VARCHAR(255), value7 VARCHAR(255), value8 VARCHAR(255), value9 VARCHAR(255), value10 VARCHAR(255), value11 VARCHAR(255), value12 VARCHAR(255), value13 VARCHAR(255), value14 VARCHAR(255), value15 VARCHAR(255))
- After having configured the query to create the log table, you will need to make the changes (if any) also inside the insert query. By default, the insert query is
_logJdbcInsertSiteScopeLog=INSERT INTO SiteScopeLog VALUES(?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?)
9 standard columns 10 counters measurements
with 19 parameters, the first 9 for standard columns from datex to monitorID and the other 10 for counters.
If you increased the number of columns to store data, you will have to add the correct number of “?”. In the previous example, 9 standard columns + 15 counters produces 24 columns to be filled by the insert query. Therefore other 5 “?” will be added:
_logJdbcInsertSiteScopeLog=INSERT INTO SiteScopeLog VALUES(?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?)
9 standard columns 15 counters measurements
- Set the driver family to the MySQL server one
_logJdbcDriverSiteScopeLog=com.mysql.jdbc.Driver
- Configure the URL to connect to MySQL server
_logJdbcURLSiteScopeLog=jdbc:mysql://<server_address>:<server_port>/<database>
- Set the database user and password properties
_logJdbcUserSiteScopeLog=<mysql_user>
_logJdbcPasswordSiteScopeLog=<mysql_password>
- Move the DBMS driver (mysql-connector-java-<version>.jar) to the <SiteScope_root_path>\WEB-INF\lib directory
- Start SiteScope service
- In SiteScope Console, navigate to Preferences, Infrastructure Preferences, Monitor Settings and enable JDBC logging.
- Save the changes.
Instructions have been provided for the MySQL case. The Oracle case is omitted since it comprises the same steps with similar values. Please refer to HP SiteScope documentation for further reference.
- Restart SiteScope service by clicking the corresponding button.
- Verify the files error.log and RunMonitor.log in the <SiteScope_root_path>\logs\ directory for the correct activation of the external database for logging.
Some important considerations
- Check your monitoring environment to correctly size the log table column number before activating the external database. You have to make sure that the maximum number of counters for every single monitor does not exceed the columns of the log table (as for the previous example).
Notice that the order of counters reported into the log table columns doesn’t correspond to the one showed in the “Dashboard” panel of SiteScope Console. The association order between counters and columns represents their selection order during the creation of the monitor and is reported in the “Properties” panel. For the previous example, after the default “counters in error” column, the other columns are associated with the counters as shown in the following figure:
This leads to other 3 important points you should consider when activating database logging:- If a counter of interest is in a position that exceeds the number of columns of the log table, you will not store it in your database unless you increase the number of columns.
- If you change the counters selection order, SiteScope will save the last current configuration to associate columns to counters and will perform this change also in the database for the next measurements. The columns will store different counters than before and, as a consequence, the new configuration sent to SiteScope connector will produce a misinterpretation for data stored before the change.
- The storage of new counters for a monitor doesn’t produce counters misinterpretation. Nevertheless you may need to increase the number of columns of your log table to store all data. To perform the change, you have to repeat the steps described above to modify the master.conf file. Before restarting SiteScope, you have to manually alter the table structure from inside your DBMS, adding new columns (the alter operation is not performed by SiteScope directly).
- Database aging policies are not managed from SiteScope. Configure your policies and pay attention to them when using SiteScope connector for historical data recovery
Connector configuration
Connector configuration attributes
There are three sections (tabs) in the ETL run configuration page where the behaviour of “Moviri Integrator for BMC Helix Continuous Optimization - HP SiteScope” can be specified:
- Connection parameters (common BMC Helix Continuous Optimization setting)
- SiteScope - Settings
- SiteSCope - Data Selection
SiteScope - Settings
Property Name | Value Type | Required? | Default | Description |
SiteScope login name | String | Yes | SiteScope login name of user used to connect to SiteScope Web Services. | |
SiteScope password | String | Yes | Password of SiteScope user used to connect to SiteScope Web Services. | |
SiteScope host | Numeric | Yes | IP of the host where HP SiteScope is installed. | |
SSL Authentication | Yes/No | Yes | No | Enables/Disables the SSL over http communication protocol for SiteScope Web Services, accepting also untrusted certificate (when enabled). |
SiteScope version | Selection | Yes | Higher than 11.10 | Version of HP SiteScope installed. |
SiteScope log schema | String | Yes | The name of the schema used for log. | |
SiteScope log table | String | Yes | The name of the table used for log. |
SiteScope - Data Selection
Property Name | Value Type | Required? | Default | Description |
Default last counter (YYYY-MM-DD HH24:MI:SS) | String | Yes | If last counter is not already set, use this entry | |
Recovery mode active | Yes/No | Yes | No | When recovery is active, ETL extracts data in the time window specified by the next two properties, last counter will not be updated and max days to extract will be ignored |
Recovery from date (YYYY-MM-DD HH24:MI:SS) | String | No | “Since” timestamp when recovery mode is active. Date format is specified between the brackets | |
Recovery to date (YYYY-MM-DD HH24:MI:SS) | String | No | “To” timestamp when recovery mode is active. Date format is specified between the brackets | |
Max extraction days (no value=no limit) | Numeric | No | Limit maximum number of days to extract in a single run | |
Whitelist of systems to import | String | No | Semicolon-separated list of systems whose data is going to be imported, regex wildcard can be used. | |
Empty list means all servers | ||||
Blacklist of systems to import | String | No | Semicolon-separated list of systems whose data is not going to be imported, regex wildcard can be used. | |
Empty list means none | ||||
Recreate SiteScope hierarchy | Yes/No | Yes | No | Recreate the HP SiteScope hierarchy of groups and systems related to monitors into CO |
Metric classes to import | Checkbox | Yes | Metrics related to classes that if checked will be imported | |
Remove domain suffix from system names | Yes/No | Yes | Yes | If set to yes, It will remove the domain from hostname |
Guidelines to choose the most appropriate ETL configuration
In order to set the ETL configuration that match your needs, in this paragraph some common use cases are presented.
Scenario 1: “Typical” systems capacity analysis and planning
- Goal : ensure the right servers capacity (CPU, Memory, Logical/Physical disk and Network resource utilization)
- Environment size : medium/big
- Environment peculiarity : quite steady
- Planning time period : long (6-12 months)
- Outputs: Analyses and forecast on resource utilization and violation threshold
Scenario 2: “in-depth” capacity analysis and planning for specific systems
- Goal : react on short-term growth (CPU, Memory, Logical/Physical disk and Network resource utilization)
- Environment size : small
- Environment peculiarity : new service introduction / across a change of application or devices
- Planning time period : short (weeks)
- Outputs: Growth trend, short-term forecast, correlation between resource utilization and service business drivers (users, transactions)
The choice of correct configuration brings you benefits also in terms of shorter execution time and saved disk space on database.
Every SiteScope ETL instance configuration applies to all systems selected, if there are different scenario needs for different systems, is recommended to create many ETL instances with different configuration which filters on particular systems (e.g. There are both a big and stable environment (scenario 1) and the introduction of a new service (Scenario2))
Data volume considerations
The following table is a reference to estimate the data extraction volume produced by the HP SiteScope connector as a function of the number of extracted days.
Num. of servers | Num. of monitors | Extraction Days | Rows extracted | Rows extracted for 1 system | Rows extracted for 1 monitor |
10 | 75 | 1 | 48607 | 4861 | 648 |
10 | 75 | 2 | 94900 | 4745 | 632 |
10 | 75 | 3 | 139548 | 4651 | 620 |
The results presented above assume the following connector configuration (as per metric filters specified in Scenario 1):
- 8 monitors for each system
- 10 counters per monitor
- Monitors’ runs frequency: 10 minutes
Under these assumptions, the estimated number of daily rows extracted by the connector, as a function of the number of servers, is presented below
Number of servers | Num. of monitors | Rows extracted for 1 day volume of data |
10 | 100 | 64000 |
100 | 1000 | 640000 |
1000 | 10000 | 6400000 |
Historical data extraction
In order to perform a historical recovery of data, please use “recovery mode properties” settings:
Recovery mode active=true and filling the two properties “since date” and “to date” in order to specify the time window. When recovery mode is active, the last counter will not be updated and max day to extract will be ignored.
If the ETL is newly created and has no last counter defined, the “default last counter” is used.
The pre-condition for an historical extraction is the presence of data inside the external database in the selected time period.
SSL Authentication
In order to communicate with Web Services with SSL protocol over HTTP (HTTPS) you must configure SiteScope to use SSL. Below an example of accessing SiteScope by HTTPS protocol.
To properly configure the ETL, you need to enable the SSL authentication property in SiteScope – Settings tab and specify correctly the IP of the host where SiteScope is installed and the port with SSL (8443 in the following example).
Supported Platforms
For all metrics imported by the ETL and described below in this section, the following apply:
- Supported OS families: Red Hat Enterprise Linux, Linux CentOS, Solaris, Windows NT
- Supported BMC Helix Continuous Optimization Entity Type: System (Generic)
Troubleshooting
For ETL troubleshooting, please refer to official BMC documentation available here.
Configuration and Performance Metrics Mapping
Performance Metrics
The SiteScope ETL connects to SiteScope and reads from external database monitors measurements performed on systems remotely. In the following table the supported metrics for OS families and the related SiteScope monitors and objects are reported.
Metric Name | OS family | HP SiteScope Monitor | HP SiteScope object | BMC Helix Continuous Optimization metric | Conversion Factor |
utilization | Linux/Solaris/Windows NT | CPU Monitor | CPU_UTIL | 0,01 | |
Pages/sec | Linux/Solaris/Windows NT | Memory Monitor | MEM_PAGE_RATE | ||
virtual memory used % | Windows NT | Memory Monitor | MEM_UTIL_COMMITTED_C | 0,01 | |
swap space used % | Linux / Solaris | Memory Monitor | SWAP_SPACE_UTIL | 0,01 | |
swap space MB free | Linux / Solaris | Memory Monitor | SWAP_SPACE_FREE | 1048576 | |
physical memory used % | Linux / Solaris | Memory Monitor | MEM_UTIL | 0.01 | |
physical memory MB free | Linux / Solaris | Memory Monitor | MEM_FREE | 1048576 | |
Percent full | Linux/Solaris/Windows NT | Dynamic Disk Space Monitor | BYLDISK_UTIL | 0.01 | |
MB free | Linux/Solaris/Windows NT | Dynamic Disk Space Monitor | BYLDISK_FREE_SPACE | 1048576 | |
Percent full | Linux/Solaris/Windows NT | Disk Space Monitor | BYLDISK_UTIL | 0.01 | |
MB free | Linux/Solaris/Windows NT | Disk Space Monitor | BYLDISK_FREE_SPACE | 1048576 | |
Idle | Linux Server | UNIX Resources Monitor | Processor | CPU_UTIL | 1-(value *0.01) |
1minAvg | Linux / Solaris | UNIX Resources Monitor | Load Average | CPU_RUN_QUEUE | |
system | Linux Server | UNIX Resources Monitor | Processor | CPU_UTIL_SYSTEM | 0.01 |
user | Linux Server | UNIX Resources Monitor | Processor | CPU_UTIL_USER | 0.01 |
%idle | Solaris Server | UNIX Resources Monitor | CPU utilization | CPU_UTIL | 1- (value * 0.01) |
%sys | Solaris Server | UNIX Resources Monitor | CPU utilization | CPU_UTIL_SYSTEM | 0.01 |
%usr | Solaris Server | UNIX Resources Monitor | CPU utilization | CPU_UTIL_USER | 0.01 |
1minAvg | Solaris Server | UNIX Resources Monitor | Load Average | CPU_RUN_QUEUE | |
MemFree | Linux Server | UNIX Resources Monitor | Memory | MEM_FREE | 1024 |
Active | Linux Server | UNIX Resources Monitor | Memory | MEM_ACTIVE | 1024 |
Cached | Linux Server | UNIX Resources Monitor | Memory | MEM_CACHED | 1024 |
CommitLimit | Linux Server | UNIX Resources Monitor | Memory | MEM_COMMIT_LIMIT | 1024 |
Committed_AS | Linux Server | UNIX Resources Monitor | Memory | MEM_COMMITED_AS | 1024 |
SwapFree | Linux Server | UNIX Resources Monitor | Memory | SWAP_SPACE_FREE | 1024 |
swap_avail | Solaris Server | UNIX Resources Monitor | Memory | SWAP_SPACE_FREE | value * 512 |
swap_resv | Solaris Server | UNIX Resources Monitor | Memory | SWAP_SPACE_USED | value * 512 |
freemem | Solaris Server | UNIX Resources Monitor | Memory | MEM_FREE | value * 512 |
Available | Linux Server | UNIX Resources Monitor | FileSystems | BYLDISK_FREE_SPACE | 1048576 |
Use% | Linux Server | UNIX Resources Monitor | FileSystems | BYLDISK_USED_SPACE_PCT | 0.01 |
Used | Linux Server | UNIX Resources Monitor | FileSystems | BYLDISK_USED_SPACE | 1048576 |
avail | Solaris Server | UNIX Resources Monitor | FileSystems | BYLDISK_FREE_SPACE | 1048576 |
capacity | Solaris Server | UNIX Resources Monitor | FileSystems | BYLDISK_USED_SPACE_PCT | 0.01 |
used | Solaris Server | UNIX Resources Monitor | FileSystems | BYLDISK_USED_SPACE | 1048576 |
IOs in progress | Linux Server | UNIX Resources Monitor | Disk Stats | BYDISK_QUEUE_SIZE | |
reads | Solaris Server | UNIX Resources Monitor | Physical Disk | BYDISK_PHYS_IO_READ_RATE | |
writes | Solaris Server | UNIX Resources Monitor | Physical Disk | BYDISK_PHYS_IO_WRITE_RATE | |
nread | Solaris Server | UNIX Resources Monitor | Physical Disk | BYDISK_READ_RATE | |
nwritten | Solaris Server | UNIX Resources Monitor | Physical Disk | BYDISK_WRITE_RATE | |
rcnt | Solaris Server | UNIX Resources Monitor | Physical Disk | BYDISK_QUEUE_SIZE | |
packets | Linux Server | UNIX Resources Monitor | Network Interface | BYIF_PKT_RATE | |
ReceiveBytes | Linux Server | UNIX Resources Monitor | Network Interface | BYIF_IN_BIT_RATE | 8 |
TransmitBytes | Linux Server | UNIX Resources Monitor | Network Interface | BYIF_OUT_BIT_RATE | 8 |
% idle time | Windows NT | Microsoft Windows Resource Monitor | Processor | CPU_UTIL | 1- (value * 0.01) |
% Privileged Time | Windows NT | Microsoft Windows Resource Monitor | Processor | CPU_UTIL_SYSTEM | 0.01 |
% User Time | Windows NT | Microsoft Windows Resource Monitor | Processor | CPU_UTIL_USER | 0.01 |
% Processor Time | Windows NT | Microsoft Windows Resource Monitor | Processor | CPU_UTIL | 0.01 |
Processor Queue Length | Windows NT | Microsoft Windows Resource Monitor | System | CPU_RUN_QUEUE | |
% Committed Bytes In Use | Windows NT | Microsoft Windows Resource Monitor | Memory | MEM_UTIL_COMMITTED_C | 0.01 |
available bytes | Windows NT | Microsoft Windows Resource Monitor | Memory | MEM_FREE | |
Committed Bytes | Windows NT | Microsoft Windows Resource Monitor | Memory | MEM_COMMITED | |
Cache Bytes | Windows NT | Microsoft Windows Resource Monitor | Memory | MEM_CACHED | |
Pages/sec | Windows NT | Microsoft Windows Resource Monitor | Memory | MEM_PAGE_RATE | |
% Free Space | Windows NT | Microsoft Windows Resource Monitor | LogicalDisk | LDISK_USED_SPACE_PCT | 1- (value * 0.01) |
% Idle Time | Windows NT | Microsoft Windows Resource Monitor | LogicalDisk | LDISK_UTIL | 1- (value * 0.01) |
Free Megabytes | Windows NT | Microsoft Windows Resource Monitor | LogicalDisk | LDISK_FREE | 1048576 |
% Free Space | Windows NT | Microsoft Windows Resource Monitor | LogicalDisk | BYLDISK_USED_SPACE_PCT | 1- (value * 0.01) |
% Idle Time | Windows NT | Microsoft Windows Resource Monitor | LogicalDisk | BYLDISK_UTIL | 1- (value * 0.01) |
Free Megabytes | Windows NT | Microsoft Windows Resource Monitor | LogicalDisk | BYLDISK_FREE_SPACE | 1048576 |
Avg. Disk Queue Length | Windows NT | Microsoft Windows Resource Monitor | PhysicalDisk | DISK_IO_LENGTH | |
Disk Bytes/sec | Windows NT | Microsoft Windows Resource Monitor | PhysicalDisk | DISK_TRANSFER_RATE | |
% Disk Time | Windows NT | Microsoft Windows Resource Monitor | PhysicalDisk | DISK_UTIL | 0.01 |
Disk Read Bytes/sec | Windows NT | Microsoft Windows Resource Monitor | PhysicalDisk | DISK_READ_RATE | |
Disk Write Bytes/sec | Windows NT | Microsoft Windows Resource Monitor | PhysicalDisk | DISK_WRITE_RATE | |
Avg. Disk Queue Length | Windows NT | Microsoft Windows Resource Monitor | PhysicalDisk | BYDISK_QUEUE_SIZE | |
Disk Bytes/sec | Windows NT | Microsoft Windows Resource Monitor | PhysicalDisk | BYDISK_TRANSFER_RATE | |
% Disk Time | Windows NT | Microsoft Windows Resource Monitor | PhysicalDisk | BYDISK_UTIL | 0.01 |
Disk Read Bytes/sec | Windows NT | Microsoft Windows Resource Monitor | PhysicalDisk | BYDISK_READ_RATE | |
Disk Write Bytes/sec | Windows NT | Microsoft Windows Resource Monitor | PhysicalDisk | BYDISK_WRITE_RATE | |
Packets/sec | Windows NT | Microsoft Windows Resource Monitor | Network Interface | BYIF_PKT_RATE | |
Bytes Received/sec | Windows NT | Microsoft Windows Resource Monitor | Network Interface | BYIF_OUT_BIT_RATE | 8 |
Bytes Sent/sec | Windows NT | Microsoft Windows Resource Monitor | Network Interface | BYIF_IN_BIT_RATE | 8 |
Bytes Total/sec | Windows NT | Microsoft Windows Resource Monitor | Network Interface | BYIF_BIT_RATE | 8 |
Configuration metrics
This is a list of configuration metrics extracted by SiteScope ETL.
Metric Name | OS family | Monitor class | HP SiteScope object | BMC Helix Continuous Optimization metric | Conversion Factor |
MB total | Linux/Solaris/Windows NT | Dynamic Disk Space Monitor | BYLDISK_SIZE | 1048576 | |
model name | Linux Server | UNIX Resources Monitor | Processor Info | CPU_MODEL | |
cpu MHZ | Linux Server | UNIX Resources Monitor | Processor Info | CPU_MHZ | |
clock_MHz | Solaris Server | UNIX Resources Monitor | Processor Info | CPU_MHZ | |
MemTotal | Linux Server | UNIX Resources Monitor | Memory | TOTAL_REAL_MEM | 1024 |
SwapTotal | Linux Server | UNIX Resources Monitor | Memory | SWAP_SPACE_TOT | 1024 |
ifspeed | Solaris Server | UNIX Resources Monitor | Network Interface | BYIF_BANDWIDTH | |
Current Bandwidth | Windows NT | Microsoft Windows Resource Monitor | Network Interface | BYIF_BANDWIDTH |
Derived metrics
In addition to the metrics available from the data source, the following metrics are computed by the connector:
OS family | HP SiteScope monitor | HP SiteScope object | Derived BMC Helix Continuous Optimization metric | HP SiteScope source metrics |
Windows NT | Memory Monitor | MEM_COMMITED | virtual memory MB free; virtual memory used % | |
Linux Server | UNIX Resources Monitor | Memory | SWAP_SPACE_UTIL | SwapFree; SwapTotal |
Linux Server | UNIX Resources Monitor | Memory | SWAP_SPACE_USED | SwapTotal; SwapFree |
Solaris Server | UNIX Resources Monitor | Memory | SWAP_SPACE_UTIL | swap_resv; swap_avail |
Solaris Server | UNIX Resources Monitor | Memory | SWAP_SPACE_TOT | swap_resv; swap_avail |
Solaris Server | UNIX Resources Monitor | Memory | SWAP_SPACE_TOT | swap_resv; swap_avail |
Linux Server | UNIX Resources Monitor | Disk Stats | BYDISK_UTIL | ms spent doing IOs |
Linux Server | UNIX Resources Monitor | Disk Stats | BYDISK_PHYS_IO_READ_RATE | Reads |
Linux Server | UNIX Resources Monitor | Disk Stats | BYDISK_PHYS_IO_WRITE_RATE | Writes |
Solaris Server | UNIX Resources Monitor | Network Interface | BYIF_IN_PKT_RATE | ipackets |
Solaris Server | UNIX Resources Monitor | Network Interface | BYIF_OUT_PKT_RATE | opackets |
Solaris Server | UNIX Resources Monitor | Network Interface | BYIF_IN_BIT_RATE | Rbytes |
Solaris Server | UNIX Resources Monitor | Network Interface | BYIF_OUT_BIT_RATE | Obytes |
Metric Classes
All of the metrics managed by the connector are grouped in the following “Metric Classes”
CPU and Memory Basic Metrics
Memory Advanced Metrics
Logical Disk Occupation Metrics
Physical Disk Performance Metrics
Network Interface Metrics
The following table shows for each metric class the contained metrics
Metric Class | BMC Helix Continuous Optimization Metric |
CPU and Memory Basic Metrics | CPU_UTIL |
MEM_PAGE_RATE | |
MEM_UTIL | |
MEM_FREE | |
Memory Advanced Metrics | MEM_UTIL_COMMITTED_C |
MEM_COMMITED | |
SWAP_SPACE_UTIL | |
SWAP_SPACE_FREE | |
SWAP_SPACE_USED | |
MEM_ACTIVE | |
MEM_CACHED | |
MEM_COMMIT_LIMIT | |
MEM_COMMITED_AS | |
CPU_UTIL_SYSTEM | |
CPU_UTIL_USER | |
CPU_RUN_QUEUE | |
Logical Disk Occupation Metrics | BYLDISK_UTIL |
BYLDISK_FREE_SPACE | |
BYLDISK_USED_SPACE_PCT | |
BYLDISK_USED_SPACE | |
LDISK_USED_SPACE_PCT | |
LDISK_UTIL | |
LDISK_FREE | |
Physical Disk Performance Metrics | BYDISK_QUEUE_SIZE |
BYDISK_PHYS_IO_READ_RATE | |
BYDISK_PHYS_IO_WRITE_RATE | |
BYDISK_UTIL | |
BYDISK_READ_RATE | |
BYDISK_WRITE_RATE | |
DISK_IO_LENGTH | |
DISK_TRANSFER_RATE | |
DISK_UTIL | |
DISK_READ_RATE | |
DISK_WRITE_RATE | |
BYDISK_TRANSFER_RATE | |
Network Interface Metrics | BYIF_PKT_RATE |
BYIF_IN_BIT_RATE | |
BYIF_OUT_BIT_RATE | |
BYIF_IN_PKT_RATE | |
BYIF_OUT_PKT_RATE | |
BYIF_BIT_RATE |
The SiteScope ETL can be configured to collect only specific metric classes by configuring the related custom properties.
Overlapping Metrics
SiteScope can measure server performance metrics with two distinct categories of monitors:
- generic monitors, which apply to all OS families, and specific OS monitors, which apply to a specific OS type server. The first category is composed by CPU Monitor, Memory Monitor, Dynamic Disk Space Monitor and Disk Space Monitor (for SiteScope version 10).
- UNIX Resources Monitors and Microsoft Windows Resource Monitors.
This leads to some metrics measured by both generic and OS specific monitors with the consequence of repeating or overlapping those measurements. In order to avoid the overwrite of common metrics measurements, the connector implements a mechanism of precedence for which, if both OS specific and generic monitors are monitoring the same metric for the same server, the OS specific monitor will have precedence over the generic one and only its measurements will be imported. Be aware of what follows:
The ETL filters measurements only in case two monitors with overlapping metrics collect data for the same system
The ETL will not make distinction on the sub-resource monitored, only on the monitor metrics and the host monitored. For example, following the table 10, if both the Dynamic Disk Space Monitor and the Microsoft Windows Resources Monitor collect the metric BYLDISK_UTIL for the host 10.31.168.156 and the sub-resource “C:”, only the measurement performed by the Microsoft Windows Resource Monitor will be imported. Besides if the Dynamic Disk Space Monitor collects metrics on a “D:” sub-resource, also this will not be imported, even if the Microsoft Windows Resource Monitor is not making measurements on it (i.e. the mechanism doesn’t distinguish any sub resource, only checks for monitor, host and metric). In the example, to monitor the “C:” and “D:” sub resources you can use a Dynamic Disk Space Monitor alone, which collects data on both logical disks, or a Microsoft Windows Resource Monitor on both “C:” and “D:”.
Below the list of overlapped metrics:
OS family | Monitor ignored | Monitor privileged | BMC Helix Continuous Optimization metric |
Windows NT | Dynamic Disk Space Monitor | Microsoft Windows Resource Monitor | BYLDISK_UTIL |
Linux/Solaris/Windows NT | Dynamic Disk Space Monitor | UNIX Resources Monitor/ Microsoft Windows Resource Monitor | BYLDISK_FREE_SPACE |
Windows NT | Disk Space Monitor | Microsoft Windows Resource Monitor | BYLDISK_UTIL |
Linux/Solaris/Windows NT | Disk Space Monitor | UNIX Resources Monitor/ Microsoft Windows Resource Monitor | BYLDISK_FREE_SPACE |
Windows NT | Memory Monitor | Microsoft Windows Resource Monitor | MEM_PAGE_RATE |
Linux/Solaris | Memory Monitor | UNIX Resources Monitor | MEM_FREE |
Windows NT | Memory Monitor | Microsoft Windows Resource Monitor | MEM_UTIL_COMMITTED_C |
Windows NT | Memory Monitor | Microsoft Windows Resource Monitor | MEM_COMMITED |
Linux/Solaris | Memory Monitor | UNIX Resources Monitor | SWAP_SPACE_UTIL |
Linux/Solaris | Memory Monitor | UNIX Resources Monitor | SWAP_SPACE_FREE |
Linux/Solaris/Windows NT | CPU Monitor | UNIX Resources Monitor/ Microsoft Windows Resource Monitor | CPU_UTIL |
Lookup Fields in SiteScope
Moviri Integrator for BMC Helix Continuous Optimization connector uses standard BMC Helix Continuous Optimization ETL lookup mechanism. One single entry is used as entity identifier : Lookup field = “DEFAULT”.
Object Relationships
Through Object-Relationship panel in the ETL edit run configuration, the ETL arranges the collected systems under a domain of choice.
When the “Recreate SiteScope hierarchy” option is set to true (see Section 5.1.3), the connector builds the hierarchy of groups and systems of SiteScope inside CO. The groups of SiteScope are inserted under the root domain and mapped with corresponding BMC Helix Continuous Optimization domains; the monitors instantiated into SiteScope are associated to the related systems which will be put under the respective domains.
In the example below, each group under “Capacity” contains monitors associated to only one server, resulting in the following tree:
The correspondent structure in HP SiteScope is showed here:
Otherwise, if the “Recreate SiteScope hierarchy” option is set to false, all the systems related to SiteScope monitors will be inserted directly under the root domain (in the example below is called “Flat domain”).
BMC Helix Continuous Optimization automatically creates a hierarchy rule associated to the ETL to process the Object-Relationship data.
Comments
Log in or register to comment.