Moviri Integrator for BMC Helix Capacity Optimization - HP SiteScope

“Moviri Integrator for BMC Helix Continuous Optimization – HP SiteScope” allows extracting information from HP SiteScope monitoring tool, transferring monitored servers performance and configuration data relevant for capacity management purposes.

Requirements


Supported versions of data source software

HP SiteScope from version 10.12 (and following minor releases) to version 11.00 (and following minor releases)

Supported configurations of data source software

Moviri Integrator for HP SiteScope supports SiteScope instances configured to export data to an external database. See next section for information about the supported DBMS technologies.

HP SiteScope includes SOAP-based API to manage the configuration of the monitored environment. Access to this API is required too.

Supported DBMS technology for integration

Moviri Integrator for BMC Helix Continuous Optimization – HP SiteScope supports the following DBMS technologies as HP SiteScope export DB:

  • MySQL DBMS. MySQL version 5 with the related JDBC connector available on MySQL official website is advised.
  • Oracle version 9 or higher, with the related JDBC connector shipped together with BMC Helix Continuous Optimization.

Datasource Check and Configuration

Preparing to connect to datasource software

As a first step, please ensure that the correct version of SiteScope is installed. You can perform this check from the “Help” section of the SiteScope Console:      

Set up the DBMS for external logging

In order to enable the external database logging, you have to set up and configure a DBMS. Create a schema and a user with all privileges on it for reading and writing monitoring data.

Preliminary SiteScope checks

To configure your SiteScope instance for external database logging, please ensure the following requirements are respected:

  1. Make sure you have a SiteScope login with necessary privileges to access Infrastructure Preferences inside your SiteScope instance.

  2. By default, monitoring data are stored into SiteScope<YYYY-MM-DD>.log files under <SiteScope_root_path>\logs directory. Make sure that the date and number format of data is respectively yyyy-MM-dd HH24:mm:ss (e.g. 2012-01-01 00:00:00) and with ‘.’ as decimal separator (e.g. 344.78). If not so, configure appropriately the user locale settings under which SiteScope service runs.
  3. Make sure to have a SiteScope login to use for web services access.
  4. Ensure you have an account on the machine where SiteScope is installed with the necessary rights to start and stop SiteScope service.
  5. Obtain the JDBC connector to use for the connection between your SiteScope instance and the DBMS and SiteScope ETL and the DBMS.

Configuring SiteScope for external database logging

To perform the configuration for external database logging, follow these steps:

    1. If running, stop SiteScope service.
    2. Open <SiteScope_root_path>\groups\master.config file (make a backup copy before editing) and search for the following parameters:
      1. _accessControlled: web services access type
      2. _logJdbcAutoCommitSiteScopeLog: number of monitors’ runs before collected data are committed to the database
      3. _logJdbcCreateSiteScopeLog: query for table creation
      4. _logJdbcInsertSiteScopeLog: insert query
      5. _logJdbcDriverSiteScopeLog: JDBC driver family
      6. _logJdbcURLSiteScopeLog: url for DBMS connection
      7. _logJdbcUserSiteScopeLog: DBMS user
      8. _logJdbcPasswordSiteScopeLog: encrypted password of DBMS user

Set them as follows:

      • Enable the web services access with a SiteScope login authentication

_accessControlled=true

      • Commit directly to the database the monitoring results so that SiteScope ETL can read fresh data everytime it runs

_logJdbcAutoCommitSiteScopeLog=1

      • Create a table for logging data with an arbitrary number of columns depending on the configuration of the monitored environment. By default, all columns between 1 (datex) and 9 (monitorID) indicate the same properties for all SiteScope monitors. The next columns, from value1 to value10, have values which depend on each monitor and represent the measurements of metrics. Therefore, if necessary, you may need to increase the number of columns of the table to cover all measurements performed by a monitor. By default, the query is configured to store 10 measurements:

_logJdbcCreateSiteScopeLog=CREATE TABLE SiteScopeLog (datex VARCHAR(255), serverName VARCHAR(255), class VARCHAR(255), sample VARCHAR(255), category VARCHAR(255), groupName VARCHAR(255), monitorName VARCHAR(255), status VARCHAR(255), monitorID VARCHAR(255), value1 VARCHAR(255), value2 VARCHAR(255), value3 VARCHAR(255), value4 VARCHAR(255), value5 VARCHAR(255), value6 VARCHAR(255), value7 VARCHAR(255), value8 VARCHAR(255), value9 VARCHAR(255), value10 VARCHAR(255))

If you have a monitor which performs more than 10 measurements and you want to store them in your database, you will need to add the exceeding columns to the query. For example, if you have a monitor with the following measurements in your SiteScope console:

You can read the number of counters (therefore measurements in the database) active and add the exceeding number of columns to the query:

_logJdbcCreateSiteScopeLog=CREATE TABLE SiteScopeLog (datex VARCHAR(255), serverName VARCHAR(255), class VARCHAR(255), sample VARCHAR(255), category VARCHAR(255), groupName VARCHAR(255), monitorName VARCHAR(255), status VARCHAR(255), monitorID VARCHAR(255), value1 VARCHAR(255), value2 VARCHAR(255), value3 VARCHAR(255), value4 VARCHAR(255), value5 VARCHAR(255), value6 VARCHAR(255), value7 VARCHAR(255), value8 VARCHAR(255), value9 VARCHAR(255), value10 VARCHAR(255), value11 VARCHAR(255), value12 VARCHAR(255), value13 VARCHAR(255), value14 VARCHAR(255), value15  VARCHAR(255))

      • After having configured the query to create the log table, you will need to make the changes (if any) also inside the insert query.  By default, the insert query is

_logJdbcInsertSiteScopeLog=INSERT INTO SiteScopeLog VALUES(?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?)

9 standard columns 10 counters measurements

with 19 parameters, the first 9 for standard columns from datex to monitorID and the other 10 for counters.

If you increased the number of columns to store data, you will have to add the correct number of “?”. In the previous example, 9 standard columns + 15 counters produces 24 columns to be filled by the insert query. Therefore other 5 “?” will be added:

  _logJdbcInsertSiteScopeLog=INSERT INTO SiteScopeLog VALUES(?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?,?)

9 standard columns 15 counters measurements

      • Set the driver family to the MySQL server one

_logJdbcDriverSiteScopeLog=com.mysql.jdbc.Driver

      • Configure the URL to connect to MySQL server

_logJdbcURLSiteScopeLog=jdbc:mysql://<server_address>:<server_port>/<database>

      • Set the database user and password properties

_logJdbcUserSiteScopeLog=<mysql_user>

_logJdbcPasswordSiteScopeLog=<mysql_password>

      • Move the DBMS driver (mysql-connector-java-<version>.jar) to the <SiteScope_root_path>\WEB-INF\lib directory
      • Start SiteScope service
      • In SiteScope Console, navigate to Preferences, Infrastructure Preferences, Monitor Settings and enable JDBC logging.
      • Save the changes.

 

Instructions have been provided for the MySQL case. The Oracle case is omitted since it comprises the same steps with similar values. Please refer to HP SiteScope documentation for further reference.

  1. Restart SiteScope service by clicking the corresponding button.
  2. Verify the files error.log and RunMonitor.log in the <SiteScope_root_path>\logs\ directory for the correct activation of the external database for logging.

Some important considerations

  1. Check your monitoring environment to correctly size the log table column number before activating the external database. You have to make sure that the maximum number of counters for every single monitor does not exceed the columns of the log table (as for the previous example).
  2. Notice that the order of counters reported into the log table columns doesn’t correspond to the one showed in the “Dashboard” panel of SiteScope Console. The association order between counters and columns represents their selection order during the creation of the monitor and is reported in the “Properties” panel. For the previous example, after the default “counters in error” column, the other columns are associated with the counters as shown in the following figure:

     



    This leads to other 3 important points you should consider when activating database logging:
      • If a counter of interest is in a position that exceeds the number of columns of the log table, you will not store it in your database unless you increase the number of columns.
      • If you change the counters selection order, SiteScope will save the last current configuration to associate columns to counters and will perform this change also in the database for the next measurements. The columns will store different counters than before and, as a consequence, the new configuration sent to SiteScope connector will produce a misinterpretation for data stored before the change.
      • The storage of new counters for a monitor doesn’t produce counters misinterpretation. Nevertheless you may need to increase the number of columns of your log table to store all data. To perform the change, you have to repeat the steps described above to modify the master.conf file. Before restarting SiteScope, you have to manually alter the table structure from inside your DBMS, adding new columns (the alter operation is not performed by SiteScope directly).
  3. Database aging policies are not managed from SiteScope. Configure your policies and pay attention to them when using SiteScope connector for historical data recovery

Connector configuration

Connector configuration attributes

There are three sections (tabs) in the ETL run configuration page where the behaviour of “Moviri Integrator for BMC Helix Continuous Optimization - HP SiteScope” can be specified:

  • Connection parameters (common BMC Helix Continuous Optimization setting)
  • SiteScope - Settings
  • SiteSCope - Data Selection

SiteScope - Settings

 

Property Name

Value Type

Required?

Default

Description

SiteScope login name

String

Yes

 

SiteScope login name of user used to connect to SiteScope Web Services.

SiteScope password

String

Yes

 

Password of SiteScope user used to connect to SiteScope Web Services.

SiteScope host

Numeric

Yes

 

IP of the host where HP SiteScope is installed.

SSL Authentication

Yes/No

Yes

No

Enables/Disables the SSL over http communication protocol for SiteScope Web Services, accepting also untrusted certificate (when enabled).

SiteScope version

Selection

Yes

Higher than 11.10

Version of HP SiteScope installed.

SiteScope log schema

String

Yes

 

The name of the schema used for log.

SiteScope log table

String

Yes

 

The name of the table used for log.


SiteScope - Data Selection

 

Property Name

Value Type

Required?

Default

Description

Default last counter (YYYY-MM-DD HH24:MI:SS)

String

Yes

 

If last counter is not already set, use this entry

Recovery mode active

Yes/No

Yes

No

When recovery is active, ETL extracts data in the time window specified by the next two properties, last counter will not be updated and max days to extract will be ignored

Recovery from date (YYYY-MM-DD HH24:MI:SS)

String

No

 

“Since” timestamp when recovery mode is active. Date format is specified between the brackets

Recovery to date

(YYYY-MM-DD HH24:MI:SS)

String

No

 

“To” timestamp when recovery mode is active. Date format is specified between the brackets

Max extraction days (no value=no limit)

Numeric

No

 

Limit maximum number of days to extract in a single run

Whitelist of systems to import

String

No

 

Semicolon-separated list of systems whose data is going to be imported, regex wildcard can be used.

Empty list means all servers

Blacklist of systems to import

String

No

 

Semicolon-separated list of systems whose data is not going to be imported, regex wildcard can be used.

Empty list means none

Recreate SiteScope hierarchy

Yes/No

Yes

No

Recreate the HP SiteScope hierarchy of groups and systems related to monitors into CO

Metric classes to import

Checkbox

Yes

 

Metrics related to classes that if checked will be imported

Remove domain suffix from system names

Yes/No

Yes

Yes

If set to yes, It will remove the domain from hostname


Guidelines to choose the most appropriate ETL configuration

In order to set the ETL configuration that match your needs, in this paragraph some common use cases are presented.

Scenario 1: “Typical” systems capacity analysis and planning

  • Goal : ensure the right servers capacity (CPU, Memory, Logical/Physical disk and Network resource utilization)
  • Environment size : medium/big
  • Environment peculiarity : quite steady
  • Planning time period :  long (6-12 months)
  • Outputs: Analyses and forecast on resource utilization and violation threshold

Scenario 2: “in-depth” capacity analysis and planning for specific systems

  • Goal : react on short-term growth (CPU, Memory, Logical/Physical disk and Network resource utilization)
  • Environment size : small
  • Environment peculiarity :   new service introduction / across a change of application or devices
  • Planning time period :  short (weeks)
  • Outputs: Growth trend, short-term forecast, correlation between resource utilization and service business drivers (users, transactions)

The choice of correct configuration brings you benefits also in terms of shorter execution time and saved disk space on database.

Every SiteScope ETL instance configuration applies to all systems selected, if there are different scenario needs for different systems, is recommended to create many ETL instances with different configuration which filters on particular systems (e.g. There are both a big and stable environment (scenario 1) and the introduction of a new service (Scenario2))

Data volume considerations

The following table is a reference to estimate the data extraction volume produced by the HP SiteScope connector as a function of the number of extracted days.

Num. of serversNum. of monitorsExtraction DaysRows extractedRows extracted for 1 systemRows extracted for 1 monitor
10751486074861648
10752949004745632
107531395484651620

 

The results presented above assume the following connector configuration (as per metric filters specified in Scenario 1):

  • 8 monitors for each system
  • 10 counters per monitor
  • Monitors’ runs frequency: 10 minutes

 

Under these assumptions, the estimated number of daily rows extracted by the connector, as a function of the number of servers, is presented below

Number of servers

Num. of monitors

Rows extracted for 1 day volume of data

10

100

64000

100

1000

640000

1000

10000

6400000

.


Historical data extraction

In order to perform a historical recovery of data, please use “recovery mode properties” settings:
Recovery mode active=true and filling the two properties “since date” and “to date” in order to specify the time window. When recovery mode is active, the last counter will not be updated and max day to extract will be ignored.

If the ETL is newly created and has no last counter defined, the “default last counter” is used.

The pre-condition for an historical extraction is the presence of data inside the external database in the selected time period.

SSL Authentication

In order to communicate with Web Services with SSL protocol over HTTP (HTTPS) you must configure SiteScope to use SSL. Below an example of accessing SiteScope by HTTPS protocol.

 

To properly configure the ETL, you need to enable the SSL authentication property in SiteScope – Settings tab and specify correctly the IP of the host where SiteScope is installed and the port with SSL (8443 in the following example).

 

Supported Platforms

For all metrics imported by the ETL and described below in this section, the following apply:

  • Supported OS families: Red Hat Enterprise Linux, Linux CentOS, Solaris, Windows NT
  • Supported BMC Helix Continuous Optimization Entity Type: System (Generic)

Troubleshooting

For ETL troubleshooting, please refer to official BMC documentation available here.

Configuration and Performance Metrics Mapping

Performance Metrics

The SiteScope ETL connects to SiteScope and reads from external database monitors measurements performed on systems remotely. In the following table the supported metrics for OS families and the related SiteScope monitors and objects are reported.

Metric Name

OS family

HP SiteScope Monitor

HP SiteScope object

BMC Helix Continuous Optimization metric

Conversion Factor

utilization

Linux/Solaris/Windows NT

CPU Monitor

 

CPU_UTIL

0,01

Pages/sec

Linux/Solaris/Windows NT

Memory Monitor

 

MEM_PAGE_RATE

 

virtual memory used %

Windows NT

Memory Monitor

 

MEM_UTIL_COMMITTED_C

0,01

swap space used %

Linux / Solaris

Memory Monitor

 

SWAP_SPACE_UTIL

0,01

swap space MB free

Linux / Solaris

Memory Monitor

 

SWAP_SPACE_FREE

1048576

physical memory used %

Linux / Solaris

Memory Monitor

 

MEM_UTIL

0.01

physical memory MB free

Linux / Solaris

Memory Monitor

 

MEM_FREE

1048576

Percent full

Linux/Solaris/Windows NT

Dynamic Disk Space Monitor

 

BYLDISK_UTIL

0.01

MB free

Linux/Solaris/Windows NT

Dynamic Disk Space Monitor

 

BYLDISK_FREE_SPACE

1048576

Percent full

Linux/Solaris/Windows NT

Disk Space Monitor

 

BYLDISK_UTIL

0.01

MB free

Linux/Solaris/Windows NT

Disk Space Monitor

 

BYLDISK_FREE_SPACE

1048576

Idle

Linux Server

UNIX Resources Monitor

Processor

CPU_UTIL

1-(value *0.01)

1minAvg

Linux / Solaris

UNIX Resources Monitor

Load Average

CPU_RUN_QUEUE

 

system

Linux Server

UNIX Resources Monitor

Processor

CPU_UTIL_SYSTEM

0.01

user

Linux Server

UNIX Resources Monitor

Processor

CPU_UTIL_USER

0.01

%idle

Solaris Server

UNIX Resources Monitor

CPU utilization

CPU_UTIL

1- (value * 0.01)

%sys

Solaris Server

UNIX Resources Monitor

CPU utilization

CPU_UTIL_SYSTEM

0.01

%usr

Solaris Server

UNIX Resources Monitor

CPU utilization

CPU_UTIL_USER

0.01

1minAvg

Solaris Server

UNIX Resources Monitor

Load Average

CPU_RUN_QUEUE

 

MemFree

Linux Server

UNIX Resources Monitor

Memory

MEM_FREE

1024

Active

Linux Server

UNIX Resources Monitor

Memory

MEM_ACTIVE

1024

Cached

Linux Server

UNIX Resources Monitor

Memory

MEM_CACHED

1024

CommitLimit

Linux Server

UNIX Resources Monitor

Memory

MEM_COMMIT_LIMIT

1024

Committed_AS

Linux Server

UNIX Resources Monitor

Memory

MEM_COMMITED_AS

1024

SwapFree

Linux Server

UNIX Resources Monitor

Memory

SWAP_SPACE_FREE

1024

swap_avail

Solaris Server

UNIX Resources Monitor

Memory

SWAP_SPACE_FREE

value * 512

swap_resv

Solaris Server

UNIX Resources Monitor

Memory

SWAP_SPACE_USED

value * 512

freemem

Solaris Server

UNIX Resources Monitor

Memory

MEM_FREE

value * 512

Available

Linux Server

UNIX Resources Monitor

FileSystems

BYLDISK_FREE_SPACE

1048576

Use%

Linux Server

UNIX Resources Monitor

FileSystems

BYLDISK_USED_SPACE_PCT

0.01

Used

Linux Server

UNIX Resources Monitor

FileSystems

BYLDISK_USED_SPACE

1048576

avail

Solaris Server

UNIX Resources Monitor

FileSystems

BYLDISK_FREE_SPACE

1048576

capacity

Solaris Server

UNIX Resources Monitor

FileSystems

BYLDISK_USED_SPACE_PCT

0.01

used

Solaris Server

UNIX Resources Monitor

FileSystems

BYLDISK_USED_SPACE

1048576

IOs in progress

Linux Server

UNIX Resources Monitor

Disk Stats

BYDISK_QUEUE_SIZE

 

reads

Solaris Server

UNIX Resources Monitor

Physical Disk

BYDISK_PHYS_IO_READ_RATE

 

writes

Solaris Server

UNIX Resources Monitor

Physical Disk

BYDISK_PHYS_IO_WRITE_RATE

 

nread

Solaris Server

UNIX Resources Monitor

Physical Disk

BYDISK_READ_RATE

 

nwritten

Solaris Server

UNIX Resources Monitor

Physical Disk

BYDISK_WRITE_RATE

 

rcnt

Solaris Server

UNIX Resources Monitor

Physical Disk

BYDISK_QUEUE_SIZE

 

packets

Linux Server

UNIX Resources Monitor

Network Interface

BYIF_PKT_RATE

 

ReceiveBytes

Linux Server

UNIX Resources Monitor

Network Interface

BYIF_IN_BIT_RATE

8

TransmitBytes

Linux Server

UNIX Resources Monitor

Network Interface

BYIF_OUT_BIT_RATE

8

% idle time

Windows NT

Microsoft Windows Resource Monitor

Processor

CPU_UTIL

1- (value * 0.01)

% Privileged Time

Windows NT

Microsoft Windows Resource Monitor

Processor

CPU_UTIL_SYSTEM

0.01

% User Time

Windows NT

Microsoft Windows Resource Monitor

Processor

CPU_UTIL_USER

0.01

% Processor Time

Windows NT

Microsoft Windows Resource Monitor

Processor

CPU_UTIL

0.01

Processor Queue Length

Windows NT

Microsoft Windows Resource Monitor

System

CPU_RUN_QUEUE

 

% Committed Bytes In Use

Windows NT

Microsoft Windows Resource Monitor

Memory

MEM_UTIL_COMMITTED_C

0.01

available bytes

Windows NT

Microsoft Windows Resource Monitor

Memory

MEM_FREE

 

Committed Bytes

Windows NT

Microsoft Windows Resource Monitor

Memory

MEM_COMMITED

 

Cache Bytes

Windows NT

Microsoft Windows Resource Monitor

Memory

MEM_CACHED

 

Pages/sec

Windows NT

Microsoft Windows Resource Monitor

Memory

MEM_PAGE_RATE

 

% Free Space

Windows NT

Microsoft Windows Resource Monitor

LogicalDisk

LDISK_USED_SPACE_PCT

1- (value * 0.01)

% Idle Time

Windows NT

Microsoft Windows Resource Monitor

LogicalDisk

LDISK_UTIL

1- (value * 0.01)

Free Megabytes

Windows NT

Microsoft Windows Resource Monitor

LogicalDisk

LDISK_FREE

1048576

% Free Space

Windows NT

Microsoft Windows Resource Monitor

LogicalDisk

BYLDISK_USED_SPACE_PCT

1- (value * 0.01)

% Idle Time

Windows NT

Microsoft Windows Resource Monitor

LogicalDisk

BYLDISK_UTIL

1- (value * 0.01)

Free Megabytes

Windows NT

Microsoft Windows Resource Monitor

LogicalDisk

BYLDISK_FREE_SPACE

1048576

Avg. Disk Queue Length

Windows NT

Microsoft Windows Resource Monitor

PhysicalDisk

DISK_IO_LENGTH

 

Disk Bytes/sec

Windows NT

Microsoft Windows Resource Monitor

PhysicalDisk

DISK_TRANSFER_RATE

 

% Disk Time

Windows NT

Microsoft Windows Resource Monitor

PhysicalDisk

DISK_UTIL

0.01

Disk Read Bytes/sec

Windows NT

Microsoft Windows Resource Monitor

PhysicalDisk

DISK_READ_RATE

 

Disk Write Bytes/sec

Windows NT

Microsoft Windows Resource Monitor

PhysicalDisk

DISK_WRITE_RATE

 

Avg. Disk Queue Length

Windows NT

Microsoft Windows Resource Monitor

PhysicalDisk

BYDISK_QUEUE_SIZE

 

Disk Bytes/sec

Windows NT

Microsoft Windows Resource Monitor

PhysicalDisk

BYDISK_TRANSFER_RATE

 

% Disk Time

Windows NT

Microsoft Windows Resource Monitor

PhysicalDisk

BYDISK_UTIL

0.01

Disk Read Bytes/sec

Windows NT

Microsoft Windows Resource Monitor

PhysicalDisk

BYDISK_READ_RATE

 

Disk Write Bytes/sec

Windows NT

Microsoft Windows Resource Monitor

PhysicalDisk

BYDISK_WRITE_RATE

 

Packets/sec

Windows NT

Microsoft Windows Resource Monitor

Network Interface

BYIF_PKT_RATE

 

Bytes Received/sec

Windows NT

Microsoft Windows Resource Monitor

Network Interface

BYIF_OUT_BIT_RATE

8

Bytes Sent/sec

Windows NT

Microsoft Windows Resource Monitor

Network Interface

BYIF_IN_BIT_RATE

8

Bytes Total/sec

Windows NT

Microsoft Windows Resource Monitor

Network Interface

BYIF_BIT_RATE

8


Configuration metrics

This is a list of configuration metrics extracted by SiteScope ETL.

Metric Name

OS family

Monitor class

HP SiteScope object

BMC Helix Continuous Optimization metric

Conversion Factor

MB total

Linux/Solaris/Windows NT

Dynamic Disk Space Monitor

 

BYLDISK_SIZE

1048576

model name

Linux Server

UNIX Resources Monitor

Processor Info

CPU_MODEL

 

cpu MHZ

Linux Server

UNIX Resources Monitor

Processor Info

CPU_MHZ

 

clock_MHz

Solaris Server

UNIX Resources Monitor

Processor Info

CPU_MHZ

 

MemTotal

Linux Server

UNIX Resources Monitor

Memory

TOTAL_REAL_MEM

1024

SwapTotal

Linux Server

UNIX Resources Monitor

Memory

SWAP_SPACE_TOT

1024

ifspeed

Solaris Server

UNIX Resources Monitor

Network Interface

BYIF_BANDWIDTH

 

Current Bandwidth

Windows NT

Microsoft Windows Resource Monitor

Network Interface

BYIF_BANDWIDTH

 

Derived metrics

In addition to the metrics available from the data source, the following metrics are computed by the connector:

OS family

HP SiteScope monitor

HP SiteScope object

Derived BMC Helix Continuous Optimization metric

HP SiteScope source metrics

Windows NT

Memory Monitor

 

MEM_COMMITED

virtual memory MB free; virtual memory used %

Linux Server

UNIX Resources Monitor

Memory

SWAP_SPACE_UTIL

SwapFree; SwapTotal

Linux Server

UNIX Resources Monitor

Memory

SWAP_SPACE_USED

SwapTotal; SwapFree

Solaris Server

UNIX Resources Monitor

Memory

SWAP_SPACE_UTIL

swap_resv; swap_avail

Solaris Server

UNIX Resources Monitor

Memory

SWAP_SPACE_TOT

swap_resv; swap_avail

Solaris Server

UNIX Resources Monitor

Memory

SWAP_SPACE_TOT

swap_resv; swap_avail

Linux Server

UNIX Resources Monitor

Disk Stats

BYDISK_UTIL

ms spent doing IOs

Linux Server

UNIX Resources Monitor

Disk Stats

BYDISK_PHYS_IO_READ_RATE

Reads

Linux Server

UNIX Resources Monitor

Disk Stats

BYDISK_PHYS_IO_WRITE_RATE

Writes

Solaris Server

UNIX Resources Monitor

Network Interface

BYIF_IN_PKT_RATE

ipackets

Solaris Server

UNIX Resources Monitor

Network Interface

BYIF_OUT_PKT_RATE

opackets

Solaris Server

UNIX Resources Monitor

Network Interface

BYIF_IN_BIT_RATE

Rbytes

Solaris Server

UNIX Resources Monitor

Network Interface

BYIF_OUT_BIT_RATE

Obytes

The SiteScope ETL can compute a derived metric obtained by 2 source metrics only if they are included in the same monitor, i.e. they will be stored in the same raw inside the external database. For example if you want to include the SWAP_SPACE_UTIL metric for a Solaris system, you will need to instantiate a UNIX Resources Monitor which includes both the swap_resv and the swap_avail metrics related to the Memory object:


Metric Classes

All of the metrics managed by the connector are grouped in the following “Metric Classes”

  • CPU and Memory Basic Metrics

  • Memory Advanced Metrics

  • Logical Disk Occupation Metrics

  • Physical Disk Performance Metrics

  • Network Interface Metrics

The following table shows for each metric class the contained metrics

Metric Class

BMC Helix Continuous Optimization Metric

CPU and Memory Basic Metrics CPU_UTIL
MEM_PAGE_RATE
MEM_UTIL
MEM_FREE
Memory Advanced Metrics MEM_UTIL_COMMITTED_C
MEM_COMMITED
SWAP_SPACE_UTIL
SWAP_SPACE_FREE
SWAP_SPACE_USED
MEM_ACTIVE
MEM_CACHED
MEM_COMMIT_LIMIT
MEM_COMMITED_AS
CPU_UTIL_SYSTEM
CPU_UTIL_USER
CPU_RUN_QUEUE
Logical Disk Occupation MetricsBYLDISK_UTIL
BYLDISK_FREE_SPACE
BYLDISK_USED_SPACE_PCT
BYLDISK_USED_SPACE
LDISK_USED_SPACE_PCT
LDISK_UTIL
LDISK_FREE
Physical Disk Performance MetricsBYDISK_QUEUE_SIZE
BYDISK_PHYS_IO_READ_RATE
BYDISK_PHYS_IO_WRITE_RATE
BYDISK_UTIL
BYDISK_READ_RATE
BYDISK_WRITE_RATE
DISK_IO_LENGTH
DISK_TRANSFER_RATE
DISK_UTIL
DISK_READ_RATE
DISK_WRITE_RATE
BYDISK_TRANSFER_RATE
Network Interface MetricsBYIF_PKT_RATE
BYIF_IN_BIT_RATE
BYIF_OUT_BIT_RATE
BYIF_IN_PKT_RATE
BYIF_OUT_PKT_RATE
BYIF_BIT_RATE

The SiteScope ETL can be configured to collect only specific metric classes by configuring the related custom properties.

Overlapping Metrics

SiteScope can measure server performance metrics with two distinct categories of monitors:

  • generic monitors, which apply to all OS families, and specific OS monitors, which apply to a specific OS type server. The first category is composed by CPU Monitor, Memory Monitor, Dynamic Disk Space Monitor and Disk Space Monitor (for SiteScope version 10).
  • UNIX Resources Monitors and Microsoft Windows Resource Monitors.

This leads to some metrics measured by both generic and OS specific monitors with the consequence of repeating or overlapping those measurements. In order to avoid the overwrite of common metrics measurements, the connector implements a mechanism of precedence for which, if both OS specific and generic monitors are monitoring the same metric for the same server, the OS specific monitor will have precedence over the generic one and only its measurements will be imported. Be aware of what follows:

The ETL filters measurements only in case two monitors with overlapping metrics collect data for the same system

The ETL will not make distinction on the sub-resource monitored, only on the monitor metrics and the host monitored. For example, following the table 10, if both the Dynamic Disk Space Monitor and the Microsoft Windows Resources Monitor collect the metric BYLDISK_UTIL for the host 10.31.168.156 and the sub-resource “C:”, only the measurement performed by the Microsoft Windows Resource Monitor will be imported. Besides if the Dynamic Disk Space Monitor collects metrics on a “D:” sub-resource, also this will not be imported, even if the Microsoft Windows Resource Monitor is not making measurements on it (i.e. the mechanism doesn’t distinguish any sub resource, only checks for monitor, host and metric). In the example, to monitor the “C:” and “D:” sub resources you can use a Dynamic Disk Space Monitor alone, which collects data on both logical disks, or a Microsoft Windows Resource Monitor on both “C:” and “D:”.

Below the list of overlapped metrics:

OS familyMonitor ignoredMonitor privileged

BMC Helix Continuous Optimization metric

Windows NTDynamic Disk Space MonitorMicrosoft Windows Resource MonitorBYLDISK_UTIL
Linux/Solaris/Windows NTDynamic Disk Space MonitorUNIX Resources Monitor/ Microsoft Windows Resource MonitorBYLDISK_FREE_SPACE
Windows NTDisk Space MonitorMicrosoft Windows Resource MonitorBYLDISK_UTIL
Linux/Solaris/Windows NTDisk Space MonitorUNIX Resources Monitor/ Microsoft Windows Resource MonitorBYLDISK_FREE_SPACE
Windows NTMemory MonitorMicrosoft Windows Resource MonitorMEM_PAGE_RATE
Linux/SolarisMemory MonitorUNIX Resources MonitorMEM_FREE
Windows NTMemory MonitorMicrosoft Windows Resource MonitorMEM_UTIL_COMMITTED_C
Windows NTMemory MonitorMicrosoft Windows Resource MonitorMEM_COMMITED
Linux/SolarisMemory MonitorUNIX Resources MonitorSWAP_SPACE_UTIL
Linux/SolarisMemory MonitorUNIX Resources MonitorSWAP_SPACE_FREE
Linux/Solaris/Windows NTCPU MonitorUNIX Resources Monitor/ Microsoft Windows Resource MonitorCPU_UTIL

Lookup Fields in SiteScope

Moviri Integrator for BMC Helix Continuous Optimization connector uses standard BMC Helix Continuous Optimization ETL lookup mechanism. One single entry is used as entity identifier : Lookup field = “DEFAULT”.

Object Relationships

Through Object-Relationship panel in the ETL edit run configuration,  the ETL arranges the collected systems under a domain of choice.

When the “Recreate SiteScope hierarchy” option is set to true (see Section 5.1.3), the connector builds the hierarchy of groups and systems of SiteScope inside CO. The groups of SiteScope are inserted under the root domain and mapped with corresponding BMC Helix Continuous Optimization domains; the monitors instantiated into SiteScope are associated to the related systems which will be put under the respective domains.

In the example below, each group under “Capacity” contains monitors associated to only one server, resulting in the following tree:

The correspondent structure in HP SiteScope is showed here:

Otherwise, if the “Recreate SiteScope hierarchy” option is set to false, all the systems related to SiteScope monitors will be inserted directly under the root domain (in the example below is called “Flat domain”).

BMC Helix Continuous Optimization automatically creates a hierarchy rule associated to the ETL to process the Object-Relationship data.

 


 

Was this page helpful? Yes No Submitting... Thank you

Comments