Maintenance outage for upgrade on Sunday, September 22

This site,, will be inaccessible for two hours starting at 8 AM CDT, Sunday, September 22, for a platform upgrade.

    Page tree
    Skip to end of metadata
    Go to start of metadata

    "Moviri Integrator for TrueSight Capacity Optimization – Microsoft SCOM" allows collecting information from the Microsoft System Center Operation Manager tool. It is able to extract and summarize resources performance data, configuration data and relationships among IT entities.


    Supported versions of data source software

    • Microsoft SCOM 2007 R2 (The VM Detector is not compatible with this version of SCOM)
    • Microsoft SCOM 2012
    • Microsoft SCOM 2012 SP1
    • Microsoft SCOM 2012 R2

    Supported configurations of data source software

    Moviri Integration for Microsoft SCOM supports SCOM instances mandatorily configured with data warehouse component.
    The supported DBMS versions, for the data warehouse DB, are Microsoft SQL Server 2000, 2005, 2008 and 2012.

    Supported Management packs

    In the following table are shown the Management Packs supported by "Moviri Integrator for TrueSight Capacity Optimization - Microsoft SCOM".

    Windows Server







    Windows Cluster






    SQL Server













    Virtual Machine Manager

    In order to extract virtualization metrics, the connector requires:

    1. The Microsoft Virtual Machine Manager (VMM from now on) management tool, which is in charge of collecting data for the Microsoft virtual environment
    2. A working connection among Microsoft SCOM and Virtual Machine Manager
    3. The SCOM Virtual Machine Manager Management Packs

    The following matrix presents the supported versions of the above-mentioned components.



    SCOM Management Packs

    20122012 SP12012 R2



    2007 R2




    Downloading the additional package

    ETL Module is made available in the form of an additional component, which you may download from BMC electronic distribution site (EPD) or retrieve from your content media.

    Installing the additional package

     To install the connector in the form of a TrueSight Capacity Optimization additional package, refer to Performing system maintenance tasks instructions.


    Datasource Check and Configuration

    Preparing to connect to the data source software

    As a first step, please ensure that the correct version of SCOM is installed. You can perform this check from the "About" section of the SCOM Console (as shown in Figure 2).

    Figure 9: Version Check in MS SCOM Console

    In order for SCOM to store historical metrics, it needs to be configured to use data warehouse database.
    Please also ensure that the data warehouse DBMS version is compliant with the requirement described in Section 2.5.
    The connector needs a Login that has at least read rights on the data warehouse DB. SQL Server allows two authentication types:

    • SQL Server Authentication
    • Windows Authentication

    If your SQL Server authentication mode is set to "Mixed mode" it is suggested to use a user with SQL Server Authentication for the connector, however both Authentication types are supported.

    Connect VMM to SCOM

    A working network connection between VMM and SCOM is required to have VMM collected metrics available into the SCOM datawarehouse.

    VMM 2012 to SCOM 2012

    The connect SCOM 2012 to VMM 2012 you need to access the VMM 2012 Settings panel and click on "Settings" (Red square), then on "System Center settings" (blue square) as shown in the following figure

    Now you have to click on "System Center Operations Manager", access to properties (by right click), then insert SCOM management server hostname and credentials, as shown in the following figure:

    VMM 2008 to SCOM 2007 R2

    The same steps are valid also for the connection between SCOM 2007 and VMM2008 and shown in the following figure:

    Install Moviri VM Detector management pack in SCOM (optional)

    Standard windows management pack do not expose any property to detect if a system is a VM or a physical server, in order to get that information “Moviri VM Detector” management pack enable SCOM to collect the VM technology using a WMI query on all agent monitored systems.

    To activate the “Moviri VM Detector” on SCOM

    1. Extract the MoviriVMDetector.xml file from the ETL package
    2. Import MoviriVMDetector.xml in SCOM (Administration -> Management Packs -> Import Management packs)

    3. Wait for the data collection in SCOM DWH (up to 1 day)


    SCOM Data Availability Check

    In order to make ensure data is available in SCOM DWH, please make sure that the SCOM Monitoring views do present the relevant metrics by selecting them and setting a proper chart time frame. Please repeat this step for each desired management pack and entity type you are interested in.
    As an example, the following figure shows the Host Performance view of the SCOM 2012 Virtual Machine Manager Management Pack.

    Connector configuration

    Connector configuration attributes

    This section describes the available configuration properties for the integrator.

    Section "SCOM - Data Selection"

    Property Name




    Metric classes to import



    import metric classes belonging to selected classes:
    - CPU and Memory (Basic)
    - Memory (Advanced)
    - Logical Disk Performance
    - Logical Disk Occupation
    - Physical Disk Performance
    - Network Interface
    - Windows Cluster relationships
    - Internet Information Services
    - AppFabric
    - Database
    - Hyper-V (with Relationships) 

    Management pack to import



    Import metrics and entity belonging to the selected SCOM management packs
    - Windows
    - SQL Server
    - Hyper-V 
    - Extensible

    Custom Management Pack



    If defined, the ETL will look for the standard Windows Server metrics in the custom management pack.

    Management pack filter



    Advanced property - Semicolon-separated list of management packs whose data is going to be imported. Empty list means all.

    Extensible module file locationStringNoPath on the ETL engine in which the configuration file for the extensible module is placed 

    Activate filtering on



    For each box checked, the console shows two additional properties: whitelist and blacklist, which can be filled with a semicolon-separated list of SQL Like operator expressions, in order to filter imported entities (for detailed instructions see par. 5.1.1)
    Filters are available for the following entity types:
    - Physical servers
    - Windows clusters
    - Database
    - Virtual machines 
    - Virtual hosts 
    - Virtual clusters  

    Exclude VM detected by Moviri VM Detector management packCheckboxNo

    Filter virtual machines (VMware or Hyper-V) using the information extracted from Moviri VM detector management pack (for details see

    Filter virtual machines using Moviri VM Detector management pack)

    Extract the subtree roots on whitelisted system



    If "yes" will be imported all entities contained in currently filtered entities

    Section "SCOM – Settings"

    Property Name




    Default last counter (YYYY-MM-DD HH24:MI:SS), -1 for yesterday)



    Default value of the last counter. By default, if no last counter has been set, data will be extracted from this date. By setting “-1” the extraction will start from yesterday.

    Recovery mode active



    If it is set to true the "Since date" and "To date" parameters will be took in to account as lower and upper bound of the import time interval. The last counters will not be affected

    Since (YYYY-MM-DD HH24:MI:SS)



    Lower bound of the import time interval. This property is required if it is needed to import data for a specific time period.

    To (YYYY-MM-DD HH24:MI:SS)



    Upper bound of the import time interval. This property is required if it is needed to import data for a specific time period.

    Relocate all series in time zone *



    SCOM stores all data in UTC format. This property allows timestamps to be shifted to your timezone of choice. Time zone name has to be in Java format – see below. For no shifting fill with "UTC".

    Assign time zones to series



    If set to true, information about the time zone chosen in the previous property will be recorded into CO. If set to false the timestamps computed according to the previous property will be loaded without time zone information.

    Remove SQL Server prefix



    If it is set to false the database instances name format will be like "HOST:DATABASEINSTANCE", otherwise it will be "DATABASEINSTANCE"

    Compute size and occupation metrics even for aggregated data**



    If set to true, the computed metrics will be computed even for hourly data

    Compute Hyper-V aggregations

    BooleanyesIf set to true, aggregates VM metrics to compute Host-level and Cluster-level metrics

    Data Resolution



    If it is set to 'RAW', raw data will be imported, otherwise, if it is set to 'HOUR' hourly data will be imported

    Max days to extract in a single run



    If recovery mode is not active, this property specifies the maximum number of days the etl can extract in a single run, empty or zero means no limit.

    (*)The property "Relocate all series to time zone" has to be filled with the name of the time zone in IANA (Internet Assigned Numbers Authority, see format. Some time zone names examples are the following: Europe/Rome, Europe/London, America/New_York, Australia/Melbourne.
    (**)"Compute size and occupation metrics even for aggregated data": some of the metrics the connector extracts are not directly available in the SCOM data warehouse database. They are computed using other metrics – they are called derived metrics (for more details, see section 6.2.3) . It could happen that the base metrics (upon which the derived are computed) are collected from the SCOM Agent at different time instants. In this case, if the connector is extracting data at raw level, the related derived metric will be not computed.

    If the connector is extracting data at hour level, there might be a chance that the related derived metric could be wrong, in case the SCOM Agent sample them at different instants. For those reasons, it is possible to choose whether enable or not the computation of the derived metrics, setting properly the "Compute size and occupation metrics even for aggregated data" property.

    Management pack and metric classes valid combinations

    To give a detailed filter on metrics and management pack, the two properties “Metric classes to import” and “Management pack to import” can be selected independently, but some combination gives an empty metrics selection, the following table can help the user to select them correctly.



    Metric class

    MP Windows

    MP SQL Server

    MP Hyper-V

    CPU and Memory (Basic)




    Memory (Advanced)




    Logical Disk Performance




    Logical Disk Occupation




    Physical Disk Performance




    Network Interface




    Windows Cluster relationships




    Internet Information Services












    Hyper-V (with Relationships)




    Extensible module – Customized metric support

    Moviri integrator for Capacity Optimization supports the most common Management Packs, the extensible module is a framework that to enable the extension of the metric supported in any Management packs.

    To enable the extensible module it’s necessary to check “extensible module” in the property Management pack to import and to set the location of the mapping file in Extensible module file location.

    To write correctly a new mapping file please follow the procedure shown in Extensible module for SCOM Integrator.

    Filtering systems with whitelist and blacklist

    In order to restrict SCOM ETL extraction only to chosen entities, it is possible to activate filtering by entity type based on combination of whitelist and blacklist. If whitelist and blacklist are empty, no filter will be applied.
    The two properties accept list of expressions semicolon separated, and expression can be:

    • Flat Strings (e.g. websrv105;appsrv20)
    • SQL like operator expressions: accept wildcard "%" (matches any group of characters) and "" (matches any single{_} character)

    Figure below shows a configuration example: filtering is active on physical servers, databases and virtual machines.

    Physical servers:

    Included: all servers matching "websrv%" or "appsrv%"
    Excluded: "websrv25"


    Included: all DB instances
    Excluded: all DB instances matching "dbprod%"

    Virtual machines:

    Included: all VM matching "vm1"
    Excluded: no VM excluded

    Filter virtual machines using Moviri VM Detector management pack

    If Moviri VM Detector Management Pack has been installed on SCOM, detected VMs can be excluded from the data import. In order to do so:


    1. Enable the filtering in ETL configuration in “SCOM – Data Selection” panel
    2. Run the ETL (first in simulation mode) and verify the execution logs



    Connector configuration example

    The following figure shows an example of a valid ETL configuration.


    In this particular configuration, the following properties are set:

    • Data about all metrics classes is imported
    • Metrics are retrieved from all supported management packs: Windows, SQL Server and Hyper-V;
    • Metrics are retrieved for all the available systems (no filters are set)
    • Hour data is imported
    • The series will be relocated to time zone "Europe/Rome"
    • No time zone info will be assigned to each data series
    • If lastcounter has not been already defined, data is retrieved from 2014-09-25 00:00:00
    • In order to control data volume extraction, each run extract maximum 5 days of data

    Historical data extraction

    In order to perform an historical import, in tab "SCOM – Settings " is available the Recovery mode option. When activated, fields "Since date" and "To date" will be shown, and the task imports data for the defined time interval without taking into account the last counters and without modifying them, "max days to extract in a single run" property is ignored too.


    Supported Platforms

    The following table outlines the supported platform and the mapping to BMC TrueSight Capacity Optimization entity types.

    Supported Platform

    BMC TrueSight Capacity Optimization Entity Type

    Standalone Windows Instance


    Windows Internet Information Services Web Server


    SQL Server Instance

    Database Instance

    Hyper-V Cluster

    Virtual Cluster – Microsoft HyperV

    Hyper-V Hypervisor

    Virtual Host – Microsoft HyperV

    Hyper-V Virtual Machine

    Virtual Machine – Microsoft HyperV

    Hyper-V View

    Hyper-V View leverages data imported by Moviri Integrator. Please refer to the View documentation for its usage.


    Missing data can represent a common problem; as shown above, in this case a WARNING would be associated to the ETL task. This can be due to a number of scenarios, among which:

    • The data is not available on SCOM. In this case, it is recommended to check the SCOM Console settings and status. May be that SCOM is not collecting data.
    • The data is available on SCOM but the ETL is not able to extract it. For Raw data, this can be due to the lack of overlap of the "extraction window", as shown in Figure 19. In the Figure, the ETL is trying to extract data for a time period for which there are no data in the data warehouse DB. In any case, it is possible to manually run the actual queries used for data collection against the SCOM data warehouse, as they are listed in the ETL log (when the ETL Log Level is set to 5 – Medium), in order to ascertain the presence of the data in that desired time range.
    • The parameter "Max days to extract" is set (greater then 0), if the lastcounter is too far in the past to find data: the oldest data available must be lower than the lastcounter+max days to extract (see Figure 20)

    • In big SCOM environments the max days to extract property can be useful to avoid out of memory exception due to very large query result set; on the other side, if the datasource shows lacks of data (holes) more extended than the max days to extract, the lastcounter will not be updated and the ETL does not extract any data until the lastcounter is manually updated.
      In case of such a scenario, a better strategy can be to unset the max days to extract property and run the ETL more frequently (up to every hour, at least 3/4 times a day) so that each extraction collects less than one day of data without setting any limit.






    Entity Naming Conventions

    SCOM managed entities are mapped to BMC TrueSight Capacity Optimization ones according to their Display Name.

    Exceptions to this rule are described in the next sections.

    SCOM Lower-level entities

    The BMC TrueSight Capacity Optimization entity name is extracted from the Path or Fullname SCOM managed entity attributes, in case SCOM metrics refers to lower-level entities.

    This applies for example to Disks, which SCOM models as first-class managed entities (Display Name is for example “C:”) but BMC TrueSight Capacity Optimization treats them as metric subobjects assigned to the host system.

    Hyper-V Root Partition

    Every Hyper-V hypervisor hosts a particular virtual machine for management purposes, called root (or parent or host) partition. The root partition has the same name of the hypervisor system.

    As traditional agents can be installed on this partition (such as SCOM Agent for Windows monitoring), metric clashing could possibly occur if the agent inside the root partition measures metrics that are also provided at the hypervisor level (i.e. CPU_UTIL).

    In order to avoid such circumstances and clearly distinguish between the two concepts, BMC TrueSight Capacity Optimization represents root partitions and hypervisors as distinct entities.

    To achieve this, the BMC TrueSight Capacity Optimization name of the root (parent) partition is prefixed with a specific label (“Root:”). A prefix is also used for naming lookup: the lookup name is prefixed with the “hvrootpart:” label for this purpose.

    Lookup Fields

    Moviri Integration for BMC TrueSight Capacity Optimization connector uses standard BMC TrueSight Capacity Optimization ETL lookup mechanism. One single entry is used as entity identifier: Lookup field = “DEFAULT”. The following table shows, for each supported entity, what information is used as lookup value field.

    BMC TrueSight Capacity Optimization Entity Type

    Lookup value field

    System (Generic)


    Virtual Host


    Virtual Machine


    Database Instance


    Here below some lookup tables as example:


    Object Relationships

    The connector provides a set of object relationships that aims at organizing imported entities in BMC TrueSight Capacity Optimization workspace according to the following rules.

    Assignment of imported entities to a specified domain

    The connector arranges the collected systems under a domain of choice.

    • Relationship Type: APP – SYS [identified by its data source name, DS_SYSNM], where APP is the domain of choice (as selected in the “Object Relationships” tab in the Run Configuration wizard)
    • Meaning: To group systems collected from the same data source

    A hierarchy rule associated to the ETL is automatically created by BMC TrueSight Capacity Optimization to process the Object-Relationship data.




    Windows cluster and Windows computer

    The Cluster nodes are shown in the BMC TrueSight Capacity Optimization tree as children of the cluster they belong

    Figure 25 – SQL Server tree example.


    The cluster system which own the nodes relationships could be monitored from others management packs as well, and depending on cluster name configuration, the same cluster can be named with its name without domain or with its FQDN.

    Using the default ETL loader settings the domain suffix is not removed from datasource name, and a duplicate cluster system can be created in TrueSight CO.

    To prevent duplicate cluster system creation, it’s suggested to verify what system will be created running the ETL in simulation mode and looking at the log (if the ETL has already ran, check also the existing system in CO).

    When a potential duplicate cluster has been detected, one of the following actions can be performed:

    • Import the duplicate cluster and perform a manual reconciliation
      • Does not impact existing systems and other ETLs
      • Must be done manually (not suggested for a high number of clusters )
      • From the ETL loader configuration (advanced), change the “Remove domain suffix from datasource name” to true
        • If the lookup table is shared, can impacts other ETLs system naming
        • Suitable for a SCOM ETL first run, if the SCOM ETL is currently in place, it will duplicate all systems

    SQL Server Instances and Databases

    The SQL Server instances are shown in the BMC TrueSight Capacity Optimization tree as children of the host on which they are running (Figure 25 – SQL Server tree exampleFigure 25).



    In the above figure each host has one or more SQL Server instances.

    Each SQL Server instance could have one or more Databases. The connector represents databases as subobject of their SQL Server instance.

    The connector also imports, for each database, data about filegroups. Filegroups are represented within BMC TrueSight Capacity Optimization as subobject of the SQL Server instances. 

    All the database space metrics are associated to the SQL Server instance. They have as subject the database name if they are related to the whole DB, while, if they are related to a specific filegroup of a database, they have a subobject composed by the database name and the filegroup name.

    Hyper-V Clusters, Hosts, Datastore and Virtual Machines

    Hyper-V entities are organized according to the following relationships:

    • Hosting: represents the relation existing between an Hyper-V host and a Virtual Machine running on it
    • Containment: represents the relation existing between an Hyper-V Cluster and the contained Hyper-V host / cluster shared volumes

    An example of such relationships is presented in Figure 26.


    In this particular example, the cluster system “Cluster04” contains a single Hyper-V system “hyperv-laptop” which is hosting three virtual machines (“Root:hyperv-laptop”, “WinSrv2008 – 3”, “WinSrv2008 – 4”). Furthermore, the standalone Hyper-V system “movsrv19” is hosting six virtual machines (“Mediaroom 2008”, “Media”, “RD”, “Root:movsrv19”, “WinSrv2008”, “WinSrv2008 – memdyn”).

    A relation among the Hyper-V host and its root partition is also provided.

    SQL queries to execute on SCOM DWH

    (Q1) list all installed MPs

    SELECT ManagementPackSystemName, ManagementPackDefaultName, ManagementPackDefaultDescription
    FROM dbo.vManagementPack

     (Q2) list all PERF objects and counters given a MP

    SELECT mpv.ManagementPackSystemName,



    FROM  dbo.vPerformanceRuleInstance priv

    JOIN dbo.vPerformanceRule pruv WITH (NOLOCK) ON pruv.RuleRowId = priv.RuleRowId

    JOIN dbo.vRule rv WITH (NOLOCK) ON rv.RuleRowId = priv.RuleRowId

    JOIN dbo.vManagementPack mpv WITH (NOLOCK) ON mpv.ManagementPackRowId = rv.ManagementPackRowId

    WHERE mpv.ManagementPackSystemName = '<MP NAME>' --FILTER ON MP (e.g. 'Microsoft.Windows.Server.2008.Monitoring')

    GROUP BY pruv.ObjectName,pruv.CounterName,


    ORDER BY mpv.ManagementPackSystemName,


    (Q3) list all systems with max data timestamp given a combination of MP, object, counter

    SELECT mpv.ManagementPackSystemName,






          max(prv.DATETIME) AS maxTS

    FROM Perf.vPerfDaily prv WITH (NOLOCK)

    JOIN dbo.vManagedEntity mev WITH (NOLOCK) ON mev.ManagedEntityRowId = prv.ManagedEntityRowId

    JOIN dbo.vPerformanceRuleInstance priv WITH (NOLOCK) ON priv.PerformanceRuleInstanceRowId = prv.PerformanceRuleInstanceRowId

    JOIN dbo.vPerformanceRule pruv WITH (NOLOCK) ON pruv.RuleRowId = priv.RuleRowId

    JOIN dbo.vRule rv WITH (NOLOCK) ON rv.RuleRowId = priv.RuleRowId

    JOIN dbo.vManagementPack mpv WITH (NOLOCK) ON mpv.ManagementPackRowId = rv.ManagementPackRowId

    JOIN dbo.vManagedEntityType met WITH (NOLOCK) ON mev.ManagedEntityTypeRowId = met.ManagedEntityTypeRowId

    WHERE mpv.ManagementPackSystemName = '<MP NAME>' -- FILTER ON MP (e.g. 'Microsoft.Windows.Server.2008.Monitoring')

    AND pruv.ObjectName = '<Object name>'  -- FILTER ON Object (e.g. 'LogicalDisk')

    AND  pruv.CounterName = '<Counter name>'  -- FILTER ON Counter (e.g. '% Idle Time')

    GROUP BY pruv.ObjectName, pruv.CounterName,



    ORDER BY mpv.ManagementPackSystemName,

          pruv.ObjectName, pruv.CounterName,priv.InstanceName

    (Q4) list all CONF properties given a MP

    SELECT mp.ManagementPackSystemName,



    FROM dbo.vManagedEntityTypeProperty metp

    INNER JOIN dbo.vManagedEntityType met ON metp.ManagedEntityTypeRowId = met.ManagedEntityTypeRowId

    JOIN dbo.vManagementPack mp ON met.ManagementPackRowId = mp.ManagementPackRowId

    WHERE mp.ManagementPackSystemName = '<MP NAME>'  -- FILTER ON MP

    ORDER BY met.ManagedEntityTypeSystemName,



    (Q5) list all systems with value and validity period given a combination of MP, Propertyname

    SELECT mp.ManagementPackSystemName,






    CONVERT(VARCHAR, meps.FromDateTime, 120) AS FromDateTime,

    CONVERT(VARCHAR, ISNULL(meps.ToDateTime, SYSDATETIME()), 120) AS ToDateTime

    FROM dbo.vManagedEntityPropertySet meps

    INNER JOIN dbo.vManagedEntity me ON meps.ManagedEntityRowId = me.ManagedEntityRowId

    INNER JOIN dbo.vManagedEntityTypeProperty metp ON meps.PropertyGuid = metp.PropertyGuid

    INNER JOIN dbo.vManagedEntityType met ON me.ManagedEntityTypeRowId = met.ManagedEntityTypeRowId

    JOIN dbo.vManagementPack mp ON met.ManagementPackRowId = mp.ManagementPackRowId

    WHERE mp.ManagementPackSystemName = '<MP name>'  -- FILTER ON MP

    and metp.PropertySystemName = '<Property name>' -- FILTER ON Property

    ORDER BY met.ManagedEntityTypeSystemName,