Page tree
Skip to end of metadata
Go to start of metadata

BMC TrueSight Capacity Management supports integration with BMC TrueSight Operations Management 10.1 for any platform through the BMC - TrueSight Operations Management 10.1 Generic extractor.

Note

You can use the BMC - TrueSight Operations Management 10.1 extractor for the following platforms:

  • IBM AIX
  • Oracle Solaris
  • KVM
  • Stand-alone

If you are using BMC TrueSight Operations Management version 10.0 or earlier, use the BMC - TrueSight Operations Management 9.0/9.5/9.6/10.0 extractor or BMC - TrueSight Operations Management 9.0/9.5/9.6/10.0 Generic View Extractor, depending on the platforms for which you want to extract data. 

 

This topic contains the following sections:

Overview

This extractor is a Java-based extractor that uses REST APIs to extract performance and configuration data from BMC TrueSight Operations Management. The extractor communicates with the Data Integration APIs of BMC TrueSight Operations Management. For more information, see Data Integration API calls to TrueSight Operations Management 10.1.

 

Viewing assistance

To toggle full-screen mode for this topic (recommended), type f. To hide the navigation tree on the left, type [.

Integrating TrueSight Capacity Optimization with TrueSight Operations Management

To integrate BMC TrueSight Capacity Optimization with the BMC TrueSight Operations Management, perform the following task:

  1. In the TrueSight Capacity Optimization console, navigate to Administration > ETL & SYSTEM TASKS > ETL tasks.
  2. In the ETL tasks page, under the Last run tab, click Add > Add ETL. The Add ETL page is displayed.
  3. In the Run configuration tab, for the ETL module property, select BMC - TrueSight Operations Management 10.1 Generic extractor.
  4. Specify values for the following properties under each expandable tab:

    Note

    Basic properties are displayed by default in the Add ETL page. These are the most common properties that you can set for an ETL, and it is acceptable to leave the default selections for each as is.

    Basic properties

    Property Description
    Run configuration
    ETL task name Accept the default name based on the selected ETL module or specify a different name for the ETL task. Duplicate names are allowed.
    Run configuration name Review the default name. This field is used to differentiate configurations that you can specify for the ETL task. You can then run the ETL task based on the configuration name.
    Environment Select Production or Test to mark the ETL tasks. For example, you can start by marking the task as Test and change it to Production after you have seen that you are getting what you wanted.
    Description (Optional) Enter a brief description for this ETL.
    Log level Select how detailed you want the ETL log to be. The log includes Error, Warning and Info type of log information.
    • 1 - Light: Add bare minimum activity logs to the log file.
    • 5 - Medium: Add medium-detailed activity logs to the log file.
    • 10 - Verbose: Add detailed activity logs to the log file.

    Note: Log levels 5 and 10 are typically used for debugging or troubleshooting ETL issues. Using a log level of 5 is general practice; however, you may choose level 10 to get a high level of detail while troubleshooting.

    Execute in simulation mode Select Yes if you want to validate the connectivity between the ETL engine and the target, and to ensure that the ETL does not have any other configuration issues.
    When set to Yes, the ETL will not store actual data into the data warehouse. This option is useful while testing a new ETL task.
    Module selection

    Ensure that the Based on datasource option is selected.


    Note: If you select Based on Open ETL template, BMC TrueSight Capacity Optimization is integrated with a Generic extractor based on the selected Open ETL template. For more information, see  Generic ETL based on a template.
    ETL module

    Ensure that BMC - TrueSight Operations Management 10.1 Generic extractor is selected.

    Note: You selected this property in the earlier step.

    Module description Review the short description of the ETL module.
    Entity catalog
    Sharing status Select either of the following options:
    • Shared entity catalog: Select this option if, for the same entities, data is coming from multiple sources. For example, BPA ETL.
      • Sharing with Entity Catalog: Select an entity catalog from the drop-down list.
    • Private entity catalog: Select this option if, for the same entity, data is coming from a single source.
    Object relationships
    Associate new entities to

    Specify the domain where you want to add the entities created by the ETL. You can select an existing domain or create a new one.

    infoInfo: By default, a new domain is created for each ETL, with the same name as the extractor module. As the ETL is created, a new hierarchy rule with the same name as the ETL task is created automatically, with an active status. if you update the ETL specifying a different domain, the hierarchy rule will be updated automatically.

    Select any one of the following options:

    • New domain: Create a new domain. Specify the following properties under New domain:
      • Parent: Select a parent domain for your new domain from the domain selector control.
      • Name: Specify a name for your new domain.
    • Existing domain: Select an existing domain. Make a selection for the following property:
      • Domain: Select an existing domain from the domain selector control.
    TrueSight Operations Management Connection
    Data Integration API URL

    Specify the host name of the Presentation Server in the provided URL format: https://<host>/tsws. You must replace <host> with the host name.

    Username Type the user name to connect to the Presentation Server. You can use the default user, apiuser.
    Password Type the password for the specified user name to connect to the Presentation Server. The password for the default user, apiuser, is displayed in encrypted format.
    Tenant name Specify the name of the tenant for which the data needs to be extracted. The tenants are configured on the Presentation Server. The default tenant BmcRealm is displayed.
    Platform definition JSON file path Specify the path where you saved the JSON file that has the platform specific entity definition and their configuration and performance metrics mapping. For more information, see Creating and using a platform definition JSON file.
    ETL task properties
    Task group Select a task group into which you want to classify this ETL.
    Running on scheduler Select the scheduler on which you want to run the ETL.
    Maximum execution time before warning Select the number of hours, minutes, or days to to execute the ETL for before generating warnings, if any.
    Frequency Select the frequency of ETL execution. Available options are:
    • Predefined: Select a Predefined frequency from Each Day, Each Week or Each Month.
    • Custom: Enter a Custom frequency (time interval) as the number of minutes, hours, days or weeks to run the ETL in.
    Start timestamp: hour\minute (Applies to Predefined frequency) Select the HH:MM start timestamp to add to the ETL execution that is running on a Predefined frequency.
    Custom start timestamp Select a YYYY-MM-DD HH:MM timestamp to add to the ETL execution running on a Custom frequency.

    To view or configure Advanced properties, click Advanced. You do not need to set or modify these properties unless you want to change the way the ETL works. These properties are for advanced users and scenarios only.

    Advanced properties

    Property Description
    Run configuration
    Datasets

    Select or clear metric groups for which data will be populated in the Available datasets. The connector allows you to choose only from the given list of datasets, and you cannot include additional datasets to the run configuration of the ETL.

    1. Click Edit.
    2. Select one (click) or more (shift+click) datasets that you want to exclude from Available datasets and click >> to move them to Selected datasets.
    3. Click Apply.
    Collection level
    Metric profile selection

    Select either of the following options:

    • Use Global metric profile: Select this option to use an out-of-the-box global profile that is available on the Metric profiles page. By default, all ETL modules use this profile.
    • Select a custom metric profile: Select from any of the metric profiles that you add in the Add metric profile page (Administration > DATAWAREHOUSE > Metric profiles).

    For more information, see Metric profiles.

    Levels up to

    Define the amount of metric imported into the data warehouse. Increase the level to add load to the data warehouse or decrease the metric level to reduce the number of imported metrics.

    Choose the metric level to apply on selected metrics:

    • [1] Essential
    • [2] Basic
    • [3] Standard
    • [4] Extended

    For more information, see Aging Class mapping.

    Additional properties
    List of properties

    Specify any additional properties for this ETL that act as user inputs during execution. You can specify values for these properties either at this time or from the "You can manually edit ETL properties from this page" link that is displayed for the ETL in view mode.

    1. Click Add.
    2. Add an additional property in the etl.additional.prop.n box.
    3. Click Apply.
    4. Repeat this task to add more properties.
    Loader configuration
    Empty dataset behavior Select one of the following actions to take if the loader encounters an empty dataset:
    • Warn: Abort the loader.
    • Ignore: Ignore the empty dataset and continue parsing.
    ETL log file name Type or verify the name of the file that contains the ETL execution log; the default value is: %BASE/log/%AYEAR%AMONTH%ADAY%AHOUR%MINUTE%TASKID
    Maximum number of rows for CSV output Select a number which limits the size of the output files.
    CSV loader output file name Type or verify the name of the file generated by the CSV loader; the default value is: %BASE/output/%DSNAME%AYEAR%AMONTH%ADAY%AHOUR%ZPROG%DSID%TASKID.
    Capacity Optimization loader output file name Type or verify the name of the file generated by the BMC TrueSight Capacity Optimization loader; the default value is: %BASE/output/%DSNAME%AYEAR%AMONTH%ADAY%AHOUR%ZPROG%DSID%TASKID.
    Detail mode Select the level of detail:
    • Standard: Data will be stored on the database in different tables at the following time granularities: Detail (configurable, by default: 5 minutes), Hourly, Daily, Monthly.
    • Raw also: Data will be stored on the database in different tables at the following time granularities: Raw (as available from the original data source), Detail (configurable, by default: 5 minutes), Hourly, Daily, Monthly.
    • Raw only: Data will be stored on the database in a table only at Raw granularity (as available from the original data source).

    For more information on granularities, see Accessing data using public views and Sizing and scalability considerations.

    Reduce priority

    Select one of the following priorities:

    • Normal
    • High
    Remove domain suffix from datasource name (Only for systems) Set to True to remove the domain name from the data source name. For example, server.domain.com will be saved as server.
    Leave domain suffix to system name (Only for systems) Set to True to retain the domain name in the system name. For example: server.domain.com will be saved as the system name.
    Update grouping object definition Set to True to allow the ETL to update the grouping object definition for a metric loaded by an ETL.
    Skip entity creation (Only for ETL tasks sharing lookup information with other tasks) Set to True to prevent this ETL from creating an entity. With this setting, the ETL discards data from its data source for entities not found in BMC TrueSight Capacity Optimization. It uses one of the other ETLs that share lookup to create the new entity.
    Scheduling options
    Hour mask Specify a value to execute the task only during particular hours within the day. For example, 0 – 23 or 1,3,5 – 12.
    Day of week mask Select the days so that the task can be executed only during the selected days of the week. To omit setting this filter, do not select any option for this field.
    Day of month mask Specify a value to execute the task only during particular days within a month. For example, 5, 9, 18, 27 – 31.
    Apply mask validation Set to False to disable the preceding Scheduling options that you specified. This property is useful if you want to temporarily turn off the mask validation without removing any values. By default this property is set to True.
    Execute after time Specify a value in the hours:minutes format (for example, 05:00 or 16:00) to indicate the time to wait before the task must be executed. After the task is scheduled, the task execution starts only after the specified time passes.
    Enqueueable Select one of the following options:
    • False (Default): While a task is running, additional execution commands are ignored.
    • True: While a task is running, additional execution commands are placed in a queue and executed in order after the current task is finished.

  5. Click Save.
    You return to the Last run tab under the ETL tasks page.
  6. In simulation mode, validate the results: In the ETL tasks table under ETL tasks > Last run, locate your ETL (ETL task name), click Run  to run the ETL.
    After you run the ETL, the Last exit column in the ETL tasks table will display one of the following values:
    • OK: The ETL executed without any error in simulation mode.
    • WARNING: The ETL execution returned some warnings in simulation mode. Check the ETL log.
    • ERROR: The ETL execution returned errors and was unsuccessful. Edit the active Run configuration and try again.
  7. After you verify that the ETL is running correctly, switch the ETL to production mode:
    1. In the ETL tasks table under ETL tasks > Last run, click the ETL name under the Name column.
    2. In the Run configurations table in the ETL details page, click Edit  to edit the active run configuration.
    3. In the Edit run configuration page, navigate to the Run configuration expandable tab and set Execute in simulation mode to No.
    4. Click Save.
  8. Locate the ETL in the ETL tasks table and either schedule an ETL run or click Run  to run it now.
    After you run or schedule the ETL, it will extract the data from the source and transfer it to the BMC TrueSight Capacity Optimization database.

Creating and using a platform definition JSON file 

To extract data from a set of Knowledge Modules (KM) for a new platform through TrueSight Operations Management, you must create a new JSON file that describes the platform.

To create a platform definition JSON file

  1. Analyze the Truesight Operations Management Knowledge Module (KM) to understand hierarchy of the devices and instances by using different discovery methods. For more information, see the Entity types and discovery methods section in Platform definition JSON file structure.

     Device and instance details

    • Devices monitored by a PATROL agent
    • Devices that are children of a given device
    • Instances that are children of a given device
    • Devices that are children of a given instance
    • Devices that are children of a child instance of a given device
    • Instances of a given monitor type with a given value of a configuration parameter

  2. Analyze the KM to understand the configuration and performance parameters to be extracted.
  3. Define the mapping of the Source (TrueSight Operations Management) devices, instance types, and parameters to the Destination (TrueSight Capacity Optimization) entities and metrics.
  4. Download the sample JSON file.
  5. Update the following information in the JSON file: 
    1. Define a platform “type” name for the JSON file; for example, "AIX”.
    2. Specify entity-level structure details:
      • Source-to-Destination mapping
      • Children for the entity
      • Lookup entries for the Destination
    3. Specify metric-level mapping details for Basic metrics:
      • Basic metrics are a 1:1 mapping between the Source and the Destination metric with a conversion formula, if required
      • Specify how to map “BY” metrics and how to filter subobjects using criteria
    4. Define the Derived and Aggregated metrics, if required.

       About Derived and Aggregated metrics

      • “Derived” metrics are computed at an entity level by using more than one metric of the same entity, using formula.
      • “Aggregated” metrics are computed at an entity level by using metrics of different entities that can be children, parent or subject, using formula.

      For more information about the structure and content of the file, see Platform definition JSON file structure.

  6. Save the JSON file to your local computer. For example, <platformname>-platform-def.json.
  7. Upload the file to a folder on the ETL Engine server.

 

To use the platform definition JSON file: Include the JSON file when you create the ETL:

  1. In the Add ETL page, after you select BMC - TrueSight Operations Management 10.1 Generic extractor as the ETL, open the TrueSight Operations Management configuration tab.
  2. Type the JSON file path in Platform definition JSON file path.
  3. Click Save.

For detailed procedure, see Integration steps.

Data Integration API calls to TrueSight Operations Management 10.1

TaskAPI call
Authenticate to Presentation ServerPOST https://<PresentationServerHostName>/tsws/10.0/api/authenticate/login
Retrieves a list of tenantsGET https://<PresentationServerHostName>/tsws/10.0/api/omprovider/tenants
Retrieves a list of devicesGET https://<PresentationServerHostName>/tsws/10.0/api/omprovider/devices
Retrieves a list of monitor typesGET https://<PresentationServerHostName>/tsws/10.0/api/omprovider/monitorTypes
Retrieves all instances present on the device
GET https://<PresentationServerHostName>/tsws/10.0/api/omprovider/instances
Retrieves configuration dataPOST https://<PresentationServerHostName>/tsws/10.0/api/omprovider/configdata
Retrieves performance dataPOST https://<PresentationServerHostName>/tsws/10.0/api/omprovider/perfdata
Log out and disconnectPOST https://<PresentationServerHostName>/tsws/10.0/api/authenticate/logout

Related topics

BMC TrueSight Operations Management

BMC - TrueSight Operations Management 10.1 extractor