This documentation supports the 9.1 to 9.1 Service Pack 3 version and its patches of BMC Atrium Core. The documentation for version 9.1.04 and its patches is available here.

To view the latest version, select the version from the Product version menu.

Using CMDB Data Analyzer to Investigate CMDB Data Issues

This topic describes the CMDB Data analyzer tool.

Overview of CMDB Data Analyzer

The CMDB Data Analyzer is available for performing certain data analysis operations. This topic describes details about the CMDB Data Analyzer. The CMDB Data Analyzer is a collection of tools that enable you to perform data analysis and also identify data inconsistencies in any CMDB dataset. The CMDB Data Analyzer is installed along with the BMC Atrium Core. 

Pre-requisites

  • Ensure that Java 1.8 is installed on the system from where you want to run the CMDB Data Analyzer.
  • Ensure that the JAVA_HOME environment variable is set.

When to use the CMDB Data Analyzer

CMDB Data Analyzer has been created to assist with identifying data issues within your CMDB and can help you find inconsistencies and errors such as finding duplicates in a dataset to assist deletion before pushing the dataset to production, detect certain reconciliation errors such as multimatch error that occurs due to duplicate CI instances, identify Weak CI classes that do not have any relationships, finding CIs that are not reconciled, and identify the Soft deleted CI instances.

Note

BMC recommends running Data Analyzer on source datasets, to pre-identify the possible duplicate CIs as most of the duplicate CIs are created during initial data load, when the source data is copied to production.

What can you do with the CMDB Data Analyzer

With CMDB Data Analyzer you can do the following:

  • Identify Duplicate CIs

This tool identifies the duplicate CIs in the given CMDB dataset. Duplicate CIs in the CMDB data can lead to reconciliation failures, multimatch errors, and incorrect data in consuming applications. Duplicate CIs are identified as per the standard Reconciliation Engine identification rules and custom rule set that are defined in the system.

  • Identify Orphan CI Instances

This tool identifies the orphaned CI instances. An Orpaned CI is an instance of weak CI class that does not have any relationships. Finding Orphan CI operation is only applicable to a production dataset.

  • Identify Soft Deleted CIs

This tool identifies the Soft Deleted CI instances. A Soft Deleted CI is the one which has the mark-as-deleted attribute set to Yes.

  • Identify non-reconciled CIs/Relationship CI instances

This tool identifies those CI instances that are not reconciled. A non-reconciled CIs is the one without a ReconID.

  • Identify Classes without RE Identification rule

The classes without RE identification rules are the ones that have no identification rules defined at the class level.

Who can use the CMDB Data Analyzer

A CMDB Configuration Administrator and CMDB Configuration Manager will use the CMDB Data Analyzer.

In order to access the CMDB Data Analyzer the following permissions are required:

  • AR Administrator

How to use the CMDB Data Analyzer

The CMDB Data Analyzer is installed along with BMC Atrium and is deployed at the following location

<Atrium Installation directory>\AtriumCore\cmdb\utils\DataAnalyzer

 The following table describes the files in the CMDB Data Analyzer installation directory.

File NameDescription
app.properties

The app.properties file stores the AR server details that you enter while logging into the tool. It contains the parameters that are used, such as, AR server details, hostname, user name, and password. When your AR server details are authenticated, all the parameter details are stored in this file. Alternatively you can manually enter the AR Server details in the app.properties file before launching CMDB Data Analyzer.

The app.properties file contains an encrypted password. BMC recommends not to enter this information manually.

The app.properties file contains the following properties:

  • findduplicates.config.formsWithLargeData - Add a comma separated list of classes that have the highest data load in your system, to dedicate a thread for processing. This is recommended in very high data load environments (CIs>3 Million) for better performance.
  • findduplicates.config.groupBypermits - Set this value to a low number when the number of CIs in the system are very high. Set this to 1 if database timeouts occur when the data volume is very high.
WeakCIClassesThe WeakCIClasses.txt file stores a list of weak CI classes from which the orphaned CI instances are searched. BMC provides an out of the box list of weak CI classes from which the orphaned CI instances are searched. If you want to search orphaned CI instances from a weak CI class that is not listed in this file, you should first add the weak CI class name to this file. You can modify the list of the Weak CI classes.

Important Information

BMC recommends the following for optimum performance:

  • Run the CMDB Data Analyzer during off-peak hours if you have a large data environment.
  • Copy the zip file to another computer where AR and CMDB are not installed, extract the contents in the zip file and run the CMDB Data Analyzer. Make sure that AR Server and the computer where the CMDB Data Analyzer is installed are in the same LAN.
  • Run the Find Duplicate CIs operation per class or by selecting a certain group of classes when the volume of CIs in the CMDB system is very high( ~5M +) or if the duplicates that may exist in a class are high(~+ 400K). Note that, if a single class has large data( ~5M +), then this may be resource intensive for the DB even if the utility is run per class.
  • Increase the heap size in the cmdb-data-analyzer.bat file if the HTML output report generation time is high due to high number of duplicates.

Launching the CMDB Data Analyzer

 The following steps describe how to generate results using the CMDB Data Analyzer.

  1. Launch the BMC CMDB Data Analyzer.
    • On Windows, go to your installation directory and execute cmdb-data-analyzer.bat.
    • On UNIX, go to your installation directory and execute ./cmdb-data-analyzer.sh
  2. In the BMC CMDB Data Analyzer, click Configure. The AR Server Details window is displayed.
  3. In the AR Server Details window, provide the following information
    • AR Server Host Name - The Host name of AR Server
    • Port - The Port of AR Server
    • User - The user must be have access to the AR administrator group.
    • Password - A valid password
  4. Click Save.
    The fields in CMDB Data Analyzer are enabled. Now you can perform various data analysis operations. You must click Change to configure a different AR server.
  5. In the From Dataset list, select a dataset.
  6. Select the Duplicate CI Instances check box.
  7. Click Select to select specific classes from a list of classes.
    The Select Classes window is displayed.
  8. Select the required classes and click the >> button, and click OK.
  9. Select the Use Custom Rules to Find Duplicates check box to use custom Reconciliation Engine rules to identify duplicate CIs. If you do not select this check box, standard rules are applied.
  10. In the View Results as section, select HTML. The results of CMDB Data Analyzer are generated in HTML by default. You can also select the Text format to view results.
  11. Select the Save Copy of Results at AR Server check box to store the results in the Atrium:DataAnalyzerReportStore form. You must access the Atrium:DataAnalyzerReportStore form from BMC Midtier by directly entering the form name in the URL.
  12. Click Get Results.
    The results are displayed in the default browser window.
      
    As illustrated in the steps you can select a data analysis operation from the available list of operations and view the results. Alternatively, you can also select multiple or all the available data analysis operations and then click Get Results to generate the results. The output files are generated in the Reports folder in the installation directory. 

BMC Recommendation

When you install or upgrade 9.1, CMDB Data Analyzer will be deployed in the AtriumCore installation directory - <Atrium Installation directory>\AtriumCore\cmdb\utils\DataAnalyzer.

Archiving the CMDB Data Analyzer results

The records generated by the CMDB Data Analyzer are archived based on the schedule defined in the server's archiving policy. By default, the results that were generated 2 days prior to the current date are purged. You can increase the duration to preserve older results by opening the form in the developer studio and changing the archiving properties of the form.

Troubleshooting the CMDB Data Analyzer

To troubleshoot any issues that occur in the CMDB Data Analyzer, you can refer to the cmdbdataanalyzer.log file. By default the cmdbdataanalyzer.log file is present in the logs folder of your installation directory. You can configure the log settings (logging path and log level) in the log4j.xml. Set the level value parameter in the log4j.xml file to DEBUG to get detailed logs. To handle any issues that occur in the CMDB Data Analyzer, you can refer to logs or if required, capture the logs and send the data to Support team. The log4j.xml file is available in the AtriumCore installation directory - <Atrium Installation directory>\AtriumCore\cmdb\utils\DataAnalyzer

Current Limitations

  • The HTML report is not supported on Linux and Solaris platforms.
  • A typo in the OOTB rules data for class BMC_NTDomain in the RE:Automation:Identification_Rules form exists. The attribute name for DomainGUID should be corrected to DomainGuid if an error occurs while processing the class BMC_NTDomain.

  

Was this page helpful? Yes No Submitting... Thank you

Comments