Importing data from BMC Discovery

You can import data from BMC Discovery (known before version 11.0 as BMC Atrium Discovery and Dependency Mapping) into BMC Remedyforce CMDB 2.0 by using the Pentaho Data Integration tool. The Pentaho packages for importing data from BMC Discovery are available on the BMC Communities website. For information about how configuration items (CIs) are imported and relationships are created in CMDB 2.0, see Overview of how data is imported into BMC Remedyforce.

The following topics provide information about importing data from BMC Discovery into BMC Remedyforce CMDB:

Before you begin

Before you can import data from BMC Discovery into BMC Remedyforce CMDB, you must perform the following tasks:

• Install Java Runtime Environment (JRE).
• Download the Pentaho Data Integration tool.
  If the Require TLS 1.1 or higher for HTTPS connections Salesforce critical update is enabled in your organization, you must use version 6.1 or later of the Pentaho Data Integration tool.
• Create the KETTLE_HOME variable to store the location of the Kitchen.bat file.
• Register at the BMC Communities website.
• (Optional) Configure BMC Remedyforce to retain the original Instance Name value of CIs imported from an external source.
• If you have enabled the setting to access your Salesforce organization from limited IP addresses, ensure that you have the security token to log on to your Salesforce organization.
  For more information about the security token, see Salesforce Help.

• Download the appropriate Pentaho package from the BMC Communities website. The following table helps you to decide which package to download:

  Package to download	Details
  https://communities.bmc.com/docs/DOC-28434	Imports CIs from BMC Discovery and then creates relationships between the imported CIs in BMC Remedyforce CMDB based on the Assembly ID field.
  https://communities.bmc.com/docs/DOC-33777	Imports CIs and relationships of Computer System CIs with IPEndpoint, LANEndpoint, OperatingSystem, Processor, and Software Server CIs from BMC Discovery. This package also sets the HasImpact field value of the relationship records imported in BMC Remedyforce CMDB to Yes.

  For information about the KJB (job) and KTR (transformation) files that are included in the Pentaho package, see KJB and KTR files for importing data from BMC Discovery.

  Best practice

  BMC recommends that you do not change the folder structure because doing so can interfere with the running of the batch files provided in the CombinedJobs folder.

To import data from BMC Discovery

1. Navigate to the location where you downloaded and unzipped the Pentaho Data Integration tool, navigate to the data-integration folder, and make a backup copy of the Kitchen.bat file.
2. In the folder that you downloaded from the BMC Communities website, double-click the Common folder, copy the Kitchen.bat file, and paste it into the data-integration folder.
3. To launch the Pentaho Data Integration tool, navigate to the data-integration folder and double-click the Spoon.bat file.
4. In Pentaho Spoon, select File > Open, navigate to the folder where you downloaded the Pentaho package, and open the appropriate KJB file.
   For example, to import LAN Endpoint CIs into BMC Remedyforce CMDB, open the TransferADDMLANEndpointInfotoCMDB.kjb file in the LANEndpoint folder.

5. In the Transformation step (transformation), provide your BMC Discovery server access details.

    Click here to see the detailed steps.

   1. Right-click the Transformation step, select Open referenced object, and then select Transformation.
   2. On the GenerateCSVAPIFile tab, double-click the Create CSV URL step.
   3. In the Script Values / Mod window, perform the following actions:
      1. Replace <Enter HostName> with the BMC Discovery server name or the primary IP address of BMC Discovery.
      2. Replace <Enter UserName> with the BMC Discovery user name.
         Ensure that you enter the user name and password of a BMC Discovery system administrator. 
      3. Replace <Enter Password> with the BMC Discovery password.
         
      4. To save your changes and close the Script Values / Mod window,click OK.
      5. To save the KTR file, click Save.

6. Navigate to the KJB file that you opened in step 4.

7. In the Update BE Table With ADDM <CI type name> Information step (transformation), provide your Salesforce organization access details and, if required, customize the Pentaho package.

    Click here to see the detailed steps.

   Step	Action	Details
   a.	Open the  Update BE Table With ADDM <CI type name> Information step. For example, Update BE Table With ADDM LANEndpoint Information.	Right-click the Update BE Table With ADDM <CI type name> Information step, select Open referenced object, and then select Transformation.
   b.	(Optional) Import a fixed number of rows of data.	Perform the following actions: Right-click the ADDM input step, and select Edit Step. In the Text file input window, click the Content tab. In the Limit field, enter the number of rows that you want to import. Enter one additional row value, because one less row is fetched. For example, to fetch 100 rows, enter 101. Click OK.
   c.	Provide your Salesforce organization access details.	Perform the following actions: Double-click the the Upsert into class <CI type name> step. In the Salesforce Upsert window, enter your Salesforce organization user name and password. (Optional) To verify the connection, click Test connection and then click OK. To save your changes and close the window, click OK. Double-click the Salesforce Input[CMDB_Class] step and in the Salesforce Input window, repeat step 7c-ii to step 7c-iv. Note: BMC recommends that you do not change the default API version in the Salesforce Webservice URL.
   d.	(Optional) Update the predefined mapping between the BMC Discovery fields and BMC Remedyforce CMDB.	Perform the following actions: Double-click the Upsert into class <CI type name> step. In the Salesforce Upsert window, click Edit Mapping. In the Enter Mapping window, update mappings for fields based on your requirements. For information about updating the out-of-the-box mapping, see Field mapping in CMDB 2.0. To save your settings and close the Enter Mapping window, click OK. To save your changes and close the Salesforce Upsert window, click OK.
   e.	(For the Pentaho package that imports CIs and relationships into CMDB 2.0 only) Provide your Salesforce organization access details. Note: You must perform this action for all jobs in the Pentaho package, other than the job to import Computer System CIs (TransferADDM(CS)InfotoCMDB.kjb).	Perform the following actions: Double-click one of the following steps: Salesforce Input [BaseRelationship] Salesforce Input [BaseElement] Upsert into BaseRelationship In the window that opens, enter your Salesforce organization user name and password. (Optional) To verify the connection, click Test connection and then click OK. To save your changes and close the window, click OK. Repeat step 7e-i to step 7e-iv for the other steps listed in step 7e-i. Note: BMC recommends that you do not change the default API version in the Salesforce Webservice URL.

   Important

   If you have enabled the setting to access your Salesforce organization from limited IP addresses, you must append the security token to your Salesforce organization password.

   For example, if the password for your Salesforce organization is mypassword and your security token is XXXXXXXXX, specify mypasswordXXXXXXXXX in the Password fields.

8. To save the KTR and KJB files, click Save.

9. Close the Pentaho Data Integration tool.

10. From the folder of the CI type for which you are importing data, double-click the .bat file provided in the folder.
    For example, if you are importing data for Computer System, open the SchedulingComputerSystem.bat file.

    Important

    You must use the .bat file to avoid any errors while importing.

User scenario for importing data from BMC Discovery

David is a member of the Infrastructure team for Downtown Bank, responsible for managing the laptops for ABC project. He signs up for BMC Remedyforce and expects to use the preconfigured, ITIL based incident and problem management processes for managing CIs. Also, David wants to use the CMDB to represent the physical, logical, and conceptual items and to track the relationships between the different CIs.

Charlotte, a BMC Remedyforce administrator, helps David to import details about ABC team member laptops from BMC Discovery to BMC Remedyforce CMDB. Charlotte imports the laptop data into BMC Remedyforce CMDB by running multiple jobs from the Pentaho package in the following sequence:

1. To import the operating system, processor, IP EndPoint, and LAN Endpoint data, Charlotte navigates to the CombinedJobs folder and runs the TransferAdvancedADDMinfotoCMDB.bat file.
   After running the job, she opens the Operating System, Processor, IP EndPoint, and LAN Endpoint classes in the Instance Editor and verifies that the entries are correct on the Relationships tab.
2. To import the laptop OS details, Charlotte navigates to the ComputerSystem folder and runs the SchedulingComputerSystem.bat file. Next, Charlotte navigates to the OperatingSystem folder and runs the SchedulingOperatingSystem.bat file. 
   After running the jobs, she opens the Operating System class in the Instance Editor and verifies that the entries are correct on the Relationships tab.
3. To import the laptop software-server details, Charlotte navigates to the CombinedJobs folder and runs the TransferComputerSystemAndSoftwareADDMinfotoCMDB.bat file.
   After running the job, she opens the Software Server class in the Instance Editor and verifies that the entries are correct on the Relationships tab.

KJB and KTR files for importing data from BMC Discovery

The Pentaho packages contain job (KJB) and transformation (KTR) files that are created in the Pentaho Data Integration tool. The KJB files (jobs) and KTR files (transformations) store metadata in XML format. A KJB file contains a series of transformations that are run in a sequence. A KTR file contains a single transformation. The KJB (job) files retrieve data from external sources into BMC Remedyforce CMDB.

For information about the KJB and KTR files in the Pentaho packages for BMC Discovery, see KJB files in the Pentaho packages and KTR files in the Pentaho packages.

KJB files in the Pentaho packages

Each Pentaho package includes different KJB (job) files for importing different types of configuration items (CIs), such as computer systems and LAN endpoints. These job files are bundled with related files and provided to you in folders. The folder names correspond to CI types in BMC Remedyforce CMDB.

The following table provides information about the job files that you must run to import specific CI types into BMC Remedyforce CMDB:

KTR files in the Pentaho packages

All job (KJB) files for importing data from specific CI types contain a series of transformations that are run in a sequence. Each transformation maps to a KTR file that is available, along with the KJB file, in the folder for each CI type.

The following table provides information about the KTR files and the corresponding transformations that the KJB file for each CI type contains:

For example, the ComputerSystem folder contains the CreateInitialTimeStampedFileForADDM(CS).ktr, TransferADDM(CS)InfoToCMDB.ktr, and StoreADDM(CS)Timestamp.ktr files.

The following table provides information about the steps that are included in the TransferADDM<CIType>InfoToCMDB.ktr file (Update BE Table With ADDM <CI type name> Information transformation). The Pentaho package runs these steps to transfer data from BMC Discovery into BMC Remedyforce CMDB. You can view these steps only when you open the KTR file in the Pentaho Data Integration tool.

Related topics

Applying models while importing CIs and assets

Scheduling jobs to import data

Troubleshooting common issues when importing data