Importing data from BMC Atrium Discovery
The following topics provide information about importing data from BMC Atrium Discovery and Dependency Mapping (BMC Atrium Discovery) into BMC Remedyforce CMDB by using the Pentaho Data Integration tool:
For information about how configuration items (CIs) are imported and relationships are created in CMDB 2.0, see Overview of how data is imported into BMC Remedyforce.
Pentaho packages on BMC Communities
The Pentaho packages for importing data from BMC Atrium Discovery are provided on the BMC Communities website. The following table helps you to decide which package to download:
Package to download | Details |
---|---|
https://communities.bmc.com/docs/DOC-28434
| Imports CIs from BMC Atrium Discovery and then creates relationships between the imported CIs in BMC Remedyforce CMDB based on the Assembly ID field. |
Imports CIs and relationships of Computer System CIs with IPEndpoint, LANEndpoint, OperatingSystem, Processor, and Software Server CIs from BMC Atrium Discovery. This package also sets the HasImpact field value of the relationship records imported in BMC Remedyforce CMDB to Yes. |
Best practice
If you have upgraded to CMDB 2.0 and you were using CMDB 1.0 packages, you can continue using the CMDB 1.0 packages. However, for faster imports, BMC recommends that you use CMDB 2.0 packages
KJB files in the Pentaho packages
Each Pentaho package includes different job (KJB) files for importing different types of configuration items (CIs), such as computer systems and LAN endpoints. These job files are bundled with related files and provided to you in folders. The folder names correspond to CI types in BMC Remedyforce CMDB. For more information about the KJB files, see Overview of Pentaho packages.
The following table provides information about the job files that you must run to import specific CI types:
Folder name (CI type) | Job file | Job description |
---|---|---|
ComputerSystem | TransferADDM(CS)Infoto CMDB.kjb | Transfers information about the CI type |
OperatingSystem | TransferADDM(OS)Infoto CMDB.kjb | Transfers information about the BMC_OperatingSystem CI type |
Processor | TransferADDM(CPU)Infoto CMDB.kjb | Transfers information about the BMC_Processor CI type |
IPEndpoint | TransferADDMIPEndpoint InfotoCMDB.kjb | Transfers information about the BMC_IPEndPoint CI type (both IPv4 and IPv6) |
LANEndpoint | TransferADDMLANEndpoint InfotoCMDB.kjb | Transfers information about the BMC_LANEndpoint CI type |
SoftwareServer | TransferADDMSoftwareServer InfotoCMDB.kjb | Transfers information about the Note: Depending on the organization size, running the Software Server job transfers large amounts of data to the Salesforce organization, which might lead to the organization storage limit being exceeded. |
CombinedJobs |
|
|
KTR files in the Pentaho packages
All job (KJB) files for importing data from specific CI types contain a series of transformations that are run in a sequence. Each transformation maps to a KTR file that is available, along with the KJB file, in the folder for each CI type. The following table provides information about the KTR files and the corresponding transformations that the KJB file for each CI type contains:
KTR file | Transformation in the KJB file | Description |
---|---|---|
None | Check if Delta timestamp File exists | The Pentaho package utilizes a time stamp file to determine which records were added or modified since the last time the job was run. This step is used for incremental import. If a time stamp file does not exist, the Create the initial timestamp file step is run; otherwise, the Update staging table with ADDM <CI type name> information or Update BE Table With ADDM <CI type name> Information step is run. |
CreateInitialTimeStamped FileForADDM<CIType>.ktr | Create the initial Timestamp file | Records the time of import. This transformation runs only if you are importing for the first time or you have deleted the existing time stamp file. |
TransferADDM<CIType> InfoToCMDB.ktr | Update BE Table With ADDM <CI type name> Information | Transfers data from BMC Atrium Discovery to the Base Element object of BMC Remedyforce CMDB 2.0. |
StoreADDM<CIType>Time stamp.ktr | Store the current timestamp | If the data import is successful, the time of import is saved. |
For example, the ComputerSystem folder contains the following KTR files:
- CreateInitialTimeStampedFileForADDM(CS).ktr
- TransferADDM(CS)InfoToCMDB.ktr
- StoreADDM(CS)Timestamp.ktr
The following table provides information about the steps that are included in the TransferADDM<CIType>InfoToCMDB.ktr file (Update staging table with ADDM <CI type name> information or Update BE Table With ADDM <CI type name> Information transformation). The Pentaho package runs these steps to transfer data from BMC Atrium Discovery into BMC Remedyforce CMDB. You can view these steps only when you open the KTR file in the Pentaho Data Integration tool.
Step | Description |
---|---|
Delta timestamp | Reads the saved time stamp. |
Create CSV URL | Creates a URL to query BMC Atrium Discovery to fetch data for the corresponding CI type and accepts the credentials for the BMC Atrium Discovery server. |
ADDM input | Uses the URL that is created to query BMC Atrium Discovery and lists the fields that are queried. |
Transform ADDM variables | Facilitates JavaScript transformations such as appending or trimming fields. |
Salesforce Input[CMDB_Class] | Fetches details of the BMC Remedyforce CMDB class from your Salesforce organization and accepts the credentials for the Salesforce organization. |
Get Class Name | Changes the BMC Remedyforce CMDB class name into uppercase characters to compare it with the class name that is fetched from BMC Atrium Discovery. |
Get CMDB Class Id | Maps data imported from BMC Atrium Discovery to the appropriate CI class in BMC Remedyforce CMDB. |
Sort | Sorts the records that are imported from BMC Atrium Discovery. |
Unique rows | Checks that imported records are unique so that duplicate records are not created in BMC Remedyforce CMDB |
Upsert into class <CI type name> | Stores the imported data into the specified CI class and accepts the credentials for the Salesforce organization in which you want to save the imported data. |
Success rows | Stores the rows that are imported successfully. |
Failure rows | Stores the rows that are not imported along with error code, error descriptions, and error fields. |
The following steps in this transformation are available only in the Pentaho package to import CIs and relationships into CMDB 2.0. Also, these steps are available in all jobs in the package, other than the job to import Computer System CIs (TransferADDM(CS)InfotoCMDB.kjb). | |
Salesforce Input [Base Relationship] | Fetches details of the Base Relationship class in BMC Remedyforce CMDB from your Salesforce organization and accepts the credentials for the Salesforce organization. |
Stream lookup for <CI type name> | Checks if the Base Relationship class stores any relationships with the specified CI type as the destination. |
Salesforce Input [BaseElement] | Fetches details of the Base Element class in BMC Remedyforce CMDB from your Salesforce organization and accepts the credentials for the Salesforce organization. |
Stream lookup for ComputerSystem | Identifies the computer system CIs that are the source of the relationships with the specified CI type. |
Filter rows | Identifies and filters relationships that already exist in BMC Remedyforce CMDB so that duplicate relationships are not created. |
Duplicate BaseRelationship | Records the relationships that already exist in BMC Remedyforce CMDB. |
Upsert into Base Relationships | Stores the relationship records in the This step also sets the HasImpact field value of all relationship records imported in the |
Base Relationship Upsert Failure Rows | Stores the rows that are not imported, error code, error descriptions, and error fields. |
Base Relationship Upsert Success Rows | Stores the rows that are imported successfully. |
Before you begin
Before you can import data from BMC Atrium Discovery, you must perform the following tasks:
- Install Java Runtime Environment (JRE).
- Download the Pentaho Data Integration tool.
- Create the KETTLE_HOME variable to store the location of the Kitchen.bat file.
- Register at the BMC Communities website.
Download the appropriate Pentaho package. For more information, see Pentaho packages on BMC Communities.
BMC recommends that you download the job files in the folder in which you have unzipped the Pentaho Data Integration tool.Note
If you have already downloaded the Pentaho packages and you also want to import IPv6 records of
BMC_IPEndPoint
CI types, BMC recommends that you download the latest transformation files from the IPEndpoint folder.
To import data from BMC Atrium Discovery
From the \<PentahoInstallerFolder>\data-integration folder, make a backup copy of the Kitchen.bat file.
- In the folder that you downloaded from the BMC Communities page, double-click the Common folder, copy the Kitchen.bat file, and paste it into the \<PentahoInstallerFolder>\data-integration folder.
- To launch the Pentaho Data Integration tool, in the \<PentahoInstallerFolder>\data-integration folder, double-click the Spoon.bat file, and open the appropriate KJB file.
For example, the TransferADDMLANEndpointInfotoCMDB.kjb file in the LANEndpoint folder. To open the required KTR file, right-click the Update BE Table With ADDM <CI type name> information step, select Open referenced object, and then select Transformation.
- In the KTR file, double-click the Create CSV URL step.
- In the script, provide your BMC Atrium Discovery server access details:
- Replace <Enter HostName> with the BMC Atrium Discovery server name or the primary IP address of BMC Atrium Discovery.
- Replace <Enter UserName> with the BMC Atrium Discovery user name.
Ensure that you enter the user name and password of a BMC Atrium Discovery system administrator. - Replace <Enter Password> with the BMC Atrium Discovery password.
- (Optional) To import a fixed number of rows of data, perform the following actions:
- Right-click the ADDM input step, and select Edit Step.
- In the Text file input window, click the Content tab.
- In the Limit field, enter the number of rows that you want to import.
Enter one additional row value, because one less row is fetched. For example, to fetch 100 rows, enter 101. - Click OK.
- To provide your Salesforce organization access details, perform the following actions:
- Double-click the Upsert into class <CI type name> step.
- In the Salesforce Upsert window, enter your Salesforce organization user name and password.
(Optional) To update the predefined mapping between the BMC Atrium Discovery fields and Remedyforce CMDB, click Edit Mapping.
For more information about mapping, see Overview of how CIs are imported in CMDB 2.0.Note
Starting from January 1, 2016, Salesforce is retiring www.salesforce.com as an API endpoint. To avoid connectivity issues (HTTP Status 404 error), update your Pentaho transformations that connect to https://www.salesforce.com/services/Soap/u/<API version> to https://login.salesforce.com/services/Soap/u/35.0 before the retirement date.
If you are running the Pentaho package in a Sandbox environment, modify the Salesforce Webservice URL from https://test.salesforce.com/services/Soap/u/<API version> to https://test.salesforce.com/services/Soap/u/35.0 in the updated Pentaho transformation. For more information, see Salesforce API Endpoint Retirement.- (Optional) To verify the connection, click Test connection.
- Click OK.
- (For CMDB 2.0 only) Enter the information required to access your Salesforce organization:
- Double-click Salesforce Input[CMDB_Class].
- In the Connection section, enter the Salesforce organization access details.
- (Optional) To test the connection, click Test connection.
- Click OK.
- (For importing CIs and relationships in CMDB 2.0 only) Enter the information required to access your Salesforce organization:
- Double-click the Salesforce Input [BaseRelationship] step.
- In the Connection section, enter the Salesforce organization access details.
- (Optional) To test the connection, click Test connection.
- Click OK.
- Double-click the Salesforce Input [BaseElement] step.
- In the Connection section, enter the Salesforce organization access details.
- (Optional) To test the connection, click Test connection.
- Click OK.
- Double-click the Upsert into BaseRelationship step.
- In the Connection section, enter the Salesforce organization access details.
- (Optional) To test the connection, click Test connection.
- Click OK.
- (Optional) If you have enabled the setting to access your Salesforce organization from limited IP addresses, to enable communication between Salesforce and the Pentaho Data Integration tool, perform the following actions:
In Salesforce, navigate to Setup > Reset My Security Token.
Note
If you have enabled the improved Setup user interface in your Salesforce organization, navigate to My Settings > Personal > Reset My Security Token. For more information, see http://help.salesforce.com/apex/HTViewHelpDoc?id=admin_setup_improved.htm&language=en_US.
- Click Reset Security Token.
An email message is sent to your email address stored in Salesforce. - In the Password field of the Upsert into class <CI type name> step, append the security token to the password.
For example, if your password is mypassword and your security token is XXXXXXXXX, enter mypasswordXXXXXXXXX in the Password field.
- To save the KTR and KJB files, click .
- Close the Pentaho Data Integration tool.
From the folder of the CI type for which you are importing data, double-click the .bat file provided in the folder.
For example, if you are importing data for Computer System, open the SchedulingComputerSystem.bat file.Important
You must use the .bat file to avoid any errors while importing.
The relationships between the computer system as a source and the product or software server as a destination are not shown in the Configuration Items Explorer, which can show only a limited number of relationships (due to limitations of the Salesforce platform). Displaying relationships between a computer system and product or software server might hide other important relationships between the computer system and other CIs.
User scenario for importing data from BMC Atrium Discovery
David is a member of the Infrastructure team for Downtown Bank, responsible for managing the laptops for ABC project. He signs up for BMC Remedyforce and expects to use the preconfigured, ITIL based incident and problem management processes for managing CIs. Also, David wants to use the CMDB to represent the physical, logical, and conceptual items and to track the relationships between the different CIs.
Charlotte, a BMC Remedyforce administrator, helps David to import details about ABC team member laptops from BMC Atrium Discovery to BMC Remedyforce CMDB. Charlotte imports the laptop data into BMC Remedyforce CMDB by running multiple jobs from the Pentaho package in the following sequence:
- To import the operating system, processor, IP EndPoint, and LAN Endpoint data, Charlotte navigates to the CombinedJobs folder and runs the TransferAdvancedADDMinfotoCMDB.bat file.
After running the job, she opens the Operating System, Processor, IP EndPoint, and LAN Endpoint classes in the Instance Editor and verifies that the entries are correct on the Relationships tab. - To import the laptop OS details, Charlotte navigates to the ComputerSystem folder and runs the SchedulingComputerSystem.bat file. Next, Charlotte navigates to the OperatingSystem folder and runs the SchedulingOperatingSystem.bat file.
After running the jobs, she opens the Operating System class in the Instance Editor and verifies that the entries are correct on the Relationships tab. - To import the laptop software-server details, Charlotte navigates to the CombinedJobs folder and runs the TransferComputerSystemAndSoftwareADDMinfotoCMDB.bat file.
After running the job, she opens the Software Server class in the Instance Editor and verifies that the entries are correct on the Relationships tab.
Related topics
Importing data to custom attributes
Comments
Log in or register to comment.