Troubleshooting common issues with importing data

While importing a large number of records, if you get the OutofMemoryError or Java heap size error, increase the heap size in the Spoon.bat file.

1. Go to the \pdi-ce-4.x.0-stable\data-integration or pdi-ce-5.0.1.A-stable\data-integration folder.
2. Right-click the Spoon.bat file, and select Edit.
3. Locate the following line and replace 512 with a higher value:
   If "%PENTAHO_DI_JAVA_OPTIONS%"=="" set PENTAHO_DI_JAVA_OPTIONS="-Xmx512m" "-XX:MaxPermSize=256m"
4. Click Save.
5. Relaunch the Spoon.bat file and rerun the job file.

• BMC BladeLogic Client Automation 
• Dell KACE
• Microsoft System Center Configuration Manager

A failure row file is a text file that is saved in the folder where you have saved your KJB files. Perform the necessary steps to remove the error provided for the failure rows in the failure rows file, and then import the data by using the following steps.

The following Pentaho packages provide a sample job file in the FailureRowsInput folder. You can use this sample job file as a base to create transformation files for importing data from the failure rows file to the Salesforce organization.

• BMC BladeLogic Client Automation integration with CMDB 1.0: https://communities.bmc.com/docs/DOC-18455
• Dell KACE integration with CMDB 1.0: https://communities.bmc.com/docs/DOC-21752
• Microsoft SCCM integration with CMDB 1.0: https://communities.bmc.com/docs/DOC-14522

In the following steps, it is assumed that you are using the sample KTR file provided by BMC.

To import data from the failure rows file

1. Double-click Failure file input for <CI type name>.
2. In the Selected files field, enter the failure file name location and click OK.
3. Copy the Upsert into class <CI type name> step from the appropriate KTR file and paste it into the transformation file that you have created to import data from the failure rows file.
   For example, if you are importing data for the operating system CI type, copy the Upsert into class operating system step from the KTR file for operating system.
4. Click Run.

A failure row file is a text file that is saved in the folder where you have saved your KJB files. Perform the necessary steps to remove the error provided for the failure rows in the failure rows file, and then import the data by using the following steps.

The following Pentaho packages provide a transformation file in the FailureRowsInput folder. You can use this transformation file for importing users from the failure rows file to the Salesforce organization.

• LDAP integration with BMC Remedyforce (assign permission sets and Remedyforce managed package license): https://communities.bmc.com/docs/DOC-32288
• LDAP integration with BMC Remedyforce (Salesforce Platform Licenses Only): https://communities.bmc.com/docs/DOC-22547
• LDAP integration with BMC Remedyforce (Customer Portal Manager Custom Licenses Only): https://communities.bmc.com/docs/DOC-17004

To import data from the failure rows file

1. Double-click and open the FailureRowsInput folder.
2. Double-click and open the LDAP_FAILURE_ROWS_<YYYYMMDDHHMMSS> file.
   Where YYYYMMDDHHMMSS is the time stamp of the file.
   The first line in the file displays the header row and from the second line onward details of the failed import are displayed. 
3. For each failed import record:
   1. Read the information under the headings Error Description, Error Fields, and Error Codes.
   2. Resolve the error.
4. Open the FailureLDAP transformation file with the Spoon batch file of the Pentaho Data Integration tool.
5. Double-click the Salesforce Upsert step, and enter your Salesforce organization username and password in the Connection section.
6. (Optional) To verify the connection, click Test connection.
7. Click OK.
8. To save the FailureLDAP transformation file, click .
9. Click .
10. In the Execute a transformation window, click Launch.