Troubleshooting dataload issues
While running data load operations, you might encounter certain issues such as jobs stuck in the In Progress state or jobs end with error detected job result. Ensure the correct entries in the spreadsheet data and Atrium Integrator Job list, multiple concurrent jobs are not running on a server, and the settings are configured correctly. Use this information to understand and resolve the issues.
Best Practices
When running data load operations, we recommend that you follow these tips:
- If a job fails in the load step, you cannot run that job again. Cancel the job and run this job as a new job.
- Ensure that the environment is configured correctly for Unified Data Management (UDM). For example, ensure that the load balance configurations and data paths are configured correctly.
- After you run the first UDM job, ensure that the DMT:SYS:SequencingEngine has all the sequence records.
- Clean up the UDM variable and load forms such as the CTM:LoadPeople records, DMT:ThreadManager, and CAI:Events forms periodically, especially in case of large volumes.
- Enable and run escalations on your primary server. For more information, see the how to disable escalations document on BMC Communities..
Troubleshooting load jobs that are stuck in the In Progress state
Issue symptom
Jobs are stuck in the In Progress state.
Issue scope
This issue occurs while running a dataload job.
Resolution
- Ensure that the following escalations are running in their own pool and are not shared with the other running escalations:
- DMT:DJS:SetStatus— Triggers every one minute and sets the status of the z1D_Action field to CHECKTRANSSTATUS.
- Filter DMT:DJS:ChkStepCompleted—Triggers after the z1D_Action field value is set.
For more information about escalations pools, see Setting escalation pools. - DMT:SHM:Schedule_RunSchedule
- Ensure that the custom Pentaho job is configured correctly.
For more information, see the following documentation and BMC Communities pages:
Troubleshooting load data errors
Issue symptom
The Load Data Errors field in the Step Details information (Step window) for the Load step displays the errors related to loading the data. The load errors are also displayed when Atrium Integrator has encountered an error. Errors range from a systematic Atrium Integrator issue (for example, connectivity issues) to an issue caused when the inbound data is not formatted as required (for example, invalid date formats in the dataload spreadsheets). Click View/Save Compressed Error File to see the errors or save them.
(Click the image to expand it.)
Issue scope
This issue occurs while running a dataload job.
Resolution
When a transformation (containing error handling) has trapped an error for specific data in the Spreadsheet tab or when a required field is missing or you have an incorrect selection of field values in your dataload spreadsheets. Each exception records the row, sheet, and the trapped error message and sends the output to a spreadsheet. Each Spreadsheet tab is included in its own Microsoft Excel file. You can open the spreadsheet to identify the row and the sheet that displays the error and also identify what section in the spreadsheet had incorrect data.
Before performing any other troubleshooting procedures, check that the rows in the named spreadsheet have the correct cell formatting applied, as shown in the following list:
- Row 1—General
- All other rows—Text
Important
Errors related to incorrect spreadsheet cell formatting are displayed especially if you have copied and pasted information from one spreadsheet to another.
The level of detail provided in the Load Data Errors field is based on the log level specified in the Atrium Integrator jobs and from the Job Console. If you are a DMT administrator, to help you determine why load issues are occurring, alter the log level details to something more informational (for example, Detailed, Debug, Rowlevel, and so on) so that additional details can be passed back to the step load error.
If you are using the Debug level, we recommend that you perform the following actions:
- To minimize the volume of data and determine what the warning message is, copy the required job and use only a subset of the data in the spreadsheet.
- Always reset this log level back to its normal value of Minimal to reduce future performance concerns.
Ensure that users running UDM jobs or scheduled jobs are not loading data on the computer while you are performing the debugging process. It is easier to work with smaller sets of data when you are identifying issues. We recommend that you perform the debug process during off business hours.
Tips
- If the load step is stuck in an In Progress state, verify that you have not selected the Disable Escalations server option on the AR System Administration Console under Configuration tab > System > General > Server Information.
- While running a data load job for a big number of asset records, you must set the composite index of the following fields for a faster data load:
- Company (Attribute added by ITSM extension)
- Name
- Serial Number
Troubleshooting Remedy AR System or plug-in errors
Issue symptom
The dataload step fails with Status as Error and a Job Result as Errors Detected.
Issue scope
When Remedy AR System or plug-in related errors occur, the dataload job fails.
Resolution
The system administrator must resolve such errors and then create a new dataload job. For information about creating a new job, see Creating a job and for information about running a new job, see Running a job.
(Click the image to expand it.)
Troubleshooting unique index violations error
Issue symptom
The ARERR 382 unique index violations error is displayed.
Issue scope
This issue occurs while running a dataload job.
Resolution
This error usually occurs when you import records with ID numbers that are numerically higher than the IDs that are currently assigned by your system. For information about the steps to be followed, see Importing records with higher ID numbers than those currently issued by system.
Troubleshooting Carte server related errors
Issue symptom
The Load step in the Steps panel captures and displays the errors for the following Carte server issues:
- The system is unable to establish a connection with the Carte server.
- The Carte server restarts when a dataload job is run.
Resolution
When such errors occur, the Load step is completed with the Status as Completed and Job Result as Errors Detected. As a system administrator, you must review the spreadsheet to resolve such errors and then run the job again or create a new dataload job.
If there are errors on the Load step, you cannot run the job again. You must create a new job.
Resolutions for common errors
The following table lists the common errors, cause, and their workaround:
Issue symptom | Resolution |
---|---|
The load jobs point to the load balancer and a timeout connection error is displayed with the server name in the arjavaplugin.log file. | Verify that the load balance server is listed in the UDM:RAppPassword form and the Microsoft Windows HOST file contains the following parameters:
|
The following error messages are displayed:
|
|
The following error message is displayed:
| Verify this issue on the text fields that display a small green triangle. If you do not see the triangle, click the field to set the integer. |
The load step is skipped. | Check the load step or as the DMT administrator, from the Job Console, check for a valid entry in the Atrium Integrator job list. If no data was loaded for this step or for the related validate and promote steps, ensure that you configure Atrium Integrator. For more information, see Understanding Atrium Integrator. |
The following error message is displayed:
| For more information, see Error when running jobs. |
The load step stays in the In Progress state even though all the data is on the staging form in the Done state. |
|
The following error message is displayed:
| Ensure that multiple concurrent jobs are not running on the Carte server. Increase the 1GB (default value) of heap space to add more concurrent number of jobs. |
The following error messages are displayed when performing a search:
|
|
The following error messages are displayed:
| Verify that the UDM load path is accessible and that the path is a shared path with read and write access. |
The Carte server stops responding and the following error message is displayed:
|
|
The following exception message is displayed:
| Correct the path and restart the Remedy AR System server. The Carte process does not recognize the "\u" entry in the ar.conf file. For example: BMC Software\ARSystem\ARServer\ |
The following error message is displayed:
| Verify that the CAI plugin registry has the correct settings. The filter timeout value is not set to very low. Additionally, increase the Remedy AR System server timeout settings. |
The following file does not open: //servername/D$/Workspace/UDM/ | If the file is in a server group environment, verify if the servers are communicating with each other and if the file has a read and write access to the UDM path set during the configuration. For more information, see the Knowledge Base article number 000097446. |
The following error message is displayed:
| Comment out the AR_USER parameter in the kettle.properties file. Then, restart the Atrium Integrator. |
The following error message is displayed: E | Add the alias name to the hosts file to loop back to localhost. See, KA000132182. |
Additional information
Verify the following additional settings.
Settings | Description |
---|---|
Configuring the UDM by following the recommendations and enabling the Data Management preferences for the dataload jobs. | For more information, see the following topics: |
Configuring the load file path for the BMC Remedy AR System attachments and spreadsheets repository. | For more information, see Configuring the load file path for the BMC Remedy AR System attachments and spreadsheets repository. |
CAI Plug-in Registry settings |
(Click the image to expand it.) |
Confirm that the forms have the correct server name. |
|
Gathering logs
Review the following log files for load error details:
Log file name | Location |
---|---|
arcarte.log | C:\Program Files\BMC Software\ARSystem\Arserver\Db directory. |
arjavaplugin.log | C:\Program Files\BMC Software\ARSystem\Arserver\Db directory. |
Pentaho plugin | For information about the location, see Troubleshooting Pentaho plug-in issues. |
Comments
Log in or register to comment.