Troubleshooting data import issues
Isuse symptoms
You might encounter the following errors or failures while importing data using BMC Helix Data Manager:
- Migration jobs are not created successfully.
- T table data import fails.
- Data import fails as the value is too long for character-type data.
- Data import fails due to field length mismatch.
- Data import fails due to data type error.
- Data import fails due to a unique key violation error.
Issue scope
The data import issues might occur for the following use cases:
- On-premises to on-premises data migration.
- On-premises to SaaS data migration.
Resolution
Verify the checks and troubleshoot the issue that you have faced.
Step | Task | Description |
---|---|---|
1 | Review the source and target system configurations. |
For more information, see Registering-source-and-target-systems. 2. Review the defined file system connections by performing the following tasks:
For more information, see Validating-file-system-configuration. 3. Review the discovered Data Dictionary from the source and target system, and make sure that the Forms & Fields tab shows a valid list of forms (Base, Custom, Overlay).
For more information, see Discovering-data-dictionaries. 4. To review if the version of the Migration Pack that is imported and published is valid:
For more information, see Adding custom forms to a migration pack or Creating-a-migration-pack-for-your-systems 5. When creating a Migration Pack, the BMC Helix Data Manager automatically creates data mappings between the source forms and target forms. If BMC Helix Data Manager is unable to create a mapping automatically, the fields will be flagged with a Data Mapping issue. The Data Mapping issues may include:
To review the form mapping and address the highlighted issues:
For more information, see Data mapping. |
2 | Enable and collect the logs. | BMC Helix Data Manager Logs are enabled under the BMC Helix Data Manager directory on both source and target systems. Check the hdm.log to verify whether the Date and Time details of when the activity was carried out are recorded. |
3 | Create a BMC Support case. | Make sure you capture detailed information by using the following list while creating a case with BMC Support:
|
After you determine a specific symptom or error message, use the following table to identify the cause and possible solution:
Symptom | Cause | Action | Reference |
---|---|---|---|
Data import on a specific form fails with an error message | |||
Detail: The import fails on a specific form with a permission denied error. Error: Error while executing SQL org.postgresql.util.PSQLException:ERROR: permission denied for table To view the error:
|
|
If you do not have access to run the database integration from BMC Helix Data Manager, provide the database administrator with the manual integration scripts found at this location. | Knowledge article: 000422374 |
Data import on a specific form fails with an exception | |||
Detail: Data import fails on a specific form with an exception ( For input string: "abcd" ). Error: Fatal error processing T file at line 72559 with requestId of 1234 |
| After importing the data, if you encounter an error or observe that the target system has extra fields, use a custom delimiter and rerun the export migration job on the forms. Important: We recommend using a custom delimiter with a lower memory value. For example, :hdm:. To run the export migration job by using a custom delimiter, see Running an export migration job page and set the Delimiter field value to a custom value. | Knowledge article: 000422456 |
Data import fails due to field length mismatch | |||
Detail: The data import fails with an error for a specific field in a form as the field length in the target system does not match the field length in the source system. Error:
|
|
Use the following query on the staging table or the source table to find the maximum length of a field and alter the length of that column on the target system. SELECT max(LENGTH(<column_name>)) FROM<form_name> <column_name> is the column name whose maximum length you want to find. <form_name> is the name of the form where the column is present. | Knowledge article: 000422457 |
Data import fails due to unique key violation error | |||
Detail: The data import fails when you select a migration job for data import. Error:
To view the error:
|
| To avoid the unique key violation due to:
| |
Data import fails due to Data Mapping error | |||
Detail: Data Mapping errors can directly affect the import of specific form data. Therefore, resolving any Data Mapping errors and warnings identified after configuring the Migration Pack is necessary. The Data Mapping errors are as follows:
|
| Review the different Data Mapping Status to understand the errors:
Additional steps:
| For additional details, see Data-mapping. |
Data Import fails because the integer is out of range | |||
Detail: The following error occurs because the time stamp integer value is out of range. Error: Error while executing SQL org postgresql.util.SQLException: |
|
|