This version of the software is currently available only to customers in the Controlled Availability (CA) program.

Discovering data dictionaries


Discovery is the process by which BMC Helix Data Manager gathers information from the AR System data dictionary. To perform accurate data migrations between source and target systems, it is important to understand the data models of those systems, including any customizations that have been applied. 

Related topics

The following figure shows discovery for an AR System server:

DiscoveringDataDictionaries.png

BMC Helix Data Manager Engine runs the discovery job and creates a snapshot of a source or target system that is called a data dictionary, the following data is held in a data dictionary:

Data

Description

Forms

A list of all forms containing database-managed data in the system is included.

Fields

All fields for all extracted forms.

Indexes

All indexes for all forms. Use indexes to help identify the fields that might be used as foreign keys.

Relationships

The data relationships between the forms that workflow describes. For example, a menu that holds a list of companies creates a relationship between the company form and the form to which the menu is attached.

Modules

While not directly used by BMC Helix Data Manager when performing analysis and data migrations, the metadata regarding the data dictionaries for each module in use can be helpful when comparing applications or when identifying the correct migration pack to be used.

Discovery is an essential step when setting up BMC Helix Data Manager to perform migrations against your source and target sources. Whenever changes are made to a source or target system and affect the data model (for example, adding a new field, removing a field, or changing a field length), you should run discovery to ensure that BMC Helix Data Manager has an accurate understanding of the data model. However, if you are applying a patch that only changes workflow, it is typically not necessary to run discovery.

To discover data dictionary for on-premises to on-premises migration

If you are migrating your data from an existing on-premises system to an on-premises system, discover the data dictionaries for the source and the target system in the BMC Helix Data Manager tool.

For steps, see To discover the data dictionary.

To discover data dictionary for Remedy on-premises to BMC Helix Innovation Suite Cloud migration

If you are migrating your data from Remedy on-premises system to BMC Helix Innovation Suite Cloud, discover and link the data dictionaries of the source ITSM on-premises system and the target BMC Helix ITSM cloud system.

  1. Discover the data dictionary on the source on-premises system:
    1. Log in to the BMC Helix Data Manager tool installed on the source on-premises environment (on-premises BMC Helix Data Manager).
    2. Discover the data dictionary on the source on-premises environment.
      See To discover the data dictionary.
  2. Discover the data dictionary on the target BMC Helix ITSM cloud:
    1. Log in to the BMC Helix Data Manager tool installed on the target BMC Helix ITSM cloud (Development staging server BMC Helix Data Manager).
    2. Discover the data dictionary on the target environment.
      See To discover the data dictionary.

      Important

      Make sure that you set unique names for the discovered data dictionaries for source and target systems.

  3. Export the discovered data dictionary from the target BMC Helix ITSM cloud:
    1. In BMC Helix Data Manager Workbench, select Discovery & Analysis > Discovered Data Dictionaries.
    2. Select the target data dictionary, and click Select.
    3. Select Action > Export Data Dictionary.
      discovered_data_dictionary.png
      The exported data dictionary is saved to the default location - <HDM_Installation_directory>/BMC Software/Helix Data Manager/Metadata folder.
  1. Copy the data dictionary files from the Metadata folder on the target system to the SFTP folder.
  2. SFTP the data dictionary file from the BMC Helix ITSM cloud to the source on-premises environment.
  3. On the source on-premises environment, download the data dictionary file and copy to the <HDM_Installation_directory>/BMC Software/Helix Data Manager/Metadata folder.
  4. Log in to the BMC Helix Data Manager tool installed on the source on-premises environment (on-premises BMC Helix Data Manager).
  5. Import the metadata file of the data dictionary file copied from the target system to the source BMC Helix Data Manager tool:
    1. Select Configuration > Import HDM Meta Data.
    2. Click Scan.
    3. Select the metadata file, and click Import Meta Data.
    4. Click Import on the confirmation dialog box to confirm.
  6. Navigate to the imported data dictionary and select the registered Remote target system:
    1. Select Discovery & Analysis > Discovered Data Dictionaries.
    2. Select the imported data dictionary.
    3. Click the Linked Systems tab.
    4. Select the registered Remote target system from the Available System list, and click Add.

After you complete linking the data dictionary, see Creating-a-migration-pack-for-your-systems and review the mappings.

For end-to-end process of Remedy on-premises to BMC Helix Innovation Suite Cloud migration, see Migration process for Remedy on-premises to BMC Helix Innovation Suite Cloud.

To discover the data dictionary

  1. To trigger the discovery of the data dictionary for a registered system, use one of the following methods:
    • On the Home page, click the image for the server, and select Discover Data Dictionary.
      DiscoverDataDictionary.png
    • Select Configuration > Register & Configure Systems from the menu bar. Select the system, and select Action > Discover Data Dictionary.
    • On the System Admin page, select the system and select Action > Discover Data Dictionary.

  2. In Data Dictionary Discovery dialog box, select from the following data discovery options:

    Name

    Description

    Set As Current

    Select this option to automatically set the discovered data dictionary as Current for this system. You can override this flag on the System Administration interface. Only the Current data dictionary is available for migration packs.

    By default, this option is enabled.

    Relationships 

    Select this option to view the relationships between the forms and workflow objects. The relationships appear in the data dictionaries that are displayed on the Relationships tab.

    By default, this option is disabled. 

    Database Size

    Select this option to add information about the size of the database tables and their indexes on the disk in the discovery .

    By default, this option is disabled.

    Workflow

    Select this option to store information about the workflow elements in the repository to help a consultant determine the level of customization on a system.

    By default, this option is disabled. 

    discovery.png

  3. Select one of the following options:
    • Discover & Track—to automatically open the page to track the progress of the Discovery.
    • Discover—to run the discovery without opening the tracking page.

  4. After discovery is complete, click View Discovery to view the discovered data dictionary.
    The following image shows the Discover System page details:

    JobHistory.png

To perform operations on the discovered data dictionary

To view a discovered data dictionary

  1. Drill down on a source or target system from the Home page, or select Discovery & Analysis > Discovered Data Dictionaries.
  2. To select a different data dictionary to explore, click Select at the top of the page.
    DataDictSelect.png
  3. For BMC Digital Workplace or BMC Innovation Suite data dictionaries, select the appropriate option from the Dictionary Set list.
  4. To filter this list, type in the filter fields at the top of each column or sort the list by clicking the column headers. To select the data dictionary you want to explore, click on the table and click Select to confirm the choice.

You can access the following functions from the data dictionary page:

  • Select Data Dictionary—Select from the list of data dictionaries to browse the discovered metadata.
  • Browse Module—Browse the list of modules registered with the source or target server.
  • Browse Forms, Fields & Indexes f Browse Relationships—Browse all forms, fields, and indexes that were discovered from the source or target system.
  • Browse Relationships—Browse all relationships between the application's forms and review the data relationships that were inferred from the application's workflow.
  • Link Remedy Systems—Associate source or target systems with a data dictionary.
  • Remove Data Dictionary—Permanently delete a data dictionary.
  • Rename Data Dictionary—Change the name of the data dictionary as it is displayed in BMC Helix Data Manager.
  • Compare Data Dictionary—Compare two discovered data dictionaries to identify differences in the data model.
  • Export Data Dictionary—Export a data dictionary to a metadata export file which can be shared between BMC Helix Data Manager installations.

You cannot modify any of the discovered data dictionary information held in BMC Helix Data Manager. This metadata can be updated only by performing a new discovery from the home page.

To review the list of modules and their versions

This procedure is applicable to Remedy application types only.

  1. On BMC Helix Data Manager Workbench, select Discovery & Analysis > Discovered Data Dictionaries.
  2. Select a data dictionary, and click Select.
  3. Click the Modules tab.
    You can filter and sort the list by using the column headers.
    ModulesTab.png

To browse forms, fields, and indexes in a data dictionary

  1. On BMC Helix Data Manager Workbench, select Discovery & Analysis > Discovered Data Dictionaries.
  2. Select a data dictionary, and click Select.
  3. (Remedy application types only) To filter the list of forms on the Forms & Fields tab, select the BaseCustom, and Overlay check boxes. For example, clear the Base check box to display only custom and overlaid forms.
    For relational databases and other source types, the Dictionary tab appears instead of the Forms & Fields tab. The Dictionary tab lists tables in the database.
  4. To display the details for the table or the form including the type (Regular, Display Only, Vendor, and so on), schema ID and the form help text, click the Info tab.
    DiscoveredDataDict.png
  5. To edit the form help text, use the buttons displayed on the right of the text.
    Click the pencil icon to edit the text, and click the check mark icon to confirm your changes, or click the cross to cancel without modifying the form help text.
  6. To analyze the list of fields on the form or table:
    1. Click the Fields tab.
    2. Select a field from the list to display the core details for the field in the panel below.
      You can filter and sort the list by using the column headers.
    3. (Remedy application types only) To filter the list to identify customized fields in your application, select the No Overlay and Overlaid check boxes.
      FieldsTabForDataDict.png
  7. To show any indexes that have been configured for a regular form, select the Indexes tab.

To browse discovered relationships

This procedure is applicable to Remedy application types only.

  1. In BMC Helix Data Manager Workbench, select Discovery & Analysis > Discovered Data Dictionaries.
  2. Select a data dictionary, and click Select.
  3. Click the Relationships tab.
    Not all of these relationships are valid or useful in the context of data migration. BMC Helix Data Manager automates the process of interpreting these relationships into a data model that allows you to migrate data between source and target systems.
    RelationshipsTab.png
    The list of all forms for which BMC Helix Data Manager found any relationships appears in the upper left.
  4. To filter or sort this list by the form name, use the column header.
  5. To show the list of inwards and outwards relationships for that form, select a form from this list.
    The "directionality" of the relationship is based on the direction of data flow. Consider the following example relationships from the perspective of an individual form.

    Workflow type

    Description

    Relationship type

    Set Fields

    Pulls data from a remote form into the local form.

    Inwards

    Push Fields

    Pushes data from the local form into a remote form.

    Outwards

    Menu

    Pulls one data field from a remote form into a single field on the local form.

    Inwards

    Table Field

    Typically, shows a list of records related to the single local record implying a parent-child relationship.

    Outwards

    To review all inwards and outwards relationships for a particular form, click the corresponding magnifying glass. An "inwards" relationship from another form is not synonymous with that form being a parent. The Relationship Analysis phase is when decisions about parent-child relationships are made.

  6. To view the list of forms with no workflow relationships to other forms, click the No Discovered Relationships tab.


 

Tip: For faster searching, add an asterisk to the end of your partial query. Example: cert*