This documentation supports releases of BMC Helix Continuous Optimization up to December 31, 2021. To view the latest version, select the version from the Product version menu.

Preparing to integrate CSV files with general-purpose connectors

BMC Helix Continuous Optimization enables data to be imported automatically from CSV files via some general purpose connectors. Each CSV file may contain data related to either performance and configuration data or Business Drivers.

Before deploying and configuring the appropriate ETL tasks, review the preparatory steps outlined in this topic.

Related topics

Dataset-reference-for-ETL-tasks

Horizontal and Vertical datasets

Generic-CSV-columnar-file-parser

Generic - CSV File Parser

Developing-custom-ETLs

Viewing-datasets-and-metrics-by-dataset-and-ETL-module

Out-of-the-box-ETLs 

  1. Analyze the CSV-file structure: Analyze the structure of your CSV files and identify the dataset structure (vertical or horizontal) that fits with the structure of your CSV file. For more information, see Horizontal and Vertical datasets.
  2. Determine the dataset and metrics to use: Determine the dataset and metrics that match with the actual data and metrics contained in your CSV file. You will then use the selected datasets and metrics to load your data into the BMC Helix Continuous Optimization database. For more information, see Viewing-datasets-and-metrics-by-dataset-and-ETL-module. (The full list of datasets and metrics and their related description and unit of measure can be easily accessed from Administration > DATA WAREHOUSE > Datasets & metrics.)
  3. Determine the mandatory columns: Make necessary changes to your CSV file by determining and including in them all mandatory columns for the datasets you have chosen. If needed, check descriptions for each mandatory column to understand if you need to include a particular value to some of them (for instance, if SUBOBJNM is absent, use DS_SUBOBJNM, and so on).
  4. Select a connector: Select the ETL module to import the data included into your CSV files and to deploy and configure the ETL task to be used for the import. Performance and configuration data included in CSV files can be imported into the BMC Helix Continuous Optimization database by leveraging the following generic out-of-the box connectors or custom connectors:
    1. Generic-CSV-columnar-file-parser: Use this connector if the structure of your CSV file fits with the horizontal dataset structure.
    2. Generic - CSV File Parser: Use this connector if the structure of your CSV file fits with the vertical dataset structure.

You may also consider developing a custom ETL module to integrate your CSV files. For more information, see Developing-custom-ETLs.

 

Tip: For faster searching, add an asterisk to the end of your partial query. Example: cert*