Generic - CSV columnar file parser
This topic describes how to configure and use the CSV columnar file parser, which is useful for importing data from CSV files. For more information, refer to the following sections:
Before you integrate
Before you integrate BMC Helix Capacity Optimization with the CSV columnar file parser, see Preparing-to-integrate-CSV-files-with-general-purpose-connectors.
Integration steps
To integrate BMC Helix Capacity Optimization with the CSV columnar file parser, perform the following task:
- Navigate to Administration > ETL & SYSTEM TASKS > ETL tasks.
- In the ETL tasks page, click Add > Add ETL under the Last run tab.
In the Add ETL page, set values for the following properties under each expandable tab.
Basic properties
Advanced properties
- Click Save.
You return to the Last run tab under the ETL tasks page. - Validate the results in simulation mode: In the ETL tasks table under ETL tasks > Last run, locate your ETL (ETL task name), click
to run the ETL.
After you run the ETL, the Last exit column in the ETL tasks table will display one of the following values:- OK: The ETL executed without any error in simulation mode.
- WARNING: The ETL execution returned some warnings in simulation mode. Check the ETL log.
- ERROR: The ETL execution returned errors and was unsuccessful. Edit the active Run configuration and try again.
- Switch the ETL to production mode: To do this, perform the following task:
- In the ETL tasks table under ETL tasks > Last run, click the ETL under the Name column.
- In the Run configurations table in the ETL details page, click
to edit the active run configuration.
- In the Edit run configuration page, navigate to the Run configuration expandable tab and set Execute in simulation mode to No.
- Click Save.
- Locate the ETL in the ETL tasks table and click
to Run it, or schedule an ETL run.
After you run the ETL, or schedule the ETL for a run, it will extract the data form the source and transfer it to the BMC Helix Capacity Optimization database.
CSV file format
The following examples specify the format to be used for the CSV file.
Format for system metrics
S;DURATION;DS_SYSNM;CPU_UTIL;CPU_UTILMHZ;MEM_CONSUMED
2018-09-02 00:00:00;3600;Test System;0.67;2500;1073741824
2018-09-02 01:00:00;3600;Test System;0.68;2500;1073741824
2018-09-02 02:00:00;3600;Test System;0.70;2500;1073741824
2018-09-02 03:00:00;3600;Test System;0.25;2500;1073741824
2018-09-02 04:00:00;3600;Test System;0.56;2500;1073741824
2018-09-02 05:00:00;3600;Test System;0.66;2500;1073741824
2018-09-02 06:00:00;3600;Test System;0.67;2500;1073741824
2018-09-02 00:00:00;3600;Test System;0.67;2500;1073741824
2018-09-02 01:00:00;3600;Test System;0.68;2500;1073741824
2018-09-02 02:00:00;3600;Test System;0.70;2500;1073741824
2018-09-02 03:00:00;3600;Test System;0.25;2500;1073741824
2018-09-02 04:00:00;3600;Test System;0.56;2500;1073741824
2018-09-02 05:00:00;3600;Test System;0.66;2500;1073741824
2018-09-02 06:00:00;3600;Test System;0.67;2500;1073741824
Format for business driver metrics
TS;DS_WKLDNM;EVENT_RESPONSE_TIME;INTVL;SUBOBJNM
18/02/2014 00:00;Myapps_PIN_Success;2094.888889;300000;GLOBAL
18/02/2014 00:00;Myapps_Homepage_Load;2897.285714;300000;GLOBAL
18/02/2014 00:00;Myapps_Start_Page_Load;13675.34783;300000;GLOBAL
18/02/2014 00:00;Myapps_PIN_Success;2094.888889;300000;GLOBAL
18/02/2014 00:00;Myapps_Homepage_Load;2897.285714;300000;GLOBAL
18/02/2014 00:00;Myapps_Start_Page_Load;13675.34783;300000;GLOBAL
Related topics
Dataset-reference-for-ETL-tasks
Horizontal and Vertical datasets
Tip: For faster searching, add an asterisk to the end of your partial query. Example: cert*