Generic - Custom structure format CSV parser

This article describes how to configure and use the Custom structure format CSV parser, which is useful for importing custom structure data inside a buffer table.

This topic contains the following sections:

• • Before you integrate
  •  
  • Integration steps
  • Input file format
  • Supported datasets
  • Related topics

Before you integrate

Before you integrate TrueSight Capacity Optimization with the CSV columnar file parser, refer to Preparing-to-integrate-CSV-files-with-general-purpose-connectors.

Integration steps

To integrate TrueSight Capacity Optimization with the CSV file parser, perform the following task:

1. Navigate to Administration > ETL & SYSTEM TASKS > ETL tasks.
2. In te ETL tasks page, click Add > Add ETL under the Last run tab.

3. In the Add ETL page, set values for the following properties under each expandable tab.

   • Basic
   • Advanced

   Note

   Basic properties are displayed by default in the Add ETL page. These are the most common properties that you can set for an ETL, and it is acceptable to leave the default selections for each as is.

   Basic properties

   Note

   To view or configure Advanced properties, click Advanced. You do not need to set or modify these properties unless you want to change the way the ETL works. These properties are for advanced users and scenarios only.

   Advanced properties
4. Click Save.
   You return to the Last run tab under the ETL tasks page.
5. Validate the results in simulation mode: In the ETL tasks table under ETL tasks > Last run, locate your ETL (ETL task name), click  to run the ETL.
   After you run the ETL, the Last exit column in the ETL tasks table will display one of the following values:
   • OK: The ETL executed without any error in simulation mode.
   • WARNING: The ETL execution returned some warnings in simulation mode. Check the ETL log.
   • ERROR: The ETL execution returned errors and was unsuccessful. Edit the active Run configuration and try again.
6. Switch the ETL to production mode: To do this, perform the following task:
   1. In the ETL tasks table under ETL tasks > Last run, click the ETL under the Name column.
   2. In the Run configurations table in the ETL details page, click  to edit the active run configuration.
   3. In the Edit run configuration page, navigate to the Run configuration expandable tab and set Execute in simulation mode to No.
   4. Click Save.
7. Locate the ETL in the ETL tasks table and click  to Run it, or schedule an ETL run.
   After you run the ETL, or schedule the ETL for a run, it will extract the data form the source and transfer it to the TrueSight Capacity Optimization database.

Input file format

The input file follows the open ETL structure.

Here is a sample of the supported file structure for system metrics:

Data loading can work in APPEND mode, UPDATE, TRUNCATE. ETL can work in APPEND mode, but selecting the Truncate table before load option . It can be enabled the table clean up before data loading. 
Specified table will be checked inside TrueSight Capacity Optimization schema: if table is not present, it will be created. For table creation, sql types indicated inside #COLUMNTYPES header will be used. 
If file headers are not present in the input file, parameters can be set in the ETL configuration.

Supported datasets

Only the CST (Custom Structure Tables) dataset is supported.

Related topics

Using-ETL-datasets

Generic-CSV-file-parser

Developing-custom-ETLs

Dataset-reference-for-ETL-tasks

Horizontal and Vertical datasets

Viewing-datasets-and-metrics-by-dataset-and-ETL-module