Running ETL


Complete the following tasks to ensure that the extract, transform, and load (ETL) process runs correctly:

  1. Ensure that the time zone selected for TrueSight Network Automation, Network Automation - Data Warehouse, and the database server is the same, and that the clock time is in sync with the time zone on each server.
  2. Create the ETL schedule or modify it if it is already created as required by using Task Scheduler. 
  3. You can run ETL from either from the Task Scheduler by scheduling it or from the command line. When you run ETL from the Task Scheduler, ETL is run sequentially for all the enabled sites on the scheduled time. From the command line, you can run ETL immediately either for a specific site or multiple sites with a single command. For more information, see Running ETL from the command line.

Creating and modifying the ETL data collection schedule

By default, the installation program creates a scheduled task, tsnadw_etl_tsk, for the extract, transform, and load (ETL) data collection. If it is not created by default, you must create the task. 

Note

BMC recommends that you do not run ETL more than once an hour.

To create the ETL schedule on Windows Server 2012

  1. Log on to the computer where Network Automation - Data Warehouse is installed.
  2. Select Start > All Programs > Administrative Tools > Task Scheduler.
  3. From the Actions pane, click Create Basic Task
    The Create Basic Task Wizard opens.
  4. Enter a name for the task, such as etl_task.
  5. Select the frequency at which you want to run this task, and click Next.
  6. Select a start time, and click Next.
  7. Select the Start a program option, and click Next.
  8. In Program/script, click Browse and navigate to the <TSNADWInstallationDir>\bin\bna\bds-di\scripts directory and select run_etl.bat and click Next.
  9. Click Finish.

Running ETL from the command line

Use this procedure to run ETL from the command line either for a specific site or multiple sites.

Note

You cannot run ETL for a disabled or deleted site.

To run ETL from the command line

  1. Log on to the computer where Network Automation - Data Warehouse is installed.
  2. From the command line, navigate to the <TSNADWInstallationDir>\bin\bna\bds-di\scripts directory.
  3. Use the following syntax to run ETL: run_etl.bat “SiteName1” “SiteName2
    • Separate multiple sites by spaces.
    • Include <Sitename> in double-quotes.
    • If you do not specify any argument, by default, ETL is run for all the enabled sites sequentially.

Where to go from here

Running-Windows-scheduled-tasks-as-administrator

 

Tip: For faster searching, add an asterisk to the end of your partial query. Example: cert*