Viewing the ETL status

The first time extract, transform, and load (ETL) runs after installation, it populates the empty data warehouse and can take some time. The amount of the data transferred during the first ETL run depends on the number of months that you specify while configuring the primary site for the ETL cutoff period (Pull TSNA data starting from field) during installation.

Subsequent ETL runs do not take as long because these are incremental runs and smaller amounts of data are being transferred to the reports data warehouse.

This topic provides instructions on viewing the summary of all ETL runs and the status of an individual ETL run by using the TrueSight Network Automation - Data Warehouse console.

Viewing the summary of ETL runs

1. Log in to the TrueSight Network Automation - Data Warehouse console as an administrator.

   Click here to see the steps for logging in to the console

   1. Click Start > Programs > TrueSight Network Automation - Data Warehouse > Login.
      Alternatively, you can enter the following address into a web browser: 
      https://<appServer>:<portNumber>
      
      • appServer is the server that hosts TrueSight Network Automation - Data Warehouse. 
      • portNumber is the Tomcat web server secure port that you specified during installation. 
        
        
   2. Enter DWNetworkAdmin as the user name.
   3. Enter password for the DWNetworkAdmin user that you created during installation.
      You can change the password for the DWNetworkAdmin user ID later.
   4. Click LOG IN.

2. On the ETL Status tab, the ETL Execution Summary page displays the following columns:

   Column	Description
   Status	Status of an ETL run, as follows:   indicates that the ETL run completed successfully.  indicates that the ETL run is in progress.  indicates that the ETL run failed.
   ETL Run ID	ID of the ETL run. Every ETL run is assigned a unique ID. To view the details of an ETL run, click the ETL Run ID.
   Start Time	Time when an ETL run started
   End Time	Time when an ETL run ended
   Duration (hh:mm:ss)	Time for an ETL run to finish
   Site Name	Name of the TrueSight Network Automation site for which ETL was run You can choose multiple sites using the filter.

   Note

   Click the Refresh icon to see the latest state of an ETL run.

Viewing the detailed status of an ETL run

1. On the ETL Execution Summary page, in the ETL Run ID column, click the ETL run for which you want to view the detailed status. 
   The following columns are displayed:

   Column	Description
   Status	Indicates the status of a scenario run, as follows:   indicates that the scenario run completed successfully.  indicates that the scenario run is in progress.  indicates that the scenario run failed. To view the interface at which ETL failed and the reason for the failure, click . The page shows the error description and the destination command, which generated the error.
   Scenario Name	Represents a scenario To see the details of a scenario, click the scenario name. For more details, see To browse scenarios.
   Start Time	Indicates the time when a scenario started to run
   End Time	Indicates the time when a scenario run finished
   Duration (ss:ms)	Indicates the time for a scenario run to finish

   Note

   Click the Refresh icon to see the latest state of a scenario run.

Browsing scenarios

1. On the ETL Execution Summary page, in the Scenario Name column, click a scenario for which you want to view the steps. 
   The following columns are displayed:

   Column	Description
   Status	Indicates whether an interface has run successfully, as follows: indicates that the interface run finished successfully.  indicates that the interface run is in progress.  indicates that the interface run failed. To view the step at which ETL failed and the reason for the failure, click . The page shows the error description and the destination command, which generated the error.
   Interface Name	Name of an interface in the scenario
   Start Time	Time at which an interface started to run
   End Time	Time at which an interface finished
   Duration (ss:ms)	Time for an interface to finish
   Insert	Number of rows inserted in a data warehouse table because of the execution of the interface
   Update	Number of rows updated in a data warehouse table because of the execution of the interface
   Delete	Number of rows deleted from a data warehouse table because of the execution of the interface

   Note

   Click the Refresh icon to see the latest state of an interface.

2. To view the steps in an interface, click the interface in the Interface Name column.
   The following columns are displayed:

   Column	Description
   Status	Indicates whether a step has run successfully, as follows:  indicates that the step finished successfully.  indicates that the step is running.  indicates that the step failed.
   Step Name	Name of a step in the interface
   Name	Name of the operation that was performed on the object during the execution of the step
   Start Time	Time at which a step started to run
   End Time	Time at which a step finished
   Duration (ss:ms)	Time for a step to finish
   Insert	Number of rows inserted in a data warehouse table because of the execution of the step
   Update	Number of rows updated in a data warehouse table because of the execution of the step
   Delete	Number of rows deleted from a data warehouse table because of the execution of the step

   Note

   Click the Refresh icon to see the latest state of a step.

3. To view the query executed for a step, click the step in the Step Name column.
   The Query page shows the detailed query required to execute the step.

Viewing the ETL logs

Running ETL creates a log file, etl.log in the <TSNADW_INSTALL_DIR>/logs directory. This file contains details related to the scenario execution and errors. If an ETL run fails, you can use this file to determine the point at which an ETL run failed.