Viewing the ETL status

The first time extract, transform, and load (ETL) runs after installation, it populates the empty data warehouse and can take some time. The amount of the data transferred during the first ETL run depends on the number of months that you specify while configuring the primary site for the ETL cutoff period (Pull TSNA data starting from field) during installation.

Subsequent ETL runs do not take as long because these are incremental runs and smaller amounts of data are being transferred to the reports data warehouse.

This topic provides instructions on viewing the summary of all ETL runs and the status of an individual ETL run by using the TrueSight Network Automation - Data Warehouse console.

Viewing the summary of ETL runs

  1. Log in to the TrueSight Network Automation - Data Warehouse console as an administrator.

     Click here to see the steps for logging in to the console

    1. Click Start > Programs > TrueSight Network Automation - Data Warehouse > Login.
      Alternatively, you can enter the following address into a web browser: 
      https://<appServer>:<portNumber>

      • appServer is the server that hosts TrueSight Network Automation - Data Warehouse. 
      • portNumber is the Tomcat web server secure port that you specified during installation. 

    2. Enter DWNetworkAdmin as the user name.

    3. Enter password for the DWNetworkAdmin user that you created during installation.
      You can change the password for the DWNetworkAdmin user ID later.

    4. Click LOG IN.

  2. On the ETL Status tab, the ETL Execution Summary page displays the following columns:

    ColumnDescription
    Status

    Status of an ETL run, as follows: 

    •  indicates that the ETL run completed successfully. 
    • indicates that the ETL run is in progress. 

    • indicates that the ETL run failed.
    ETL Run ID

    ID of the ETL run. Every ETL run is assigned a unique ID.

    To view the details of an ETL run, click the ETL Run ID.
    Start TimeTime when an ETL run started
    End TimeTime when an ETL run ended
    Duration (hh:mm:ss)Time for an ETL run to finish
    Site Name

    Name of the TrueSight Network Automation site for which ETL was run
    You can choose multiple sites using the filter.

    Note

    Click the Refresh icon to see the latest state of an ETL run.

Viewing the detailed status of an ETL run

  1. On the ETL Execution Summary page, in the ETL Run ID column, click the ETL run for which you want to view the detailed status. 
    The following columns are displayed:

    ColumnDescription
    Status

    Indicates the status of a scenario run, as follows: 

    •  indicates that the scenario run completed successfully.
    •  indicates that the scenario run is in progress.
    •  indicates that the scenario run failed.
      To view the interface at which ETL failed and the reason for the failure, click . The page shows the error description and the destination command, which generated the error.
    Scenario NameRepresents a scenario
    To see the details of a scenario, click the scenario name. For more details, see To browse scenarios.
    Start TimeIndicates the time when a scenario started to run
    End TimeIndicates the time when a scenario run finished
    Duration (ss:ms)Indicates the time for a scenario run to finish

    Note

    Click the Refresh icon to see the latest state of a scenario run.

Browsing scenarios

  1. On the ETL Execution Summary page, in the Scenario Name column, click a scenario for which you want to view the steps. 
    The following columns are displayed:

    ColumnDescription
    Status

    Indicates whether an interface has run successfully, as follows:

    • indicates that the interface run finished successfully.
    •  indicates that the interface run is in progress.
    •  indicates that the interface run failed.
      To view the step at which ETL failed and the reason for the failure, click . The page shows the error description and the destination command, which generated the error.
    Interface NameName of an interface in the scenario
    Start TimeTime at which an interface started to run
    End TimeTime at which an interface finished
    Duration (ss:ms)Time for an interface to finish
    InsertNumber of rows inserted in a data warehouse table because of the execution of the interface
    UpdateNumber of rows updated in a data warehouse table because of the execution of the interface
    DeleteNumber of rows deleted from a data warehouse table because of the execution of the interface

    Note

    Click the Refresh icon to see the latest state of an interface.
  2. To view the steps in an interface, click the interface in the Interface Name column.
    The following columns are displayed:

    ColumnDescription
    Status

    Indicates whether a step has run successfully, as follows:

    •  indicates that the step finished successfully.
    •  indicates that the step is running.
    •  indicates that the step failed.
    Step NameName of a step in the interface
    NameName of the operation that was performed on the object during the execution of the step
    Start TimeTime at which a step started to run
    End TimeTime at which a step finished
    Duration (ss:ms)Time for a step to finish
    InsertNumber of rows inserted in a data warehouse table because of the execution of the step
    UpdateNumber of rows updated in a data warehouse table because of the execution of the step
    DeleteNumber of rows deleted from a data warehouse table because of the execution of the step

    Note

    Click the Refresh icon to see the latest state of a step.
  3. To view the query executed for a step, click the step in the Step Name column.
    The Query page shows the detailed query required to execute the step.

Viewing the ETL logs

Running ETL creates a log file, etl.log in the <TSNADW_INSTALL_DIR>/logs directory. This file contains details related to the scenario execution and errors. If an ETL run fails, you can use this file to determine the point at which an ETL run failed.

Was this page helpful? Yes No Submitting... Thank you

Comments