Viewing the status of the data warehouse

Use the Status page to view the processing status and the volume of data processed by the ETLs. The status includes the following details:

Processing status, that includes, the message queue size, message queue age, relations queue size, and relations queue age
Volume of data processed

You can use this information to understand how much data is still to be processed and the approximate time required to process the data in the queue.

Related topic

Managing-the-Data-Warehouse

To access the Status page, click Administration > Data Warehouse > Status.

The following table describes the Status page sections:

Section

Description

Processing

Indicates the message queue size, message queue age, relations queue size, and relation queue age.

Timeseries message age: The amount of time for which data is waiting to be processed in queue.
Timeseries message queue: The number of messages in the queue for timeseries, that is, the amount of data loaded by the ETL that is yet to be processed. The ETL loads data, that is, packages of information in batches. Each package is known as a message.
Relations message age: The amount of time for which relations data is waiting to be processed in queue.
Relations message queue: The number of relation messages that need to be processed. One relation message can contain up to 500 lines of information. The connection between a system and it's child entity in the Workspace is defined as a relation.
For example, if you see two messages in this queue, it could mean that 1000 relations are waiting to be processed.

Information	Status	Indicates
Timeseries message age	Green	The total processing time is less than 8 hours.
	Yellow	The total processing time is between 8 to 24 hours.
	Red	The total processing time is more than 24 hours.
Relations message age	Green	The total processing time is less than 8 hours.
	Yellow	The total processing time is between 8 to 24 hours.
	Red	The total processing time is more than 24 hours.

Click the Processing details link to view the progress of the data ingestion process of the ETLs. For each ETL, the summary table shows the following details:

Column	Description
ETL ID	A unique identification number.
ETL name	The unique name defined for the ETL.
Start Time	The processing start date and time for the ETL.
Last update	The date and time of the latest execution of the ETL.
Timeseries processed %	The progress of the imported timeseries messages processed in percentage.
Relations processed %	The progress of the imported relations messages processed in percentage.
Tags processed %	The progress of imported tags messages processed in percentage.
Events processed %	The progress of imported events messages processed in percentage.

A task runs every hour and clears all the imports that have completed in the last hour. The processing details page lists all the import that have completed in the last hour.

After all the timeseries, relations, tags, and events messages are processed for a specific ETL, the ETL is removed from the summary table.

From the Processing details page, click Back to Warehouse status to view the Status page.

Volume

Displays values and charts for the following volumes processed by the BMC Helix Continuous Optimization components:

Processed today
Processed yesterday
Average daily processed rows (last 30 days)

The following image shows an example of the the Volume values and charts:

You can quickly gauge the status of your data warehouse from the Volume chart:

Compare Loaded Rows with Processed Rows. If loaded rows are much higher than processed rows, the queue age will be increased.
Compare Processed Rows with Average daily processed rows (last 30 days).
- If the processed rows are more, it indicates new data flows.
- If the processed rows are lower than the average value, it indicates less data flows in the system.

The data table displays the data used to build the chart. To view the data table, click Data Table at the top-right of the chart. The data table is displayed. The data flow table lists the date timestamp and the number of samples imported daily.

Reconciliation

Displays the progress of the active reconciliation processes. The entity catalog name, the total number of entities, the number of reconciled entities, and the percentage of progress is displayed.

You can click button to stop the reconciliation process. This option can be helpful if an incorrect system or too many systems are selected for reconciliation.

23.1_reconciliation_process.png

Viewing the status of the data warehouse

On this page