Data collection status

After you create a data collector, you can understand the data collection status based on the following indicators available on the Administration > Data Collectors page. You can correlate this information to conclude the data collection status.

Related topics

Where to find more information

Managing data patterns

Creating data collectors

Item

Description

Data collector polling status

Polling status can be of the following types:

Overall polling status of a data collector, that is available under the Poll Status column.
Individual status of the last ten polls for a data collector, that is available in the Collection Status History .

Data collector state

Information about whether the data collector was started or stopped, and whether the data collection is in-progress or has completed.

This information is available under the State column.

This topic contains the following information:

Overall polling status of a data collector

The overall polling status for the data collector in the Poll Status column. This status is displayed based on the status of the last five polls available in the collection status history.

Status exception

The Receive over TCP/UDP data collector displays the overall polling status based on the most recent poll status rather than the last five polls in the collection status history. The criteria for displaying the status is different because this data collector is different in the following ways:

It does not poll target hosts, instead receives data from the target hosts.
Poll interval cannot be specified, therefore, the most recent status can be the most accurate indicator of whether the collection was successful or not.

Usually the status displays green or red, which means polling was successful or unsuccessful. If no data is received in the last one hour from the time when the last poll was made, the status displays yellow, which means few polls were unsuccessful.

The following table provides a description of the various kinds of polling status that can be displayed.

Polling status	Icon	Description
Polling is successful		Polling for a data collector was consecutively successful for the last five polls.
Few polls are unsuccessful		Displayed in one of the following scenarios: Polling for a data collector was unsuccessful for some of polls in the last five polls. No data was collected in the last one hour from the time of the last poll.
Many polls are unsuccessful		Displayed in one of the following scenarios: Polling for a data collector was consecutively unsuccessful for the last five polls. The Collection Agent (or Collection Station) used for creating the data collector has stopped working. Note: If the status displayed is red (unsuccessful polling) and the next data collection happens successfully, then the status changes to green (successful polling).
Collection Agent (or Collection Station) is unavailable
Polling is suspended		Collection Agent used for creating the data collector is not enabled on the Administration > Hosts tab.
Polling status unavailable		No polling information is available. This can happen in the following scenarios: If the data collection has not started. If the data collector was stopped during a time when the data collector was preparing to start.

Individual polling status of a data collector

The individual polling status of a data collector can be viewed in the collection status history. The collection status history displays details about the last ten polls for a data collector. To view this information, you need to select a data collector and click Collection Status History.

Note

The overall status is not available for the Upload File type of data collector. This is because this data collector is expected to do a one-time data collection of the uploaded file.

The collection status history provides a summary report with the following details:

Item	Description
Status	Indicates the individual polling status, as follows:
	Icon	Description
		Polling completed successfully.
		Polling failed.
Poll Time	Date and time when the poll was made.
Description	Provides the following details: Agent type (Collection Station or Collection Agent) used for collecting data. Indicates whether the polling was successfully completed or not.
Success	Count of records that are indexed successfully.
Rejected	Count of records that are rejected. Click the count of records to see the list of actual records that are rejected. Reasons for occurrence: Data pattern does not match the pattern of the log file. Date format of the log file does not match the date format specified in the data collector. Best effort collection is disabled and some data does not match the data pattern specified in the data collector. Data matches the criteria specified in the Ignore Data Matching Input setting.
Ignored	Count of records that are ignored. Click the count of records to see the list of actual records that are ignored. Reason for occurrence: When the timezone specified in the data collector and the timezone of the target host are not in sync. Therefore, some data might fall outside the specified data retention period.
More Info	Click More Info at the end of the dialog box to see additional details of the ten polls displayed in the collection status history. The following image describes the various details displayed for each of the polls. Date and time string when the poll was made. Details of the Collection Station (or Collection Agent) used to index the data. Time (in milliseconds) taken to make the poll. Name of the data collector (source details) Number of records ignored. Total duration (in seconds) for polling, reading, and indexing the data. Number of records rejected. Total number of bytes read. Date and time when the last event (or record) was indexed. Total number of bytes indexed. Epoch time when the last record (or event) got indexed.

Page tree

Data collection status

Overall polling status of a data collector

Individual polling status of a data collector