You can perform a search to troubleshoot issues by specifying a search criteria on the Search tab. Your search criteria (search string) can be composed of words, name=value pairs, fields, tags, and so on. For more information, see Searching the data. The search string is a set of expressions that are separated by various logical operators such as two ampersands (&&
), two pipes (||
), and so on. For more information, see Search string syntax.
This topic contains the following information:
Search commands are a set of commands containing arguments and can be run on the output of a particular search that you must have already performed. You can chain a set of search commands so that the output of one search command is consumed as the input to the subsequent search command. Multiple search commands can be chained by using a pipe separator (|).
Some of the commands add fields that you can use for further processing your data. For example, when you run the group
command, the following fields are automatically added in each of the records displayed:
duration
numentries
group_complete
For other commands such as extract
or table
, the additional field names are dynamic in nature and are added depending on the input specified. These fields can be used in subsequent commands added to your existing search query. These fields are virtual fields and cannot be added to the Fields section under the Filters panel.
At a high level, you can use search commands for the following purposes:
The following example use cases provide scenarios that help you better understand the value of using search commands.
Examples
Scenario 1
John has an application hosted on the cloud. The application web tier is hosted on an Apache HTTPD server, which provides information regarding all URLs accessed. This information is stored in the access.log file.
Goal: John wants to find out which browsers are most used by customers, to decide on the browsers for which support must be continued.
To find out the most used browsers, John needs to use a command that provides a total count of the URLs accessed using the various browsers. Suppose in the data that John is monitoring (access.log), there is a browser field; John can run the stats
command with the count function on the browser field.
Action: Run the following search command on the log entries related to the access.log file:
COLLECTOR_NAME=access.log | stats count(browser) by browser
Scenario 2
John wants to create a traffic-light indicator for the cpupercent field (CPU usage) in the following manner and summarize the results in a chart:
Actions:
COLLECTOR_NAME="script_54" | valmap field=cpupercent GREEN=0-5 YELLOW=6-50 RED=51-100 | chgname range with CPU_STATUS
COLLECTOR_NAME="script_54" | valmap field=cpupercent GREEN=0-5 YELLOW=6-50 RED=51-100 | chgname range with CPU_STATUS
| stats count(HOST) by CPU_STATUS
The following table provides a list of supported search commands for achieving various goals:
What do I want to do? | Supported search command | Description |
---|---|---|
Manipulate search results by performing the following functions:
| fields | Keep or remove fields in search results. |
filter | Filter results based on a criteria condition. | |
top | Get the most common values of a field. | |
rare | Get the least common values of a field. | |
head | Return the first n search results based on sort order. The | |
tail | Return the last n search results. The | |
dedup | Remove data records that contain fields with duplicate values. | |
Perform first-level analysis such as the following:
| chgname | Change the name of a field. |
chgvalue | Arrange values into buckets based on user-defined ranges. | |
concat | Concatenate field values (or string values) and assign them to the specified target field | |
difftime | Compute the difference between the current time stamp and the event time stamp and assign the value to a new "difftime" field. | |
eval | Evaluate an expression (a field name along with a specified operation) and assign the resulting value to a new field; for example, change the case of a field value, split a field value, and copy portions of a field value. | |
extract | Extract field values or raw event data and assign the values or data to new fields by using the Java regular expression capturing groups. | |
extractkv | Extract name=value pairs from raw event data depending on the delimiters specified. | |
stats | Create an aggregate representation of data in the form of a table of statistics and a corresponding chart based on the fields specified. | |
table | Extract fields from events with information in a tabular format. | |
valmap | Classify numeric field values with a specified category name depending on the range specified. | |
Present (or report) data quickly by specifying a search string | timechart | Create a time-series representation of data in the form of a table of statistics and a corresponding chart based on the fields specified. |
Perform advanced analysis such as complex pattern matching | group | Group events depending on the group options (conditions) specified to create a transaction of events. |
Search commands that provide tabular output are considered as tabular commands, which include the following:
Tabular commands provide a time-series representation of data in the form of a table of statistics and a corresponding chart based on the field or fields specified.
When you run a tabular command, by default, the results are summarized in the chart view. To see the results summarized in various ways, click the vertical three dots menu next to Chart View and select one of the following options:
To return to the chart view, select Chart View from the three dots menu.
The following table provides information about the various views available.
Kind of view | Description | |
---|---|---|
Chart View
| Provides a graphical representation of data. Click this view and select one of the following options to view a graphical representation of the search results. | |
Chart type | Click to preview | |
(Default) Bar | ||
Column | ||
Line | ||
The bars displayed in the chart are clickable. When you click a value in the table, the tabular view is toggled to the search results view and events associated with those values are displayed. By default, the legend is displayed. To hide the legend, clear the selected Show Legend check box. | ||
Tabular View | Provides a tabular representation of data. The values displayed in the table are clickable. When you click a value in the table, the tabular view is toggled to the search results view and events associated with those values are displayed. | |
Compare View | Select one of the following compare options from the three dots menu next to the time range displayed and click Compare to see a comparison of charts. You can also specify a new search query in the box displayed under the time range and then click Compare. This helps you understand how your current search results differ from the compared time context. Note: If the original query contains a long string separated by pipes (|), then the comparison run (against the next query) is only based on the portion of the original query before the first pipe. After you run a comparison, you can return to the compare options; to do this, click Expand to change options at the bottom-right of the chart and change the search query or select another compare option. After selecting the compare option, or changing the search query, or both, you need to click Change to run the comparison. | |
Compare option | Example | |
Same time Compares the current chart with another chart for the same time context, but a different search query. You need to provide the new search query to enable the comparison | Not applicable | |
Previous time (same duration) Compares current chart with the chart for | Original: Feb 26, 11:51am - Feb 26, 12:51pm Compared: Feb 26, 10:51am - Feb 26, 11:51am | |
Previous day (same duration) Compares current chart with the chart for | Original: Feb 26,11:51am - Feb 26, 12:51pm Compared: Feb 25,11:51am - Feb 25, 12:51pm | |
Previous week (same duration) Compare current chart with the chart for | Original: Feb 26, 11:51am - Feb 26, 12:51pm Compared: Feb 19, 11:51am - Feb 19, 12:51pm |
Field names are case sensitive.
Search commands that rely on fields work only if the specified field is present in the search results.
2 Comments
Rupesh kumar Agrawal
Priyanka Nanwani