Collecting logs

Data collection in BMC Helix Log Analytics is based on open source data collectors to collect logs from different data sources or applications deployed in your environment. Before collecting logs, identify your monitoring requirements—the applications and files from which you want to collect logs. For log collection, we are using a docker-based Fluentd connector. It requires parsing formats based on which logs are parsed while collection such as Apache, Apache error, and so on. For more information, see Downloading and installing connectors for third-party integrations.  You can also define which log messages you want to include or exclude by using the grep condition. For more information about these parsing formats and grep condition, see Logs parsing and filtering.

The following table lists the log collection options:

You can also use open source collectors—Filebeat and Logstash—to collect logs. However, you need to manage all the connectors as it is not supported in the BMC Helix Developer Tools connector framework. For more information, see Collecting-logs-by-using-Logstash-and-Filebeat.