Troubleshooting log collection from files
No logs are ingested
Resolution
Check the following:
- If correct key and pattern are configured for Regexp and Exclude for the grep filter.
- If the configured format expression matches the logs that you are collecting.
Logs are not being filtered while collection
Resolution
Check if key and pattern are configured correctly for Regexp and Exclude for the grep filter.
Invalid format expression
Resolution
Validate the expression at Rubular or Fluentular.
Configured integration is in disconnected state
Resolution
Ensure that the docker container is up and running.
Verify parameters are correctly populated in the fluentd pipeline
Resolution
Verify that the configurations entered on the UI are saved successfully in the configuration file.
- Docker connector: Go to /opt/bmc/connectors/<connector_name>/<integration_name>/pipeline. Open the file_log_pipeline.conf file by running the cat file_log_pipeline.conf command.
- Windows connector: Go to <connector download folder>\opt\td-agent\file_log_pipeline.conf. Verify the configurations in this file.
config error .... error="Duplicate key: <key_Name>" in connector logs
Issue symptoms
Integration is shown in the Configured state, but this error is shown in the connector td-agent logs.
Issue scope
Issue might occur with all connectors and integrations.
Resolution
In the integration configuration for log collection, when you configure the grep filter, ensure that for the same directive, keys are unique. For example, do not repeat the msgType key for multiple Regexp directives.
Then, verify that the configurations entered on the UI are saved successfully in the configuration file:
- Docker connector: Go to /opt/bmc/connectors/<connector_name>/<integration_name>/pipeline. Open the file_log_pipeline.conf file by running the cat file_log_pipeline.conf command.
- Windows connector: Go to <connector download folder>\opt\td-agent\file_log_pipeline.conf. Verify the configurations in this file.
- Linux connector: Open the file_log_pipeline.conf file located in the opt/td-agent/etc/data/<Integration_ID>/pipeline/ folder and modify the the file by removing the duplicate entry. Then, restart the td-agent service.
Unable to run the batch script to install the Windows connector
Resolution
Confirm that you have the permissions execute the script. Ensure that you launch the command prompt with Run as Administrator option.
Unable to run the shell script to install the Linux connector
Resolution
Ensure that you have the root permissions to run a script file.
Batch script to install the Windows connector failed
Resolution
Check the logs for error. The installation script execution logs are displayed on the command prompt and are also added to the installation log file, which is located at <folder where you extracted the downloaded zip file>\BMC-DevTools\opt\<connector_Name> with name <connector_name>_install.log.
Path too long error while extracting the Windows connector .zip file
Resolution
You get this error when you use Windows out-of-the-box utility to extract a .zip file. Resolve the error by following either of the following:
- Ensure that the destination folder name is short.
- Use 7-zip or any other utility to extract the file.
System cannot find the specified path error while installing the Windows connector
Resolution
You get the BMC-DevTools folder after extracting the tdc-connector-windows-<build_number>.zip file. The BMC-DevTools folder and the .bat file to install the connector must be at the same level in the folder hierarchy. For example, if you extract the downloaded connector file in the C:\Connector folder, ensure that the downloaded .bat file is also present inside the Connector folder.
Not able to execute install script error while installing the Linux connector
Resolution
Ensure that you have extracted the .tar.gz file in the /opt directory.
/opt/td-agent already exist error while running the Linux connector install script
Resolution
On the Linux server, either the connector is already installed or a td-agent is currently running. Remove the existing installation and run install script again.
/opt/bmc-devtools/td-agent does not exist error while running the Linux connector install script
Resolution
Extract the installation .tar.gz file in the /opt directory only.
Permission denied error
When you are installing the Windows connector, you get the permission denied error even though you are installing as an administrator.
Issue symptoms
Windows connector installation fails.
Issue scope
Issue might occur with Windows connector installation.
Resolution
Ensure that there are no spaces in the name of the folder where you are installing the connector.