Flume is an open-sourced distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data. It has a simple and flexible architecture based on streaming data flows. It is robust and fault tolerant with tunable reliability mechanisms and many failover and recovery mechanisms. It uses a simple extensible data model that allows for online analytic application.
Software Pattern Summary
|Product Component||OS Type||Versioning||Pattern Depth|
|Apache Flume||Unix||Active, File||Instance-based|
Platforms Supported by the Pattern
The pattern supports only UNIX platforms.
Software Instance Triggers
|Trigger Node||OS Type||Attribute||Condition||Argument|
Simple Identification Mappings
The following components are identified using simple identity mappings.
|Name||cmd matches||args matches|
Obtaining key variables
Obtaining Flume Install Root
Flume install root is obtained from the trigger process arguments using the following regular expression:
Version information for the product is currently collected using one of four possible methods.
The methods are tried in an order of precedence based on likely success and/or accuracy of the information that can be gathered. Once a result is obtained, the methods lower in precedence are not attempted. In order of precedence the methods are:
BMC Atrium Discovery extracts version information from the command result
If the version information wasn't obtained using previous methods, BMC Atrium Discovery extracts it from the RELEASE-NOTES file located in the <install_root> directory using the following regular expression:
- Apache Flume\s+(\d+(?:\.\d+)*)
Application Model Produced by Software Pattern
Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data. It has a simple and flexible architecture based on streaming data flows. It is robust and fault tolerant with tunable reliability mechanisms and many failover and recovery mechanisms. It uses a simple extensible data model that allows for online analytic application.
Software Pattern Model
The pattern produces an instance based Software Instance for Apache Flume, with the SI key that is created using the SI type (Apache Flume) and the name of the host that runs the Oracle SQL Connector for HDFS instance and process with arguments.
Software Instance Modeling
Subject Matter Expertise
Subject Matter Expert input will be welcome on any other potential approaches not discussed above to improving product relations to other products.
The pattern for Apache Flume was tested using actual installations of BMC Atrium Discovery running on Linux.
Created By: Dmytro Ostapchuk (18 December 2014)