Apache Kafka

Discover with BMC Discovery
download

This product can be discovered by any edition of BMC Discovery. Download our free Community Edition to try it out, or see what else it can discover !

What is this?
This is a product information page, containing details of the information that BMC Discovery gathers about a product and how it is obtained.
Product Name
Kafka
Publisher Page
Apache
Category
Distibuted Messaging System
Release
TKU-Jun-2017
Change History
Apache Kafka - Change History
Reports & Attributes
Apache Kafka - Reports & Attributes
Publisher Link
Apache

Product Description

Apache Kafka is a distributed, partitioned, replicated commit log service. It provides the functionality of a messaging system.

Known Versions

  • 0.7.0
  • 0.7.1
  • 0.7.2
  • 0.8.0
  • 0.8.1
  • 0.8.2
  • 0.8.2.1
  • 0.8.2-beta
  • 0.8.1.1 Release

Software Pattern Summary

Product Component

OS Type

Versioning

Pattern Depth

Apache Kafka ServerUnix/WindowsPathInstance-based
Apache Kafka ClusterUnix/WindowsSoftware InstanceInstance

Platforms Supported by the Pattern

The pattern discovers Apache Kafka Server deployed on both Unix and Windows systems.

Identification

Software Instance Triggers

Pattern

Trigger Node

Attribute

Condition

Argument

Apache Kafka ServerDiscoveredProcesscmdmatches

unix_cmd 'java'

windows_cmd 'java'

and
argsmatches regex '/libs/kafka_[^/\s]+\.jar'
or
argsmatches'kafka\.Kafka'
Apache Kafka ClusterSoftware Instancetype='Apache Kafka Server'
and
zoo_familymatchesregex '(\S+:\d+)'

Simple Identification Mappings

The trigger process is given a simple identification mapping:

Name

Command

Arguments

Apache Kafka Serverunix_cmd 'java'regex '/libs/kafka_[^/\s]+\.jar'
Apache Kafka Serverwindows_cmd 'java'regex 'kafka\.Kafka'
Apache Kafka Clustertyperegex '(\S+:\d+)'

Obtain Install root

The pattern retrieves root from following regular expression:

  • regex '-Xloggc:(/\S+)/logs/kafkaServer-gc\.log' - for Unix
  • 'Kafka\s*"?(\w\:.+)\\config\\' - for Windows

The pattern also attempts to fetch zookeeper_chroot by following regular expression:

  •  regex '(/\S+)'

Obtaining the version information 

The pattern obtains version information through Path versioning by following regular expression:

  •  regex '\bkafka_\d\.\d+\-(\d+(?:\.\d+)*)'

The pattern obtains product version using following regular expression:

  •  regex '(\d+(?:\.\d+)?)'

Obtaining Configuration file

The pattern obtains configuration information by following regular expression:

  •  regex 'kafka\.Kafka\s(?:\S+/(\S+\.properties))' - for Unix
  • 'Kafka\s*"?(\w\:.+\\config\\server.properties)' - for Windows

Obtaining Port information

The pattern attempts to retrieve port information for zoo_keeper port using following regular expression:

  •  regex ':(\d+)'

Application Model Produced by Software Pattern

Software Pattern Model

Pattern Trigger

The Apache Kafka server pattern triggers on java process which has '/opt/kafka_2.10-0.8.2.0/bin/../core/build/libs/kafka_2.10*.jar' or '"C:\Program Files (x86)\MicroStrategy\Messaging Services\Kafka\kafka_2.11-0.10.1.0\libs*" kafka.Kafka' in arguments.

The Apache Kafka Cluster patterns triggers on Software Instance which depends on zookeeper host.

SI Depth

The Apache Kafka Server pattern models Software Instance which key is based on location of config file for each instance.

The Apache Kafka Cluster models Software Instance which key is based on zookeeper_chroot, SI type and zookeper service key.

 

Software Instance Modeling

This is version for SI for each instance found:

 

 

Updated

Software Instance-Cluster

Cluster member

Relationship Creation

The pattern creates the following relationship between Apache Kafka and Apache Zookeeper.

Subject Matter Expertise

Subject Matter Expert input will be welcome on any other potential approaches not discussed to improving product versioning coverage and depth of Apache Kafka model.

Information Sources

Open Issues

There are no known open issues with this pattern.

 

© Copyright 2003-2017 BMC Software, Inc, Legal notices
Click here for the provisions described in the BMC License Agreement and Order related to third party products or technologies included in the BMC Product.