Page tree
Skip to end of metadata
Go to start of metadata

This topic provides information about configuring the Hadoop monitoring solution by using Central Monitoring Administration.

On the Add Monitor Types dialog, with the Monitoring Profile set to Hadoop, and the Monitor Type set to Hadoop, provide the following details:

FieldDescription
Environment Configuration
Environment name

Enter a logical unique name for the environment. A container will be created with the environment name. This environment will hold all the hosts. BMC recommends you to provide only alphanumeric characters in environment name.

Valid values: a-z, A-Z, 0-9

Invalid values: # ' . | ? \ " [ ] + = &

Hadoop Connection
Hadoop Vendor

Select the monitored Hadoop vendor. The supported vendors are:

  • Apache Hadoop
  • Big Insite
  • Cloudera
  • Horton
  • Map R
Host/IP

Enter a unique, user-defined host name or an IP address

Port
Enter the Hadoop NameNode port number. Default port number is 50070
Use HTTP

Select this checkbox if you want to use HTTPs protocol for connection. By default, HTTP protocol is used for connection.

Hadoop Credentials
User NameEnter the username to connect to the Hadoop server. Depending on the Hadoop environment, the Hadoop User Name may not be required.
PasswordEnter the password (if required) to connect to the Hadoop server.
Confirm PasswordRe-enter the password for confirmation.
Java Home Details
Java homeEnter the directory where you have installed Java version 1.7 or later.
Local admin OS Credentials
The Local admin OS credentials are used to run the Java collector. The local admin must have permissions to run the Java declared in the Java Home field.
User NameEnter the local administrator user name
PasswordEnter the local administrator password
Confirm PasswordRe-enter the password for confirmation
Monitor Data
Collection level

Select the collection level for monitoring the Hadoop instances

  1. Availability - Enables monitoring of the Hadoop instance availability (if instance is running or is down) of one of the following instances existing in the environment
    1. NameNode
    2. SecondaryNameNode
    3. ResourceManager
    4. DataNode
    5. NodeManager
    6. JobHistory
    7. JobTracker
    8. TaskTracker
  2. Full data monitoring - Enables the monitoring of all Hadoop instances
  3. Custom data monitoring - Manually select the Hadoop instances to monitor
Custom Hadoop Metiric

Select the list of metrics for monitoring.

  1. NameNode Metrics
    • NameNode All - Select this checkbox to monitor all NameNode metrics
    • Selection - Select the NameNode metrics you want to monitor
  2. DataNode Metrics
    • DataNode All - Select this checkbox to monitor all DataNode metrics
    • Selection - Select the DataNode metrics you want to monitor
  3. ResourceManager Metrics
    • ResourceManager All - Select this checkbox to monitor all ResourceManager metrics
    • Selection - Select the ResourceManager metrics you want to monitor
  4. JobTracker Metrics
    • JobTracker All - Select this checkbox to monitor all JobTracker metrics
    • Selection - Select the JobTracker metrics you want to monitor
  5. NodeManager Metrics
    • NodeManager All - Select this checkbox to monitor all NodeManager metrics
    • Selection - Select the NodeManager metircs you want to monitor
  6. TaskTracker Metrics
    • TaskTracker All - Select this checkbox to monitor all TaskTracker metrics
    • Selection - Select the TaskTracker metrics you want to monitor
  7. SecondaryNameNode Metrics
    • SecondaryNameNode All - Select this checkbox to monitor all SecondaryNameNode metrics
    • Selection - Select the SecondaryNameNode metrics you want to monitor

 

Server TrustStore Details
TrustStore file (jks)If you select to use HTTPs protocol for connection, you must provide the location to the Java Keystore File (JKS) for a successful connection to the URL in a secure mode.
TrustStore passwordEnter the password to the JKS file.
Filtering
DataNode filtering options
Filtering mode

Specify the filtering type for filtering the DataNodes

  • None - Selects all available DataNodes for filtering
  • Include - Includes only the DataNodes entered in the Include/Exclude from Monitoring field
  • Exclude - Excludes the DataNodes entered in the Include/Exclude from Monitoring field
Include/Exclude from Monitoring (regex)Specify a regular expression or the DataNode names to either include or exclude DataNodes from filtering
NodeManager filtering options
Filtering mode

Specify the filtering type for filtering the DataNodes

  • None - Selects all available NodeManagers for filtering
  • Include - Includes only the NodeManagers entered in the Include/Exclude from Monitoring field
  • Exclude - Excludes the NodeManagers entered in the Include/Exclude from Monitoring field
Include/Exclude from Monitoring (regex)Specify a regular expression or the NodeManager names to either include or exclude NodeManagers from filtering
KM Administration
Optional JVM args

Enter JVM arguments for the Hadoop JAVA collector.

LoggingSeelct this option to enable PSL and Java logging
Availability collection time (min)Select the availability collection time in minutes
Data collection time (min)Select the metrics collection time in minutes
Device mappingSelect to enable device mapping to consolidate the configured devices at the device level
Add to ListClick this option to add the configuration to the List - Environment Configurations list
Modify SelectionClick this option to modify the configuration details
Remove from ListClick this option to remove the configuration from the List - Environment Configurations list
List - Environment ConfigurationsDisplays a list of environments you have configured
ResetClick this option to reset the monitor configuration to its default values.
AddClick this option to add the configuration.
CloseClick this option to close the Add Monitor Types configuration screen.
  • No labels

2 Comments

  1.  

    1.