Configuring Hadoop in PATROL

This topic provides instructions to configure and to delete a configured Hadoop environment.

To configure a Hadoop environment

1. From the PATROL Console work area, right-click Hadoop node (HADOOP_MAIN application class)
2. Choose the Register Hadoop Environment KM menu command to display the Register Hadoop environment dialog box.
3. Use the Register Hadoop environment dialog box, to add a new Hadoop environment. 
4. Enter the information, as follows:
   1. Environment name - Enter a logical unique name for the environment. A container will be created with the environment name. This environment will contain the Hadoop components. For example, if you add Hadoop NameNode details, you will see all the Hadoop NameNode components and data related to it. BMC recommends you to provide only alphanumeric characters in environment name. 

      Valid values: a-z, A-Z, 0-9

      Invalid values: # ' . | ? \ " [ ] + = &

   2. Hadoop connection details, 
      1. Hadoop Vendor -  Select the monitored Hadoop vendor. The supported vendors are:
         • Apache Hadoop
         • Big Insite
         • Cloudera
         • Horton
         • Map R
      2. Hadoop Host - Enter a unique, user-defined host name or an IP address.
      3. Hadoop Port - Enter the Hadoop port number. This port number depends on the component you want to monitor. If you want to monitor ResourceManager, enter the ResourceManager port number. Default port number is NameNode port, 50070.
      4. Hadoop User - Enter the username to connect to the Hadoop server. Depending on the Hadoop environment, the Hadoop User may not be required.
      5. Hadoop Password - Enter the password (if required) to connect to the Hadoop server.
      6. Secure (HTTPS) - Select this checkbox if you want to use HTTPs protocol for connection. By default, HTTP protocol is used for connection.
      7. Trust Store - If you select to use HTTPs protocol for connection, you must provide the location to the Java Keystore File (JKS) for a successful connection to the URL in a secure mode.
      8. Trust Password - Enter the password to the JKS file.
         
   3. Enter the Java collector settings,
      1. JAVA_HOME - Enter the directory path where you have installed Java version 1.7 or later. 
      2. Executing user - Enter the local administrator user name. The executing username and password must have permissions to run Java.
         
      3. Executing password - Enter the local administrator password.
   4. Enter the Collection details,
      1. Availability -  Enables monitoring of the Hadoop monitored groups availability (if instance is running or is down) of one of the following instances existing in the environment:
         1. 1. NameNode
            2. SecondaryNameNode
            3. ResourceManager
            4. DataNode
            5. NodeManager
            6. JobHistory
            7. JobTracker
            8. TaskTracker
      2. Full - Enables the monitoring of all Hadoop monitored groups, like UGIMetrics, StartUpProgress, and other groups.

      3. Custom -  Manually select the Hadoop monitored groups to monitor. A screenshot  of the custom monitoring option is given below:
         

         Monitored group	Metrics
         Data Node	Select the list of metrics for monitoring: Metrics System Stats DataNode Activity FS Dataset State Jvm Metrics RPC Activity DataNode Info Ugi Metrics
         Job Tracker	Select the list of metrics for monitoring: RPC Activity RPC Detailed Activity Metrics System Stats Queue Metrics Default Ugi Metrics Jvm Metics Startup Progress JobTracker Metrics JobTracker Info
         Name Node	Select the list of metrics for monitoring: Metrics System Stats NameNode Activity RPC Detailed Activity NameNode Retry Cache FS Namesystem Jvm Metrics NameNode Info Ugi Metrics RPC Activity FS Namesystem State Startup Progress
         Node Manager	Select the list of metrics for monitoring: RPC Activity Jvm Metrics NodeManager Metrics Shuffle Metrics RPC Detailed Activity Ugi Metrics Metrics System Stats
         Resource Manager	Select the list of metrics for monitoring: RPC Detailed Activity Jvm Metrics Metrics System Stats Cluster Metrics RPC Activity Ugi Metrics Queue Metrics
         Secondary Name Node	Select the list of metrics for monitoring: Ugi Metrics SecondaryNameNode Info Metrics System Stats Jvm Metrics Startup Progress
         Task Tracker	Select the list of metrics for monitoring: Shuffle Server Metrics TaskTracker Metrics Metrics System Stats Startup Progress Jvm Metrics TaskTracker Info RPC Activity Ugi Metrics

5. Click OK to save the configuration.
6. Click Cancel to exit without saving.

To delete a configured Hadoop environment

1. From the PATROL Console work area, right-click Environment name that you want to delete.
2. Choose the Unregister Hadoop Environment KM menu command to delete the selected environment.
3. Click Ok to confirm. 

Related topics

Register Hadoop environment dialog box

Configuring in Central Monitoring Administration console