Hadoop DataNode activity (HADOOP_DATANODE_ACTIVITY)

This application class monitors Datanode activities of the KM. The DataNode activities include sending and receiving of data packets over the network, volume failures, flush, read, write operations etc. The Hadoop KM gathers these attributes by executing the following query:

<DataNode jmx url>?qry=Hadoop:service=DataNode,name=DataNodeActivity.*

where,

<DataNode jmx url> is the Java Management Extensions url, http://<<datanode host name>>:<<datanode port>>/jmx

qry is Hadoop by default

service contains the type of the group, for example, DataNode, ResourceManager, JobTracker, ResourceManager, TaskTracker and other available groups

name contains the type of metrics data you want to collect and display, for example, JVMmetrics, Queuemetrics, RPCactivity and other available metrics types

Application class attributes

Attributes (parameters)

• Block checksum op avg time (BlockChecksumOpAvgTime)
• Block checksum op num ops (BlockChecksumOpNumOps)
• Block reports avg time (BlockReportsAvgTime)
• Block reports num ops (BlockReportsNumOps)
• Blocks cached (BlocksCached)
• Blocks get local path info (BlocksGetLocalPathInfo)
• Blocks read (BlocksRead)
• Blocks removed (BlocksRemoved)
• Blocks replicated (BlocksReplicated)
• Blocks uncached (BlocksUncached)
• Blocks verified (BlocksVerified)
• Blocks written (BlocksWritten)
• Block verification failures (BlockVerificationFailures)
• Cache reports avg time (CacheReportsAvgTime)
• Cache reports num ops (CacheReportsNumOps)
• Copy block op avg time (CopyBlockOpAvgTime)
• Copy block op num ops (CopyBlockOpNumOps)
• Flush nanos avg time (FlushNanosAvgTime)
• Flush nanos num ops (FlushNanosNumOps)
• Fsync count (FsyncCount)
• Fsync nanos avg time (FsyncNanosAvgTime)
• Fsync nanos num ops (FsyncNanosNumOps)
• Heartbeats avg time (HeartbeatsAvgTime)
• Heartbeats num ops (HeartbeatsNumOps)
• Megabytes read (MBytesRead)
• Megabytes written (MBytesWritten )
• Packet ack round trip time nanos num ops (PacketAckRoundTripTimeNanosNumOps)
• Read block op avg time (ReadBlockOpAvgTime)
• Read block op num ops (ReadBlockOpNumOps)
• Reads from local client (ReadsFromLocalClient)
• Reads from remote client (ReadsFromRemoteClient)
• Replace block op avg time (ReplaceBlockOpAvgTime)
• Replace block op num ops (ReplaceBlockOpNumOps)
• Send data packet blocked on network nanos avg time (SendDataPacketBlockedOnNetworkNanosAvgTime)
• Send data packet blocked on network nanos num ops (SendDataPacketBlockedOnNetworkNanosNumOps)
• Send data packet transfer nanos avg time (SendDataPacketTransferNanosAvgTime)
• Send data packet transfer nanos num ops (SendDataPacketTransferNanosNumOps)
• Volume failures (VolumeFailures)
• Write block op avg time (WriteBlockOpAvgTime)
• Write block op num ops (WriteBlockOpNumOps)
• Writes from local client (WritesFromLocalClient)
• Writes from remote client (WritesFromRemoteClient)