Hadoop Monitoring

JMX Monitoring in Hadoop

Add the following line to hadoop-env.sh:

export HADOOP_NAMENODE_OPTS=" -Dcom.sun.management.jmxremote.authenticate=false \
    -Dcom.sun.management.jmxremote.ssl=false \
    -Dcom.sun.management.jmxremote.port=8004 \
    -Dcom.sun.management.jmxremote.password.file=$HADOOP_HOME/conf/jmxremote.password \
    -Dcom.sun.management.jmxremote.access.file=$HADOOP_HOME/conf/jmxremote.access"

Nagios JMX Plugin

The check_jmx plugin is available from NagiosExchange. Download and unpack the plugin and run make. Copy the contents of the plugins/ directory (a .jar and a script) to your Nagios installation's plugins directory. Edit the check_jmx script as necessary for your environment.

Finally, test the plugin:

./check_jmx -U service:jmx:rmi:///jndi/rmi://node182:8004/jmxrmi -O hadoop.dfs:service=DataNode,name=DataNodeStatistics -A BlockReportsMaxTime -w 10 -c 150
./check_jmx -U service:jmx:rmi:///jndi/rmi://node182:8004/jmxrmi -O java.lang:type=Memory -A HeapMemoryUsage -K used -C 10000000
Topic revision: r3 - 30 Sep 2010 - 14:16:21 - BrianBockelman
Hello, TWikiGuest
Register

 
TWIKI.NET

TWiki | Report Bugs | Privacy Policy

This site is powered by the TWiki collaboration platformCopyright by the contributing authors. All material on this collaboration platform is the property of the contributing authors..