| Cluster management with CERN's Lemon monitoring software |
|
auteur: Maurice, geplaatst: 2007-09-07, laatste update: 2007-09-07, populariteit:  4600+ |
|
I found a sensor monitoring system that has been developed by CERN (yep, the particle accellerators).
| Quote: Lemon is a server/client based monitoring system. On every monitored node, a monitoring agent launches and communicates using a push/pull protocol with sensors which are responsible for retrieving monitoring information. The extracted samples are stored on a local cache and forwarded to a central Measurement Repository using UDP or TCP transport protocol with or without authentication/encryption of data samples. Sensors can collect information on behalf of remote entities like switches or power supplies. The Measurement Repository can interface to a relational database or a flat-file backend for storing the received samples. Web based interface is provided for visualizing the data. |
I'm not sure what it is capable of, but I like to find out. The screenshots look promising.
SuSE
I'm using SuSE 9.3 as OS, the binaries CERN provides are for Red Hat or Red Hat Enterprise server. The symbolic links for the libraries are not needed for Red Hat or other Linux distributions.
The complete software repository can be found here.
In this example I install server, agent and webserver on the same machine. This may be all different machines.
Installation
 First download the latest RPM from CERN. Download:
- The flat file server (edg-fabricMonitoring-server)
- The client or agent (edg-fabricMonitoring-agent)
Make symbolic links for libssl and libcrypto libraries. This example is for SuSE 9.3, but you get an idea of what I mean:
ln -s /usr/lib/libssl.so.0.9.7 /lib/libssl.so.4
ln -s /usr/lib/libcrypto.so.0.9.7 /lib/libcrypto.so.4 |
Install client and server
rpm -i --nodeps edg-fabricMonitoring-agent-2.15.0-1.i386.rpm
rpm -i --nodeps edg-fabricMonitoring-server-2.15.0-1.i386.rpm |
Now move the startup/shutdown scripts to the correct directory (they where installed in a Red Hat specific location). For SuSE 9.3 execute:
mv /etc/init.d/init.d/* /etc/init.d
rm -rf /etc/init.d/init.d |
Configuration files can be found in the /etc/lemon/ directory. For example server configuration in /etc/lemon/server/edg-fmon-server.conf and client configuration in /etc/lemon/agent/general.conf
| Note: the /etc/init.d/edg-fmon-server and /etc/init.d/edg-fmon-agent scripts still don't work under SuSE after this action. |
These executables are now available:
edg-fmon-server - EDG Fabric Monitoring Server
EDG fmon server is the monitoring repository collector daemon. It receives the samples measured by running edg-fmon-agent processes on remote hosts.
edg-fmon-agent - EDG Fabric Monitoring Agent
EDG fmon agent is the monitoring daemon. Once running, the configured metrics are sampled at regular intervals and sent to a central repository (edg-fmon-server).
ledg-fmon-cleanspool - EDG Fabric Monitoring CleanSpool Utility
edg-fmon-cleanspool is a utility which clean's up the spool files left by the edg-fmon-agent and edg-fmon-server.
edg-fmon-buildconfig
Not sure what this file is for.
edit /etc/lemon/server/edg-fmon-server.conf to your needs
Start the server:
Check the log /var/log/edg-fmon-server.log
...
2007-09-07 14:28:26 Soap port : 12510
2007-09-07 14:28:26 Socket bound successful 6
2007-09-07 14:28:26 UDPTransport_open(): Receive buffer size = 131071
2007-09-07 14:28:26 Server : starting on TCP port 12509
2007-09-07 14:28:26 TCP server ready on port 12509 |
Edit /etc/lemon/agent/transport/udp.conf to your needs (you can specify a hostid, but it is not needed)
UDP
Server localhost
Port 12509
AgentID mynode |
Edit /etc/lemon/agent/general.conf (you can specify a hostid, but it is not needed)
MSA mynode
General
LogFile /var/log/edg-fmon-agent.log
LocalCache
Path /var/spool/edg-fmon-agent
SampleOnDemand
PipePath /var/run/edg-fmon-agent
ShortHostname 1
PrivateKeyFile /etc/lemon/keys/lemon_rsa1024_key
DigestType SHA1
Exception
StatePath /etc/lemon/exceptions/state.conf
|
Start the agent:
| edg-fmon-agent -c /etc/lemon/agent -l /var/log/edg-fmon-agent.log |
Check the log /var/log/edg-fmon-agent.log
...
2007-09-07 15:25:25 MSA configuration completed
2007-09-07 15:25:25 Waiting 2 seconds for sensors
2007-09-07 15:25:27 MSA is now running |
Shutting down servers
As I haven't got the /etc/init.d/edg-fmon-server and /etc/init.d/edg-fmon-agent scripts working, you have to kill the agent and server processes manually:
ps -ax | grep fmon
Warning: bad ps syntax, perhaps a bogus '-'? See http://procps.sf.net/faq.html
19744 ? Ss 0:00 /usr/sbin/edg-fmon-agent -c /etc/lemon/agent -l /var/log/edg-fmon-agent.log
19746 ? Sl 0:00 /usr/libexec/sensors/edg-fmon-sensor-linux
19795 ? Ssl 0:00 edg-fmon-server
19835 pts/0 R+ 0:00 grep fmon
kill 19744
kill 19795 |
Webinterface
Now the agent and server have been installed. To show the sampled data, you have to download and install a webinterface.
It is called lrf*.i386.rpm.
Install the rpm
| rpm -i lrf-1.0.7-15.i386.rpm |
Ignore the errors and warnings about users, groups and lemonmrd.
mv /etc/init.d/init.d/* /etc/init.d
rm -rf /etc/init.d/init.d |
The configuration file can be found at /etc/lemon/lemonmrd.conf edit it to your needs
Edit /etc/lemon/lrf/clusters.conf to your needs
[cluster_x]
hosts=pc1,pc2
name=Cluster 1
[cluster_y]
hosts=pc3,pc4
name=Cluster 2 |
The logfile can be found at /var/log/lemonmrd.log
The webpages can be found at /var/www/html/lrf/
There is also a /var/www/html/lrf/config.php configuration file. Edit it to your needs.
From here you are on your own now. More documentation about the web interface can be found here.
Some tips to get the web interface running
Edit /etc/lemon/lemonmrd.conf and add the cluster you specified in /etc/lemon/lrf/clusters.conf
Note that if you saw user or group warning during the installation of the webserver it could be necessary to manually set file permissions within the /var/www/html/lrf directory.
Web interface troubleshooting: http://wiki.kip.uni-heidelberg.de/ti/SysMES/images/0/0e/LemonHowto.pdf
Some tips for changing startup/shutdown scripts
You can edit the startup/shutdown scripts /etc/init.d/edg-fmon-agent, /etc/init.d/edg-fmon-server and /etc/init.d/lemonmrd to get them working under SuSE.
Comment out the line . /etc/rc.d/init.d/functions:
| #. /etc/rc.d/init.d/functions |
Replace all daemon occurences with startproc
Create /usr/bin/success and /usr/bin/failure files with only this line:
Make these file executable
chmod a+x /usr/bin/success
chmod a+x /usr/bin/failure |
Links
Homepage: http://lemon.web.cern.ch.
Documentation: http://lemon.web.cern.ch/lemon/docs.shtml.
Webserver documentation http://lemon.web.cern.ch/lemon/doc/components/lrf/index.html
Lemon How-to's (PDF): http://wiki.kip.uni-heidelberg.de/ti/SysMES/images/0/0e/LemonHowto.pdf
Downloads: http://lemon.web.cern.ch/lemon/downloads.shtml.
Repository: http://project-lemon-download.web.cern.ch/project-lemon-download/.
Tags Linux How-to`s
Copyright © 1999-2008 Maurice de Bijl
Dit artikel is gepubliceerd op 2007-09-07
|
Reacties op dit artikel
Er zijn nog geen reacties geplaatst op dit artikel. Je kunt de eerste zijn.
Reactie toevoegen
Een reactie toevoegen is simpel en registratie is niet nodig!Je IP-adres wordt gelogd, maar niet gepubliceerd, alle reacties hebben een E-mail bevestiging nodig en worden stuk voor stuk gemodereerd. Misbruik wordt niet getolereerd.
Naderhand wijzigen van je reactie is niet mogelijk
|  |
|
