SLAC CPE Software Engineering Group
 

System Checks


SLAC Detailed
SLAC Computing
Software Home
Software Detailed
 

 

This page will describe the cronjob that monitors our startup files and RPMs on all our servers


 

              

On LCLS-UWD, as uwd, I run a cronjob which kicks off our system checks:

10 5 * * * /nfs/slac/g/lcls/sys/uwd/bin/start_sys_chks 2>&1 >/tmp/start_sys_chks.log

start_sys_chks:

  • Creates a server list based upon "/afs/slac/g/lcls/tools/uwd/config/Server-list"
  • Checks to see if server is alive
    • kicks off    ~uwd/bin/system_chks

system_chks:

  • creates directories if needed
    • /nfs/slac/g/cd/watchdogs/$HOST/  (AFS)
    • /u1/lcls/sys/uwd/$HOST   (NFS)
  • Checks init.d, rc2.d, and rc3.d
    • Does comparisons and sends emails if any changes
  • RPM check
    • Does comparisons and sends emails if any changes

 


Copies of all our startup files are located

  • /nfs/slac/g/cd/watchdogs/$HOST   ( AFS Hosts )
  • /u1/lcls/sys/uwd/$HOST                  ( Private Hosts )

 

EX)

 

[root@mccfs5 uwd]# ls -l /u1/lcls/sys/uwd/lcls-daemon2/*/*
-rw-rw-r-- 1 uwd lcls 29171 Jul 30 05:10 /u1/lcls/sys/uwd/lcls-daemon2/RPM/rpm_listing
-rw-rw-r-- 1 uwd lcls 29171 Jul 29 05:10 /u1/lcls/sys/uwd/lcls-daemon2/RPM/rpm_listing--old
-rw-rw-r-- 1 uwd lcls 0 Jul 30 05:10 /u1/lcls/sys/uwd/lcls-daemon2/RPM/rpm_mail

/u1/lcls/sys/uwd/lcls-daemon2/etc/init.d:
total 118
-rw-rw-r-- 1 uwd lcls 2658 Jul 30 05:10 init.d-listing
-rw-rw-r-- 1 uwd lcls 2658 Jul 29 05:10 init.d-listing--old
-rw-rw-r-- 1 uwd lcls 0 Jul 30 05:10 init.d-mail
-rwxr-xr-x 1 uwd lcls 1662 Jun 11 2009 st.alh
-rwxr-xr-x 1 uwd lcls 1654 Jun 11 2009 st.alhCUD
-rwxr-xr-x 1 uwd lcls 1678 Jun 11 2009 st.alhelogAutoEntry
-rwxr-xr-x 1 uwd lcls 1656 Dec 1 2011 st.caRepeater
-rwxr-xr-x 1 uwd lcls 1657 Jun 23 2011 st.caRepeater--old
-rwxr-xr-x 1 uwd lcls 1650 Jun 11 2009 st.cmlog
-rwxr-xr-x 1 uwd lcls 1658 Jun 11 2009 st.cmlogClientD
-rwxr-xr-x 1 uwd lcls 1754 Jun 11 2009 st.cwAL
-rwxr-xr-x 1 uwd lcls 1754 Jun 11 2009 st.cwBC
-rwxr-xr-x 1 uwd lcls 1754 Jun 11 2009 st.cwBL
-rwxr-xr-x 1 uwd lcls 1754 Jun 11 2009 st.cwBP
-rwxr-xr-x 1 uwd lcls 1754 Jun 11 2009 st.cwBS
-rwxr-xr-x 1 uwd lcls 1754 Jun 11 2009 st.cwCU
-rwxr-xr-x 1 uwd lcls 1754 Aug 3 2010 st.cwCV
-rwxr-xr-x 1 uwd lcls 1754 Jun 11 2009 st.cwFB
-rwxr-xr-x 1 uwd lcls 1754 Jun 11 2009 st.cwIM
-rwxr-xr-x 1 uwd lcls 1754 Jan 26 2011 st.cwKN
-rwxr-xr-x 1 uwd lcls 1754 Apr 9 2010 st.cwKY
-rwxr-xr-x 1 uwd lcls 1754 Feb 3 2011 st.cwLR
-rwxr-xr-x 1 uwd lcls 1754 Feb 3 2011 st.cwLR~
-rwxr-xr-x 1 uwd lcls 1754 Jun 11 2009 st.cwLS
-rwxr-xr-x 1 uwd lcls 1754 Jun 11 2009 st.cwMC
-rwxr-xr-x 1 uwd lcls 1754 Jun 11 2009 st.cwMG
-rwxr-xr-x 1 uwd lcls 1754 Jan 26 2011 st.cwML
-rwxr-xr-x 1 uwd lcls 1754 Jun 11 2009 st.cwMP
-rwxr-xr-x 1 uwd lcls 1754 May 19 2011 st.cwNW
-rwxr-xr-x 1 uwd lcls 1754 Jun 11 2009 st.cwPM
-rwxr-xr-x 1 uwd lcls 1754 Jun 3 2010 st.cwPP
-rwxr-xr-x 1 uwd lcls 1754 Jun 11 2009 st.cwRF
-rwxr-xr-x 1 uwd lcls 1754 Jun 11 2009 st.cwTM
-rwxr-xr-x 1 uwd lcls 1754 Sep 22 2010 st.cwVA
-rwxr-xr-x 1 uwd lcls 0 Aug 3 2010 st.cwVA--old
-rwxr-xr-x 1 uwd lcls 1754 Jun 11 2009 st.cwWA
-rwxr-xr-x 1 uwd lcls 1655 Jul 30 2010 st.fbckmonitor
-rwxr-xr-x 1 uwd lcls 1636 Jul 30 2010 st.fbckmonitor~
-rwxr-xr-x 1 uwd lcls 1631 Jun 11 2009 st.fwdBro
-rwxr-xr-x 1 uwd lcls 1659 Jun 11 2009 st.fwdCliS
-rwxr-xr-x 1 uwd lcls 1650 Jun 11 2009 st.gwLCLS
-rwxr-xr-x 1 uwd lcls 1685 May 19 2011 st.gwLCLS4FACET
-rwxr-xr-x 1 uwd lcls 1685 May 19 2011 st.gwLCLS4FACET~
-rwxr-xr-x 1 uwd lcls 1686 Jun 11 2009 st.ioclogandfwdserver
-rwxr-xr-x 1 uwd lcls 1677 Jun 11 2009 st.lclselog_move
-rwxr-xr-x 1 uwd lcls 1687 Aug 27 2009 st.mpshist
-rwxr-xr-x 1 uwd lcls 1669 Jun 11 2009 st.mpshist--old
-rwxr-xr-x 1 uwd lcls 1636 Jun 11 2009 st.rdbSrv

/u1/lcls/sys/uwd/lcls-daemon2/etc/rc2.d:
total 1
-rw-rw-r-- 1 uwd lcls 0 Jun 19 2009 rc2.d-listing--old
-rw-rw-r-- 1 uwd lcls 0 Jun 19 2009 rc2.d-mail

/u1/lcls/sys/uwd/lcls-daemon2/etc/rc3.d:
total 9
-rw-rw-r-- 1 uwd lcls 3249 Jul 30 05:10 rc3.d-listing
-rw-rw-r-- 1 uwd lcls 3249 Jul 29 05:10 rc3.d-listing--old
-rw-rw-r-- 1 uwd lcls 0 Jul 30 05:10 rc3.d-mail

 



 

 

[SLAC CPE Software Engineering Group][ SLAC Home Page]

 

Author: Ken Brobeck, 30-Jul-2012
Last updated, 30-Jul-2012