Alert Analysis of PATHCHIRP data
The data being analyzed here is the pathchirp values of the pathchirp data sets.
The algorithm is a simplified and modifed version of the
anomalous event analysis uses a modified "plateau" algorithm (
ppt,
pdf) developed from
Automated Event Detection for Active
Measurement Systems McGregor A. J and Braun H-W.
Connie Logg and Les Cottrell
Program Logic Manual |
Perl pseudo code |
Examples of alerts and
code
This page was created from the pathchirp data on Sat Sep 6 10:40:08 2008 for iepm on iepm-bw
by: /afs/slac/package/netmon/bandwidth-tests/v3src/alerts/runperiod
The data includes 121 remote hosts.
EVENT SUMMARY
node = iepm-bw.caltech.ul-org
Analyzed at Sat Sep 6 10:40:08 2008 by /afs/slac/package/netmon/bandwidth-tests/v3src/alerts/triganal on iepm-bw for iepm with data from /nfs/slac/g/net/iepm-bw/iepm-bw.slac.stanford.edu/alerts/pathchirp/iepm-bw.caltech.ul-org
User selected change threshold = 33, data_column=pathchirp
(pathchirp)
The number of standard deviations that a data value must lie outside the mean to be evaluated as a trigger value is defined by the sensitivity = 2
history buffer size = 239 (7200 mins) entries,
size of trigger buffer = 11 (360 mins) entries, TT = (lastmn - sensitivity*laststd)
nt = number of entries in the trigger buffer
| line color = magenta | drop in bandwidth greater than 33 % |
Bandwidth Data
No Events detected
| NODENAME | lastmean | laststdev | trigmean | trigstdev |
%change last-trig | %change lasttrig-trig | detected D&T | trig-start D&T | tdiff | trigger buffer |
| iepm-bw.caltech.ul-org | 1096.55 | 109.655 | 381.64 |
245.585 | 65.1963 | 0 | 08/26/2008 19:13:13 | 08/26/2008 12:06:27 | 391 | (440.09,50,496.23,818.58,454.46,661.32,213.64,311.7,80.09,265.13,144.7,643.74) |
triggers = 1; aborted triggers = 0; alerts = 1; avg. data separation= 30.08 mins; history_buffer_length=239( 119.8 hours); trigger_buffer_length=11( 5.5 hours)
node = iepm-bw.cern.ch
Analyzed at Sat Sep 6 10:40:22 2008 by /afs/slac/package/netmon/bandwidth-tests/v3src/alerts/triganal on iepm-bw for iepm with data from /nfs/slac/g/net/iepm-bw/iepm-bw.slac.stanford.edu/alerts/pathchirp/iepm-bw.cern.ch
User selected change threshold = 33, data_column=pathchirp
(pathchirp)
The number of standard deviations that a data value must lie outside the mean to be evaluated as a trigger value is defined by the sensitivity = 2
history buffer size = 239 (7200 mins) entries,
size of trigger buffer = 11 (360 mins) entries, TT = (lastmn - sensitivity*laststd)
nt = number of entries in the trigger buffer
| line color = magenta | drop in bandwidth greater than 33 % |
Bandwidth Data
No Events detected
| NODENAME | lastmean | laststdev | trigmean | trigstdev |
%change last-trig | %change lasttrig-trig | detected D&T | trig-start D&T | tdiff | trigger buffer |
| iepm-bw.cern.ch | 1296.87 | 129.687 | 444.48 |
224.6001 | 65.7267 | 0 | 08/25/2008 09:41:42 | 08/25/2008 02:11:33 | 425 | (288.27,1031.69,325.86,323.78,340.21,201.11,330.56,326.45,626.79,589.77,518.6,430.66) |
triggers = 1; aborted triggers = 0; alerts = 1; avg. data separation= 30.07 mins; history_buffer_length=239( 119.8 hours); trigger_buffer_length=11( 5.5 hours)
node = node1.desy.de
Analyzed at Sat Sep 6 10:40:34 2008 by /afs/slac/package/netmon/bandwidth-tests/v3src/alerts/triganal on iepm-bw for iepm with data from /nfs/slac/g/net/iepm-bw/iepm-bw.slac.stanford.edu/alerts/pathchirp/node1.desy.de
User selected change threshold = 33, data_column=pathchirp
(pathchirp)
The number of standard deviations that a data value must lie outside the mean to be evaluated as a trigger value is defined by the sensitivity = 2
history buffer size = 238 (7200 mins) entries,
size of trigger buffer = 11 (360 mins) entries, TT = (lastmn - sensitivity*laststd)
nt = number of entries in the trigger buffer
| line color = magenta | drop in bandwidth greater than 33 % |
Bandwidth Data
No Events detected
| NODENAME | lastmean | laststdev | trigmean | trigstdev |
%change last-trig | %change lasttrig-trig | detected D&T | trig-start D&T | tdiff | trigger buffer |
| node1.desy.de | 1081.89 | 108.189 | 435.3 |
256.2966 | 59.7649 | 0 | 08/26/2008 20:36:20 | 08/26/2008 13:11:50 | 419 | (102.74,633.87,589.5,460.09,765.74,711.01,50,461.61,740.75,267.27,218.55,222.51) |
triggers = 1; aborted triggers = 0; alerts = 1; avg. data separation= 30.25 mins; history_buffer_length=238( 120.0 hours); trigger_buffer_length=11( 5.5 hours)
node = node1.sdsc.edu
Analyzed at Sat Sep 6 10:40:45 2008 by /afs/slac/package/netmon/bandwidth-tests/v3src/alerts/triganal on iepm-bw for iepm with data from /nfs/slac/g/net/iepm-bw/iepm-bw.slac.stanford.edu/alerts/pathchirp/node1.sdsc.edu
User selected change threshold = 33, data_column=pathchirp
(pathchirp)
The number of standard deviations that a data value must lie outside the mean to be evaluated as a trigger value is defined by the sensitivity = 2
history buffer size = 239 (7200 mins) entries,
size of trigger buffer = 11 (360 mins) entries, TT = (lastmn - sensitivity*laststd)
nt = number of entries in the trigger buffer
| line color = magenta | drop in bandwidth greater than 33 % |
Bandwidth Data
No Events detected
| NODENAME | lastmean | laststdev | trigmean | trigstdev |
%change last-trig | %change lasttrig-trig | detected D&T | trig-start D&T | tdiff | trigger buffer |
| node1.sdsc.edu | 1201.22 | 120.122 | 302.02 |
226.2797 | 74.8572 | 0 | 08/26/2008 19:33:15 | 08/26/2008 12:22:18 | 399 | (440.66,247.73,644.93,598.75,119.99,278.6,44.43,533.7,66.31,47.66,125.44,476.01) |
triggers = 1; aborted triggers = 0; alerts = 1; avg. data separation= 30.08 mins; history_buffer_length=239( 119.8 hours); trigger_buffer_length=11( 5.5 hours)
node = node1.triumf.ca
Analyzed at Sat Sep 6 10:40:59 2008 by /afs/slac/package/netmon/bandwidth-tests/v3src/alerts/triganal on iepm-bw for iepm with data from /nfs/slac/g/net/iepm-bw/iepm-bw.slac.stanford.edu/alerts/pathchirp/node1.triumf.ca
User selected change threshold = 33, data_column=pathchirp
(pathchirp)
The number of standard deviations that a data value must lie outside the mean to be evaluated as a trigger value is defined by the sensitivity = 2
history buffer size = 239 (7200 mins) entries,
size of trigger buffer = 11 (360 mins) entries, TT = (lastmn - sensitivity*laststd)
nt = number of entries in the trigger buffer
| line color = magenta | drop in bandwidth greater than 33 % |
Bandwidth Data
No Events detected
| NODENAME | lastmean | laststdev | trigmean | trigstdev |
%change last-trig | %change lasttrig-trig | detected D&T | trig-start D&T | tdiff | trigger buffer |
| node1.triumf.ca | 318.48 | 31.848 | 135.32 |
67.9541 | 57.5107 | 0 | 08/26/2008 21:54:52 | 08/26/2008 15:20:37 | 359 | (219.91,206.38,51.1,50,142.8,246.38,77.81,146.09,121.55,50,149.39,162.47) |
triggers = 1; aborted triggers = 0; alerts = 1; avg. data separation= 30.10 mins; history_buffer_length=239( 119.9 hours); trigger_buffer_length=11( 5.5 hours)
node = node1.umich.ul-org
Analyzed at Sat Sep 6 10:41:12 2008 by /afs/slac/package/netmon/bandwidth-tests/v3src/alerts/triganal on iepm-bw for iepm with data from /nfs/slac/g/net/iepm-bw/iepm-bw.slac.stanford.edu/alerts/pathchirp/node1.umich.ul-org
User selected change threshold = 33, data_column=pathchirp
(pathchirp)
The number of standard deviations that a data value must lie outside the mean to be evaluated as a trigger value is defined by the sensitivity = 2
history buffer size = 239 (7200 mins) entries,
size of trigger buffer = 11 (360 mins) entries, TT = (lastmn - sensitivity*laststd)
nt = number of entries in the trigger buffer
| line color = magenta | drop in bandwidth greater than 33 % |
Bandwidth Data
No Events detected
| NODENAME | lastmean | laststdev | trigmean | trigstdev |
%change last-trig | %change lasttrig-trig | detected D&T | trig-start D&T | tdiff | trigger buffer |
| node1.umich.ul-org | 1002.17 | 100.217 | 375.56 |
250.1657 | 62.5253 | 0 | 08/26/2008 18:17:29 | 08/26/2008 11:57:03 | 348 | (767.44,729.4,331.37,124.69,129.2,362.4,596.11,419.48,50,74.79,566.48,355.3) |
triggers = 1; aborted triggers = 0; alerts = 1; avg. data separation= 30.08 mins; history_buffer_length=239( 119.8 hours); trigger_buffer_length=11( 5.5 hours)
node = node1.utoronto.ca
Analyzed at Sat Sep 6 10:41:27 2008 by /afs/slac/package/netmon/bandwidth-tests/v3src/alerts/triganal on iepm-bw for iepm with data from /nfs/slac/g/net/iepm-bw/iepm-bw.slac.stanford.edu/alerts/pathchirp/node1.utoronto.ca
User selected change threshold = 33, data_column=pathchirp
(pathchirp)
The number of standard deviations that a data value must lie outside the mean to be evaluated as a trigger value is defined by the sensitivity = 2
history buffer size = 238 (7200 mins) entries,
size of trigger buffer = 11 (360 mins) entries, TT = (lastmn - sensitivity*laststd)
nt = number of entries in the trigger buffer
| line color = magenta | drop in bandwidth greater than 33 % |
Bandwidth Data
No Events detected
| NODENAME | lastmean | laststdev | trigmean | trigstdev |
%change last-trig | %change lasttrig-trig | detected D&T | trig-start D&T | tdiff | trigger buffer |
triggers = 0; aborted triggers = 0; alerts = 0; avg. data separation= 30.18 mins; history_buffer_length=238( 119.7 hours); trigger_buffer_length=11( 5.5 hours)
node = node2.ornl.gov
Analyzed at Sat Sep 6 10:41:38 2008 by /afs/slac/package/netmon/bandwidth-tests/v3src/alerts/triganal on iepm-bw for iepm with data from /nfs/slac/g/net/iepm-bw/iepm-bw.slac.stanford.edu/alerts/pathchirp/node2.ornl.gov
User selected change threshold = 33, data_column=pathchirp
(pathchirp)
The number of standard deviations that a data value must lie outside the mean to be evaluated as a trigger value is defined by the sensitivity = 2
history buffer size = 240 (7200 mins) entries,
size of trigger buffer = 12 (360 mins) entries, TT = (lastmn - sensitivity*laststd)
nt = number of entries in the trigger buffer
| line color = magenta | drop in bandwidth greater than 33 % |
Bandwidth Data
No Events detected
| NODENAME | lastmean | laststdev | trigmean | trigstdev |
%change last-trig | %change lasttrig-trig | detected D&T | trig-start D&T | tdiff | trigger buffer |
triggers = 0; aborted triggers = 0; alerts = 0; avg. data separation= 29.92 mins; history_buffer_length=240( 119.7 hours); trigger_buffer_length=12( 6.0 hours)
node = node7.slac.stanford.edu
Analyzed at Sat Sep 6 10:41:41 2008 by /afs/slac/package/netmon/bandwidth-tests/v3src/alerts/triganal on iepm-bw for iepm with data from /nfs/slac/g/net/iepm-bw/iepm-bw.slac.stanford.edu/alerts/pathchirp/node7.slac.stanford.edu
User selected change threshold = 33, data_column=pathchirp
(pathchirp)
The number of standard deviations that a data value must lie outside the mean to be evaluated as a trigger value is defined by the sensitivity = 2
history buffer size = 239 (7200 mins) entries,
size of trigger buffer = 11 (360 mins) entries, TT = (lastmn - sensitivity*laststd)
nt = number of entries in the trigger buffer
| line color = magenta | drop in bandwidth greater than 33 % |
Bandwidth Data
No Events detected
| NODENAME | lastmean | laststdev | trigmean | trigstdev |
%change last-trig | %change lasttrig-trig | detected D&T | trig-start D&T | tdiff | trigger buffer |
| node7.slac.stanford.edu | 993.42 | 99.342 | 330.94 |
229.2263 | 66.6868 | 0 | 08/26/2008 19:30:14 | 08/26/2008 13:51:42 | 300 | (675.49,509.44,393.94,713.79,157.5,166.43,162.81,99.7,49.03,503.64,166.8,372.73) |
triggers = 1; aborted triggers = 0; alerts = 1; avg. data separation= 30.08 mins; history_buffer_length=239( 119.8 hours); trigger_buffer_length=11( 5.5 hours)