Alert Analysis of ABwE Raw capacity data

The data analyzed for alerts is the ABwE exponentially weighted moving average of available bandwidth estimate data for about 40 hosts in 12 countries in N. America (US and Canada), Europe (.ch, .cz, .de, .fr, .it, .nl, .uk) and Asia (.jp, .pk,. su) with bottleneck capacities from 512kbps to 1000Mbps. The data points are measured from SLAC at 3 minute intervals. The Event analysis uses a modified "plateau" algorithm developed from Automated Event Detection for Active Measurement Systems McGregor A. J and Braun H-W. The history buffer duration we used in the plateau algorithm was 600 points (the interval between points was 1 minute) or 10 hours, and the trigger buffer was 60 points or 1 hour.

Connie Logg and Les Cottrell
Program Logic Manual
Perl pseudo code
This page was created from the averaged-new ABwE data on Mon Jun 7 11:09:43 2004 for iepm on nettest1 by: version 1.2, 5/26/04 of runperiod.les using threshold=0.1, statistical_limit = 2 and writing data to /nfs/slac/g/net/iepm-bw/bandwidth-tests/eventanalysis/nikhef-1/new. The data goes back 12 days to 5/11/2004 18:00 and includes 0 remote hosts.
EVENT SUMMARY

node = node1.nikhef.nl
starttime = 5/11/2004 18:00; endtime = 05/24/04 00:00; change threshold = 0.1, statistical_limit = 2, data_column=4
The number of standard deviations that a data value must lie outside the mean to be evaluated as a trigger value is defined by the sensitivity = 2
maximum history buffer size = 600
Number of minutes the throughput must be depressed is controlled by the trigger buffer length = 60

line color = magenta drop in bandwidth greater than 0.1 %, the statistical_limit = 2
Bandwidth Data Event Info

NODENAME lastmean laststdev trigmean trigstdev %change
last-trig F1 %change
lasttrig-trig date&time trigger buffer

node1.nikhef.nl 999.83 1.44 101.54 3.62 89.8443 326.08 0 05/14/04 16:59:14 97.200 (101.700,102.900,104.000,99.100,105.000,100.600,97.800,104.000,105.100,101.300,100.200,98.400,102.400,97.500,102.500,99.700,102.000,121.800,104.200,99.800,98.600,101.200,95.500,101.800,100.900,99.900,99.200,104.000,99.600,104.800,100.300,101.300,100.400,103.300,104.600,98.100,99.600,100.700,103.000,106.100,102.900,103.400,100.300,100.900,103.100,98.600,99.100,101.200,100.300,98.800,98.700,103.100,99.600,105.600,104.800,99.300,97.600,103.200,97.200)

node1.nikhef.nl 911.53 267.72 101.28 2.51 88.8890 4.28 0 05/14/04 19:44:38 104.000 (99.800,99.400,104.900,101.400,98.500,103.000,99.000,99.900,100.600,102.800,99.900,101.200,103.700,103.200,104.100,105.200,99.600,97.200,104.400,103.900,101.200,102.000,98.900,99.500,101.500,101.700,96.200,106.000,96.400,100.100,103.300,102.100,99.000,103.900,101.200,104.400,99.700,96.900,99.900,101.500,104.000,101.400,102.600,103.100,99.800,101.400,100.600,105.000,97.700,101.700,100.700,98.400,102.200,101.700,94.900,102.500,100.800,105.800,104.000)

node1.nikhef.nl 997.5 17.3 101.4 2.77 89.8346 72.33 0 05/20/04 05:07:02 104.700 (106.100,106.000,102.800,101.200,98.800,100.000,98.400,99.700,103.900,99.900,105.000,99.700,98.400,101.200,99.300,102.800,99.600,101.400,100.700,100.700,106.400,103.700,96.300,102.600,103.500,100.800,101.600,104.000,105.000,98.400,103.500,102.100,104.500,95.300,103.300,102.500,97.700,100.800,101.100,102.500,97.800,102.300,104.400,99.700,100.700,103.900,104.200,98.100,94.800,106.700,99.800,98.900,100.400,98.700,104.200,103.100,101.200,98.000,104.700)

node1.nikhef.nl 909.15 267.53 101.98 4.53 88.7829 4.27 0 05/20/04 08:08:11 95.700 (103.600,104.600,100.900,102.100,101.000,104.300,99.700,98.200,97.100,100.500,97.900,103.600,102.800,105.400,103.900,100.200,102.300,103.900,99.900,104.600,100.400,107.000,100.400,102.700,100.900,105.000,98.900,100.000,104.400,104.200,105.200,99.800,105.600,99.400,98.000,100.100,97.200,103.800,103.100,101.400,99.700,99.600,100.500,99.600,98.500,103.800,103.700,97.600,103.800,102.200,105.700,108.100,98.200,99.700,97.300,128.900,98.900,101.200,95.700)

triggers = 4; aborted triggers = 0; alerts = 4; datastart=1084333543; dataend=1085381846; duration=1048303 ; avg. data separation= 164.3 seconds

NODENAME	lastmean	laststdev	trigmean	trigstdev	%change last-trig	F1	%change lasttrig-trig	date&time	trigger buffer
node1.nikhef.nl	999.83	1.44	101.54	3.62	89.8443	326.08	0	05/14/04 16:59:14 97.200	(101.700,102.900,104.000,99.100,105.000,100.600,97.800,104.000,105.100,101.300,100.200,98.400,102.400,97.500,102.500,99.700,102.000,121.800,104.200,99.800,98.600,101.200,95.500,101.800,100.900,99.900,99.200,104.000,99.600,104.800,100.300,101.300,100.400,103.300,104.600,98.100,99.600,100.700,103.000,106.100,102.900,103.400,100.300,100.900,103.100,98.600,99.100,101.200,100.300,98.800,98.700,103.100,99.600,105.600,104.800,99.300,97.600,103.200,97.200)
node1.nikhef.nl	911.53	267.72	101.28	2.51	88.8890	4.28	0	05/14/04 19:44:38 104.000	(99.800,99.400,104.900,101.400,98.500,103.000,99.000,99.900,100.600,102.800,99.900,101.200,103.700,103.200,104.100,105.200,99.600,97.200,104.400,103.900,101.200,102.000,98.900,99.500,101.500,101.700,96.200,106.000,96.400,100.100,103.300,102.100,99.000,103.900,101.200,104.400,99.700,96.900,99.900,101.500,104.000,101.400,102.600,103.100,99.800,101.400,100.600,105.000,97.700,101.700,100.700,98.400,102.200,101.700,94.900,102.500,100.800,105.800,104.000)
node1.nikhef.nl	997.5	17.3	101.4	2.77	89.8346	72.33	0	05/20/04 05:07:02 104.700	(106.100,106.000,102.800,101.200,98.800,100.000,98.400,99.700,103.900,99.900,105.000,99.700,98.400,101.200,99.300,102.800,99.600,101.400,100.700,100.700,106.400,103.700,96.300,102.600,103.500,100.800,101.600,104.000,105.000,98.400,103.500,102.100,104.500,95.300,103.300,102.500,97.700,100.800,101.100,102.500,97.800,102.300,104.400,99.700,100.700,103.900,104.200,98.100,94.800,106.700,99.800,98.900,100.400,98.700,104.200,103.100,101.200,98.000,104.700)
node1.nikhef.nl	909.15	267.53	101.98	4.53	88.7829	4.27	0	05/20/04 08:08:11 95.700	(103.600,104.600,100.900,102.100,101.000,104.300,99.700,98.200,97.100,100.500,97.900,103.600,102.800,105.400,103.900,100.200,102.300,103.900,99.900,104.600,100.400,107.000,100.400,102.700,100.900,105.000,98.900,100.000,104.400,104.200,105.200,99.800,105.600,99.400,98.000,100.100,97.200,103.800,103.100,101.400,99.700,99.600,100.500,99.600,98.500,103.800,103.700,97.600,103.800,102.200,105.700,108.100,98.200,99.700,97.300,128.900,98.900,101.200,95.700)