Long Flows Reported by NetFlow
I-Heng Mei, Les Cottrell, and Connie Logg
Updated: Wed Jan 29 10:35:41 PST 2003


Long Flows: Sometimes NetFlow reports a greatly inflated elapsed time for some streams during a test run. This causes the passive throughput calculations for that day to be inaccurate, and adversely affects the correlation between passive/web throughput and active/passive throughput. Currently, we define a long flow to be any flow that lasts longer than 100 seconds (this threshold may be lowered). A normal stream during one of the bandwidth tests should last at most ~20 seconds. Note, long flows have also occurred in web100 data, but only three times (all on transfers between SLAC and node1.rcf.bnl.gov).

The tables show the ratio of the # of long flows to the # of total flows for each node/test.

colors
%long = 0
0 < %long <= 2
2 < %long <= 5
5 < %long
Passive Long FlowsWeb100 Long Flows
nodetestlong flowstotal flows%long
node1.cacr.caltech.edubbcpdisk08000.00
node1.cacr.caltech.edubbcpmem08560.00
node1.cacr.caltech.edubbftp18540.12
node1.cacr.caltech.eduiperf08720.00
node1.cacr.caltech.edutotal133820.03
node1.cern.chbbcpdisk167922.02
node1.cern.chbbcpmem388244.61
node1.cern.chbbftp08400.00
node1.cern.chiperf08000.00
node1.cern.chtotal5432561.66
node1.clrc.ac.ukbbcpdisk013950.00
node1.clrc.ac.ukbbcpmem1114840.74
node1.clrc.ac.ukbbftp014660.00
node1.clrc.ac.ukiperf014690.00
node1.clrc.ac.uktotal1158140.19
node1.dl.ac.ukbbcpdisk77510.93
node1.dl.ac.ukbbcpmem47920.51
node1.dl.ac.ukbbftp07840.00
node1.dl.ac.ukiperf87921.01
node1.dl.ac.uktotal1931190.61
node1.ece.rice.edubbcpdisk07910.00
node1.ece.rice.edubbcpmem68300.72
node1.ece.rice.edubbftp08240.00
node1.ece.rice.eduiperf07840.00
node1.ece.rice.edutotal632290.19
node1.eecis.udel.edubbcpdisk0540.00
node1.eecis.udel.edubbcpmem0540.00
node1.eecis.udel.edubbftp0540.00
node1.eecis.udel.eduiperf0620.00
node1.eecis.udel.edutotal02240.00
node1.fnal.goviperf080.00
node1.fnal.govtotal080.00
node1.in2p3.frbbcpdisk2717401.55
node1.in2p3.frbbcpmem7517604.26
node1.in2p3.frbbftp017580.00
node1.in2p3.friperf018190.00
node1.in2p3.frtotal10270771.44
node1.jlab.orgbbcpdisk07510.00
node1.jlab.orgbbcpmem08090.00
node1.jlab.orgbbftp07910.00
node1.jlab.orgiperf07840.00
node1.jlab.orgtotal031350.00
node1.kek.jpbbcpdisk07440.00
node1.kek.jpbbcpmem07840.00
node1.kek.jpbbftp77840.89
node1.kek.jpiperf07680.00
node1.kek.jptotal730800.23
node1.lanl.govbbcpdisk01980.00
node1.lanl.govbbcpmem02080.00
node1.lanl.govbbftp02040.00
node1.lanl.goviperf02040.00
node1.lanl.govtotal08140.00
node1.man.ac.ukbbcpdisk020330.00
node1.man.ac.ukbbcpmem021300.00
node1.man.ac.ukbbftp022890.00
node1.man.ac.ukiperf022200.00
node1.man.ac.uktotal086720.00
node1.mcs.anl.govbbcpdisk031670.00
node1.mcs.anl.govbbcpmem034430.00
node1.mcs.anl.govbbftp039160.00
node1.mcs.anl.goviperf039630.00
node1.mcs.anl.govtotal0144890.00
node1.mib.infn.itbbcpdisk014790.00
node1.mib.infn.itbbcpmem1715601.09
node1.mib.infn.itbbftp015770.00
node1.mib.infn.itiperf014000.00
node1.mib.infn.ittotal1760160.28
node1.nersc.govbbcpdisk118061.36
node1.nersc.govbbcpmem108461.18
node1.nersc.govbbftp18560.12
node1.nersc.goviperf78390.83
node1.nersc.govtotal2933470.87
node1.nikhef.nlbbcpdisk02020.00
node1.nikhef.nlbbcpmem02080.00
node1.nikhef.nlbbftp02110.00
node1.nikhef.nliperf02080.00
node1.nikhef.nltotal08290.00
node1.nslabs.ufl.edubbcpdisk07840.00
node1.nslabs.ufl.edubbcpmem08240.00
node1.nslabs.ufl.eduiperf08880.00
node1.nslabs.ufl.edutotal024960.00
node1.rcf.bnl.govbbcpdisk09700.00
node1.rcf.bnl.govbbcpmem010510.00
node1.rcf.bnl.govbbftp010300.00
node1.rcf.bnl.goviperf010200.00
node1.rcf.bnl.govtotal040710.00
node1.riken.go.jpbbcpdisk028640.00
node1.riken.go.jpbbcpmem230620.07
node1.riken.go.jpbbftp028980.00
node1.riken.go.jpiperf030340.00
node1.riken.go.jptotal2118580.02
node1.roma1.infn.itbbcpdisk1815941.13
node1.roma1.infn.itbbcpmem12017206.98
node1.roma1.infn.itbbftp118000.06
node1.roma1.infn.itiperf016130.00
node1.roma1.infn.ittotal13967272.07
node1.sdsc.edubbcpdisk07840.00
node1.sdsc.edubbcpmem17840.13
node1.sdsc.edubbftp03520.00
node1.sdsc.eduiperf04240.00
node1.sdsc.edutotal123440.04
node1.sox.i2.edubbcpdisk0960.00
node1.sox.i2.edubbcpmem01010.00
node1.sox.i2.eduiperf0920.00
node1.sox.i2.edutotal02890.00
node1.stanford.edubbcpdisk08330.00
node1.stanford.edubbcpmem08660.00
node1.stanford.edubbftp08620.00
node1.stanford.eduiperf08400.00
node1.stanford.edutotal034010.00
node1.triumf.cabbcpdisk07410.00
node1.triumf.cabbcpmem07800.00
node1.triumf.cabbftp07840.00
node1.triumf.caiperf08000.00
node1.triumf.catotal031050.00
node1.ucl.ac.ukbbcpdisk1215740.76
node1.ucl.ac.ukbbcpmem9921184.67
node1.ucl.ac.ukbbftp2711932.26
node1.ucl.ac.ukiperf0500.00
node1.ucl.ac.uktotal13849352.80
node1.utdallas.edubbcpdisk28000.25
node1.utdallas.edubbcpmem28480.24
node1.utdallas.edubbftp08470.00
node1.utdallas.eduiperf07750.00
node1.utdallas.edutotal432700.12
node2.ccs.ornl.govbbcpdisk08000.00
node2.ccs.ornl.govbbcpmem18390.12
node2.ccs.ornl.govbbftp08390.00
node2.ccs.ornl.goviperf08160.00
node2.ccs.ornl.govtotal132940.03
node2.cern.chbbcpdisk16880.15
node2.cern.chbbcpmem08080.00
node2.cern.chbbftp18080.12
node2.cern.chiperf07920.00
node2.cern.chtotal230960.06
node2.gsfc.nasa.govbbcpdisk5719982.85
node2.gsfc.nasa.govbbcpmem20320809.76
node2.gsfc.nasa.govbbftp520550.24
node2.gsfc.nasa.goviperf2020190.99
node2.gsfc.nasa.govtotal28581523.50
node2.in2p3.frbbftp021530.00
node2.in2p3.friperf023550.00
node2.in2p3.frtotal045080.00
node2.nersc.govbbcpdisk02140.00
node2.nersc.govbbcpmem02250.00
node2.nersc.govbbftp02160.00
node2.nersc.goviperf02240.00
node2.nersc.govtotal08790.00
node2.nslabs.ufl.edubbcpdisk07520.00
node2.nslabs.ufl.edubbcpmem07920.00
node2.nslabs.ufl.edubbftp07830.00
node2.nslabs.ufl.eduiperf08550.00
node2.nslabs.ufl.edutotal031820.00
nodetestlong flowstotal flows%long
node1.cacr.caltech.edubbcpdisk08080.00
node1.cacr.caltech.edubbcpmem08640.00
node1.cacr.caltech.edubbftp08570.00
node1.cacr.caltech.eduiperf08320.00
node1.cacr.caltech.edutotal033610.00
node1.cern.chbbcpdisk08000.00
node1.cern.chbbcpmem08320.00
node1.cern.chbbftp08480.00
node1.cern.chiperf07760.00
node1.cern.chtotal032560.00
node1.clrc.ac.ukbbcpdisk014100.00
node1.clrc.ac.ukbbcpmem015000.00
node1.clrc.ac.ukbbftp014700.00
node1.clrc.ac.ukiperf013950.00
node1.clrc.ac.uktotal057750.00
node1.dl.ac.ukbbcpdisk07520.00
node1.dl.ac.ukbbcpmem08000.00
node1.dl.ac.ukbbftp07920.00
node1.dl.ac.ukiperf07760.00
node1.dl.ac.uktotal031200.00
node1.ece.rice.edubbcpdisk07920.00
node1.ece.rice.edubbcpmem08320.00
node1.ece.rice.edubbftp08320.00
node1.ece.rice.eduiperf07760.00
node1.ece.rice.edutotal032320.00
node1.eecis.udel.edubbcpdisk0550.00
node1.eecis.udel.edubbcpmem0550.00
node1.eecis.udel.edubbftp0550.00
node1.eecis.udel.eduiperf0630.00
node1.eecis.udel.edutotal02280.00
node1.fnal.goviperf080.00
node1.fnal.govtotal080.00
node1.in2p3.frbbcpdisk017600.00
node1.in2p3.frbbcpmem017800.00
node1.in2p3.frbbftp017770.00
node1.in2p3.friperf018390.00
node1.in2p3.frtotal071560.00
node1.jlab.orgbbcpdisk07600.00
node1.jlab.orgbbcpmem08080.00
node1.jlab.orgbbftp08000.00
node1.jlab.orgiperf07920.00
node1.jlab.orgtotal031600.00
node1.kek.jpbbcpdisk07520.00
node1.kek.jpbbcpmem07920.00
node1.kek.jpbbftp07920.00
node1.kek.jpiperf07760.00
node1.kek.jptotal031120.00
node1.lanl.govbbcpdisk02000.00
node1.lanl.govbbcpmem02100.00
node1.lanl.govbbftp02060.00
node1.lanl.goviperf02060.00
node1.lanl.govtotal08220.00
node1.man.ac.ukbbcpdisk020320.00
node1.man.ac.ukbbcpmem021600.00
node1.man.ac.ukbbftp023040.00
node1.man.ac.ukiperf022500.00
node1.man.ac.uktotal087460.00
node1.mcs.anl.govbbcpdisk031500.00
node1.mcs.anl.govbbcpmem034250.00
node1.mcs.anl.govbbftp039130.00
node1.mcs.anl.goviperf039890.00
node1.mcs.anl.govtotal0144770.00
node1.mib.infn.itbbcpdisk014800.00
node1.mib.infn.itbbcpmem015790.00
node1.mib.infn.itbbftp015800.00
node1.mib.infn.itiperf011600.00
node1.mib.infn.ittotal057990.00
node1.nersc.govbbcpdisk08160.00
node1.nersc.govbbcpmem08480.00
node1.nersc.govbbftp08640.00
node1.nersc.goviperf08240.00
node1.nersc.govtotal033520.00
node1.nikhef.nlbbcpdisk02040.00
node1.nikhef.nlbbcpmem02100.00
node1.nikhef.nlbbftp02100.00
node1.nikhef.nliperf02060.00
node1.nikhef.nltotal08300.00
node1.nslabs.ufl.edubbcpdisk07920.00
node1.nslabs.ufl.edubbcpmem08320.00
node1.nslabs.ufl.eduiperf08240.00
node1.nslabs.ufl.edutotal024480.00
node1.rcf.bnl.govbbcpdisk19800.10
node1.rcf.bnl.govbbcpmem010300.00
node1.rcf.bnl.govbbftp110400.10
node1.rcf.bnl.goviperf110300.10
node1.rcf.bnl.govtotal340800.07
node1.riken.go.jpbbcpdisk028620.00
node1.riken.go.jpbbcpmem030320.00
node1.riken.go.jpbbftp029160.00
node1.riken.go.jpiperf029580.00
node1.riken.go.jptotal0117680.00
node1.roma1.infn.itbbcpdisk015810.00
node1.roma1.infn.itbbcpmem017200.00
node1.roma1.infn.itbbftp017590.00
node1.roma1.infn.itiperf016200.00
node1.roma1.infn.ittotal066800.00
node1.sdsc.edubbcpdisk07920.00
node1.sdsc.edubbcpmem07920.00
node1.sdsc.edubbftp03600.00
node1.sdsc.eduiperf04320.00
node1.sdsc.edutotal023760.00
node1.sox.i2.edubbcpdisk0970.00
node1.sox.i2.edubbcpmem01020.00
node1.sox.i2.eduiperf0780.00
node1.sox.i2.edutotal02770.00
node1.stanford.edubbcpdisk08320.00
node1.stanford.edubbcpmem08560.00
node1.stanford.edubbftp08640.00
node1.stanford.eduiperf08480.00
node1.stanford.edutotal034000.00
node1.triumf.cabbcpdisk07360.00
node1.triumf.cabbcpmem07840.00
node1.triumf.cabbftp07920.00
node1.triumf.caiperf08080.00
node1.triumf.catotal031200.00
node1.ucl.ac.ukbbcpdisk013710.00
node1.ucl.ac.ukbbcpmem020410.00
node1.ucl.ac.ukbbftp011940.00
node1.ucl.ac.ukiperf0500.00
node1.ucl.ac.uktotal046560.00
node1.utdallas.edubbcpdisk08080.00
node1.utdallas.edubbcpmem08560.00
node1.utdallas.edubbftp08560.00
node1.utdallas.eduiperf06640.00
node1.utdallas.edutotal031840.00
node2.ccs.ornl.govbbcpdisk08080.00
node2.ccs.ornl.govbbcpmem08480.00
node2.ccs.ornl.govbbftp08400.00
node2.ccs.ornl.goviperf08240.00
node2.ccs.ornl.govtotal033200.00
node2.cern.chbbcpdisk06960.00
node2.cern.chbbcpmem08160.00
node2.cern.chbbftp08160.00
node2.cern.chiperf08000.00
node2.cern.chtotal031280.00
node2.gsfc.nasa.govbbcpdisk020000.00
node2.gsfc.nasa.govbbcpmem021000.00
node2.gsfc.nasa.govbbftp020400.00
node2.gsfc.nasa.goviperf020000.00
node2.gsfc.nasa.govtotal081400.00
node2.in2p3.frbbftp021540.00
node2.in2p3.friperf022900.00
node2.in2p3.frtotal044440.00
node2.nersc.govbbcpdisk02560.00
node2.nersc.govbbcpmem02640.00
node2.nersc.govbbftp02560.00
node2.nersc.goviperf02640.00
node2.nersc.govtotal010400.00
node2.nslabs.ufl.edubbcpdisk07590.00
node2.nslabs.ufl.edubbcpmem08000.00
node2.nslabs.ufl.edubbftp07840.00
node2.nslabs.ufl.eduiperf08000.00
node2.nslabs.ufl.edutotal031430.00