High Performance WAN Testbed Experiences & Results

Outline

Who did it: Collaborators and sponsors

What was done?

On February 27-28, over a Terabyte of data was transferred in 3700 seconds by S. Ravot of Caltech between the Level3 PoP in Sunnyvale, near SLAC, and CERN.

The data passed through the TeraGrid router at StarLight from memory to memory as a single TCP/IP stream at an average rate of 2.38 Gbps (using large windows and 9KByte “jumbo” frames).

This beat the former record by a factor of approximately 2.5,  and used the US-CERN link at 99% efficiency.

How was it done: Typical testbed

Typical Components

Challenges

Windows and Streams

Even with big windows (1MB) still need multiple streams with Standard TCP

New TCP Stacks

Stock vs FAST TCP
MTU=1500B

Jumbo frames

TCP stacks with 1500B MTU @1Gbps

Jumbo frames, new TCP stacks at 1 Gbits/s

Other gotchas

Who needs it?

What’s next?

More Information

Impact on others