Caltech Scientists Set Data Transfer Record
Thursday, November 29th, 2007The California Institute of Technology just announced today that its scientists have set a new record for sustained data transfer, showing how long distance, wide area links can be used for clustered supercomputing. The record 80+ Gbps sustained data transfer was demonstrated at the SuperComputing 2007 conference. According to Caltech:
Multigigabit/s end-to-end network performance will empower scientists to form “virtual organizations” on a planetary scale, sharing their collective computing and data resources in a flexible way. In particular, this is vital for projects on the frontiers of science and engineering, in data-intensive fields such as particle physics, astronomy, bioinformatics, global climate modeling, geosciences, fusion, and neutron science.
Essentially, this kind of technology is useful for distributing difficult computer applications across the Internet. It’s interesting to note the heavy influence of technology firms here in Southern California in contributing to the effort. According to Caltech:
The record-setting demonstration was made possible through the use of seven 10-Gbps links to SC07 provided by SCinet, CENIC, National Lambda Rail, and Internet2, together with a fully populated Cisco 6500E series switch-router, 10-gigabit Ethernet network interfaces provided by Intel and Myricom, and a fiber channel disk array provided by Data Direct Networks equipped with 4-Gbps host bus adapters from QLogic. The server equipment consisted of 36 widely available Supermicro systems using dual quad-core Intel Xeon processors, and Western Digital SATA disks.
The setup includes hardware from Arcadia-based Myricom; Chatsworth-based Data Direct Networks; Aliso Viejo-based QLogic; and Lake Forest-based Western Digital. The whole demonstration was run on the FAST TCP protocol, which is from Caltech and is the basis of Pasadena startup FastSoft.



