Dr. R. Les Cottrell, MS 97, Stanford Linear Accelerator Center (SLAC), 2575
Sand Hill Road, Menlo Park, California 94025,
<cottrell@slac.stanford.edu>
Emails were sent on September 21-23, 2001 to potential
contacts for sites, inviting them to join the project. The contacts (those in red have
agreed to join) ordered alphabetically by site are shown below:
Linda Winkler, ANL, US, <winkler@mcs.anl.gov>
+ William E. Allcock [allcock@mcs.anl.gov]
Dantong Yu, BNL, Long Island, US, <dtyu@rcf.rhic.bnl.gov>
Harvey Newman, Caltech, Pasadena, US, <newman@hep.caltech.edu>
+ Julian J. Bunn [julian@cacr.caltech.edu]
+ Suresh Singh <suresh@cacr.caltech.edu>
Olivier Martin, CERN, Geneva, CH, <omartin@dxcoms.cern.ch>
+ Sylvain Ravot [Sylvain.Ravot@cern.ch]
Robin Tasker, Daresbury Lab, Liverpool, UK, <R.Tasker@dl.ac.uk>
+ Kummer, PS (Paul) [P.S.Kummer@dl.ac.uk]
Jim Leighton, ESnet, Berkeley, US, <JFLeighton@lbl.gov>
Ruth Pordes, FNAL, Chicago, US, <ruth@fnal.gov>
+ Frank Nagy <nagy@fnal.gov>
+ Phil DeMar <demar@fnal.gov>
Andy Germain, GSFC, US, <andyg@rattler-f.gsfc.nasa.gov>
+ George Uhl [uhl@rattler-f.gsfc.nasa.gov]
Jerome Bernier, IN2P3, Lyon, FR, <bernier@cc.in2p3.fr>
+ Dominique Boutigny [boutigny@in2p3.fr]
Emanuele Leonardi, INFN, Rome, IT, <Emanuele.Leonardi@roma1.infn.it>
Guy Almes, Internet 2, US, <almes@internet2.edu>
+ Matt Zekauskas <matt@advanced.org>
+ Stanislav Shalunov <shalunov@internet2.edu>
+ Ben Teitelbaum <ben@internet2.edu>
Chip Watson, JLab, Newport News, US, <chip.watson@jlab.gov>
Yukio Karita, KEK, Tokyo, JP, <karita@nwgvax.kek.jp>,
Teiji Nakamura <teiji@nwgsun2.kek.jp>
Wu-chun Feng, LANL, Los Alamos, US, <feng@lanl.gov>,
Mike Fisk <mfisk@lanl.gov>
Bob Jacobsen, LBL, Berkeley, US, <Bob_Jacobsen@lbl.gov>,
Shane Canon <Canon@nersc.gov>
Tom Dunigan, ORNL, Oak Ridge, US, <thd@ornl.gov>
+ Bill Wing <wrw@email.cind.ornl.gov>
Richard Baraniuk, Rice University, <richb@rice.edu>,
Rolf Riedi [riedi@rice.edu]
John Gordon, Rutherford Lab, Oxford, UK, <J.C.Gordon@RL.AC.UK>
+ Adye, TJ (Tim) [T.J.Adye@RL.AC.UK]
Reagan Moore, SDSC, San Diego, UA, <moore@SDSC.EDU>
+ Kevin Walsh [kwalsh@SDSC.EDU]
+ Arcot Rajasekar <sekar@SDSC.EDU>
Warren Matthews, SLAC, Menlo Park, US <matthews@slac.stanford.edu>
+ Paola Grosso <grosso@slac.stanford.edu>
+ Gary Buhrmaster <buhrmaster@slac.stanford.edu> +
Connie Logg <cal@slac.stanford.edu>
+ Andy Hanushevsky <abh@slac.stanford.edu>
+ Jerrod Williams <jerrodw@slac.stanford.edu>
+ Steffen Luitz <luitz@slac.stanford.edu>
Warren Matthews, Stanford University, Palo Alto, US,
Milt Mallory <milt@stanford.edu>
William Smith, Sun Micro Systems [William.Smith@sun.com],
Rocky Snyder rocky.snyder@sun.com
Andrew Daviel, TRIUMF, Vancouver, CA, <andrew@andrew.triumf.ca>
Paul Avery, University of Florida, Gainesville, US, <avery@phys.ufl.edu>
+ Gregory Goddard [gregg@nersp.nerdc.ufl.edu]
Thomas Hacker, University of Muchigan, <hacker@umich.edu>
Joe Izen, University of Texas at Dallas, US, <joe@utdallas.edu>
Miron Livny, University of Wisconsin, Madison, US, <miron@cs.wisc.edu>
+ Paul Barford <pb@cs.wisc.edu>
+ Dave Plonka <plonka@doit.wisc.edu>
The unprecedented avalanche
of data already being generated by and for new and future High Energy and Nuclear Physics (HENP)
experiments at Labs such as SLAC, FNAL,
KEK and CERN is demanding new strategies
for how the data is collected, shared, analyzed and presented. For example the
SLAC BaBar experiment and JLab
are each already collecting over a TByte/day, and BaBar expects to
increase by a factor of 3 in the coming year. The Fermilab CDF and
D0 experiments are ramping
up to collect similar amounts of data, and
the CERN LHC experiment expects to
collect over ten million TBytes. The strategies being
adopted to analyze and store this unprecedented amount of data is the
coordinated deployment of Grid technologies such as those being developed for
the Particle Physics Data Grid and the Grid
Physics Network. It is anticipated that these technologies will be deployed at hundreds of institutes
that will
be able to search out and analyze information from an interconnected worldwide
grid of tens of thousands of computers and storage devices. This in turn will
require the ability to sustain over long periods the transfer of
large amounts of data between collaborating
sites with relatively low latency. The Bandwidth to the World
project is designed to demonstrate the current data transfer capabilities to
several sites with high performance links, worldwide. In a sense the site
at SC2001 is acting like a HENP tier 0 or tier 1 site (an accelerator or major
computation site) in distributing copies of
the raw data to multiple replica sites. The demonstration
will be over real live production networks with no efforts to manually limit
other traffic. Since we believe we will be able to saturate our link to SciNet
and control the router in
our booth,
which will be at one end of the congested
link, we also hope to be able to investigate/demonstrate the effectiveness of QBone
Scavenger Service (QBSS) in managing competing traffic flows and on
the response time of lower volume interactive traffic on high
performance links.
On the SC2001 floor we will have a few high performance Linux hosts with Gbit/sec
network interfaces connected to a Cisco 65xx series Catalyst switch to be
located in the
SLAC/FNAL booth. The switch
will have at least 2 * 1Gbps links to SCiNet and a built in router capability. The hosts will will run various
high throughput applications including iperf and bbcp
publication, man
pages) a secure
peer-to-peer high performance copy program. These programs will be called from
scripts to automate running multiple copies, gathering performance statistics,
and reporting in real time and recording the results. We will also have scripts
to gather SNMP data from the booth router. The over 20 remote sites are connected by
various networks, including Internet 2, ESnet, JAnet, GARR, and Renater. We have
identified and contacted sites and are identifying hosts that are suitable for the demonstration.
The requirements for the hosts at the remote sites
are fairly limited.
The
information gathered will be recorded in files, and analyzed with various tools
including Excel. Universal
Time History (UTH) utility real time plots of the throughput and the
aggregate throughput (see mock-up)
to each remote site will be
displayed on monitors in the
SLAC/FNAL booth. On another monitor we will display
ping round trip times (RTT) to sites around the world from the Denver show
floor, and on a third monitor we will show throughput from SLAC to various
Grid and HENP sites wordlwide.
Longer term analysis (non-real time) will be made to summarize and
report on the demonstration and will be made publicly available via the web. The
web URL for this project will be: http://www-iepm.slac.stanford.edu/monitoring/bulk/sc2001/.
We will be using the Internet 2, ESnet,
JAnet, GARR, Renater
WANs and the CERN-STARTAP link. ESnet will have an OC48 from Denver to Sunnyvale. SLAC will have an
OC12 to Sunnyvale. The SC2001
SLAC/FNAL booth will have 2*Gbps connections to SciNet.
Offsite resources
will be at the sites listed in the table below. Each site will have one or more Unix hosts running an
iperf server. We are measuring throughputs to
many of the sites from SLAC. We also measure ping Round
Trip Times (RTTs), losses,
and derived
throughputs among other metrics. Note that at the time the ESnet connection to SLAC was only OC3
(155Mbps). It will be upgraded to OC12 (622Mbps) before the start of
SC2001.
| Logo |
Site |
Host |
OS |
MHz |
NIC |
Site connectivity |
Iperf BW from SLAC |
 |
ANL |
1.mcs.anl.gov |
Linux 2.4.2 |
2*866 |
1000Mbps |
622Mbps (ESnet) |
118Mbps
Sep '01 |
 |
BNL |
2.rhic.bnl.gov
1.rcf.bnl.gov |
Solaris 5.8
Linux 2.2.18 i686 |
4*248
448.879 |
|
155Mbps (ESnet) |
55Mbps
Jul '01 |
 |
Caltech |
1.cacr.caltech.edu |
Linux 2.4 |
1000 |
1000Mbps |
622Mbps (I2) |
320Mbps
Jul '01 |
 |
CERN |
1.cern.ch |
Solaris 5.6 |
2*360 |
100Mbps |
155Mbps |
80Mbps
Jul '01 |
 |
Daresbury |
1.dl.ac.uk |
Linux 2.4.2-2 |
996.315 |
|
|
38Mbps
Sep '01 |
 |
FNAL |
1.iepm.info |
Linux 2.4 |
200 |
100Mbps |
155Mbps (ESnet) |
91Mbps 1 Nov '01 |
 |
GSFC |
1.gsfc.nasa.gov |
FreeBSD 3.5 |
933 |
100Mbps |
(NASA) |
20Mbps Oct '01, probs w' ssh |
 |
IN2P3 |
1.in2p3.fr |
Solaris 5.7 |
4*400 |
1000Mbps |
155Mbps |
105Mbps
Jul '01 |
 |
INFN |
1.roma1.infn.it |
Solaris 5.6 |
4*400 |
100Mbps |
(GARR) |
30Mbps |
 |
Internet 2 |
1.internet2.edu,
2.internet2.edu |
FreeBSD 4.3 |
1000 |
1000Mbps |
2.5Gbps (I2) |
230Mbps / 30Mbps Oct'01 |
 |
JLab |
1.jlab.org |
Linux 2.4 |
1495 |
100Mbps |
155Mbps (ESnet) |
58Mbps Oct-01 |
 |
KEK |
1.kek.jp |
Linux 2.2 |
451 |
10Mbps |
10Mbps |
8.8Mbps / 3.6Mbps Oct-01 |
 |
LANL |
1.lanl.gov |
Linux 2.4 |
933 |
1000Mbps |
622Mbps (ESnet) |
400Mbps Nov 5 '01 |
 |
LBL |
1.lbl.gov |
Linux 2.2 |
700 |
|
622Mbps (ESnet) |
60Mbps |
 |
NERSC |
1.nersc.gov |
Solaris 5.6 |
6*336 |
1000Mbps |
622 Mbps (ESnet) |
96Mbps / 60 Mbps (Oct '01) |
 |
ORNL |
1.ccs.ornl.gov
2.ccs.ornl.gov |
Linux 2.2.18
AIX 4.3 |
400 |
1000Mbps |
622Mbps (ESnet) |
90Mbps
Sep '01 |
|
RAL |
1.hepgrid.clrc.ac.uk |
Linux 2.2.16-3 |
604 |
1000Mbps |
622Mbps (ESnet/JAnet) |
38Mbps
Sep '01 |
 |
Rice University |
1.ece.rice.edu |
Solaris 5.7 |
2*400 |
100Mbps |
|
Inbound ports blocked
(10/19/01) / 30Mbps (Oct-19 '01) |
 |
SDSC |
2.sdsc.edu (E6000),
1.sdsc.edu (Ultra 4) |
Solaris 5.7.
Solaris 5.8 |
8*248,
4*400 |
1000Mbps |
622Mbps (Abilene),
622 Mbps (vBNS),
155Mbps (ESnet) |
118Mbps Sep-01 / 457Mbps, Oct-01 |
 |
SLAC |
1.slac.stanford.edu |
Solaris 5.8 |
6*336 |
1000Mbps |
155Mbps (ESnet),
622Mbps (I2) |
|
 |
Stanford |
l.stanford.edu
|
Linux 2.2 |
300 |
100Mbps |
622Mbps (I2) |
80Mbps |
 |
Sun Micro Systems |
|
Solaris 5.8 |
|
|
|
|
 |
TRIUMF |
1.triumf.ca |
Linux 2.2.19 |
871 |
100Mbps |
22Mbps (BCnet/CAnet 3) |
16Mbps |
 |
U Florida |
1.nslabs.ufl.edu,
2.nslabs.ufl.edu |
Linux 2.4 |
800 |
1000Mbps |
155Mbps (I2) |
90Mbps
Sep '01 |
 |
UT Dallas |
1.utdallas.edu |
Solaris 5.7 |
2*400 |
100Mbps |
(I2) |
40Mbps
Sep '01 |
 |
U Michigan |
1.ctaalliance.org |
Linux 2.4 |
2*797 |
100Mbps |
(I2) |
84Mbps Nov 05 '01 |
 |
U Wisconsin |
1.cs.wisc.edu |
Linux 2.4 |
1000 |
1000Mbps |
OC12 (I2) |
90Mbps Oct '01 |
We will be located in the SLAC/FNAL
booth.
We only require IP based communications.
No specialized on-show floor equipment is needed for the demonstration.
Created September 21, 2001, last update November 9, 2001.
Comments to iepm-l@slac.stanford.edu
