AtlanticWave-SDX
  • Home
  • About
    • Collaborators
    • Meet the Team
    • Careers
    • Fellowships
    • Outreach
  • Engineering
    • Documentation
    • Release notes
    • Network Infrastructure
    • Development
  • News
    • News 2025
    • News 2024
    • News 2023
    • News 2022
    • News 2021
    • News 2020
    • News 2019
    • News 2018
    • News 2017
    • News 2016
    • News 2015
  • Publications
    • Project Publications
    • Project Presentations
    • Press releases
    • SDX Related Publications
  • Contact us
  • Home
  • About
    • Collaborators
    • Meet the Team
    • Careers
    • Fellowships
    • Outreach
  • Engineering
    • Documentation
    • Release notes
    • Network Infrastructure
    • Development
  • News
    • News 2025
    • News 2024
    • News 2023
    • News 2022
    • News 2021
    • News 2020
    • News 2019
    • News 2018
    • News 2017
    • News 2016
    • News 2015
  • Publications
    • Project Publications
    • Project Presentations
    • Press releases
    • SDX Related Publications
  • Contact us

LSST 100 Gbps Network Demonstration at Supercomputing Conference 2018

  • Home
  • LSST 100 Gbps Network Demonstration at Supercomputing Conference 2018

LSST 100 Gbps Network Demonstration at Supercomputing Conference 2018

vassi2019-06-03T21:43:04+00:00

image_from_ios_Jeff_KantorSC18November 20, 2018 – The LSST Network Engineering Team (NET) had a strong presence at the Supercomputing 2018 Conference (SC18) in Dallas, TX, last week, including a successful demonstration of the data transfer capabilities of the fiber optic networks that will be used during LSST operations. Digital data were transferred from the Base Site in La Serena, Chile, to the LSST Data Facility at the National Center for Supercomputing Applications (NCSA) in Champaign, IL. During the data transfer demonstration, a peak rate of 100 Gigabits/second (Gb/s) was achieved for short periods, and a sustained rate of 80 Gb/s was achieved over a three hour period, exceeding the test target. This test was run over links provisioned by several networking organizations: REUNA from La Serena to Santiago, FIU/Amlight from Santiago to Miami, SCInet from Miami to Chicago (Starlight), and NCSA from Chicago to Champaign. SCInet links provided by CenturyLink and internet2 were used to transfer the data from Miami to Chicago because LSST 100 Gb/s links will not be available in that path until FY20. All of the other links were those that will be used by LSST during operations.

Data Transfer Nodes (DTN) configured in La Serena and Champaign with nuttcp (a network performance measurement tool) generated a sustained memory-to-memory data rate over 80 Gb/s, over a period of three hours. Simultaneously, the DTNs, using the Fermilab Multicore-Aware Data Transfer Middleware (MDTM) software, achieved a peak of 36 Gb/s transferring 200 Gigabytes of DECam public data (FITS files) provided by the National Optical Astronomy Observatory (NOAO). Note that in LSST operations, there will be over 20 DTNs (aka archiver/forwarders) simultaneously sending data, so each one will require far less than 36 Gb/s. In addition, on the Champaign end the files were ingested into a GPFS shared file system, and a Jupyter Notebook running an application provided by LSST Data Management was used to visualize the files. Finally, an additional test transfer from Champaign to La Serena is being conducted and has so far achieved a peak of 40 Gb/s, sufficient for the annual transfer of LSST Data Releases to Chile.

Instrumentation in the DTNs and links and Grafana software were used to provide a real-time, web display of network performance during the demonstration. This was monitored live from the NCSA booth at the Supercomputing 2018 Conference. A number of conference attendees witnessed the demonstration and presentation, and participated in a question and answer session.

According to LSST NET Lead Jeff Kantor, “This demonstration shows not only that we have continuity and performance from the network point of view, but also that all of the partners acted as a very well-coordinated engineering team for LSST.”

Congratulations to the LSST NET SC18 Demonstration Team:

Albert Astudillo (REUNA)
Jeronimo Bezerra (FIU/AmLight)
Julio Ibarra (FIU/AmLight)
Sandra Jaque (REUNA)
Matt Kollross (UIUC/NCSA)
Ron Lambert (LSST/AURA)
Sean McManus (NOAO)
Wil O’Mullane (LSST/AURA)
Rodrigo Pescador (RNP)
Andres Villalobos (LSST/AURA)
Adil Zahir (FIU/AmLight)

Additional support was provided by a number of other people within these organizations. We are particularly grateful to SCInet, Starlight, and Fermilab for enabling this demonstration.

Original LSST article published here

Share this post

Facebook Twitter LinkedIn Google + Email

Related Posts

FIU is hosting GENI Regional workshop (GRW) & GENI Engineering Conference (GEC25)

Hosted by: Florida International University

DATE

GENI Regional Workshop (GRW): Monday, March 13, 2017 GENI Engineering Conference (GEC): Tuesday, March 14 to Wednesday... read more

Research and Education Infrastructure Inclusion, Innovation, and Competitiveness

With contributions and endorsements from over 50 community participants and organizations, Internet2, CENIC, EDUCAUSE, and The Quilt provided support to... read more

Evolution of the Research and Education network in Brazil

The first network in Brazil to be part of the global Internet reached 30 years of age in 2022 and... read more

Rubin Observatory Will Help Unravel Mysteries of Dark Matter and Dark Energy

Vera C. Rubin Observatory’s unprecedented deep and wide survey will create most precise map of Universe ever

11 October 2023 Rubin Observatory’s... read more

In-Band Network Telemetry @ AmLight demo at Supercomputing Conference SC21

Network Research Exhibition @ RENCI’s Virtual Booth (sc.renci.org) The goal of this demo is to showcase the benefits and challenges of deploying... read more

PoP-BA Network Technologies Workshop (Workshop de Tecnologias de Redes do PoP-BA/RNP)

During September 18th and 19th, 2023, the XIV PoP-BA Network Technologies Workshop warmly welcomed attendees for an engaging in-person meeting.... read more

AmLight Express and Protect project adds three 200Gbps optical waves for Research and Education between the U.S. and Brazil

      PRESS RELEASE AmLight Express and Protect project adds three 200Gbps optical waves for Research and Education between the U.S. and Brazil   Miami,... read more

Pegasus and AtlanticWave-SDX Help Orchestrating Science Applications

The original post is published at https://pegasus.isi.edu/2021/03/08/pegasus-and-atlanticwave-sdx-help-orchestrating-science-applications/ Authors: Cong Wang (Renaissance Computing Institute), Yufeng Xin (Renaissance Computing... read more

Experiments and Demonstrations Using World-scale Experimental Network with Ten International 100Gbps Paths at SC24

National Institute of Information and Communications Technology (NICT) has shown at SC24 *1  held in Atlanta, Georgia, USA from 18 to... read more

AmLight Express and Protect demonstrates the utility of the collaborative initiative to connect South Africa via AmLight-SACS

Miami, Florida, March 30, 2020 – On March 1, 2020, we announced AmLight Express and Protect interconnects three continents by activating... read more

Get In Touch

Contact Us

Center For Internet Augmented Research & Assessment Florida International University
  • Address: 11200 SW 8St, PC312 Miami, FL 33199
  • Email: contacts@amlight.net

Follow Us

Facebook Twitter

Click here to subscribe to our mailing list

© Copyright 2015-2025 | Florida International University | Contact Webmaster