SC 2015 High Speed Scientific Data Transfers using SDN

SC15-logoAustin, Texas – During the SuperComputing 2015 (SC15) conference November 16-20, an International team of high energy physicists, computer scientists, and network engineers led by the California Institute of Technology (Caltech), SPRACE Sao Paulo and University of Michigan, together with teams from FIU, Vanderbilt and support from vendors including Dell, Mellanox, QLogic, SGI and Spirent are working together to demonstrate large data flow transfers across an highly intelligent SDN network. This work is being supported by SCinet Network Research Exhibition (NRE) and also presented in the INDIS workshop and submitted to IEEE ACM for the publication. Click here to read the paper submitted to IEEE.

SDN Demonstrations

SDN demonstration revolves around an OpenFlow ring connecting 7 different booths and two WAN connections. Some of the WAN connections are built using the NSI and then stitched using the custom SDN application. This helps creating an intelligent design where large flows traverse across various paths based on either the shortest or the fastest routes availability. Remote NSI paths are shown in the picture below. An interesting aspect is that all the remote switches will be controlled by a single ODL controller in the Caltech booth at the show floor.

The group has just released first working library to control the SDN controller OpenDaylight (Lithium). The library is written in Python and is available at github:

SuperComputing 2015 SDN-Ring


High Speed DTN demonstrations at 100GE

With the recent scientific innovations and continuous outcomes in the major fields like LHC, Genomis, Astronomy, Oceanlogy, the data volumes are increasing and requires efficient protocols and mechanisms to transport across the globe. The group will present such technologies and demonstrate data transfers at 100GE from disk to disk.

A separate demonstration will show the future challenges on the systems design for the 400GE and beyond between a pair of systems.

Named Data Networking (NDN)

NDN project aims to develop a new Internet architecture that can capitalize on strengths — and address weaknesses — of the Internet’s current host-based, point-to-point communication architecture in order to naturally accommodate emerging patterns of communication. By naming data instead of their locations, NDN transforms data into a first-class entity. At SC15, a separate NDN node will be announcing LHC data objects while the visualization software from the NDN group will show case data flows to the shortest routes.

This work is made possible by the strong support of the US Department of Energy Office of Science and the National Science Foundation.

CIARA presentations at SC15:

Title:OpenWave: U.S.-Brazil 100G Experimental Alien Wave
Time: 10:00am-10:20am, Nov 17 at Caltech booth
Presenters: Julio Ibarra, Heidi Morgan, Donald Cox, and Louis Fox

Title:LSST Project Update“, Click here to watch video about LSST
Time: 10:00am-10:20am, Nov 19 at Caltech booth
Presenters: Heidi Morgan

Title:Data Transfer in a Science DMZ using SDN with Applications for Precision Medicine in Cloud and High-performance Computing
Time: 8:40am – 9:00am, Nov 20th
Presenters: Nam Pho, Dino Magri, Fernando Redigolo, Byoung-Do Kim, Timothy Feeney, Heidi Morgan, Chirag Patel, Chris Botka and Tereza Carvalho

Title:AtlanticWave-SDX: An International SDX to Support Science Data Applications
Time: 9:20am – 9:40am, Nov 20th
Presenters: Joaquín Chung, Jacob Cox, Julio Ibarra, Jeronimo Bezerra, Heidi Morgan, Russell Clark and Henry Owen

For original article click here.


SuperComputing 2015 “SDN for Scientific Networking”


Join us for a special workshop “SDN for Scientific Networking”, a technical half-day workshop held in conjunction with SuperComputing’15, that brings together domain scientists, HPC experts, network operators and security practitioners for a discussion of the current state of Software Defined Networking (SDN). With participants from campuses, academia, research, industry, and government, this workshop will discuss current and proposed uses for SDN in scientific communities. This workshop will explore the use of SDN for network optimization, address the security challenges with SDN and discuss emerging SDN architectures. The paper panels and lightning talks will focus on innovative SDN use cases either planned or in production.

Title:OpenWave: U.S.-Brazil 100G Experimental Alien Wave
Time: 10:00am-10:20am, Nov 17 at Caltech booth
Presenters: Julio Ibarra, Heidi Morgan, Donald Cox, and Louis Fox

Title:LSST Project Update“, Click here to watch video about LSST
Time: 10:00am-10:20am, Nov 19 at Caltech booth
Presenters: Heidi Morgan

Title:Data Transfer in a Science DMZ using SDN with Applications for Precision Medicine in Cloud and High-performance Computing
Time: 8:40am – 9:00am, Nov 20th
Presenters: Nam Pho, Dino Magri, Fernando Redigolo, Byoung-Do Kim, Timothy Feeney, Heidi Morgan, Chirag Patel, Chris Botka and Tereza Carvalho

Title:AtlanticWave-SDX: An International SDX to Support Science Data Applications
Time: 9:20am – 9:40am, Nov 20th
Presenters: Joaquín Chung, Jacob Cox, Julio Ibarra, Jeronimo Bezerra, Heidi Morgan, Russell Clark and Henry Owen

For website click here.
For the schedule of the workshop click here.



AARNet launches SDN innovation platform for researchers

AARNet, Australia’s Academic and Research Network, today announced the launch of the Australia Wide-Area SDN Testbed, an innovation platform for developing high-speed technologies, established in collaboration with nine universities and CSIRO Data61. The announcement was made during the Open Networking Foundation SDN Down Under event in Sydney.

Software Defined Networking (SDN) is an emerging technology with the potential to revolutionise the way networks are provisioned and managed. SDN offers solutions for improving network flexibility and reducing costs via software-based management and control.

A real-world research environment

“The Testbed is a real-world research network environment, a simulation of the Internet that we’ve put in place to make it easier for researchers in the fields of computer science, engineering and mathematics to test, prototype and validate advanced networking concepts in the SDN arena and accelerate the development of high-speed networking. Developing and supporting initiatives to explore what the future network might look like has been a focus of AARNet’s work since its early days of pioneering the Internet in Australia,” says AARNet’s CEO Chris Hancock.

David Wilde, AARNet’s Chief Technology Officer says access to a wide-area SDN testbed provides researchers with new opportunities to exploit the potential of SDN.

“We know SDN works in single domain environments, like the campus and data centre, but little research has been undertaken to validate whether the technology works across multiple domains with different administrators, such as telco carriers and enterprises.”

A consortium of researchers from CSIRO Data61 and nine universities, led by the University of New South Wales (UNSW), secured LIEF (Linkage Infrastructure, Equipment and Facilities) grant funding from the Australian Research Council to deploy SDN equipment within each of their labs.

The other eight consortium members are University of Technology Sydney, Macquarie University, University of Adelaide, RMIT, Swinburne, University of Queensland, University of Wollongong and Australian National University.

To read full article please click here.


Press release: AtlanticWave-SDX





Media Contact:
Heidi Morgan, Director
Center for Internet Augmented Research and Assessment (CIARA)
Florida International University

AtlanticWave-SDX: A Distributed Intercontinental Experimental Software Defined Exchange for Research & Education Networking

Miami, Florida, April 15, 2015 – Florida International University’s Center for Internet Augmented Research and Assessment (CIARA) is pleased to announce AtlanticWave-Software Defined Exchange: A Distributed Intercontinental Experimental Software Defined Exchange (SDX) NSF Award ACI#1451024.

Software Defined Networking (SDN) deployments that cross multiple domains are constructed manually, involving significant coordination and effort by network operators.  Americas Lightpaths (AmLight) is a production infrastructure for communication and collaboration between the U.S. and Western Hemisphere science and engineering research and education communities. In August 2014, AmLight evolved to become a full SDN. Demand is growing to develop the capability to support end-to-end network services, capable of spanning multiple SDN domains.

Capabilities and resources to operate multi-domain/multi-layer SDN networks must evolve in order for the delivery of end-to-end services to scale. In response Florida International University (FIU) and Georgia Institute of Technology (GT) are collaborating on the AtlanticWave-SDX: a distributed experimental SDX, supporting research, experimental deployments, prototyping and interoperability testing, on national and international scales. In addition, AtlanticWave-SDX aims to take on a leadership role in the planning, coordination and prototyping of experimental SDX by creating an environment in which researchers and practitioners can collaborate on at-scale experimentation and prototyping of SDN applications and services, enabling domain scientists to instantiate instruments on demand, or application-specific infrastructure on demand, across multi-domain networks, on a global scale.

AMPATH, led by FIU and SoX, led by GT, are Open R&E Exchange Points (RXP), operating as Platforms of Network Innovation.  Both serve U.S. science research and education communities by managing production-level operational open exchange points, connecting a diverse community of national and international R&E networks. Both also support and participate in experimental Openflow/SDN deployments.  AtlanticWave-SDX is comprised of two components: (1) a network infrastructure development component to bridge 100G of network capacity between R&E backbone networks in the U.S. and South America; and (2) an innovation component to build a distributed intercontinental experimental SDX between the U.S. and South America, by leveraging open exchange point resources at SoX (Atlanta), AMPATH (Miami), and Southern Light (São Paulo, Brazil).

Florida LambdaRail (FLR), Florida’s Research and Education Network, supports FIU/AMPATH in this partnership in Florida.  For the past 12 months FLR, in collaboration with FIU/AMPATH, has been conducting SDN experimentation to provide a 100G wave in support of the NSF AmLight OpenWave experiment between Miami and Jacksonville.  By June of this year, FLR will have completed a 100 Gbps upgrade of its entire 1,540 miles network.  “A key driver for us in support of our 100G network upgrade is our commitment to enabling statewide, regional, national and international research initiatives,” said Joseph Lazor, CEO of Florida LambdaRail.  “We are excited about AtlanticWave-SDX as it presents a great opportunity for our global research & education community to take advantage of our new capacity to collaborate on vital next-generation network research and application development.

The absence of operational multi-domain SDN networks limits the usability of SDN to motivate the development of novel services and applications.  A distributed experimental SDX will provide an environment for development and prototyping of functions and services essential towards advancing knowledge to support end-to-end services, capable of spanning multiple SDN domains.

Caltech working together with iCAIR, Internet2 and ESnet intends to extend this functionality to sites involved in the LHC program across the US and in Europe as well as Latin America through AtlanticWave-SDX.  Harvey Newman, Professor of Physics at Caltech, said: “Software-driven strategic load balancing and flow moderation across a global set of SDXs are an essential part of the emerging picture of the next generation of intelligent networks. This will help physicists throughout the world to realize the potential for a new round of discoveries that may emerge during the higher energy data-taking round that is about to begin at the LHC, and pave the way for other major science programs, such as LSST.

AtlanticWave-SDX will enhance global e-Science collaborations by providing science applications with novel functions and services based on SDN technologies.  SDN application development will be able to be prototyped across multi-domain/multi-layer SDN networks connected through a distributed experimental SDX fabric connected to AMPATH, SoX and Southern Light.  AtlanticWave-SDX will contribute to a network architecture designed to support the needs of U.S.-Western Hemisphere research and education communities in a manner that supports the evolving nature of discovery and scholarship.

About Florida International University: Florida International University is a vibrant, student-centered public research university, ideally located in Miami, that is worlds ahead in its commitment to learning, research, entrepreneurship, innovation, and creativity so that our graduates are prepared to succeed in a global market (
About CIARA: Florida International University’s Center for Internet Augmented Research and Assessment (CIARA), in the Division of IT, has developed an international, high-performance research connection point in Miami, Florida, called AMPATH (AMericasPATH; AMPATH extends participation to underrepresented groups in Latin America and the Caribbean, in science and engineering research and education through the use of high-performance network connections. AMPATH is home to the Americas Lightpaths (AmLight) high-performance network links connecting Latin America to the U.S., funded by the National Science Foundation (NSF), award #ACI-0963053 and the Academic Network of São Paulo (award #2003/13708-0) (
About Georgia Institute of Technology: Georgia Institute of Technology, also known as Georgia Tech, is one of the nation’s leading research universities, providing a focused, technologically based education to more than 21,500 undergraduate and graduate students. Georgia Tech has many nationally recognized programs, all top-ranked by peers and publications alike, and is ranked in the nation’s top 10 public universities by U.S. News and World Report. It offers degrees through the Colleges of Architecture, Computing, Engineering, Sciences, the Scheller College of Business, and the Ivan Allen College of Liberal Arts. As a leading technological university, Georgia Tech has more than 100 centers focused on interdisciplinary research that consistently contribute vital research and innovation to American government, industry, and business. (
About SoX: Southern Crossroads (SoX) also known as Southern Light Rail (SLR) is a 501(c)3 organization that serves the Southeastern U.S. Research and Education community. SoX provides high-speed, global connectivity and other commodity services. SoX also serves as the Southeast connector to National Lambda Rail (NLR), Internet2 and other major U.S as well as International research networks (
About California Institute of Technology: The California Institute of Technology (Caltech) is a world-renowned science and engineering research and education institution, where extraordinary faculty and students seek answers to complex questions, discover new knowledge, lead innovation, and transform our future. Global Caltech’s facilities are Jet Propulsion Laboratory, Caltech Seismological Laboratory, and International Observatory Network (
About Princeton University: Princeton is an independent, coeducational, nondenominational institution that provides undergraduate and graduate instruction in the humanities, social sciences, natural sciences and engineering. As a world-renowned research university, Princeton seeks to achieve the highest levels of distinction in the discovery and transmission of knowledge and understanding. At the same time, Princeton is distinctive among research universities in its commitment to undergraduate teaching (
About RNP: The Brazilian Education and Research Network (RNP), qualified as a Social Organization (OS) by the Brazilian government, is supervised by the Ministry of Science, Technology and Innovation (MCTI), and is maintained through the inter-ministerial RNP program, which also includes the Ministries of Education (MEC), Health (MS) and Culture (MinC). The first Internet provider in Brazil with national coverage, RNP operates a high-performance nationwide network, with points of presence in all 26 states and the national capital, providing service to over 1200 distinct locations. RNP’s more than four million users are making use of an advanced network infrastructure for communication, computation and experimentation, which contributes to the integration of the national systems of Science, Technology and Innovatiob, of Higher Education, of Health and of Culture (
About ANSP: The Academic Network of São Paulo (ANSP) provides connectivity to the top R&E institutions, facilities and researchers in the State of São Paulo, Brazil, including the University of São Paulo, the largest research university in South America. ANSP directly connects to AmLight in Miami at 20G. ANSP also provides connectivity to Kyatera, a 9-city dark-fiber-based optical network infrastructure linking 20 research institutions in the state and a number of special infrastructure projects like GridUNESP, one of the largest computational clusters in Latin America, supporting interdisciplinary grid-based science (
About AURA: The Association of Universities for Research in Astronomy (AURA) is a consortium of 40 US institutions and 4 international affiliates that operates world-class astronomical observatories. AURA’s role is to establish, nurture, and promote public observatories and facilities that advance innovative astronomical research. In addition, AURA is deeply committed to public and educational outreach, and to diversity throughout the astronomical and scientific workforce. AURA carries out its role through its astronomical facilities (
About Internet2: Internet2, U.S. national backbone network, peers with Latin American R&E networks over AtlanticWave and PacificWave, from multiple peering points. Internet2 comprises 252 U.S. universities, 82 leading corporations, 68 affiliate members, including government agencies, 41 regional and state education networks, and more than 65 national research and education networking partners representing over 100 countries (
About Florida LambdaRail: FLR is the regional optical network of Florida, formed as a consortium of the Florida’s research universities, to support their research and education mission (

Download CIARA FIU press release pdf version here.
For Georgia Tech press release click here.

    GT-Coursera-logo-square             MEDlsstWHT