AtlanticWave-SDX
  • Home
  • About
    • Collaborators
    • Meet the Team
    • Careers
    • Fellowships
    • Outreach
  • Engineering
    • Documentation
    • Release notes
    • Network Infrastructure
    • Development
  • News
    • News 2025
    • News 2024
    • News 2023
    • News 2022
    • News 2021
    • News 2020
    • News 2019
    • News 2018
    • News 2017
    • News 2016
    • News 2015
  • Publications
    • Project Publications
    • Project Presentations
    • Press releases
    • SDX Related Publications
  • Contact us
  • Home
  • About
    • Collaborators
    • Meet the Team
    • Careers
    • Fellowships
    • Outreach
  • Engineering
    • Documentation
    • Release notes
    • Network Infrastructure
    • Development
  • News
    • News 2025
    • News 2024
    • News 2023
    • News 2022
    • News 2021
    • News 2020
    • News 2019
    • News 2018
    • News 2017
    • News 2016
    • News 2015
  • Publications
    • Project Publications
    • Project Presentations
    • Press releases
    • SDX Related Publications
  • Contact us

Evaluating INT, JTI, and sFlow @ AmLight

  • Home
  • Evaluating INT, JTI, and sFlow @ AmLight

Evaluating INT, JTI, and sFlow @ AmLight

vassi2022-12-09T21:41:17+00:00

Renata Frez, Dr. Julio Ibarra, and Jeronimo Bezerra participated in the Internet2 Technology Exchange which is a premier technical event in the global research and education community. The goal is to convene technologists, scientists, engineers, architects, analysts, students, and anyone passionate about technology, innovation, and challenging tasks. TechEx provides a forum for debate and discussion that enable timely conversations critical to ensuring that we, as a community of technology leaders committed to supporting research and collaboration, are aligned and are moving forward together. 

Renata Frez presented “Evaluating INT, JTI, and sFlow @ AmLight” at the Advanced Networking session

Abstract: Like most research and education networks (REN), AmLight has diverse science drivers and workflows. While some science drivers operate on best-effort, some require steady jitter and delay, and some have strict SLA for packet loss and service outages. For international long-haul highly-distributed RENs such as AmLight, the critical component to enable the quality of service users require/demand is an efficient network monitoring framework. Monitoring the network state and events must be done accurately and as close to real-time as possible. Legacy technologies and approaches, such as SNMP and flow sampling, have always been the main approaches used by network operators to monitor the network state. These technologies have their limitations and they are well-known, for instance, the lack of real-time support.

In 2014, when AmLight became an SDN infrastructure with OpenFlow, OpenFlow counters were added to the existing SNMP/sFlow monitoring combo. However, OpenFlow counters suffered the same inconsistencies as SNMP: each vendor had its level of accuracy and minimum polling interval. Multiple vendors were evaluated regarding the quality of the counters provided via OpenFlow, and results were presented at the 2016 Traffic Monitoring and Analysis (TMA) workshop and the 2016 Internet2 Technology Exchange. In the end, AmLight learned that SNMP + sFlow + OpenFlow counters were not sufficient to achieve its monitoring goals.
Since 2018, AmLight has focused on monitoring the network by leveraging advancements in the field of programmable data planes, more specifically, In-band Network Telemetry (INT). As a solution for leveraging INT was not commercially available, AmLight built its telemetry exporting and gathering framework in partnership with NoviFlow and Barefoot Networks. The development of a telemetry framework was the scope of work of the NSF AmLight-INT project. The academic community praised the outcomes of the AmLight-INT project, and the solution developed was presented multiple times since 2018, including at the 2019 Internet2 Technology Exchange. In production at AmLight, INT gives real-time per-packet visibility with zero impact on network devices’ network functions, since all telemetry data is gathered and exported directly from the switch’s ASIC.

Although INT provides visibility of 100% of the packets flowing through programmable switches, its goals are focused on real-time granular network state monitoring. Leveraging INT for long-term reports and top talkers can lead to an expensive monitoring environment due to the amount of data generated. Moreover, AmLight is not entirely composed of programmable switches, as it leverages legacy Top of Rack (ToR) switches and Juniper MX routers. As a result, monitoring legacy devices is still mandatory for AmLight. To understand how close to real-time its legacy devices can accurately perform, AmLight pushed the limits of its legacy monitoring tools. Juniper expanded its MX family with a network streaming telemetry solution called Juniper Telemetry Interface (JTI), which provides telemetry summaries every two seconds. JTI has been in use at AmLight since 2021. JTI, for instance, aims to replace SNMP with a closer-to-real-time solution to gather interface counters.
In 2022, AmLight performed multiple simulations and field evaluations to compare how each monitoring technology reported specific events, from microbursts to DDoS attacks. Also, AmLight experienced various events (microbursts and DDoS attacks) that helped shape the solution to its needs. AmLight compared INT, SNMP, sFlow, and JTI by creating paths that included all sorts of technologies, and used highly precise traffic generators to create network events. Results, methodology and lessons learned will be presented to the audience, as well as how AmLight combined its monitoring technologies to guarantee science drivers’ expectations are met.

More details about the event can be found here: https://internet2.edu/2022-technology-exchange/2022-program/advanced-networking-sessions/

Share this post

Facebook Twitter LinkedIn Google + Email

Related Posts

The 3rd Global Research Platform Workshop (3GRP)

October 10-11, 2022Salt Lake City, Utah, USA The 3rd GRP Workshop (3GRP) is co-located with the 18th IEEE International Conference on e-Science.... read more

Global 100G session at I2 Global Summit 2019

Highlights of the AmLight project were presented at Global 100G session at the Internet2 Global Summit on March 7 along with... read more

CI Lunch and Learn talk: Introducing the new AmLight-ExP project focusing on Autonomic Network Architecture

On Friday, March 18th, at 2 pm Miami time, Jeronimo Bezerra, CIARA Associate Director, will be presenting to the CI... read more

Rubin Observatory Will Help Unravel Mysteries of Dark Matter and Dark Energy

Vera C. Rubin Observatory’s unprecedented deep and wide survey will create most precise map of Universe ever

11 October 2023 Rubin Observatory’s... read more

Trusted CI webinar: Q-Factor: Real-time data transfer optimization, September 27th @11am Eastern

Members of FIU and ESnet are presenting the talk, Q-Factor: Real-time data transfer optimization leveraging In-band Network provided by P4... read more

Research and Education Infrastructure Inclusion, Innovation, and Competitiveness

With contributions and endorsements from over 50 community participants and organizations, Internet2, CENIC, EDUCAUSE, and The Quilt provided support to... read more

Angola Cables & Americas Lightpaths Consortium Sign Memorandum of Understanding; Infrastructure for Research and Education

       PRESS RELEASEMedia Contact:For Angola Cables, SA: Antonio Costa, Head of MarketingTlm ‪+244 927 686 279‬‬‬‬‬‬‬‬‬antonio.costa@angolacables.co.aowww.angolacables.co.aoLote Cellwave,... read more

AmLight Express and Protect interconnects three continents by activating 100G end-to-end links between the U.S., Brazil and South Africa

Miami, Florida, March 1, 2020 – Florida International University (FIU), Rede Nacional de Ensino e Pesquisa (RNP), Tertiary Education and Research... read more

A Summer of Cyberinfrastructure

By Megan Johnson, NCSAOriginal article here: https://access-ci.org/a-summer-of-cyberinfrastructure/ For those not yet familiar, the Student Training and Engagement Program (STEP) is... read more

NSF CI Compass: Webinar: Supporting Production Science at Major Facilities by Leveraging Research and Education Networks ft. Julio Ibarra

CI Compass is excited to announce the next installment in our webinar series: Supporting Production Science at Major Facilities by Leveraging... read more

Get In Touch

Contact Us

Center For Internet Augmented Research & Assessment Florida International University
  • Address: 11200 SW 8St, PC312 Miami, FL 33199
  • Email: contacts@amlight.net

Follow Us

Facebook Twitter

Click here to subscribe to our mailing list

© Copyright 2015-2025 | Florida International University | Contact Webmaster