Skip to content
Let's talk

Futurum Research

Research Report

AI Platforms3 min read

Why Ethernet is Vital to Fulfilling AI’s Potential

Research Director, Communication Networks

Updated

The short answer

In our latest white paper, Why Ethernet is Vital to Fulfilling AI’s Potential, we explore why the Broadcom portfolio provides Ethernet solutions and capabilities that assure lower costs and address network congestion challenges by optimizing network efficiency, especially for scaling and optimizing…

Futurum's Ron Westfall, David Nicholson and Daniel Newman,

Cite this

Ron Westfall, David Nicholson and Daniel Newman, The Futurum Group, "Why Ethernet is Vital to Fulfilling AI’s Potential," August 13, 2024. https://trial.futurumgroup.com/research-reports/why-ethernet-is-vital-to-fulfilling-ais-potential/

Why Ethernet is Vital to Fulfilling AI’s Potential

Ethernet outperforms all other networking technologies in terms of efficiency, as measured by the lowest job completion time (JCT) for AI training and inference. It has become the go-to choice for expansive AI clusters, offering the unique capability to link over a million AI accelerators essential for scaling AI networks. The creation of AI systems is an intricate task that requires interoperability, standardization, and technology prowess among various suppliers, spotlighting the necessity of a shared, open platform to unite these components. Ethernet uniquely delivers networking solutions that ensure peak performance and scalability with cost-effectiveness and agility, due primarily to its foundation on open standards and its extensive ecosystem support.

In contrast, InfiniBand technology is commonly deployed in high-performance computing (HPC) scenarios, where attaining low unloaded latency is the primary focus. However, from our view, when it comes to AI training and inference clusters, Ethernet outperforms InfiniBand. Specifically, Ethernet can offer several advantages, including greater bandwidth, higher radix, multi-vendor standard solutions, lower cost, power-efficient economics, improved throughput, and overall better performance. As such, for large-scale AI workloads that demand high bandwidth, reliable transport, and predictable tail latency, Ethernet is the preferred choice over InfiniBand.


In our latest white paper, Why Ethernet is Vital to Fulfilling AI’s Potential, we explore why the Broadcom portfolio provides Ethernet solutions and capabilities that assure lower costs and address network congestion challenges by optimizing network efficiency, especially for scaling and optimizing fast expanding AI workloads. Broadcom solutions, such as the switch-scheduled fabric based on Jericho 3-AI switch, endpoint-scheduled fabric based on the Tomahawk switch family, and Broadcom’s 400G Ethernet NICs, enable the AI infrastructure and fabric vital to making the network the compute platform essential to fulfilling the unique distributed computing demands of AI.


This paper provides insights into:

  • The evolving Ethernet landscape
  • Why Ethernet meets the AI scaling challenge
  • Why Broadcom Ethernet solutions are essential to AI workload optimization
  • How the Broadcom E2E Ethernet portfolio provides major cost improvements and sharp power advantages
  • The Ultra Ethernet Consortium’s vital role in advancing AI training and inference

Ethernet is best suited for meeting the demands of rapidly evolving networking and scaling demands of AI clusters. Broadcom E2E networking solutions are integral to ensuring the successful implementation of the largest Ethernet installations worldwide and AI clusters are clearly no exception. The foundation for the competitive advantages of Broadcom’s portfolio are the delivery of major cost and power efficiency improvements over alternative solutions. The portfolio-wide merits of Broadcom’s E2E networking solution is underpinned by the company’s strategic commitment to keeping Ethernet open. To learn more, download Why Ethernet is Vital to Fulfilling AI’s Potential today!

In partnership with:

Broadcom

Download Now

Published by Futurum.

About the author

Ron Westfall

Ron Westfall

Research Director, Communication Networks

Ron is an experienced, customer-focused research expert and analyst, with over 20 years of experience in the digital and IT transformation markets, working with businesses to drive consistent revenue and sales growth. He is a recognized authority at tracking the evolution of and identifying the key disruptive trends within the service enablement ecosystem, including a wide range of topics across software and services, infrastructure, 5G communications, Internet of Things (IoT), Artificial Intelligence (AI), analytics, security, cloud computing, revenue management, and regulatory issues. Prior to his work with The Futurum Group, Ron worked with GlobalData Technology creating syndicated and custom research across a wide variety of technical fields. His work with Current Analysis focused on the broadband and service provider infrastructure markets. Ron holds a Master of Arts in Public Policy from University of Nevada — Las Vegas and a Bachelor of Arts in political science/government from William and Mary.

Coverage on Broadcom
  • Analyst Insights180
  • Research Reports18
  • Documents1
All Broadcom coverage
See the full picture in the platform

Vendor scoring, the benchmark data behind these findings, and the analyst team that produced them.

Open the platform (opens in a new tab)Become a client
The Weekly

Subscribe to The Weekly

The week's market signals, one email, no filler. Unsubscribe any time.