The high-tech world we live in today demands super high speeds in our global IT infrastructure. In this commentary, Ben Miller at Keysight Technologies brings us to the frontiers of the data super highways needed to power the data-intensive applications that we use at work and in our lives.
Pushing the speed envelope with 1.6T data centre networks.
For the last 30 years, modern society has depended on data centre networks.
Networking speeds must continue to increase to keep up with the demand caused by emerging technologies such as autonomous vehicles (AVs) and artificial intelligence (AI).
About the Author: Ben Miller is a Product Marketing Manager at Keysight Technologies, with experience in the semiconductor and test & measurement industries. He joined Keysight in 2022 as Product Marketing Manager for Digital Applications Software, promoting software solutions for Keysight’s oscilloscope, AWG, and BERT products. Ben has a bachelor’s degree in electrical engineering from the University of Texas at Austin.
Further innovation in high-speed data will enable 800 gigabits per second (800G) and 1.6 terabits per second (1.6T) network speeds.
Cloud and edge computing: The intelligence factory
A recent trend is the offloading of data processing to external servers.
Hyperscale data centres have popped up globally to support cloud computing networks.
Smaller data centres for edge computing have also become more common for time-sensitive applications.
Data centres have become “intelligence factories” providing powerful computing resources for high-demand applications.
Edge computing is compelling for its impact on AVs.
Instead of hosting a supercomputer in the car to process the sensor data, AVs use smaller servers on the “edge,” dramatically reducing latency.
Cloud computing applications span from controlling factory robots to hosting thousands of VR users in the metaverse.
Today’s 400G data centres are not yet fast enough for many emerging applications, so the networking industry is already looking toward 1.6T.
Autonomous vehicles show the benefits of edge computing.
Inside the data centre
Data centre network speeds are facilitated by physical layer transceivers, which follow the Institute of Electrical and Electronics Engineers (IEEE) and the Optical Internetworking Forum (OIF) standards.
Both industry groups define the interoperability of each interface in the data centre.
As of this writing, the most current standards are IEEE 802.3ck (networks over 100 Gb/s lanes) and OIF CEI-112G (defining 112 Gb/s speeds).
Data centre server interfaces align with OIF CEI and IEEE standards. (Courtesy Tony Chan Carusone, Alphawave IP)
Innovations and challenges for 800G/1.6T
Over the last few decades, Ethernet speeds have grown dramatically, reaching 400 Gb/s over four 56 GBaud (GBd) PAM4 lanes.
The industry expects to double the speed twice over the next few years.
The first generation of 800G will likely consist of eight 112 Gb/s lanes with a total aggregate data rate of 800 Gb/s.
However, increasing the data rate per lane (from 112 Gb/s to 224 Gb/s) is more efficient.
Ethernet speeds over time, starting with the first IEEE 802.3 standard.
The IEEE and OIF will consider the tradeoffs of each method of implementation when defining the 800G and 1.6T standards.
Below are three challenges and potential solutions for achieving 224 Gb/s lane rates:
1. Switch Silicon
Networking switch chips enable low latency switching between elements in the data centre.
From 2010 to 2022, switch silicon bandwidth rose from 640 Gb/s to 51.2 Tb/s after multiple improvements in complementary metal-oxide semiconductor (CMOS) process technology.
The next generation of switch silicon will double the bandwidth once again to 102.4T. These silicon switches will support 800G and 1.6T over 224 Gb/s lanes.
2. Forward Error Correction
Forward error correction (FEC) refers to transmitting redundant data to help a receiver piece together a signal with corrupted bits.
Types of FEC architectures and their tradeoffs. (Courtesy Cathy Liu, Broadcom Inc.)
FEC algorithms can recover data frames from random errors but are struggle against burst errors when entire frames are lost.
Each FEC architecture has tradeoffs and advantages of coding gain, overhead, latency, and power efficiency. In 224 Gb/s systems, more complex FEC algorithms will be necessary to minimise burst errors.
3. Optical Modules and Power Efficiency
The most difficult challenge facing data centres is power consumption. Optical module power consumption has increased with each generation.
Power consumption trends of optical modules. (Courtesy Supriyo Dey, Eoptolink)
As optical module designs mature, they become more efficient, meaning that power consumption per bit is decreasing.
However, with an average of 50,000 optical modules in each data centre, the modules’ high average power consumption remains a concern.
Pluggable and co-packaged optical modules. (Courtesy Tony Chan Carusone, Alphawave IP)
Co-packaged optics can reduce power consumption per module, moving the optoelectronic conversion inside the package, but there are still questions about cooling requirements.
Countdown to 1.6T
800G is coming, building upon the groundwork the IEEE and OIF set with 400G.
The first 51.2T switch silicon was released in 2022, enabling sixty-four 800 Gb/s ports, and validation began on the first 800G transceivers.
This year, the standards organisations will release the first versions of the IEEE 802.3df and OIF 224 Gb/s standards giving developers a better indication of how to build 800G and 1.6T systems using 112 Gb/s and 224 Gb/s lanes.
Projected timeline for 800G and 1.6T developments.
In the next two years, expect the standards organisations to finalise the physical layer standards and real development and validation to begin shortly after.
Operators are currently upgrading data centers to 400G networks, but they only buy time until the next inevitable speed upgrade.
Data centres will always need more efficient and scalable data technologies to support data-heavy emerging tech.
Tags: AI, byline, commentary, data centers, data centres, Ethernet, interviews, Keysight, opinion, Tech Focus, technology
Those astronomical speeds seem so unfathomable to the average individual user!
Agreed. These are the data super highways that power the IT infrastructure behind our work and life apps. The current state is at 400 Gbps, and expected to double to 800G over the next few years. The 1.6T which the writer (Ben Miller) is talking about is still state of the art!