Optical Technology for Data Centres — Presentation 02
Co-Packaged Optics and Optical I/O
Moving the optics from the faceplate onto the switch or processor package: why the electrical channel is the problem, optical engines and external lasers, the OIF agreements, what vendors have announced and claim, serviceability, heat and fibre, and optical I/O chiplets for compute.
CPOOptical engineELSFPXSROptical I/OpJ/bit
Switch die→mm of substrate→Optical engine→Fibre to the faceplate
Concepts used here, and where they are explained. Each links to a glossary entry: this series glossary, the Silicon Photonics Fundamentals glossary for device physics, or the glossaries of other sister series for concepts they already explain.
In a pluggable design each lane leaves the switch die, crosses the package and many centimetres of board to a faceplate cage, and is re-timed in the module (deck 01). Co-packaged optics (CPO) puts the optical engine on the switch's own package substrate, millimetres from the die, so the electrical channel nearly disappears.
Shorter channel, simpler SerDes. Less loss to equalise means less equaliser, and no module DSP at all: the energy that was spent driving and recovering a lossy trace twice (in the switch and in the module) mostly goes away. A SerDes IP vendor contrasts a 15 dB VSR channel with a 28 dB long-reach channel with two connectors (Synopsys, vendor article).
The faceplate stops being the limit. Bandwidth leaves the box as fibre, not as module cages, and module heat no longer has to leave through the faceplate (deck 01, slide 11).
The cost is everything a pluggable made easy: replacing one port's optics, mixing optics types, and keeping lasers away from a hot ASIC (slides 07–09).
02
Anatomy of a Co-Packaged Switch
Optical engines are silicon photonic chips with their drivers and TIAs (electronic–photonic integration), placed around the ASIC's edge where its SerDes are. Broadcom's 51.2 Tb/s design uses eight 6.4 Tb/s engines (slide 04).
Lasers stay outside in front-panel modules and feed continuous-wave light to the engines over polarisation-maintaining fibre (external laser source): lasers are the least reliable and most heat-sensitive part, and the front panel is the coolest place in the box.
Fibre runs from each engine to faceplate connectors (slide 09); the engines' fibre attach is the packaging problem of OptSiP 03 repeated many times on one substrate.
The application spaces and the interfaces to be standardised for co-packaging (PDF)
3.2 Tb/s Co-Packaged Module IA (OIF-Co-Packaging-3.2T-Module-01.0)
March 2023
An optical module with 8 × 400G optical interfaces (FR4 or DR4) behind 32 CEI-112G-XSR host lanes (or 32 CEI-56G-XSR for backward compatibility), for Ethernet switching; the first project under the framework (PDF)
External Laser Small Form Factor Pluggable IA (OIF-ELSFP-01.0)
August 2023
A front-panel, hot-swappable laser module with a blind-mate multi-fibre optical connector at the rear (press release); revision 02.0 in January 2025 (PDF)
CEI-112G-XSR+ IA
January 2024
Die-to-die and die-to-optical-engine electrical lanes, up to 13 dB bump to bump (press release)
Why agreements matter here: without them, every CPO switch is a single vendor's closed system of ASIC, engines, lasers and fibre. Defining the electrical lane, the module and the laser lets switch, engine and laser makers work separately, which is what MSAs did for pluggables (deck 01).
NVIDIA Spectrum-X and Quantum-X Photonics (March 2025)
1.6 Tb/s per port; Spectrum-X 128 × 800G or 512 × 200G (100 Tb/s), with a 400 Tb/s variant; Quantum-X 144 × 800G InfiniBand on 200G SerDes, liquid-cooled
4× fewer lasers, 3.5× more power efficiency, 63× greater signal integrity, 10× better network resiliency, 1.3× faster deployment; Quantum-X later in 2025, Spectrum-X in 2026
Read these as vendor claims. Each compares against the vendor's own choice of pluggable baseline, which the releases do not fully specify; “optical interconnect power” excludes the switch core. They agree in direction, not in a number you can design with.
The interactive on the next slide rebuilds the comparison from per-stage energies you can set, so you can see which assumptions give 50% and which give 70%.
05
Interactive: Energy Along the Electrical Path
Energy per bit for one switch port, added up stage by stage for three architectures: a DSP-retimed pluggable (host VSR SerDes, module DSP, optics, laser), a linear-drive pluggable (no DSP, some extra host effort) and co-packaged optics (a short XSR lane, optics, external laser). Every default is illustrative, chosen to be consistent with deck 01's interactive (a DSP module near 11 W at 800G); set them from a datasheet to test a vendor's claim.
51.2
2.50
1.00
6.00
1.25
5.00
2.00
Pluggable (DSP)
—
Linear-drive pluggable
—
Co-packaged
—
CPO saving vs DSP
—
Optics power, DSP
—
Optics power, CPO
—
Limits: one direction of a link counted once; the same optics and laser energy for all three, though CPO engines can use lower-swing drivers and different lasers; the switch core's power is excluded, as in the vendors' “optical interconnect power”. Power is energy per bit × capacity.
06
Optical I/O for Compute
The same idea applied to processors: an optical chiplet in the GPU, CPU or memory package replaces long electrical links for scale-up and memory traffic (deck 04). Unlike switch CPO, which serves standard Ethernet ports, optical I/O chiplets often run many wavelengths at modest rates per wavelength.
Announcement
What the vendor claims
Source
Ayar Labs TeraPHY with SuperNova light source (OFC 2023)
Up to 4 Tb/s bidirectional: 64 lanes at 32 Gb/s each way on 8 fibre pairs × 8 DWDM wavelengths, up to 100 m, on-chip lasers; 5 pJ/bit against about 15 pJ/bit for pluggable modules
Many wavelengths, modest rates: 64 lanes at 32 Gb/s (Intel) is the dense-WDM, ring-based architecture of OptSiP 03, slide 12, with its comb or multi-wavelength sources (multi-wavelength sources) and ring tuning (thermal tuning).
The chiplet interface: UCIe, the die-to-die standard released in March 2022, includes an off-package usage model through retimers onto other media, optics among them (UCIe Consortium).
The photonic link module of the Compute in Transit series takes a different path: a pluggable that also computes on the data it carries.
07
Serviceability and Reliability
What is lost
A failed pluggable is swapped in a minute; a failed optical engine may mean replacing the whole switch package.
Every engine must be known good before assembly: one bad engine scraps a high-value substrate.
Mixing reaches and port types on one switch is harder when the optics are fixed at manufacture.
How designs answer it
Pluggable external lasers (ELSFP, slide 03): the part most likely to fail stays replaceable.
Redundancy and spare lanes in the engines and laser sources.
Detachable fibre connectors at the engine, so fibre can be attached after test and replaced (slide 09).
The case for lasers outside: a trade-press analysis puts typical transceiver failure rates at about 200 FIT and argues that clusters with a million links need lasers at least a hundred times more reliable (Herrick, Compound Semiconductor). No peer-reviewed external-laser FIT figure was found for this deck.
Field evidence so far is vendor-reported: Broadcom reports about one million cumulative 400G-equivalent port device hours of flap-free CPO operation at Meta, in a high-temperature lab, and a 65% reduction in optics power (Broadcom, October 2025).
Link flaps and failures matter because a training job stops when any link in it fails (deck 04, slide 10).
08
Heat Next to the ASIC
Optics dislike heat and the switch die makes a lot of it. Silicon photonic devices drift with temperature at about 72 pm/K for a typical silicon wire (OptSiP 01, slide 10), and germanium detectors leak more current when hot (dark current).
Ring-based engines need active tuning to follow the substrate's temperature (thermal tuning); Mach–Zehnder-based engines tolerate drift better at the cost of size and drive power (OptSiP 02, slide 04). The trade is tuning power and control against footprint.
Lasers are kept off the package for this reason (slide 02): laser efficiency falls and wavelength drifts as temperature rises (wall-plug efficiency).
Cooling changes with it: NVIDIA's Quantum-X Photonics switch is liquid-cooled (slide 04). Heat that used to leave through hot faceplate modules now leaves through the package's cold plate along with the ASIC's.
09
Fibre at Scale
51.2 Tb/s of 100 Gb/s lanes (512 lanes)
Fibres per direction
Data fibres in total
Parallel single-mode, one lane per fibre (DR)
512
1,024
Four wavelengths per fibre (FR4)
128
256
Eight wavelengths per fibre
64
128
Arithmetic: lanes ÷ wavelengths per fibre, doubled for the two directions; laser feed fibres are extra. The OIF 3.2T module offers both DR4 and FR4 optics (slide 03).
Fibre count is a packaging cost: every fibre must be aligned to an engine at sub-micrometre tolerance (packaging) and routed to the faceplate. WDM trades fibres for lasers, multiplexers and tuning (bandwidth scaling).
Detachable fibre interfaces let engines be tested before fibre is committed and fibre be replaced later: SENKO and GlobalFoundries showed a wafer-level detachable fibre interface for CPO at ECOC 2025 (SENKO; vendor announcement).
Laser fibres must hold polarisation, because silicon photonic circuits are polarisation-dependent (OptSiP 01, slide 03).
OIF's XSR+ agreement names multi-chip modules, CPO and near-packaged optics as its intended uses (slide 01): the electrical lane is defined once and used at several distances.
Each step towards the die trades field replaceability for electrical energy and density; which step is right depends on how much bandwidth must leave the chip and how often its optics fail.
11
When CPO Wins, and When Pluggables Do
CPO's case is strongest when
The switch is at the largest radix and lane rate, so the host channel is longest and lossiest.
All ports are the same type and reach (an AI back-end fabric is the clearest case).
Power and cooling, not optics cost, limit how many accelerators a building can hold.
The operator buys the switch, optics and lasers as one system.
Pluggables keep winning when
Ports need different reaches and media (front-end and data-centre interconnect).
Field replacement per port and multi-vendor sourcing matter most.
Linear drive or a better DSP closes enough of the power gap at the current lane rate (deck 01's interactive).
These are the arguments as engineering trade-offs, not a forecast; the vendor claims of slide 04 are the evidence so far, and they come from the companies selling CPO.
12
What to Take Away
CPO shortens the electrical channel from a faceplate host trace (VSR: up to 16 dB at Nyquist) to millimetres on the package (XSR: up to 50 mm; XSR+: up to 13 dB bump to bump), removing the module DSP and most of the equalisation.
OIF has defined the pieces: a framework (2022), a 3.2T module (2023), the external laser module ELSFP (2023, revised 2025) and the XSR+ lane (2024).
Vendors claim 50–70% lower optical interconnect power (Broadcom) and 3.5× better power efficiency (NVIDIA) against their own pluggable baselines; the interactive shows how such numbers follow from per-stage assumptions.
The price is serviceability, heat and fibre: lasers moved to the faceplate, known-good engines, detachable fibre and tuning against a hot substrate.
Optical I/O chiplets bring the same idea to processors, with many wavelengths at modest rates (Intel: 64 × 32 Gb/s; Ayar Labs: 4 to 8 Tb/s), at vendor-claimed energies near 5 pJ/bit.