Optical Technology for Data Centres — Presentation 02

Co-Packaged Optics and Optical I/O

Moving the optics from the faceplate onto the switch or processor package: why the electrical channel is the problem, optical engines and external lasers, the OIF agreements, what vendors have announced and claim, serviceability, heat and fibre, and optical I/O chiplets for compute.

CPO Optical engine ELSFP XSR Optical I/O pJ/bit
Switch die → mm of substrate → Optical engine → Fibre to the faceplate
00

Topics We'll Cover

Concepts used here, and where they are explained. Each links to a glossary entry: this series glossary, the Silicon Photonics Fundamentals glossary for device physics, or the glossaries of other sister series for concepts they already explain.

01

Why Move the Optics Into the Package

In a pluggable design each lane leaves the switch die, crosses the package and many centimetres of board to a faceplate cage, and is re-timed in the module (deck 01). Co-packaged optics (CPO) puts the optical engine on the switch's own package substrate, millimetres from the die, so the electrical channel nearly disappears.

Electrical channelWhat it spansLoss or reach allowedSource
CEI-112G-VSRSwitch to a pluggable module, with one connectorUp to 16 dB at NyquistOIF (OFC 2020)
CEI-112G-XSRDie to die, or die to optical engineReach up to 50 mmOIF (project page)
CEI-112G-XSR+Die to die and die to optical engine, for multi-chip modules, CPO and near-packaged opticsBump-to-bump loss up to 13 dB at Nyquist, 36–58 GBdOIF (press release, January 2024)
02

Anatomy of a Co-Packaged Switch

package substrate switchASIC optical engines front panel ELSFP laser ELSFP laser fibreconnectors laser light in (PM fibre)data fibre out
03

The OIF Agreements

DocumentDateWhat it defines
Co-Packaging Framework Document (OIF-Co-Packaging-FD-01.0)February 2022The application spaces and the interfaces to be standardised for co-packaging (PDF)
3.2 Tb/s Co-Packaged Module IA (OIF-Co-Packaging-3.2T-Module-01.0)March 2023An optical module with 8 × 400G optical interfaces (FR4 or DR4) behind 32 CEI-112G-XSR host lanes (or 32 CEI-56G-XSR for backward compatibility), for Ethernet switching; the first project under the framework (PDF)
External Laser Small Form Factor Pluggable IA (OIF-ELSFP-01.0)August 2023A front-panel, hot-swappable laser module with a blind-mate multi-fibre optical connector at the rear (press release); revision 02.0 in January 2025 (PDF)
CEI-112G-XSR+ IAJanuary 2024Die-to-die and die-to-optical-engine electrical lanes, up to 13 dB bump to bump (press release)
04

What Switch Vendors Have Announced

AnnouncementCapacity and buildWhat the vendor claimsSource
Broadcom “Humboldt” (2022, with Tencent)Tomahawk 4, 25.6 Tb/s, four 3.2 Tb/s enginesMore than 50% saving in optical interconnect power against pluggablesBroadcom
Broadcom “Bailly” (March 2024)Tomahawk 5, 51.2 Tb/s, eight 6.4 Tb/s engines70% lower optical interconnect power; 8× better silicon area efficiencypress release
Broadcom “Davisson” (October 2025)Tomahawk 6, 102.4 Tb/s, sixteen 6.4 Tb/s engines70% reduction in optical interconnect power, more than 3.5× lower than pluggablespress release
NVIDIA Spectrum-X and Quantum-X Photonics (March 2025)1.6 Tb/s per port; Spectrum-X 128 × 800G or 512 × 200G (100 Tb/s), with a 400 Tb/s variant; Quantum-X 144 × 800G InfiniBand on 200G SerDes, liquid-cooled4× fewer lasers, 3.5× more power efficiency, 63× greater signal integrity, 10× better network resiliency, 1.3× faster deployment; Quantum-X later in 2025, Spectrum-X in 2026press release
05

Interactive: Energy Along the Electrical Path

Energy per bit for one switch port, added up stage by stage for three architectures: a DSP-retimed pluggable (host VSR SerDes, module DSP, optics, laser), a linear-drive pluggable (no DSP, some extra host effort) and co-packaged optics (a short XSR lane, optics, external laser). Every default is illustrative, chosen to be consistent with deck 01's interactive (a DSP module near 11 W at 800G); set them from a datasheet to test a vendor's claim.

51.2
2.50
1.00
6.00
1.25
5.00
2.00
Pluggable (DSP)
—
Linear-drive pluggable
—
Co-packaged
—
CPO saving vs DSP
—
Optics power, DSP
—
Optics power, CPO
—

Limits: one direction of a link counted once; the same optics and laser energy for all three, though CPO engines can use lower-swing drivers and different lasers; the switch core's power is excluded, as in the vendors' “optical interconnect power”. Power is energy per bit × capacity.

06

Optical I/O for Compute

The same idea applied to processors: an optical chiplet in the GPU, CPU or memory package replaces long electrical links for scale-up and memory traffic (deck 04). Unlike switch CPO, which serves standard Ethernet ports, optical I/O chiplets often run many wavelengths at modest rates per wavelength.

AnnouncementWhat the vendor claimsSource
Ayar Labs TeraPHY with SuperNova light source (OFC 2023)4 Tb/s bidirectional, below 5 pJ/bit (10 W), latency below 10 nspress release
Ayar Labs UCIe optical chiplet (March 2025)8 Tb/s TeraPHY with a 16-wavelength SuperNova source; described as the first UCIe optical chipletpress release
Intel Optical Compute Interconnect chiplet (2024 prototype)Up to 4 Tb/s bidirectional: 64 lanes at 32 Gb/s each way on 8 fibre pairs × 8 DWDM wavelengths, up to 100 m, on-chip lasers; 5 pJ/bit against about 15 pJ/bit for pluggable modulesIntel newsroom
07

Serviceability and Reliability

What is lost

  • A failed pluggable is swapped in a minute; a failed optical engine may mean replacing the whole switch package.
  • Every engine must be known good before assembly: one bad engine scraps a high-value substrate.
  • Mixing reaches and port types on one switch is harder when the optics are fixed at manufacture.

How designs answer it

  • Pluggable external lasers (ELSFP, slide 03): the part most likely to fail stays replaceable.
  • Redundancy and spare lanes in the engines and laser sources.
  • Detachable fibre connectors at the engine, so fibre can be attached after test and replaced (slide 09).
08

Heat Next to the ASIC

09

Fibre at Scale

51.2 Tb/s of 100 Gb/s lanes (512 lanes)Fibres per directionData fibres in total
Parallel single-mode, one lane per fibre (DR)5121,024
Four wavelengths per fibre (FR4)128256
Eight wavelengths per fibre64128

Arithmetic: lanes ÷ wavelengths per fibre, doubled for the two directions; laser feed fibres are extra. The OIF 3.2T module offers both DR4 and FR4 optics (slide 03).

10

Near-Packaged Optics and Other Middle Grounds

OptionWhere the optics sitElectrical channelKeepsGives up
DSP pluggableFaceplate moduleHost board, VSRReplaceability, interoperabilityPower, faceplate density
Linear-drive pluggableFaceplate moduleHost board, linearReplaceabilityMargin, a split link (deck 01)
Near-packaged opticsOn the board next to the packageShort board traceSome separation of optics and ASICFaceplate replaceability
Co-packaged opticsOn the package substrateXSR, millimetresLowest electrical energyField replacement of optics
Optical I/O chipletIn the compute packageDie-to-dieBandwidth density at the die edgeStandard Ethernet optics
11

When CPO Wins, and When Pluggables Do

CPO's case is strongest when

  • The switch is at the largest radix and lane rate, so the host channel is longest and lossiest.
  • All ports are the same type and reach (an AI back-end fabric is the clearest case).
  • Power and cooling, not optics cost, limit how many accelerators a building can hold.
  • The operator buys the switch, optics and lasers as one system.

Pluggables keep winning when

  • Ports need different reaches and media (front-end and data-centre interconnect).
  • Field replacement per port and multi-vendor sourcing matter most.
  • Linear drive or a better DSP closes enough of the power gap at the current lane rate (deck 01's interactive).

These are the arguments as engineering trade-offs, not a forecast; the vendor claims of slide 04 are the evidence so far, and they come from the companies selling CPO.

12

What to Take Away