IBM’s Breakthrough in Optical Technology

Technology giant IBM has unveiled breakthrough research into optics technology that could significantly enhance how data centers train and operate generative AI (Gen AI) models.

The company’s co-packaged optics innovation is set to replace traditional electrical interconnects in data centers, promising remarkable gains in speed and energy efficiency for AI and various computing applications.

Researchers at IBM have developed a new process for co-packaged optics (CPOs) that enables connectivity within data centers at light speed. This innovation could redefine how high-bandwidth data is transmitted between chips, circuit boards, and servers.

Revolutionizing Connectivity

Fibre optic technology is instrumental in managing most of the world’s communications traffic by transmitting data using light instead of electricity. However, while external communications networks utilize fibre optics, internal connections within data centers predominantly rely on copper electrical wires.

These copper wires connect GPU accelerators that frequently experience downtime while waiting for data from other sources, leading to substantial costs and energy consumption.

This groundbreaking research aims to facilitate:

• Over a 5x reduction in power consumption, potentially lowering costs for scaling Gen AI.

• Extending data center interconnect cable lengths from one meter to hundreds of meters.

• Accelerated AI model training, enabling developers to enhance large language models (LLMs) up to five times faster.

• Energy savings equivalent to that used by 5,000 US homes, which would greatly increase overall energy efficiency for data centers.

IBM researchers have demonstrated that it is possible to harness the speed and capacity of optics technology within data centers. The new CPO prototype module can significantly heighten data center communication bandwidth, thereby reducing GPU downtime and expediting AI processing.

Dario Gil, IBM Senior Vice President and Director of Research, noted, ‘As Gen AI demands more energy and processing power, the data center must evolve – and co-packaged optics can make these data centers future-proof.’

Enhancing Bandwidth Between Chips

As chip technology advances, transistors have become densely packed onto chips. The aim of IBM’s CPO technology is to enhance the interconnection density between accelerators. This advancement will enable chipmakers to add optical pathways connecting chips beyond the limitations of current electrical pathways.

IBM anticipates that these new high bandwidth density optical structures, integrated with the ability to transmit multiple wavelengths, could amplify bandwidth between chips by as much as 80 times compared to existing electrical connections.

The innovation presents an opportunity for chipmakers, allowing them to embed six times more optical fibres at the edge of a silicon photonics chip. Each fibre, being substantially thin, can extend from a few centimeters to hundreds of meters in length while transmitting terabits of data per second. Dario added, ‘With this breakthrough, tomorrow’s chips will communicate much like how fibre optics cables carry data in and out of data centers, ushering in a new era of faster, more sustainable communications that can handle the AI workloads of the future.’

• 0 Comments
• IBM
• Optical Technology