A Linux Foundation Project
Osmosis · Open Coherent Interconnect

Osmosis: An Open, Auditable Coherent Interconnect for POWER

OpenCAPI delivered direct, cache-coherent, high-bandwidth connectivity between POWER processors and accelerators — specified publicly, proven in production, and still fully documented. Osmosis is the OpenPOWER Foundation initiative to bring this technology forward as the open coherent interconnect for sovereign AI compute. The specs are archived. The reference designs are on GitHub. The opportunity is now.

Support This Initiative View Archived Specs ↗
Background

What Osmosis Is Built On

Osmosis is built on the OpenCAPI specification — a direct, cache-coherent, high-bandwidth interface between POWER processors and accelerators. Open, auditable, and implementable by anyone.

The open interconnect opportunity: Coherent accelerator fabric — the technology that enables direct, low-latency connectivity between processors and AI accelerators at memory speeds — has historically required fully auditable, open specifications. OpenCAPI provided exactly that: a fully documented, publicly specified standard proven in production across OpenPOWER systems at banks, national labs, and hyperscalers. Osmosis brings this forward.

Conventional Accelerator Interconnect

The Challenge

  • Data must be copied into accelerator memory before processing
  • DMA overhead adds 1,200–1,800 ns per accelerator request
  • Every inference request pays the transfer tax twice
  • Specification and implementation tied to a single vendor
  • Third-party accelerator integration is complex and constrained
  • AI inference at scale is limited by data movement, not compute
  • Regulated industries cannot audit a closed accelerator fabric
Osmosis / OpenCAPI — Open Standard

OpenCAPI 3.0 (Osmosis baseline)

  • Up to 400 GB/s aggregate (25 Gbps × 8 lanes × 2)
  • Cache-coherent CPU↔accelerator, FPGA, HSM, SmartNIC
  • Dedicated SerDes on OpenPOWER processor die — no PCIe path
  • Sub-microsecond latency, lower than PCIe by design
  • Public specification — anyone can implement
  • Open-source FPGA reference designs on GitHub
  • Any vendor's accelerator can attach — fully auditable

Technical Specification

Signaling 25 Gbps PAM-4 SerDes, dedicated lanes on OpenPOWER processor die
Coherency model Full cache coherency — accelerator participates in the processor memory domain
Latency Sub-microsecond; deterministic, not subject to PCIe switch hops
OMI (Open Memory Interface) OpenCAPI extension for coherent memory expansion — up to 410 GB/s per socket on OpenPOWER systems
Specification status Publicly archived at CXL Consortium; OpenCAPI 3.0 Transaction Layer and PHY specs available for download
Open-source IP OC-Accel FPGA framework, OpenCAPI3.0_Client_RefDesign, and OMI device designs on GitHub (OpenCAPI org)
Deployed in OpenPOWER systems (2018 onwards) — production deployments at banks, hyperscalers, and national labs
History

The OpenCAPI Foundation — and the Osmosis Opportunity

In August 2022, the OpenCAPI Consortium transferred its trademarks and specifications to the CXL Consortium. The specifications remain fully public, the reference designs are on GitHub, and the technology is proven. Osmosis is the path forward — bringing these assets under active OPF stewardship.

2016 — Consortium Founded

IBM, Xilinx, Mellanox, Micron, Google, Toshiba Memory, and HPE form the OpenCAPI Consortium. Specification released publicly. First silicon ships on an OpenPOWER processor.

Complete

2021 — Proven at Scale

OpenPOWER systems ship with OpenCAPI / OMI controllers per socket, delivering 410 GB/s memory bandwidth — validating the technology across production deployments at banks, national labs, and hyperscalers.

Complete

2022 — Consortium Dissolves

OpenCAPI Consortium signs letter of intent to transfer all assets — trademarks, specifications, OMI spec — to the CXL Consortium. Open-source GitHub IP remains available.

IP transferred
!

Today — Osmosis Launch

Specs are archived and downloadable. FPGA reference designs are on GitHub. OPF is working with the original consortium founders to secure a formal patent license that enables the community to build confidently.

Action needed

What Osmosis Delivers

Patent license secured → FPGA reference implementation officially sanctioned → third-party POWER licensees add OpenCAPI ports to ASIC designs → complete open coherent accelerator fabric for sovereign AI compute.

Unlocked by this initiative

Osmosis and CXL are complementary, not competing: CXL is a PCIe protocol — it runs on the PCIe physical layer and excels at memory pooling and disaggregation. OpenCAPI used dedicated high-speed SerDes wired directly to the POWER memory fabric, designed for tight-coupled, cache-coherent, accelerator-attached-at-processor-speed workloads. They solve different problems. Osmosis fills the gap for the coherent, low-latency, high-bandwidth use case that no open standard currently addresses.

Strategic Case

Why Osmosis Matters for Sovereign AI

Sovereign AI programs require every layer of compute infrastructure to be auditable and open — including the interconnect between processor and accelerator. Osmosis is the only initiative building that open coherent fabric.

Sovereign Programs Need Open Interconnects

Governments and regulated enterprises building sovereign AI compute need every layer of the stack — including the accelerator interconnect — to be fully auditable. Osmosis is the only initiative building an open, documented, coherent accelerator fabric for this market.

Full-Stack Auditability

For financial regulators, intelligence agencies, and healthcare systems, the interconnect between processor and accelerator sits inside the trust boundary. OpenCAPI's specification was fully public — every layer inspectable — and Osmosis preserves and extends that openness.

The Pieces Already Exist

The specifications are archived and downloadable. The FPGA reference designs are live on GitHub. Microwatt (OPF's open POWER soft core) runs on commodity FPGAs. The only missing piece is a clear IP license that allows the community to build without legal uncertainty.

The Ask

Partnering With the Founders

The original OpenCAPI Consortium founding members built the technology that Osmosis is building on. We are inviting each of them to formally grant royalty-free (or FRAND) patent coverage to OpenPOWER Foundation members — the same model that made the POWER ISA an open ecosystem.

IBM
Primary inventor. Holds core POWER-specific SerDes and transaction layer patents. Already granted POWER ISA to OPF — this is the natural extension.
Founding Partner Invited
AMD / Xilinx
Xilinx contributed FPGA-side implementation IP and PHY patents. Now AMD. Open-source reference designs already exist on GitHub under their stewardship.
Founding Partner Invited
NVIDIA / Mellanox
Mellanox contributed network adapter and SmartNIC implementation patents before acquisition by NVIDIA. Now holds those rights.
Founding Partner Invited
Micron Technology
Contributed memory-side OMI interface IP and DDIMM implementation patents. OMI is foundational to OpenCAPI's memory expansion capability.
Founding Partner Invited
Google
Contributed accelerator endpoint and coherency protocol patents as a founding data-centre consumer of the standard.
Founding Partner Invited
Kioxia / Toshiba Memory
Contributed storage-class memory interface IP in the original consortium.
Founding Partner Invited

Built on precedent: In 2019, IBM transferred the POWER ISA to the OpenPOWER Foundation under an open licence. That single act unlocked an entire ecosystem of open processors, compilers, and firmware. An OpenCAPI patent license grant completes the open hardware stack from ISA to interconnect — the same proven model applied to a new layer.

If This Succeeds

What Osmosis Enables

With the patent license in place, a community that already has the specs, the reference designs, and the processor ISA can move forward with confidence — from FPGA prototypes to ASIC integration to a complete open sovereign stack.

Near Term — FPGA

Wire the existing OC-Accel FPGA framework into Microwatt (OPF's open POWER soft core). Running today on commodity FPGAs. An IP grant makes this a formally sanctioned OPF reference implementation — opening the path for every OPF member to build on a legally clear foundation.

Medium Term — Third-Party ASICs

POWER ISA licensees building their own chips — including emerging fabs in India, Africa, and Southeast Asia — can add OpenCAPI ports to their designs. The foundry SerDes IP is available from TSMC and Samsung on standard process nodes.

Medium Term — Open Accelerator Cards

Vendors building inference accelerators, HSMs, and SmartNICs for the POWER ecosystem can implement OpenCAPI endpoints — enabling direct memory-coherent AI inference offload with lower latency and higher bandwidth than PCIe.

Long Term — Complete Open Stack

Open ISA (POWER) + open coherent fabric (OpenCAPI) + open accelerator designs + open firmware (OpenBMC/OpenFSP) = a fully auditable, sovereign AI compute stack with no closed components in the critical path.

Resources

Start Building Now

While the IP grant process is underway, the existing open-source implementations are available for development and evaluation.

Support the Osmosis

If your organisation depends on open, auditable compute infrastructure — or if you represent one of the founding consortium members — we want to hear from you. The path from archived spec to working open ecosystem starts with this conversation.