EVPN-VXLAN fabrics for 400G and 800G data centers

IP Infusion delivers the complete data center fabric: OcNOS-DC preloaded on qualified switches from 100G to 800G, under one support contract. Leaves run EVPN-VXLAN with a distributed anycast gateway and EVPN multihoming, and spines carry the IP underlay. Add switches to grow.

900+operators run OcNOS
60+countries
18qualified data center switches

How the fabric works

A data center fabric connects every server in the building. In a leaf-spine design every leaf reaches every other leaf through one spine, EVPN-VXLAN lets many tenants share the fabric in isolation, and dual-homed servers stay reachable when a leaf goes down.

EVPN-VXLAN leaf-spine data center fabricTwo spines connect to three leaves and a border leaf. Server racks for two tenants attach to the leaves, and the border leaf connects the fabric to the WAN.Ethernet segmentSpine-01Spine-02Leaf-01VTEPAnycast gatewayLeaf-02VTEPAnycast gatewayLeaf-03VTEPAnycast gatewayNew leafVTEPBorder leafEVPN L3 gatewayDownTenant ATenant BTenant ANew rackWANWorkload moves, same gateway
Tenant ATenant BIllustrative

Each tenant gets its own VRF and VNIs. Only prefixes you permit cross between them.

A server links to two leaves on one Ethernet segment. If one leaf goes down, traffic keeps flowing through the other, with no peer-link. MLAG is supported too.

EVPN multihoming →

A distributed anycast gateway lets a workload move between racks without re-addressing.

EVPN-VXLAN →

Add leaves for servers and spines for bandwidth. The rest of the fabric stays as it is.

BGP underlay →

Running in production

Data center operators that moved to OcNOS on open switches.

Madeo Consultant, France

Replaced its incumbent switches with OcNOS on Edgecore and UfiSpace.

“We are now delivering software as a service more efficiently, thanks to the increased performance and future-proofing achieved with IP Infusion’s solution.”

François Defrocourt, Solutions Engineer

Scott Data, Omaha

Runs OcNOS on UfiSpace, Edgecore and Celestica. Lead times went from years to weeks.

“OcNOS and an open networking strategy hits all the right notes in terms of cost, support, and features.”

Ken Moreano, CEO

Technical summary

What OcNOS-DC runs in the fabric. Follow a link for the deep dive.

OcNOS-DC data center fabric technical summary
Area OcNOS-DC Deep dive
Overlay EVPN-VXLAN for Layer 2 and Layer 3: IRB with a distributed anycast gateway, and EVPN prefix routes (Type 5) for tenant subnets.
Underlay BGP unnumbered with extended next hop, ECMP for VXLAN traffic, and BFD for fast failure detection.
Multihoming EVPN multihoming for dual-homed servers, with no peer-link. MLAG is supported too.
Tenancy Per-tenant VRFs and VNIs, inter-VRF route leaking, route-target filtering, and EVPN MAC limits.
Border and DCI EVPN Layer 3 gateway and VXLAN Layer 3 stitching at the border leaf, with 400G OpenZR+ optics on supported switches.
Security Storm control, ARP ACLs, dynamic ARP inspection and ACLs on IRB interfaces.
Visibility gNMI streaming telemetry using OpenConfig models, SNMP VXLAN statistics, and ERSPAN on VXLAN access ports.
Automation ZTP over IPv4 and IPv6, Ansible, and NETCONF with YANG models.
Lossless traffic PFC and ECN for RoCEv2 traffic across the VXLAN fabric.

Support varies by switch model. Check each platform in the OcNOS Feature Matrix.

Switches by role

18 qualified data center platforms from Edgecore, UfiSpace and Celestica.

Edgecore AS9726-32DB 400G leaf switch

Leaf and interconnect leaf

Edgecore AS9726-32DB / UfiSpace S9300-32D

Broadcom Trident 4 · 12.8 Tbps · 400G

The AS9726-32DB also seats a 400G OpenZR+ optic for the interconnect.

Datasheet →
Edgecore AS9736-64D 400G spine switch

Spine (400G)

Edgecore AS9736-64D

Broadcom Tomahawk 4 · 25.6 Tbps · 64 x 400G

Underlay ECMP and EVPN route reflection, sized for fabric width.

Datasheet →
Edgecore AIS800-64D 800G spine switch

Spine and super-spine (800G)

Edgecore AIS800-64D / UfiSpace S9321-64E

Broadcom Tomahawk 5 · 51.2 Tbps · 64 x 800G

800G spine ports for wider fabrics.

Datasheet →
Edgecore AS7726-32X 100G leaf switch

100G leaf / ToR

Edgecore AS7726-32X / UfiSpace S9110-32X

Broadcom Trident 3 · 3.2 Tbps · 100G

Access leaves for 25G and 100G server racks.

Datasheet →

Optics have proven multi-vendor interoperability. Ask us for the transceiver list. See every qualified platform.

One system, one contract

Bought as OcNOS Systems: switch, OcNOS-DC and support from one vendor.

Qualified build

OcNOS-DC preloaded, qualified per switch model and ASIC stepping.

One support path

One PO, one support contract, one RMA path. P1 response from 8 hours (Standard) to 30 minutes (Enterprise).

Zero-touch Day 0

A new switch pulls its configuration and joins the fabric. No console session.

Day 2 operations

gNMI, NETCONF, OpenConfig and Ansible. Refresh switch and software on their own cycles.

Two sites, one routed interconnect

Border leaves join two fabrics at Layer 3 over 400G OpenZR+.

Two data center fabrics joined by a routed 400G OpenZR+ interconnectSite A and Site B each run an EVPN-VXLAN leaf-spine fabric. Their border leaves stitch the fabrics at Layer 3 and light a 400G OpenZR+ link between the sites, carrying each tenant's routes as EVPN Type-5 routes.Site ASite B400G OpenZR+EVPN Type-5 routesLeaf A1VTEPLeaf A2VTEPSpine AunderlayBorder AL3 gatewayBorder BL3 gatewaySpine BunderlayLeaf B1VTEPLeaf B2VTEP● Tenant A● Tenant B

Layer 3 stitch

Each border leaf stitches its VXLAN domain to the other site. No flat Layer 2 stretch.

Per-tenant routes

EVPN Type-5 routes carry each tenant's prefixes. Isolation holds across both sites.

No transponder

A 400G OpenZR+ optic in the switch port lights the wavelength.

Frequently asked questions

An EVPN-VXLAN leaf-spine data center fabric is a scale-out network that grows by adding switches. Every leaf is a VXLAN tunnel endpoint, BGP carries the underlay between leaf and spine, and EVPN advertises MAC and IP host routes, as well as IP prefixes, so the fabric learns reachability in the control plane instead of by flood and learn. IP Infusion delivers it as one system: the switch, OcNOS-DC pre-loaded, and one support contract, with a distributed anycast gateway, EVPN multihoming, and multi-tenant VRF isolation.
Each tenant gets its own set of VXLAN network identifiers (VNIs): Layer 2 VNIs carry bridged traffic and Layer 3 VNIs carry routed traffic inside a per-tenant VRF. Because traffic is encapsulated per VNI and routed inside a VRF, one tenant cannot see another tenant on the shared fabric. Where two tenants need to reach each other, inter-VRF route leaking over EVPN-VXLAN passes only the specific prefixes you permit, so isolation stays the default and sharing is explicit. Support for routed tenants varies by switch model; check each platform in the OcNOS Feature Matrix.
EVPN multihoming lets a server attach to two or more leaves on one Ethernet segment (ESI), in single-active or port-active mode, so if a leaf or link fails the server's traffic moves to the other leaf. It is signaled entirely in the EVPN control plane, so there is no dedicated peer-link and no proprietary pairing between the leaves. MLAG, by contrast, pairs exactly two switches over a peer-link and runs active-active. OcNOS-DC supports both, so a design that needs both links forwarding at once can use MLAG.
The border leaf in each fabric connects the two fabrics at Layer 3 with the EVPN Layer 3 gateway and VXLAN Layer 3 stitching, and each fabric advertises its tenant IP prefixes to the other as EVPN IP-prefix routes, with per-tenant VRF isolation kept across the sites. For the transport, a 400G OpenZR+ coherent optic in the port of a ZR+ capable switch lights the wavelength directly, so there is no separate transponder. For the optics deep dive, see the routed-optical solution, and for the coherent reach math see the coherent DCI technology page.
Yes. OcNOS-DC runs what an EVPN-VXLAN leaf-spine fabric needs on merchant-silicon switches: EVPN-VXLAN with a distributed anycast gateway, EVPN multihoming, a BGP-unnumbered underlay, multi-tenant VNIs, and ZTP with gNMI and NETCONF for operations. Madeo Consultant replaced its incumbent switches with OcNOS on Edgecore and UfiSpace. IP Infusion delivers the switch, the software, and the support as one system under one contract, so you can source hardware from more than one vendor and refresh the switch and the software on their own cycles. Support varies by switch model.
A new switch boots and pulls its configuration through Zero Touch Provisioning, so a switch goes from the box to a production leaf without a console session. From there the fabric is operated with streaming telemetry over gNMI, NETCONF and OpenConfig models, and Ansible, and the same models let you push and verify EVPN and VXLAN state as code. IP Infusion ships the switch with OcNOS-DC preloaded and a Day 0 baseline, so every leaf and spine starts from a known configuration.

Map your fabric with our engineers

Tell us your racks, tenants and sites. We match them to qualified switches.