How does OCI guarantee predictable network bandwidth?
In the world of cloud computing, "variable performance" is often the hidden tax you pay for using shared infrastructure. Most providers oversubscribe their networks, assuming not everyone will use their full bandwidth at once.
Oracle Cloud Infrastructure (OCI) takes a different approach. To guarantee predictable network bandwidth and ultra-low latency, OCI uses a combination of specialized physical topology and hardware-based virtualization.
Most traditional data centers use a "hierarchical" tree structure where many servers are funneled into a single core switch. This creates a bottleneck (oversubscription) at the top.
OCI uses a Flat, Non-Blocking Clos Network (specifically a 3-stage Folded Clos or "Fat-Tree" topology).
No Oversubscription: OCI designs its network with a 1:1 subscription ratio. This means every server can communicate at its full advertised line rate (e.g., 25 Gbps or 100 Gbps) simultaneously without competing for bandwidth at the switch level.
Deterministic Paths: In this architecture, there are many equal paths between any two points in the data center. OCI uses ECMP (Equal-Cost Multi-Path) routing to spread traffic across these paths, ensuring that no single link becomes a hotspot.
In a typical cloud, the "network" is actually software running on the host CPU. If that CPU gets busy, your network performance drops—a phenomenon known as "jitter."
OCI removes this variable by using Off-box Network Virtualization.
Dedicated Hardware: The network stack (encapsulation, security rules, and routing) is moved to a custom SmartNIC (the Cloud Control Computer) outside the host server.
CPU Isolation: Because the host CPU is never interrupted to process network packets for the cloud's management layer, your application gets 100% of the network throughput it was promised, 100% of the time.
OCI doesn't just "hope" the bandwidth is there; they enforce and guarantee it through two mechanisms:
When you launch an instance, the bandwidth is "hard-capped" based on the shape. For example, a VM with 1 OCPU might get 1 Gbps, while a larger shape gets 40 Gbps. Because the network is non-blocking (see Step 1), OCI knows the physical capacity is always available to meet that cap.
Oracle is unique in offering a Performance SLA. While most providers only guarantee "Availability" (uptime), OCI’s SLA covers:
Availability: Is the network up?
Manageability: Can you manage your network resources?
Performance: Does the network consistently deliver the latency and throughput specified?
If the network underperforms relative to its baseline, Oracle provides service credits, which is a powerful incentive for them to maintain a non-congested physical plant.
For the most demanding workloads (like AI training or CFD simulations), OCI offers Cluster Networking using RoCE v2 (RDMA over Converged Ethernet).
Direct Memory Access: This allows servers to bypass the OS kernel and talk directly to each other's memory.
Dedicated Rails: These instances are connected via a secondary, high-bandwidth "rail" (up to 1600 Gbps in 2026 superclusters) that is physically separate from the standard VCN traffic. This ensures that a massive data backup on the standard network won't slow down a high-speed AI training job.
| Feature | Traditional Cloud | OCI Architecture |
| Topology | Oversubscribed (Hierarchical) | Non-blocking (Clos) |
| Virtualization | In-Kernel (Software) | Off-box (Hardware) |
| Bandwidth | "Up to" (Best effort) | Guaranteed (Shape-based) |
| Guarantees | Uptime only | Performance SLAs |