Network Computing is part of the Informa Tech Division of Informa PLC

This site is operated by a business or businesses owned by Informa PLC and all copyright resides with them. Informa PLC's registered office is 5 Howick Place, London SW1P 1WG. Registered in England and Wales. Number 8860726.

Ethernet Technology Grows Up--And Out: Page 2 of 2

Not Your Father's Ethernet
The FCoE protocol, like native Fibre Channel, requires the underlying physical transport to be lossless. As a result, vendors have developed extensions to the Ethernet standard specifically for lossless 10-Gbps Ethernet speeds and data center fabrics, which could carry all types of traffic. These extensions to the Ethernet standard are referred to collectively as "Converged Enhanced Ethernet," or CEE (by Brocade and others); or "Data Center Ethernet," or DCE (by Cisco). Cisco DCE extensions are a superset of the CEE extensions, and there's no consensus on what the final group of standards will look like. For the sake of simplicity, we'll use the term "enhanced Ethernet."

Enhanced Ethernet includes features that make it suitable as a universal I/O fabric for the data center, with the ability to transport storage payloads without the overhead of TCP/IP, and without packet loss.

FCoE requires enhanced Ethernet, which in turn requires 10-Gbps Ethernet-capable chipsets and hardware, including network adapters and switches. Cisco's DCE-capable Nexus 5000 switch is available for "top-of-rack" applications in 20- and 40-port models. The larger chassis-and-blade-based Nexus 7000 is designed primarily as a data center aggregation switch, but 10-Gb line cards with DCE extensions are scheduled to ship this year. Emulex, Intel, and QLogic are shipping DCE-capable 10-Gbps Ethernet NICs designed to work with Cisco's Nexus 5000 unified fabric. Brocade will likely ship FCoE-compatible products later this year.

Unfortunately, enhanced Ethernet requires new chipsets, so "standard" 10-Gbps Ethernet NICs and switches now shipping won't be compatible with extended 10-Gbps Ethernet; new hardware will be required.

When One Is Better Than Two
Enhanced Ethernet can carry multiple payload types, including TCP/IP and FCoE, so vendors are positioning it as the universal fabric for next-generation data centers, connecting servers with storage, IP networks, and other servers for clustering applications.

Data center architects and vendors dream of the perfect "unified" data center fabric, in which a single, high-performance fabric meets the needs of IP, storage, and interserver payloads. This is the promise of enhanced Ethernet and FCoE. A unified data center fabric provides some interesting business and technical benefits, including:

Less hardware and easier management. Only one pair of NIC cables is needed per server (for redundancy), instead of two NICs and two Fibre Channel host bus adapters. One set of switches is necessary instead of two, and there's only one data center to manage.

The Essentials
  iSCSI FCoE
Payload SCSI Fibre Channel
Transport TCP/IP over Ethernet Enhanced Ethernet
Network scope LAN, MAN, LAN Data center (non-WAN routable)
Server CPU overhead Medium to high Low
Speed 1 or 10 Gb 10 Gb
Works with standard Ethernet Yes No
Typical applications Small, midsize SANs Midsize, large SANs
Availability Now Later in 2009–2010

More flexibility and adaptability. A unified fabric is an enabler for next-generation virtualized data center architectures, where servers, storage, and other resources can be dynamically allocated to adapt to changing workloads and new applications, with fewer physical changes required. This plays nicely into the move to virtualize and automate the data center.

Lower power consumption. Fewer NICs, cables, and switches mean less wattage is needed. Reducing the number of components by one-half or more would provide substantial savings.

It's About Choices
At this point, iSCSI advocates will correctly point out that SANs built on standard Ethernet and iSCSI also represent a "unified" or "converged" data center architecture, albeit one that operates over TCP/IP with the associated advantages and limitations.

In reviewing the present state of Ethernet storage networks, and looking at what's coming next, several things are clear, while others fall into the "wait and see" category.

Deploying 10-Gbps Ethernet to the server is an easy decision, especially for connecting blade chassis and virtualized servers to the network. Because of its relative low cost and ease of implementation, iSCSI has earned a well-deserved role for entry- and midlevel storage network applications. The advent of lower-cost 10-Gbps Ethernet hardware will likely drive up the rate of adoption.

FCoE's biggest area of opportunity is higher-end storage systems, especially in enterprises, where iSCSI isn't prevalent. This is because FCoE promises to deliver performance similar to or better than Fibre Channel in all applications and integrate with the existing ecosystem of Fibre Channel SAN tools--and the skill sets of SAN administrators.

Many companies are interested in a high-performance unified fabric for the data center that retains Fibre Channel payloads and services but leverages the lower cost, lower power, and other benefits that come with a single fabric. The availability of lower-cost 10-Gbps Ethernet NICs and switches is sure to help drive deployments beyond just early-adopter companies. However, vendors still have to prove that FCoE and enhanced Ethernet can deliver on the promise of a unified fabric for the enterprise.

Vince Conroy is the CTO for FusionStorm; he leads the company's managed hosting and services operation. Write to him at Vince Conroy.