We ratcheted the test up by turning on a 100-line access list on each box. We set up the access list so that the IP packets made it do a lookup on all 100 lines for every packet that came through, with a permit on the very last line. We also cranked up the difficulty on the Ixia box by setting it so that as it was doing the throughput tests, it would cycle through 10,000 unique IP addresses. This challenges the device under test, which will attempt to cache IP flows to increase the efficiency of the lookups. We were impressed that, in spite of this stress, both the Extreme and the Foundry boxes nailed this test, maintaining the exact same levels of throughput they experienced without access lists turned on.
We then turned on QoS and sent alternating high- and low-priority packets with corresponding settings to the ToS (Type of Service)/DiffServ (Differentiated Services) bits. We observed how well the devices could handle having their bandwidths oversubscribed. To accomplish this, we added an extra 1 gigabit of input, so that the ports capable of 8 gigabits of output had to deal with the normal maximum traffic plus an extra gigabit's worth. We made sure there was always enough bandwidth to handle the high-priority traffic by itself, then checked to see if all the high-priority traffic arrived. We also varied the number of high- and low-priority packets sent at one time. We started by alternating between three high- and three low-priority packets, which is the lowest the Ixia device could handle, and worked our way up, sending larger bursts of each kind of traffic. Both the BlackDiamond and BigIron did fine ... until we started hitting 500-packet bursts. At this point, the Foundry box started dropping some high-priority packets. By the time we got to 10,000-packet bursts, the BigIron didn't appear to be giving any preference to the high-priority packets. The company said it performed a similar test (with better results) with a Spirent Communications' SmartBits box, but it was with beta software. We suspect that the SmartBits test was sending different traffic patterns.
It's worth mentioning that the Foundry box did better with QoS tests when we exceeded the 8-gigabit capacity on the input ports with the Ixia tester, which was easily able to generate a full 10 Gbps of traffic. Because the BigIron does QoS on incoming traffic, it performed better than the BlackDiamond. Extreme doesn't prioritize traffic as it comes into the interface but pointed out that it would have done better if flow control were turned on. In reality, it's unlikely either box would be connected to another device capable of generating a full 10 Gbps of traffic, though it's likely that each vendor will release next-generation equipment that doesn't have the 8-gigabit constraint. We also discovered that the Foundry BigIron is set up so that it always gives higher priority to traffic from 1-gigabit ports than to traffic from 10-gigabit ports. We'd prefer more flexibility.
Interoperability Tests
While it's all well and good to adhere to a standard, it's not worth much if you can't play nice with other vendors' devices in the real world. With this in mind, we plugged the Foundry and Extreme boxes directly into each other via one 10-gigabit port each. We used the remaining 10-gigabit ports to connect each box back to the Ixia tester. We then ran throughput tests for all the packet sizes and found no compromise in performance.
Not wanting to let them off so easy, we dug up a Net Optics tap to work into the mix. The Net Optics device is designed to tap into the data stream and reproduce it out another port for an analyzer without causing disruption. We put the Net Optics tap between the switches and successfully reran the throughput tests. This proved not only that the Foundry and Extreme switches could interoperate with another vendor's product, Net Optics' tap, but that the Net Optics box is able to tap into a 10-gigabit connection without interfering with performance. When an 802.3ae analyzer does become available, the tap will be ready for Foundry and Extreme.
While we were impressed with both products, we gave our Editor's Choice nod to Extreme because the BlackDiamond edged out Foundry's BigIron by offering slightly superior performance with QoS enabled and better pricing. However, we would not hesitate to recommend either device--the vendors comprise an elite group willing to subject their equipment to rigorous testing. Think of it this way: It's nice to win the Super Bowl, but it's also an accomplishment to make it to the game and more than hold your own.
REPORTS
Analyize In-Line NAC strategies and products.
ANALYTICS Plan and design your enterprise blade server deployments
InformationWeek U.S. IT Salary Survey 2008
Salaries for business technology professionals are falling. Here's what you need to know in order to make good hiring decisions and personal career choices. Purchase Today: $299
REPORTS
ANALYTICS
Follow 
