Networking

07:00 AM
Pablo Valerio
Pablo Valerio
Commentary
Connect Directly
Twitter
RSS
E-Mail
50%
50%

Can New Math Speed Up The Internet?

Scientists from Denmark, in collaboration with MIT and Caltech researchers, have developed a new way to transmit information over the Internet using mathematical equations instead of sending packets.

In 1977, Abraham Lempel and Jacob Ziv of the Israel Institute of Technology came up with the algorithms for LZ1 and LZ2 lossless data compression. At that time, the Internet was not even a dream. Packet switching was in diapers, and TCP/IP did not become standard until five years later. However, their research is the foundation of most data compression systems used today to transmit large quantities of data.

Now, a group of scientists from Denmark's Aalborg University, in collaboration with researchers from Caltech and MIT, want to introduce a new way to transmit information over the Internet that they claim is 5-10 times faster, using mathematical equations instead of sending packets.

Seem crazy? It looked like a hoax to me at first, but after reading the paper carefully, I came to the conclusion that the science is sound, and that the scientists have demonstrated its effectiveness.

Roughly 98% of telecommunicated information is being carried over the Internet today, versus 1% in 1993 and 53% in 2000 (registration required). According to the IEEE, though we have increased the speed of data transmission over the Internet from 300 bit/s in 1984 to 1Gbit/s in 2014 (3.3 million times faster), the amount of data being transmitted every day is billions of times larger than it was 30 years ago. In fact, Intel said that more data was transmitted in 2010 over the Internet than in the entire history of the Internet through 2009.

That is why new approaches such as this one from Denmark can give new life to the Internet and help deliver the services we demand every day.

The technology is based on Random Linear Network Coding, and its main advantage is the ability to send information compressed into the data stream with the ability to reconstruct itself if parts are missing, using network coding to store and send the signal in a different way. The technique processes data packets in chunks and, unlike traditional packet switching, allows users to receive them in any order.

Network coding is especially helpful with multimedia content such as music and video streaming. Imagine Netflix being able to send Blu-ray quality video to its subscribers using only 2 Mbit/s.

Another advantage the technology offers is security. Because data in a TCP connection always travels along the same path, it's easy for hackers and government organizations to spy on communications. But network-coded data can travel by different paths and can be reconstructed only at its destination, and only by its intended recipient.

Frank Fitzek

"With the old systems you would send packet 1, packet 2, packet 3 and so on. We replace that with a mathematical equation. We don't send packets. We send a mathematical equation," Frank Fitzek, professor of electronic systems at Aalborg University and a network coding pioneer, explained in an Aalborg news post. "You can compare it with cars on the road. Now we can do without red lights. We can send cars into the intersection from all directions without their having to stop for each other. This means that traffic flows much faster."

Fitzek claims that, in experiments with network coding of Internet traffic, equipment manufacturers experienced speeds 5-10 times faster than usual.

Network coding could be critical to implement the next generation of 5G wireless standards, new software-defined networks, and the explosion of Internet-connected devices known as the Internet of Things.

Due to the new protocols, information will have to be encoded and decoded using patented technology. That means that new networking hardware and software needs to be developed. But network coding can take advantage of multipath TCP (implemented in iOS 7).

We'll probably have to wait a few years to see network coding being used to deliver data to our homes, but large organizations, especially cloud providers, could start using it internally to speed up data transmissions between their servers, saving money and resources.

Pablo Valerio has been in the IT industry for 25+ years, mostly working for American companies in Europe. Over the years he has developed channels, established operations, and served as European general manager for several companies. While primarily based in Spain, he has ... View Full Bio
Comment  | 
Print  | 
More Insights
Comments
Newest First  |  Oldest First  |  Threaded View
Zia68
50%
50%
Zia68,
User Rank: Apprentice
8/18/2014 | 4:15:57 AM
Great initiative
Enjoyed the article and would be happy to be connected to Steinwurk and others.
MarciaNWC
50%
50%
MarciaNWC,
User Rank: Strategist
8/6/2014 | 4:16:42 PM
Re: next steps
Thanks for those details Pablo. For those interested in hearing more about the technology, Aalborg's Frank Fitzek posted a video of a lecture he gave on network coding.  
Pablo Valerio
50%
50%
Pablo Valerio,
User Rank: Author
8/6/2014 | 3:22:11 PM
Re: next steps
Another group working on implementation of the technology is CodeOn, based in Cambridge, MA.

MIT's Prof. Muriel Médard has been working together with the Aalborg team and is a member of both groups.
Pablo Valerio
50%
50%
Pablo Valerio,
User Rank: Author
8/6/2014 | 2:07:00 PM
Re: next steps
Marcia, my understanding is that the group in Denmark with some colleagues from the US have started a company called "Steinwurk" to promote the technology.

Curently they have released a network coding library called Kodo, implemented in C++, which allows to implement Random Linear Network Coding Code (RLNC).

They are currently supporting multiple platforms, which can be found here:

http://buildbot.steinwurf.dk/
MarciaNWC
50%
50%
MarciaNWC,
User Rank: Strategist
8/6/2014 | 11:48:42 AM
next steps
Pablo, what's the next step in the process for this project? Did the group provide any details on how they hope to advance this?
Cartoon
Slideshows
Audio Interviews
Archived Audio Interviews
Jeremy Schulman, founder of Schprockits, a network automation startup operating in stealth mode, joins us to explore whether networking professionals all need to learn programming in order to remain employed.
White Papers
Register for Network Computing Newsletters
Current Issue
2014 Private Cloud Survey
2014 Private Cloud Survey
Respondents are on a roll: 53% brought their private clouds from concept to production in less than one year, and 60% ­extend their clouds across multiple datacenters. But expertise is scarce, with 51% saying acquiring skilled employees is a roadblock.
Video
Twitter Feed