The Tape Format Rot Fear Factor

Posted by Howard Marks
November 22, 2011

As I speak with users at the backup seminars I teach around the country, I often hear them say that they avoid using tape for long-term data retention, expressing their concern with something like, "They come out with a new format every few years, and then you can't read your tapes." While it is technically true that eventually you'll have to migrate data from old tapes to new media, you should probably be able to go longer between migrations with tape than with disk archives.

Now, don’t get me wrong--I’m not saying that tape format rot isn’t a concern, just that it’s an eminently controllable concern. I’ve played What kind of tape is it? with a box of tapes from the warehouse as much as anyone, but that problem comes from falling back on old backups because our organization doesn’t have a real data archiving strategy.

In addition, consolidation in the tape drive market has left the industry standardized on one midrange tape format, LTO Ultrium. The administrator running the data archives in the future will know LTO tapes even if only as the last tape format used before holographic data crystals replaced them. LTO drives can read tapes written on drives back two versions, so today’s current LTO-5 drive can read LTO-3 and LTO-4 tapes as well as its native LTO-5 format. Since LTO-3 drives are still being produced, a library with LTO-3 and LTO-5 drives can read any LTO tape written since LTO-1 was introduced back in 2000.

Some of the folks I talk to just don’t want to go through a tape format upgrade every few years. To those folks I say don’t. Just because LTO-6 tape drives come out, you don’t need to get them right away, I mean, these aren’t new iPhones. If LTO-5 gives you the capacity and performance you need, keep it. Wait until LTO-7 comes out.

In a well-managed archive, data should be migrated off old media before it’s stranded by retiring the drives that can read it, regardless of whether it’s stored on disk or tape. Tape vendors have been promising 20-year data retention on their products for years. Being a trusting soul, I recommend tapes be validated every two to three years, and that data be migrated to new tapes every 10 years.

There are significant economic pressures to migrate data from one generation of disk storage as quickly as every five years. The biggest pressure comes from the storage vendor significantly raising maintenance costs or discontinuing maintenance on systems by declaring them at end of life. Migrating to a new disk array also means a four to eight times increase in capacity per drive, and a corresponding reduction in power consumption.

Related Reading

More Insights