Records Management and eDiscovery
Posted by Christine Taylor on July 31, 2009
Records management has always been painful but now it's nearly impossible given the unending growth in ESI. Since corporations are infamous for keeping every stick of data, we're looking at hundreds of terabytes of data just in the data center with many more hundreds of TBs on servers, SAN, NAS, tape, and workstations scattered throughout the enterprise. These terabyte-to-petabyte levels represent a lot of records to manage for multiple business needs including eDiscovery, compliance and data retention.
The overwhelming size of the data universe has made manual records management an impossible affair. For business processes like eDiscovery and compliance, the 2006 amendments to the Federal Rules of Civil Procedure severely shortened the time frame to meet eDiscovery requests and added to eDiscovery procedural burdens. Federal investigations and regulatory compliance are also increasing concerns in the executive suite.
The upshot is that companies have a lot of potentially relevant records that they must find fast to meet eDiscovery and investigatory demands. Companies used to be able to argue undue burden, but today's courts are increasingly rejecting that argument and holding companies accountable for protecting and producing relevant records. (That's a pretty way of saying that judges are less inclined to cut complainers some slack. Sad but true.)
Disconnected data silos make large-scale data management and collection extraordinarily difficult. This is where ESI indexing and mapping come in handy. I spend a lot of time writing about analytics and review because that's where the eDiscovery financial pain point is. But I always stress that good records management policies have to include index/collection/mapping software that lets you do it in the first place. StoredIQ and Exterro are good in this sector with their ability to locate and act on records for business processes. Another good entrant is B&L Associates, whose ADM centrally indexes and manage backup/archival for data management, eDiscovery and compliance.




Comment by Objectivity on July 31, 2009 10:10 PM
This is a great post and I couldn't agree more that this nightmare needs to be addressed. One of the things I think needs more attention is on how exactly all this ESI is actually being stored. Without some index being maintained for years to come the vast amount of file stored on spinning disk and/or tape lose context. This is why I believe that object-based storage represents the next wave of technology to help organizations deal with this. The ability to store rich, descriptive metadata with a file as a complete object maintains context for the long-term. Applications that manage records (ECM) or are used for categorization of file-based data are well suited to take advantage of object-based storage. They can simply store a relevant amount of metadata with the file and the customer knows they will always be able to access the metadata as a finding tool and retrieve the actual file. Right now this kind of technology is being positioned for cloud storage, however I believe it is going to be the future of file-based storage because of its ability to scale, its protection and its low cost. Products like Caringo CAStor and EMC Atmos are object-based and I expect application vendors and customers will start to take advantage of their value. File systems are too limiting when it comes to organizing and managing massive file counts.
Reply to this comment