Few IT managers would relish the prospect of dealing with a data repository packed with 100 billion records, although the rapidly expanding New York Stock Exchange (NYSE) has harnessed the power of just such a system.
Seven years ago the Stock Exchange began work with business intelligence specialist 1010data to build a repository capable of providing market data to its myriad of customers, which now holds a mind-boggling amount of information.
"Theres historical trades and quotes from all of the North American equity exchanges, and also Nasdaq," says Mark Schaedel, vice president of data products at the New York Stock Exchange (NYSE) Euronext, explaining that 750 million new records are often added to the system in one day. "We also have all of our transactions, executions, and orders related to NYSE and the Archipelago Exchange that we acquired three years ago."
NYSE is on something of an M&A tear at the moment, joining forces with the Euronext network of European exchanges in a $20 billion deal in 2006, and also forging partnerships with exchanges in places such as India and Brazil.
"The platform will be supporting similar data from these exchanges as well," says Schaedel, explaining that NYSE customers can access the storage system through the organizations NYXdata.com Website or its FTP servers. "We have, as far as I am concerned, infinite capacity available on demand."