IBM Set New Big Data Record

IBM Break Storage Performance Record

IBM researchers have successfully scanned 10 billion data files on a single system, in 43 minutes, according to a press release. This beats the previous record of one billion files in three hours by a factor of 37, which was also set by IBM researchers at the Supercomputing 2007 conference in Reno. This was achieved using General Parallel File System (GPFS) running on a cluster of 10 eight core systems and solid state storage.

"Today's demonstration of GPFS scalability will pave the way for new products that address the challenges of a rapidly growing, multi-zettabyte world," said Doug Balog, vice president of storage platforms at IBM. "This has the potential to enable much larger data environments to be unified on a single platform and dramatically reduce and simplify data management tasks such as data placement, aging, backup and migration of individual files."

According to the press release, the size of digital data increased by 47% over the past year, putting businesses under pressure on how to manage and store the additional data.

Jessica Thornsby

What do you think?

JAX Magazine - 2014 - 05 Exclucively for iPad users JAX Magazine on Android

Comments

Latest opinions