Big Data is only getting bigger
Hadoop ecosystem to be worth over $800m by 2016, forecasts analyst
There's been a lot of talk proclaiming 2012 the year of Big Data, or more appropriately the year it permeates the mainstream, so to speak. A new research report from the International Data Corporation (IDC) estimates that the global Hadoop-MapReduce market to be worth $818m by 2016.
Within their WorldWide Hadoop-MapReduce Ecosystem Software 2012-2016 Forecast, the IDC says the hugely open source distributed data ecosystem generated $77 million in 2011 and to grow annually by 60.2% (Compound Annual Growth Rate). This isn't even taking into account Hadoop's first stable version right at the end of the year, which was effectively a signal to the enterprise world that this revolutionary rethinking of storing and distributing both structured and unstructured data is ready for the challenge.
Many think Hadoop will develop along the lines of the Linux ecosystem, becoming ubiquitous within that specialist field, and you can't really fault that logic. Dan Vesset, vice president, Business Analytics Solutions at IDC is one person prophesying such, saying:
Over the next decade, much of the revenue will be accrued by hardware, applications, and application development and deployment software vendors - both established IT providers and start-up, which in aggregate have raised more than $300 million in venture capital funding.
December's Apache Hadoop 1.0 release has already seen a lot of hesistent enterprises embrace the Hadoop methodology, no doubt leading to many problems being solved, such as how to store vast amounts of data efficiently and retrieving it quicksharp. The Apache Foundation's backing certainly makes sure that all avenues are open to the Hadoop community, in making sure their message is heard loud and clear.
IDC believe one of the key drivers for this market is social media and the increasing availability of interactional, attitudinal, and behavioural data from it, with many seeking to mine such data for its full value. Currently, social media is a relatively untapped field in this respect, with potential to becoming a leading light.
Aside from the potential stumbling blocks of 'the scarcity of tools and qualified staff', a major factor expected to inhibit growth during the forecast period is the competition between open source vendors and their closed source counterparts, perhaps playing each other to force lower license fees from the latter group. This in turn would see a slower revenue growth from closed source options. This is hardly surprising when you consider how large the open source behemoth is in today's market.
What remains to be seen is whether this Hadoop growth is tenable after an encouraging start. Is the $818m merely pie in the sky or something much more substantial? We'll have to wait and see...