Big data skills crisis needs vendor action: IDC
- 22 April, 2012 22:00
Enterprise IT departments are struggling to take advantage of the benefits big data can bring due to a lack of skills in the marketplace, according to IDC research VP Susan Feldman.
"There aren't a lot of people who are very skilled in these new technologies. How are enterprises supposed to hire people if they aren't there?" asked Feldman.
The most common technology used by companies to analyse hundreds of terabytes, or even petabytes, of unstructured data is an open-source tool called Hadoop.
Hadoop uses a process called parallel programming, which allows analytics to be run on hundreds of servers, with lots of disk drives, all at the same time. It stores this data in a file system called HDFS (Hadoop distributed file system), in effect a flat file system that can spread data across multiple disk drives and servers.
However, it is widely agreed in the industry that Hadoop is an extremely complex system to master and requires intensive developer skills.There is also a lack of an effective ecosystem and standards around the open-source offering.
"There are very few Hadoop experts around, and there are only very poor tools available for using it. You don't only need experts that know how to master an Hadoop file system, but experts that know how to master an Hadoop file system using bad tools," said Feldman.
Feldman urged the likes of Autonomy, EMC, Teradata and IBM to improve the tools on offer to reduce the impact of the skills crisis.
"If vendors could supply the expertise, if they could keep the software updated, then this would lessen the burden on IT departments in the enterprise," she said.
"Integrating all of the big data pieces into a well formed architecture, so that everything can interact with everything else, that's very difficult. Most people doing this could probably happily hire ten extra people, but they just aren't around."
IDC predicts a compound annual growth rate of 39.4 percent in big data hardware, software and service sales between 2010 and 2015. However, this doesn't take into account open-source offerings, which accounts for a significant amount of enterprise use, but is difficult to measure.
Rethinking the worst case
The brand called CIO
Motorola turns to the Moto G's price to reserve its smartphone fortunes
Virtual desktop computing service: The next cloud disruptor?
Google app translation service now available to Android developers
Case Study: Sustainability Value in a Virtual World
Over time we have learnt that teleconferencing services have made organisations work faster, more focused and environmentally responsible. In this case study, we look at the travel costs that are avoided, the more effective decision-making capacity that is unlocked and the better work-life balance that is afforded to employees. Click to download!
5 Ways To Be More Productive At Work
Think back to the last time all your employees were in the office, at their desks, on the same day. It’s no surprise that you might struggle, between travel and off-site meetings, remote staff, flexible schedules and sick days. In today's competitive business climate, organisations need to maintain productivity and connectedness with their staff, despite not always being onsite. In this whitepaper, we look at five ways you can improve productivity, no matter where employees are.
The Power of Transformational Knowledge
Apple saves $5 million a year on case and email deflection, while its agents find information 47 per cent faster than before they invested in something called Transformational Knowledge. In today’s consumer-empowered marketplace, you cannot afford negative customer experiences. However many companies lack the tools and processes required to empower their employees to deliver great customer experiences. In this whitepaper, we look at how to breakdown silos and deliver great customer experiences.