Paul Krill
Editor at Large

Despite gains, Hadoop still has big holes to fill

analysis
Jun 5, 20142 mins

Analysts see the distributed computing system lacking in areas like security and ease-of-use

While the Apache Hadoop distributed data processing platform has made great strides in enterprise businesses, it still needs ease-of-use, security, lifecycle management, and tooling to solidify its status, key industry analysts believe.

Hadoop has to become “part of the IT environment,” said Ovum analyst Tony Baer at the Hadoop Summit conference in San Jose, Calif., this week, but it must become easier to use and not be so programmer-centric.

Lifecycle management and data governance and stewardship are not suitably addressed by Hadoop technology at the moment, Baer said. “Do we keep this data on Hadoop forever? Or do we basically deprecate it at some point? There’s some industries where you’re going to have to get rid of data.”

Baer also mentioned security capabilities he believes are needed in Hadoop. Although Hadoop vendor Cloudera acquired Gazzang this week, bringing encryption and key management to Cloudera’s distribution of Hadoop, there are other areas, such as role-based access and single sign-on, that need to be addressed.

For many companies, Hadoop already is a first-class citizen in the enterprise, analyst Mike Gualtieri of Forrester, said. The inquiries he receives have morphed from people asking what exactly Hadoop is to how to implement it. “The momentum is there and there’s a sweet spot in every enterprise for Hadoop, but the ecosystem has to grow up a lot more,” he said, noting the need for tools to manage both traditional data systems and Hadoop. For its part, Microsoft boosted Hadoop this week, offering up faster querying technology to the Hadoop Hive and Stinger subprojects.

Business executives will be more inclined to use technologies like Hadoop if they believe they are being passed up by rivals using data to the extent that they can, said Jeff Kelly, big data analyst at Wikibon. “Fear can be quite a motivator.”

This story, “Despite gains, Hadoop still has big holes to fill,” was originally published at InfoWorld.com. Get the first word on what the important tech news really means with the InfoWorld Tech Watch blog. For the latest developments in business technology news, follow InfoWorld.com on Twitter.

Paul Krill

Paul Krill is editor at large at InfoWorld. Paul has been covering computer technology as a news and feature reporter for more than 35 years, including 30 years at InfoWorld. He has specialized in coverage of software development tools and technologies since the 1990s, and he continues to lead InfoWorld’s news coverage of software development platforms including Java and .NET and programming languages including JavaScript, TypeScript, PHP, Python, Ruby, Rust, and Go. Long trusted as a reporter who prioritizes accuracy, integrity, and the best interests of readers, Paul is sought out by technology companies and industry organizations who want to reach InfoWorld’s audience of software developers and other information technology professionals. Paul has won a “Best Technology News Coverage” award from IDG.

More from this author