Unstructured data growth set to boilover

A new survey confirms that unstructured information is growing at a faster clip than relational data and is driving the Big Data explosion.

Undertaken by by Unisphere Research for ECM vendor MarkLogic, the survey of 446 data managers and professionals found 35 percent of respondents believe unstructured information has already or will surpass relational data in the next 36 months. Add in those who think it will happen in the next decade, and the number rises to 52 percent.

A majority of survey respondents also acknowledge that unstructured information is growing out of control and is driving the Big Data explosion – a full 91 percent of respondents say unstructured information already lives in their organizations, but many aren't sure what to do about it.

"The report clearly shows that most IT managers are facing significant challenges with unstructured information and Big Data," said Joe Dalton, CMO, MarkLogic.

"They know there is immense value hidden within this information, but don't understand how to handle it and throw old technologies at the problem. With relational databases, companies are using 30 year-old technology to try to tackle today's information challenges. This would be like trying to build a website with a typewriter. Companies need to start looking for the right tool for the job."

Among some of the key survey findings:
* 86 percent of respondents admit that unstructured data is important to their organization, yet only 11 percent have clear procedures and policies for managing unstructured data in place.
* 80 percent of respondents know the amount of unstructured data will rise in the next three years, but only 24 percent of respondents believe their current infrastructure will be able to adequately manage it.
* 40 percent of managers are unaware of the extent unstructured data exists in their organization, and only 45 percent of organisations are moderately or strongly committed to leveraging this resource, creating a competitive advantage for those companies that do.

"It's interesting to note that the majority of organizations spend most of their time managing relational data, yet expect unstructured data to grow and eventually surpass structured data," said Joseph McKendrick, research analyst, Unisphere Research. "This is further complicated when very few companies have separate governance procedures for unstructured information and admit the processes they do have in place are inadequate. There is a clear need for better business processes that engage unstructured data, leading to improved decision making."

Among the interesting trends uncovered is that even organizations with higher concentrations of unstructured information face issues with corporate awareness regarding the existence of this data. They devote most of their resources to managing the smaller portion of their data, while moving unstructured information into special-purpose databases or content management systems.

For more information or to download a copy of the report,  click HERE.