Baby steps to Big Data

Most organisations need to address a range of core  data needs and technology infrastructure issues before launching big data initiatives, research released by CompTIA, a non-profit association for the information technology (IT) industry, suggests.

CompTIA’s  survey of 500 U.S. IT and business executives found only 37 percent reported being very familiar with the concept of big data.

Approximately one in five businesses claim to have a big data initiative underway, while 36 percent plan to embark on one in the next 12 months.

“As expected for an emerging technology with an evolving definition, many executives are still moving along the big data learning curve,” said Tim Herbert, vice president, research, CompTIA.

Accounts of large retailers, government agencies, healthcare providers, utility companies and other organisations doing impressive things with big data offer a glimpse of the potential of this trend. But the reality is that most organisations have far more basic data-related needs.

“Not every business will need a big data strategy,” Herbert said. “But just about every business will need to effectively aggregate, store, manage and analyse the data they do have, regardless of its volume, velocity or variety.”

Slightly more than one-third of survey respondents say they are exactly or very close to where they want to be in managing and using data. In relatively few areas do businesses report proficiency – just 20 percent of respondents say they are currently doing well at analyzing web traffic patterns; 15 percent at measuring email marketing campaign effectiveness; and 12 percent at social media monitoring.

 

“Basic work needs to be done before many companies are ready for a big data initiative,” Herbert noted. “Many companies are still struggling with analytics, storage, backup and business continuity.”

The CompTIA study reveals a number of other data-related challenges:

• Nearly three in four companies report a high or moderately high degree of data silos within their organisation, making it difficult to view data holistically.

• Many do not have a complete or accurate understanding of their data profile, especially as it relates to unstructured data, such as audio and video files and social streams of data.

• Just one in three companies have a comprehensive business continuity and disaster recovery plan in place.

As companies work to improve their data utilization and move closer to realizing the possibilities of big data, they will have to contend with the possibility of workforce skills gaps.

“Big data initiatives often require bringing together technical, analytical, statistical and creative thinking skills,” said Herbert. “Historically, these skill sets have been somewhat compartmentalized, a situation many companies will need to address.”

Fifty-nine percent of respondents want to either start or improve upon their capabilities in detecting patterns in their data, while 67 percent want to do the same with relationship analytics, such as understanding how variables are correlated.