Data analytics company Alteryx has found that data professionals are wasting half of their time each week finding, protecting, or preparing data – costing organisations significant amounts of money.
The team commissioned a study called ‘The IDC InfoBrief: The State of Data Discovery and Cataloging’, based on a comprehensive survey of over 400 people performing data functions across North America and Europe.
Despite massive growth in data analytics demand globally, this new study shows that there is still work to be done for organisations to get the most of their data assets and infrastructures, particularly when it comes to data discovery and cataloguing.
Data professionals are spending more time governing, searching and preparing data than they are on extracting business value.
Data professionals spend 60 per cent of their time getting to insight, but just 27 per cent of that time is spent on actual analysis.
Instead, 37 per cent of that ‘getting to insight’ time is spent searching for data and 36 per cent of that time is spent preparing data.
These data workers waste 30 per cent of their time – on average 14 hours per week – because they cannot find, protect or prepare data.
They waste another 20 per cent of their time – 10 hours per week – building information assets that already exist.
In total, they lose 50 per cent of their time every week on unsuccessful activities or repeating efforts.
Even though data discovery and integrity is important for business, 30 to 50 per cent of organisations say they are not where they want to be.
The inefficiencies of data intelligence and knowledge is costing U.S. organisations $1.7m per year for every 100 employees, and European organisations €1.1m per year for every 100 employees.
“It is evident that many professionals are not aware of what resources are available within data assets like data lakes, how to access the data, where it came from, or how to glean trusted insights,” said Langley Eide, chief strategy officer at Alteryx.
“Unless organisations make changes to their infrastructure now, and close the gaps on data discovery, integrity and cataloguing, processes will only become more inefficient as data volume and variety continues to grow.”
Stewart Bond, director of data integration and integrity software research at IDC said: “Data discovery is important to all aspects of business, from operations efficiency to compliance to risk reduction, revenue growth and beyond.
“Knowledge of how, where and why data is used, by whom, and what information already exists will help data professionals refrain from repeating efforts, increase personal productivity and free-up time for more advanced analytics.”