You can't do Big Data if you can't do Small Data
If you can't do Small Data efficiently and effectively now, asks Brian Fitzpatrick, how do you think you'll be able to do Big Data in the future?
The future of our infrastructure is digital, but just who is best placed to build the local authority capability to manage this revolution?
Who will look after the impact of decisions made by assets self-reporting their condition, and automatically informing investment priorities? Who is going to look out for the needs of our citizens as we enter the age of automated design, and algorithmic prioritisation?
Will we build that capability ourselves in our highways maintenance sector? Is that the right thing to do, or will we (whisper it quietly given the current environment) outsourcethis transformation?
For many highways authorities, using the software tools and data management platforms that can best process, analyse, translate and turn highways data into meaningful information is a mystical, expensive and time-consuming process, and they don't have enough resources now.
The way data and information is collected, and used in day-to-day maintenance activity is inefficient in the first place, and rooted in historical 'analogue' practice eg inefficiencies arise from
· different proprietary information systems and platforms in use which don't talk to each other
a lack of standardisation of paper and computer processes and tools
· collecting the same condition data every year but only utilising a small percentage of it
· a fragmented value chain around the delivery of services
· poor information connectivity and flow, lots of activity duplication
· relatively immature data architecture in local government
· the consequential high cost of data collection and recollection
· limited analysis (and time for analysis) of data, to turn data into information, and from that gain insight to improve service and enable innovation
· little time for customer needs or priorities beyond making sure the road surface is fit
It doesn't have to be that way but currently for many authorities it just is.
Big Data is the ability to connect and use all of the collected information 'out there'to reveal patterns, trends, and associations, especially relating to human behaviour and interactions, and thus make better decisions around infrastructure investment and operations.
Big Data is going to be increasingly relevant to the way we plan, invest in, and manage our highways networks going forward as the number of sensors capturing, processing and reporting information grows, exponentially, in the next few years.
If local highways authorities alreadyhave at their disposal lots of other relevant data than just the inventory and condition available to them, but don't use that properly, then what is the point of being able to collect more data if we can't use it?
An additional concern is that although highways officers and service providers were amongst the 'early adopters' of digital technology, they now face being left behind as the world moves on and huge corporations are heavily investing in better understanding how data will be transmitted and harvestedfrom the infrastructure and asset platforms which local authorities currently maintain, which will lead to a natural interest in them owning or managing those networks.
I have no problem with who runs our networks, as long as they are managed properly and transparently. My concern is that by carrying on the way we are, highways authorities will miss out on the potential to themselves intelligently plan for and utilise 'Big Data' in the future, to the benefit of their local communities, and towns and cities. Or they will miss the right time to do it and we all then end up paying a hefty premium for a transformation to retro fit such capacity and capability.
Highways members, officers and infrastructure services providers need to 'stay in the game' and not be potentially marginalised. My question is if you can't do Small Data efficiently and effectively now, how do you think you'll be able to do Big Data in the future?
The revolution is coming, but getting it started in an equitable and transparent fashion, setting the ground rules for the way assets will be managed and our infrastructure maintained in the future, will need all of us, working together to define the way we want those decisions to be made.
Brian Fitzpatrick is founder of Fitzpatrick Advisory. He is speaking at Highways UK at the NEC on 6/7 November on achieving real change for the local highway network and overcoming the barriers that to date have limited reform