CAP automotive are a data business supplying the automotive industry with used car pricing and technical information. CAP’s Retail Valuation (i.e. the value at which a used car is advertised on the forecourt) has long served the automotive industry as a guide to the potential margin available on used vehicles.
With dealers’ margins coming under increasing pressure, CAP wanted to create a completely new methodology for generating their published Retail Values – one which responded to the used car market more closely, and would assist dealers in finding the pricing ‘sweet spot’.
Working closely with CAP’s operational, technical and research teams, the DataShed developed a solution which takes in a daily feed of adverts from multiple sources, applies a set of data quality and validation processes, then feeds the cleaned adverts through multiple data mining algorithms to output a value for every possible vehicle (there’s around 65,000 vehicle variations), across 10 different plates, and over 6 mileage points.
The key to this project was to find a way to incorporate existing industry knowledge into a technical data solution. Often, the data would suggest one conclusion, and industry knowledge would disagree with the conclusion. Finding a way of ensuring that the output of the models both reflected the market, while also incorporating years of experience was particularly challenging.
The eventual solution was an automated daily feed into CAP’s core product, and included multiple processing steps:
3 consultants delivered a large-scale data processing platform using the Microsoft BI stack, including data mining structures, reporting cubes and an ASP.net application to manage the process and analyse the output.
The solution pulls & processes approximately 700,000 live adverts per day. Once complete around 4million price points are generated – and then rigorously tested against a wide range of business rules, adjusted where necessary, and then published into CAP’s Black Book products
Delivering the project, although critical, wasn’t the end of it. We also helped CAP find analytical people, recruit them and set up an analysis team to support the ongoing maintenance and extension of the solution.