Increased Response
The Challenge
Increased Response had a requirement to identify duplicates in data from a large client, as part of an overall project. The client had 205 million consumer records supplied from five different sources. These files needed to be matched together to identify any overlap of records across the five files. This involved the manipulation of some very large datasets, some over 20 Gb in size.
The most impressive aspect of Datactics technology is the speed. To be able to process 205 million records in such a short time frame, with matching of this quality, is staggering.
Andy Smith, Increased Response
The Solution
Increased Response met Datactics at the Direct Marketing show. A proof of concept was designed to address this challenge and to establish that the job could be delivered within their client’s given requirements. Using Datactics technology to import, enhance and deduplicate the huge volumes of consumer data, the project was swiftly completed. The results and quality of the deduplication exercise greatly surpassed client expectations.
As a result:
- 53% of total records were identified as duplicates and purged, as they matched with those retained
- 23% were found to exist in more than one file and retained
- 24% were found to be distinct with no other matching records
- 0.09% of the records were deemed to have data insufficient for a match
Andy Smith, Increased Response’s MD:
“Clearly this shows the best application of grid computing concepts in the marketing world. The reports showing each cluster of matches lined up against each other was impressive. We were immediately able to validate that the matching and suppression were what we had expected.”
The Benefits
- Improved productivity
- Cleaner data
- Higher performance batch processing
- Enhanced scale – no limits on data size




