Compromising a $6B big data project through poor data quality: the Aadhaar case study - Anand V
2,563 views · Published 31 July 2018 · 40:29 · Indexed 12 November 2026
Channel: Hasgeek TV · 2018 · Science & Technology
The Aadhaar project holds at least 3 PB of data and possibly more. It’s promise of providing a unique multi-modal biometric backed Identity to everyone in India has hinged on the quality of biometric templates obtained during enrollment and also the veracity and trustworthiness of the identity documents. The scale needed for the project can only be achieved through enrollment centers that are spread out and available in every village. The UIDAI enlisted Common Service Centers (CSC) and 60,000 Private agents for both enrollment and updates. Frauds are inevitable in such a scaled-up system and hence much care was taken to standardize the enrollment process through software, which was deployed on the enrollment centers. Another set of defences were built in the back end through data analytics to detect fraud. Every confirmed fraud resulted in adding more security features in the enrollment software. However the UP Aadhaar hack case, provided the first glimpse into how the fraudsters managed to disable the security features and also defeat the back end data analytics. The offline nature of data acquisition provided a window large enough to compromise the data quality of the biometric templates and the identity documents without getting detected for at least an year. Further the streamlining of the process of data acquisition, made it very hard to stop the deployment and further usage of the compromised software even today, thus illustrating the problem of data acquisition at scale with good quality. I helped the Petitioners, who challenged the Aadhaar project on the Supreme Court of India to understand the technology behind Aadhaar and can say with some modesty that I also helped the senior counsels Mr. Shyam Divan, Mr. Gopal Subramaniam, Mr. Anand Grover and Mr. Vishwanath to sharpen their propositions in the court.
More from this channel
-
3:19
Flipkart on Scaling PHP in the Cloud
-
35:00
On web standards and accessibility
-
1:05:20
Introduction to HTML5 boilerplate
-
43:45
Bits, bytes and blobs -Mrinal Wadhwa
-
52:30
A primer on ECMAScript 5 -Rajasekharan Vengalil
-
50:11
Zero to App with jQuery Mobile -Anirudh Sanjeev
-
34:26
JavaScript Gone Wild -Akash Mahajan
-
39:32
Bulding great mobile web apps: Some things you might want to know -Shwetank Dixit