Building the case for restricted use of predictive policing tools in India
Keywords:Preventive detention, algorithmic outcomes, restricted use, marginalised communities, criminal justice norms
The use of predictive policing by law enforcement agencies has lately proliferated across several states in India. Predictive policing uses machine learning models to analyse substantial amounts of crime data to map and predict crimes, offenders, identities of the perpetrators and victims of crime. The aim is to enable the efficient allocation of limited resources at the disposal of law enforcement agencies for crime prevention. However, evidence suggests that predictive policing, in its current form, suffers from serious limitations. Inferior quality datasets are being used to train algorithms and citizens are unable to contest inaccurate algorithmic outcomes that could lead to their preventive detentions, often to the detriment of criminal justice norms and constitutional fundamental rights of citizens. More importantly, in the absence of oversight mechanisms restricting its use, the use of predictive policing has ended up reinforcing and amplifying police biases in law enforcement. This paper focuses, in particular, on the many ways in which predictive policing increases the risk of preventive detentions under section 151 of the Code of Criminal Procedure (CrPC), 1973 and proposes recommendations to preclude possibilities of unlawful preventive detentions using predictive policing tools. In part 1, the paper reviews the practice of preventive detention of potential offenders by the police in India—under section 151 of the CrPC. In part 2, I build the case for restricted use of predictive policing tools to only predict the location, type and time of the crime and not potential offenders or victims. In the last part, I recommend substantive measures and procedural safeguards to secure the reliable and accountable use of place-based predictive policing tools in India.
Amnesty International India. “Justice Under Trial: A Study of Pre-trail Detention in India”. 2017.https://www.amnesty.nl/content/uploads/2017/07/UT_Final.pdf?x79902.
Asher-Schapiro, Avi. “California city bans predictive policing in U.S. first”. Reuters. 25 June 2020. https://www.reuters.com/article/us-usa-police-tech-trfn-idUSKBN23V2XC.
Babele, Aryan. “Intrusive tech-enabled surveillance and ‘National Security’ secrecy: mounting concerns of mass snooping amid informational asymmetry”. International Journal of Law and Information Technology, Volume 29, Issue 1, Spring 2021, Pages 24–56. 11 December 2020. https://academic.oup.com/ijlit/article-abstract/29/1/24/6031211?redirectedFrom=PDF.
Bokil, Ameya et al. “Settled Habits, New Tricks: Casteist Policing Meets Big Tech in India”. TNI Longreads. May 2021. https://longreads.tni.org/stateofpower/settled-habits-new-tricks-casteist-policing-meets-big- tech-in-india.
Common Cause & Lokniti, Centre for the Study Developing Societies (CSDS). “Status of Policing in India Report 2018 - A Study of Performance and Perceptions.” 2018. https://www.tatatrusts.org/upload/pdf/spir-2018-common-cause.pdf.
Corbett-Davies, Sam et al. “Algorithmic Decision Making and the Cost of Fairness”. January 27, 2017. https://arxiv.org/abs/1701.08230.
Fair Trials. “Automating Injustice: The Use of Artificial Intelligence & Automated Decision-making Systems in Criminal Justice in Europe”. https://www.fairtrials.org/sites/default/files/publication_pdf/Automating_Injustice.pdf.
FICCI and EY. “Predictive policing and way forward”. 2018. https://ficci.in/spdocument/23009/FICCI_EY_Predictive Policing_.pdf.
George, Rohan. “Predictive Policing: What is it, How it works, and its Legal Implications”. The Centre for Internet & Society. 24 November 2015. https://cis-india.org/internet-governance/blog/predictive- policing-what-is-it-how-it-works-and-it-legal-implications.
Gupta, Apar. “Legal notice to recall the request for proposal for “automated facial recognition system””. 18 July 2019. https://drive.google.com/file/d/1XNeqiyjCF0KWbiZB5mRUCtVyyxU2wj2v/view.
Hyderabad City Police. “Smart Policing Initiatives”. July 2016. https://www.svpnpa.gov.in/images/npa/pdfs/SIITApp/ITApplicationsinHyderabadPoliceNPA4July2016.p df; Bopanna, Akriti. “India’s Tryst With Predictive Policing” Vidhi Centre for Legal Policy. 13 April 2020. https://vidhilegalpolicy.in/blog/indias-tryst-with-predictive-policing/.
Internet Freedom Foundation. “Hyderabad Police force people to remove their masks before photographing them. We sent a legal notice. #SaveOurPrivacy”. May 2021. https://internetfreedom.in/hyderabad- police-force-people-to-remove-their-masks-before-photographing-them-we-sent-a-legal-notice- saveourprivacy/.
Jauhar, Ameen. “Indian Law Enforcement’s Ongoing Usage of Automated Facial Recognition Technology – Ethical Risks and Legal Challenges”. Vidhi Centre for Legal Policy. 10 August 2021.https://vidhilegalpolicy.in/research/indian-law-enforcements-ongoing-usage-of-automated-facial- recognition-technology-ethical-risks-and-legal-challenges/.
Kerala High Court. Waheeda Ashraf vs The Union Of India. 8 April 2021. https://indiankanoon.org/doc/123725577/.
Lau, Tim. “Predictive Policing Explained”. Brennan Centre For Justice. 1 April 2020. https://www.brennancenter.org/our-work/research-reports/predictive-policing-explained.
Law Commission of India. “One Hundred and Seventy Seventh Report on Law Relating to Arrest”, December 2001. https://lawcommissionofindia.nic.in/reports/177rptp1.pdf.
Lee, Nicol Turner et al. “Algorithmic bias detection and mitigation: Best practices and policies to reduce consumer harms”. 22 May 2019. Brookings Institution. https://www.brookings.edu/research/algorithmic-bias-detection-and-mitigation-best-practices-and- policies-to-reduce-consumer-harms/#footnote-35.
Lindenmuth, Kimberly. “Prevention or Self-Fulfilling Prophecy? Predictive Policing’s Erosion of the Presumption of Innocence”. 2019. Law School Student Scholarship. 1018. https://scholarship.shu.edu/student_scholarship/1018.
Author: Antara Vats
Building the case for restricted use of predictive policing tools in India 7
International Review of Information Ethics Vol. 32 (11/2022)
Madras High Court. A.V.Bellarmin vs Mr.V.Santhakumaran Nair. 13 August 2015. https://indiankanoon.org/doc/117916926/
Marda, Vidushi & Shivangi Narayan. “Data in New Delhi’s Predictive Policing System”. FAT* ’20, January 27– 30, 2020, Barcelona, Spain. Association for Computing Machinery.https://www.vidushimarda.com/storage/app/media/uploaded-files/fat2020-final586.pdf
Mcgrory, Kathleen & Neil Bedi. “Targeted”. Tampa Bay Times. 3 September 2020.https://projects.tampabay.com/projects/2020/investigations/police-pasco-sheriff- targeted/intelligence-led-policing/.
Mehrotra, Karishma. “Indian faces were run through facial recognition tech tools. Here’s why you should be concerned”. The Scroll. 5 August 2021. https://scroll.in/magazine/1001836/facial-recognition- technology-isnt-wholly-accurate-at-reading-indian-faces-find-researchers.
Ministry of Home Affairs. “Crime and Criminal Tracking Network and Systems (CCTNS) - Capacity Building Guidelines” 2009. http://crimebranchjkpolice.nic.in/docs/CCTNStraining.pdf.
Ministry of Home Affairs. “Model Police Manual”. Bureau of Police Research and Development.https://bprd.nic.in/WriteReadData/userfiles/file/6798203243-Volume%202.pdf; Ministry of Home Affairs. “Model Police Manual”. Bureau of Police Research and Development.https://bprd.nic.in/content/63_1_ModelPoliceManual.aspx.; Ministry of Home Affairs. “Guidelines to the Indian Police - Code of Conduct for the Police in India”, 4 July 1985. https://police.py.gov.in/MHA%20-%20Model%20Code%20of%20Conduct%20- %20Indian%20Police.pdf.
Ministry of Home Affairs. “Report of the Comptroller and Auditor General of India on Performance Audit of “Manpower and Logistics Management in Delhi Police””. 2020. https://cag.gov.in/uploads/download_audit_report/2020/9.%20Digital%20Initiatives%20of%20Delhi% 20Police-05f911198e45a25.81448827.pdf.
Ministry of Statistics & Programme Implementation. “Report of the Committee on Crime Statistics”, 2012. http://mospi.nic.in/sites/default/files/publication_reports/Report_crime_stats_29june11.pdf.
National Academies of Sciences, Engineering, and Medicine. “Proactive Policing: Effects on Crime and Communities” Washington, DC: The National Academies Press. 2018. https://doi.org/10.17226/24928.
Pasco Sheriff’s Office. “Intelligence-Led Policing Manual”. 2018. https://cryptome.org/2021/06/ilp_manual012918.pdf.
Perry, Walter J. Et al. “Predictive Policing - The Role of Crime Forecasting in Law Enforcement Operations.” Rand Corporation.
https://www.rand.org/content/dam/rand/pubs/research_reports/RR200/RR233/RAND_RR233.pdf. Press Trust of India. “Delhi police facial recognition software has only 2 per cent accuracy: HC told”. Business
Standard. 23 August 2018. https://www.business-standard.com/article/pti-stories/delhi-police-facial-
Press Trust of India. “Upgrade face recognition software: Delhi high court”. Times of India. 4 August
Santa Cruz Sentinel. “Santa Cruz, Calif., Bans Predictive Policing Technology”. Government Technology. 24
Scanlan, Jeremiah. "Auditing Predictive Policing," Brigham Young University Prelaw Review: Vol. 33 , Article 4.
Seventh Schedule. Article 246. https://www.mea.gov.in/Images/pdf1/S7.pdf.
Singh, Rahul. “Criminal Justice in the Shadow of Caste: Study on Discrimination Against Dalit and Adivasi
Prisoners & Victims of Police Excesses.” 2018. National Dalit Movement for Justice.
Siyuan, Chen. “The Future of the Similar Fact Rule in an Indian Evidence Act Jurisdiction: Singapore”. NUJS
Law Review. July 2013. http://docs.manupatra.in/newsline/articles/Upload/A922076C-D4D6-40A8-
Supreme Court of India. Ahmed Noormohmed Bhatti vs State Of Gujarat And Ors. 16 March 2005.
Author: Antara Vats
Building the case for restricted use of predictive policing tools in India 8
International Review of Information Ethics Vol. 32 (11/2022)
Supreme Court of India. Joginder Kumar vs State Of U.P. 25 April 1994. https://jajharkhand.in/wp/wp- content/judicial_updates_files/07_Criminal_Law/04_arrest_and_custody/Joginder_Kumar_vs_State_Of_ U.P_on_25_April,_1994.PDF.
Supreme Court of India. Justice K. S. Puttaswamy (Retd.) and Anr. vs Union Of India And Ors. 24 August 2017. https://indiankanoon.org/doc/127517806/.
Supreme Court of India. Kharak Singh vs The State Of U. P. & Others. 18 December 1962. https://indiankanoon.org/doc/619152/.
United Nations Human Rights Office of the High Commissioner. “Artificial intelligence risks to privacy demand urgent action – Bachelet”. 15 September 2021. https://www.ohchr.org/EN/NewsEvents/Pages/DisplayNews.aspx?NewsID=27469&LangID=E.
United States District Court, Case No. 8:12-cv-00555/ “Dalanea Taylor; Tammy Heilman; Darlene Deegan; and Robert A. Jones III, v Chris Nocco, in his official capacity as Pasco Country Sheriff”. https://ij.org/wp-content/uploads/2021/03/Doc.-01-Complaint.pdf.
UNODC. “Crime prevention and criminal justice.”https://www.unodc.org/e4j/en/secondary/criminal- justice.html#:~:text=Crime%20prevention%20saves%20lives%20and,and%20disregard%20for%20h uman%20rights.
Vedavalli, Priya. “Overview of Expenditure on Police| Union Budget 2021-22”, IDFC Institute Blog. 04 February 2021. https://www.idfcinstitute.org/blog/2021/february/overview-of-expenditure-on-police- union-budget-2021-22; Common Cause & Lokniti, Centre for the Study Developing Societies (CSDS). “Status of Policing in India Report 2019 - Police Adequacy and Working Conditions”. 2019.https://www.csds.in/uploads/custom_files/1566973059_Status_of_Policing_in_India_Report_201 9_by_Common_Cause_and_CSDS.pdf.
Završnik, Aleš. “Criminal justice, artificial intelligence systems, and human rights”. ERA Forum 20, 567–583. 2020. https://doi.org/10.1007/s12027-020-00602-0.