Mental Models, Expectations and Implications of Client-Side Scanning: An Interview Study with Experts
In short
Client-side scanning (CSS) checks content on a user’s own device and is discussed as a way to stop the spread of child sexual abuse material (CSAM). A major challenge in this debate is that the people involved interpret what the technology can and cannot do, and how it would be implemented, very differently. This study asked experts how they understand CSS, what they expect from it and what they see as its implications.
How the study was done
- 28 expert interviews
- Semi-structured
We conducted and analyzed 28 semi-structured interviews with experts from child protection, law enforcement, data protection and academia. We first discussed client-side scanning as a technology on its own, then in the context of fighting CSAM.
Key findings
- Understanding
Different mental models
How broad and deep experts’ understanding of client-side scanning was depended on their technical background. The term covers very different types of scanning, which the study structures into dimensions.
- Challenges
Expected problems
Experts described their expectations on goals, adoption, implementation and use of the technology, and the challenges they expect if it is deployed.
- Debate
Preferred for lack of alternatives
Client-side scanning is often the preferred solution in the child sexual abuse debate because there is no alternative.
- Society
Children can lose rights too
Depending on the implementation, children, the intended beneficiaries, can also face significant limits on their rights, such as privacy and free will.
What should change
Client-side scanning can be built to detect any content, and its proposed safeguards are policy, not technology. No system has a zero false positive rate, so even a tiny error rate across many benign cases can produce far more suspects than actual perpetrators. Further interdisciplinary discussion is needed to define and understand its impact on society, particularly on vulnerable groups such as children.
Common questions
What is client-side scanning?
Client-side scanning (CSS) checks content on a user’s own device. It is discussed as a way to stop the spread of child sexual abuse material (CSAM). The term covers very different types of scanning, and experts’ understanding of it depended on their technical background.
Why is client-side scanning favored in the debate on child sexual abuse material?
In our interviews, client-side scanning was often the preferred solution in the child sexual abuse debate because there is no alternative. Experts also described their expectations on its goals, adoption, implementation and use, and the challenges they expect if it is deployed.
What are the risks of client-side scanning?
Client-side scanning can be built to detect any content, and its proposed safeguards are policy, not technology. No system has a zero false positive rate, so even a tiny error rate across many benign cases can produce far more suspects than actual perpetrators. Depending on the implementation, children can also face significant limits on their rights, such as privacy and free will.
Abstract
Client-Side Scanning (CSS) is discussed as a potential solution to contain the dissemination of child sexual abuse material (CSAM). A significant challenge associated with this debate is that stakeholders have different interpretations of the capabilities and frontiers of the concept and its varying implementations. In this paper, we explore stakeholders’ understandings of the technology and the expectations and potential implications in the context of CSAM by conducting and analyzing 28 semi-structured interviews with a diverse sample of experts. We identified mental models of CSS and the expected challenges. Our results show that CSS is often a preferred solution in the child sexual abuse debate due to the lack of an alternative. Our findings illustrate the importance of further interdisciplinary discussions to define and comprehend the impact of CSS usage on society, particularly vulnerable groups such as children.
Cite this paper
@inproceedings{10.1145/3613904.3642310,
author = {Bhardwaj, Divyanshu and Guthoff, Carolyn and Dabrowski, Adrian and Fahl, Sascha and Krombholz, Katharina},
title = {Mental Models, Expectations and Implications of Client-Side Scanning: An Interview Study with Experts},
year = {2024},
isbn = {9798400703300},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
url = {https://doi.org/10.1145/3613904.3642310},
doi = {10.1145/3613904.3642310},
abstract = {Client-Side Scanning (CSS) is discussed as a potential solution to contain the dissemination of child sexual abuse material (CSAM). A significant challenge associated with this debate is that stakeholders have different interpretations of the capabilities and frontiers of the concept and its varying implementations. In this paper, we explore stakeholders’ understandings of the technology and the expectations and potential implications in the context of CSAM by conducting and analyzing 28 semi-structured interviews with a diverse sample of experts. We identified mental models of CSS and the expected challenges. Our results show that CSS is often a preferred solution in the child sexual abuse debate due to the lack of an alternative. Our findings illustrate the importance of further interdisciplinary discussions to define and comprehend the impact of CSS usage on society, particularly vulnerable groups such as children.},
booktitle = {Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems},
articleno = {833},
numpages = {24},
keywords = {child sexual abuse material, client-side scanning, crime prevention, surveillance},
location = {Honolulu, HI, USA},
series = {CHI '24}
}