CHI 2024

Mental Models, Expectations and Implications of Client-Side Scanning: An Interview Study with Experts

Divyanshu Bhardwaj*, Carolyn Guthoff*, Adrian Dabrowski, Sascha Fahl, Katharina Krombholz* Equal contribution

In short

Client-side scanning (CSS) checks content on a user’s own device and is discussed as a way to stop the spread of child sexual abuse material (CSAM). A major challenge in this debate is that the people involved interpret what the technology can and cannot do, and how it would be implemented, very differently. This study asked experts how they understand CSS, what they expect from it and what they see as its implications.

How the study was done

  • 28 expert interviews
  • Semi-structured

We conducted and analyzed 28 semi-structured interviews with experts from child protection, law enforcement, data protection and academia. We first discussed client-side scanning as a technology on its own, then in the context of fighting CSAM.

Key findings

  1. Understanding

    Different mental models

    How broad and deep experts’ understanding of client-side scanning was depended on their technical background. The term covers very different types of scanning, which the study structures into dimensions.

  2. Challenges

    Expected problems

    Experts described their expectations on goals, adoption, implementation and use of the technology, and the challenges they expect if it is deployed.

  3. Debate

    Preferred for lack of alternatives

    Client-side scanning is often the preferred solution in the child sexual abuse debate because there is no alternative.

  4. Society

    Children can lose rights too

    Depending on the implementation, children, the intended beneficiaries, can also face significant limits on their rights, such as privacy and free will.

What should change

Client-side scanning can be built to detect any content, and its proposed safeguards are policy, not technology. No system has a zero false positive rate, so even a tiny error rate across many benign cases can produce far more suspects than actual perpetrators. Further interdisciplinary discussion is needed to define and understand its impact on society, particularly on vulnerable groups such as children.

Common questions

What is client-side scanning?

Client-side scanning (CSS) checks content on a user’s own device. It is discussed as a way to stop the spread of child sexual abuse material (CSAM). The term covers very different types of scanning, and experts’ understanding of it depended on their technical background.

Why is client-side scanning favored in the debate on child sexual abuse material?

In our interviews, client-side scanning was often the preferred solution in the child sexual abuse debate because there is no alternative. Experts also described their expectations on its goals, adoption, implementation and use, and the challenges they expect if it is deployed.

What are the risks of client-side scanning?

Client-side scanning can be built to detect any content, and its proposed safeguards are policy, not technology. No system has a zero false positive rate, so even a tiny error rate across many benign cases can produce far more suspects than actual perpetrators. Depending on the implementation, children can also face significant limits on their rights, such as privacy and free will.

Abstract

Client-Side Scanning (CSS) is discussed as a potential solution to contain the dissemination of child sexual abuse material (CSAM). A significant challenge associated with this debate is that stakeholders have different interpretations of the capabilities and frontiers of the concept and its varying implementations. In this paper, we explore stakeholders’ understandings of the technology and the expectations and potential implications in the context of CSAM by conducting and analyzing 28 semi-structured interviews with a diverse sample of experts. We identified mental models of CSS and the expected challenges. Our results show that CSS is often a preferred solution in the child sexual abuse debate due to the lack of an alternative. Our findings illustrate the importance of further interdisciplinary discussions to define and comprehend the impact of CSS usage on society, particularly vulnerable groups such as children.

Cite this paper