Paris 2024 Will Be Most Beautiful Olympic. So We Surveillance You Like Orwellian
Paris 11.07am
When Juliette, a French single mum on welfare, went to visit her critically ill father she ended up with a ruinous demand for repayment of social security benefits. He died soon after and she found herself under investigation by France’s CNAF. She’d been flagged by an algorithm.
The investigation determined that she owed thousands of euros that would be deducted from her monthly welfare payments. What Juliette did not know at the time was that she was one of hundreds of thousands of people on welfare in France being flagged by an algorithm.
If you may read in twitter / X that Palestinian killed by algorithm AI [BY ISRAEL] or orwellian grid map [WORLD WAR 2, in the Netherland, grid map called STIPPENKAART] by Israel push a lot of Gazans to living in ‘checkbox area’, French people actually living ‘at least’ nearly same with Gazans. Surveillance, flagged algorithm, etcetera.
Plestia Alaqad. Anne Frank
If the devastation of entire Gaza neighborhoods is the measure, Israel's reliance on artificial intelligence [AI] to generate targets has been a disaster. It shows an indifference to Palestinian civilian life that is a virtual invitation to war-crime charges.
France is an early member of a club of nations that experiment with predictive tech on vulnerable populations. Its risk-scoring algorithm has roots in a Sarkozy era moral panic over welfare fraud, which saw him vow in 2008 to “punish fraudsters.”
For more than a decade and without any public consultation, CNAF has deployed machine learning at a massive scale in a hunt for welfare fraud. Each year, nearly half of France’s population is silently ranked by a secretive risk score between 0 and 1. The only way to obtain the machine score is to make a subject access request under the General Data Protection Regulation.
People with the highest scores are subject to the CNAF’s most invasive investigations, where fraud controllers are empowered to search people’s homes, count toothbrushes to guess how many people live there, question their neighbours and scour bank records. Seven out of every ten people investigated in this way are flagged by the algorithm.
Over the course of six months Lighthouse and Le Monde investigated the algorithm deployed by CNAF. We used freedom-of-information laws to obtain far-reaching access to the building blocks of the system that enabled us to take it apart and analyse how it scores millions of people. We found that the algorithm hones in on people’s vulnerabilities — which have no apparent connection with fraud — such as being a single parent, having a low income or a disability.
Rewrite again, France is an early member of a growing club of nations that experiment with predictive technology on vulnerable populations with profound consequences.
In 2021, Lighthouse worked with Algorithm Watch’s Nicolas Kayser-Bril to send a freedom-of-information request asking for the source code of the CNAF’s algorithm. The agency disclosed the source code, but redacted the variables that would allow us to understand how it actually scores people. After an appeal was rejected, work on the investigation paused as we pursued access elsewhere.
In parallel, digital rights groups La Quadrature du Net and Changer de Cap mounted a series of campaigns calling for the CNAF to release the code of the algorithm. Earlier this year, they successfully argued in front of France’s Commission for Access to Administrative Documents (CADA) that the CNAF should have to release the source code for previous versions of its risk assessment algorithm. The CNAF independently disclosed unredacted source code to La Quadrature and Le Monde. La Quadrature’s analysis can be found here.
Obtaining runnable code is rare and the far-reaching access we acquired enabled us to test how different kinds of people are scored (see this blog for a detailed discussion of the methodology). With nearly half of France’s population scored every year by the model, in principle a wide variety of people are at risk of being flagged. Yet when we tested the model we found that in practice it only flags the most vulnerable while it is nearly impossible for the better-off to score high enough to be investigated. Meanwhile poorly constructed criteria mean that arbitrary changes in behaviour — like sending an email one month instead of two months ago — can land people flagged
Interviews with insiders and CNAF officials allowed us to trace the system’s history back to the growing hysteria around welfare fraud in late 2000s as Nicolas Sarkozy vowed to “punish fraudsters.” Months of community-level reporting and interviews with lawyers allowed us illustrate the drastic consequences for vulnerable people.
The technology story provides an interactive explanation of our joint audit and how the algorithm makes broad, prejudiced generalisations about millions of people. It finds evidence that the system both directly and indirectly discriminates against groups protected under French discrimination law.
The people story traces the human consequences of being flagged for investigation and its dramatic toll on people’s lives. Readers follow Juliette as she types her details into a prototype of the algorithm and watch as her risk score rises. It ranges across France — where the level of unclaimed benefits is estimated to exceed 30 percent — and follows welfare recipients who struggle to navigate the complex rules of a system where mistakes are cast as deliberate fraud.
The system story traces the history of the system and how a small experiment at a local CNAF in Bordeaux went national amidst a growing moral-panic over welfare fraud. It shows how even key figures close to the algorithm’s development are beginning to sound the alarm, including former CNAF director Daniel Lenoir.
I know a lot of high-ranking media, such as New York Times, Guardian, Anadolu, BILD, Spiegel, Financial Times, Strait Times, Washington Post etc subscribed my substack. Plestia ‘Bosbos’ Alaqad ready to be your Stringer inside Gaza under bombing by Israel. Plestiaa2011@gmail.com
Toddler with Plestia, before war, living in Northern Gaza and they evacuated to Southern Gaza. Since Friday, Oct 13, when Israel announced to every Gazans from northern move to southern, more than 5,000 killed in southern, not counting barbaric bombing in northern Gaza. Northern Gaza is being depopulated, while even residents in the south are ordered to evacuate as the israelis implement their ethnic cleansing. Refugee literally fulfilled Israel warning, and still killed with barbaric bombing by Israel. Documentation by Plestia Alaqad
Thank you, as always, for reading. If you have anything like a spark file, or master thought list (spark file sounds so much cooler), let me know how you use it in the comments below. Thank you so much for letting me vent! If you enjoyed this article, you can give pledge to me (click PLEDGE button) or simply share this article with a friend. It helps me more than you realise.
If you enjoyed this post, please share it.
______________
Professor Hendrik, Professor Eric, and another person, Prof David A. Andelman, former Bureau Chief NYTimes recommended my substack, also some Chief Technology of Financial Times (FT) recommended my substack, not only subscribe. I'd be happy to get more & more PLEDGE and recommendations for better crafted writing (via Bank Central Asia (with my full-name ADI MULIA PRADANA, clearing code 0140119, account number 0201558866 or via STRIPE. For me, prefer Bank Central Asia).
If a friend sent this to you, you could subscribe here 👇. All content is free, and paid subscriptions are voluntary.
Subscribed
——————————————————————————————————
-prada- Adi Mulia Pradana is a Helper. Former adviser (President Indonesia) Jokowi for mapping 2-times election. I used to get paid to catch all these blunders—now I do it for free. Trying to work out what's going on, what happens next. Now figure out and or prevent catastrophic of everything.
(Very rare compliment and initiative pledge, and hopefully more readers more pledges to me. Thank you. My note-live blog about Russia - Ukraine already click-read 6 millions, not counting another note especially Live Update Substack (mostly Live Update Election or massive incident)
=======
Thanks for reading Prada’s Newsletter. I was lured, inspired by someone writer, his post in LinkedIn months ago, “Currently after a routine daily writing newsletter in the last 10 years, my subscriber reaches 100,000. Maybe one of my subscribers is your boss.” After I get followed / subscribed by (literally) prominent AI and prominent Chief Product and Technology of mammoth global media (both: Sir, thank you so much), I try crafting more / better writing.
To get the ones who really appreciate your writing, and now prominent people appreciate my writing, priceless feeling. Prada ungated/no paywall every notes-but thank you for anyone open initiative pledge to me.
(Promoting to more engage in Substack) Seamless to listen to your favorite podcasts on Substack. You can buy a better headset to listen to a podcast here (GST DE352306207).
Listeners on Apple Podcasts, Spotify, Overcast, or Pocket Casts simultaneously. podcasting can transform more of a conversation. Invite listeners to weigh in on episodes directly with you and with each other through discussion threads. At Substack, the process is to build with writers. Podcasts are an amazing feature of the Substack. I wish it had a feature to read the words we have written down without us having to do the speaking. Thanks for reading Prada’s Newsletter.
Wants comfy jogging pants / jogginghose amid scorching summer or (one day) harsh winter like black jogginghose or khaki/beige jogginghose like this? click
if you in Germany and using FRAENK provider, you can use code to get additional quota. THES3, DUSS17, JANZ43, MATC40, KIMR13. For code KIMR13 and rabat / discount, you can asked Kim Rosendahl in Instagram
amore ‘MIO’ is MEOWMAS. MEOW HAMAS
Headset and Mic can buy in here, but not including this cat, laptop, and couch / sofa