Weapons of Math Destruction

It's interesting to read this book and think about the media trying to scare us about China's “oppressive social credit score” system.
Meanwhile we have a patchwork of far less transparent black box systems that control...
• if you get into college
• if you get offered a job
• If you get a mortgage
• If you get targeted by scam universities or scam credit systems
• if you get approve to rent a home
• if you get fired or promoted
• if you get stopped by the police
• if you get bail
• if you get a longer criminal sentence
• if you get probation
And more. Existing systemic bias is coded into these algorithms, resulting in a venire of “science” and “objectivity” used to justify further systemic oppression.
Racist cops find more crime in poor non-white neighborhoods → algorithms designed to find “where crime might happen” takes this garbage data and outputs garbage results → Cops further oppress these neighborhoods, locking up more poor people → An algorithm looks at the material conditions of a defendant and determines that since he's poor, his friends and family are and have had run-ins with the law, and he has few professional prospects, he is likely to reoffend and gets a more stringent sentence.
This feedback loop reinforces our racist, classist criminal justice system while claiming to use “scientific, non-biased” tools. This is just one of the many examples of “big data” run amuck outlined in ths book.

Many more include leveraging big data to suck as much money out of poor people as they can possibly get away with. Because when we have a global economic system primarily driven by profit instead of helping people, the newest technological revolutionary tools will be used not to push humanity forward, but to suck up all our personal information to serve us targeted ads, many of which include ads to scam us.

Great book. highly recommended.