2404 – The Future Ahead Will Be Weird AF (the Ultimate AI CoreCore Experience) I+II part (2024)

I am indebted to Rusty Foster to these incredible pastiches of Adam Curtis.

Silvia Dal Dosso predicts that The Future Ahead Will Be Weird AF but the present is already in the past and the weird future ahead is here right now.”

SCAM FACTORIES

Yes, magicians, managers, and PR agents have always multiplied illusions to our disadvantage, but what if technology and innovation do not enhance reality but make scams even easier? Can one detach AI from what is happening in the actual geopolitical ‘shatter belt’ – like Myanmar (which is completely overshadowed by the ongoing genocide committed by Israel in Palestine). Nobody even talks about this region that used to be associated just with the Golden Triangle drug trafficking. From the Rohingya massacre to the Myanmar civil war, there is increasing instability and organized crime spilling over into China – but also fake gambling towns built overnight posing as “fake” part of the Road & Belt Initiative BRI – China’s and currently the world’s most ambitious infrastructure project. Also, fake job offers are becoming more and more sophisticated. It would be uncomplete to ignore how hustle culture online scamming and human trafficking have transformed into an industry since COVID. The Chinese movie “No More Bets” – was turned into an unlikely diplomatic success. While initially banned by several SE Asian countries the movie managed to bring about cooperation in “combating transnational crime and promoting cooperation in the Asia-Pacific region”. 

MACHINE LEARNING ILLUSIONISM

Machine learning consumes a lot of energy. It also seems to hallucinate a lot and upset a lot of people. What are we to do with this unregulated proliferation of illusions, deceptions, and mimicry in an era of post-post-post-post truth? Is it ok if AI offloads dreams and nightmares on us? Is this another externality? Does it matter if it gets powered by the sun’s seemingly inexhaustible energy? Or it doesn’t even matter what we think anyway since our energy thirst is just unstoppable – 20th-century industries and Carbon Technocracies have helped design our insatiable and energophage present. And then there is Oliver Stone promising us that nuclear power is the answer to the climate crisis and that several of his friends are working on it. Yeah, and seriously why blame Oliver Stone for cozying up with dictators when powerful CEOs dream of becoming absolutist monarchs and anti-state monarchists (Reichsbürger) are conspirationists with a pedigree? How is it that would-be emperors are invited as speakers and anarcho-capitalists cryptobros meetings, well maybe the answer is that technobros are actually turning the neocon world into a simulation theory by actualizing a form of the Truman Show.

It is weird as fuck already, and tomfoolery is the order of the day. AI hype boosterism combined with a good dose of deep fake scare is making things feel irrecoverable and irretrievable fucked. How to build up a coherent video of all the AI rampage and hyperbolic BS out there? Well, Silvia Dal Dosso demonstrates just that. Documentarists seem relegated to the trashbin of history because even Hypernormalisation sounds passé. Well, let us see what morphings and monstrous becomings entice and grab our attention. Who then will also offer us a fluctuating lifeboat through AI sludge and is this really unprecedented? As the YT video shows, animals were always cheating, fooling around and with each other. Octopi are masters at camouflaging themselves. Game theorists were always trying to find how cooperation developed, how animals (or plants, or viruses) evolved, and found ways to counter cheating, and the reality is that both mutualism and cheating promote multifarious complexity and deception is always a sign of intelligence no? (check Frans de Waal) At the same, there is a need for a broader genealogy of decision-making, the reconceptualization of reason, decision-making, and “freedom” – that for Orit Halpern “underpins contemporary relations between machine learning, reactionary politics, and neoliberal economics“. A change that he locates between 1950 – 1970 and that “systems might change and adapt nonconsciously”.

Play is everywhere, but today’s neoliberal regime has made it very easy for cheaters by deregulating (“desire for unsupervised learning in nets and the agglomeration of ever larger data sets” – Orit Halpern).  Everything was a bet on industries and corporations that would self-regulate and self-organize. Well, that almost never happens. When things get so tragic it is hard not to feel we’re at the butt of the AI jokes. We are hunted down by constant doppelganger effects, and it feels like Techgnosis and High Weirdness researchers Erik Davis and Naomi Klein critics of shock therapy and destruction capitalism meet on the same page of irreducible weirdness and farce.

Scams are innate to capitalism, and Eastern European countries entered capitalism by being exposed to nation-wide multiple pyramid schemes. Oligarchy in the East was born out of that and “financially illiterate East Europeans” became easy prey. On the other hand in a heavily mediated online world people are being now scammed precisely when they look for EXPERIENCE (aka unmediated and immediate immersion), AI -technology-empowered scammers had a field day since COVID struck and many developed into corporate-size businesses (not to say that corporations aren’t themselves overvalued scams). So it is not what tech billionaires are warning about – but simply put capitalism + AI = turbo-charging scamming. Already voice-assisted and image-assisted distress signals are being used to scam parents out of their savings.

Mimicking Adam Curtis does the trick but also completely outperforms Curtis at his best game – The Future Ahead will Be Weird is as weird as Fuck and dangerous as Fuck (to quote Whitehead) is a rare good addition, building up on all the online fake deluge and even historicizing it. Watch it laugh and despair!

2355 – Scavengers Reign (animation mini series 2023)

timespace coordinates: planet Vesta in the far future when interstellar cargo ships roam the galaxy

MV5BYWUxYjMxNWMtNDY4Mi00NjQ3LTljMDItNTdjNjkzOTU1ZGI4XkEyXkFqcGdeQXVyMTEzMTI1Mjk3._V1_FMjpg_UX1000_

adult animated science fiction drama television series created by Joseph Bennett and Charles Huettner (here is an interview)

Probably this is one of the most expected pieces of SF this year. And it delivers and is excellent on several accounts, contrasting with most of what gets labeled as SF nowadays. There is no lack of visually stunning cinematic works that seem to lack something – be it plotwise, involvement, or character development or are bound to repeat some form of techno-orientalist cliche with super-advanced yet missing Asians.

Is there any type of exoplanetary SF possible today when most of the future visions are somehow retro vintage SF golden age or very derivative? This was contradicted at the end of 2023 by Joseph Bennett and Charles Huettner with a new independent, daring SF “eco-gothic” SF series production for the Max video-on-demand subscription channel that emanated out of the Californian animation industry. Scavengers Reign has somehow demonstrated that not everything is being consumed by the Disney Studios monster. Although I doubt there’s life after you fall into the D sarlacc’s capacious stomach.

Scavenger Reign stands closer to the European animation school and in particular the French comics and animation. It oozes Métal Hurlant and René Laloux with the geometric forests, panoramic vistas and its changeling alien ecosystems. But there is certainly also an anime/manga aspect – or the traces of the best of anime and manga. There is a touch of weird naturalism, of eerie transformations, and of horrific metamorphosis, particularly if one thinks in terms of the Katsuhiro Otomo’s masterpiece Akira from 1982 which was stunning for its realism and Nausicaä of the Valley of the Wind manga (not anime!) by Hayao Miyazaki. Biological genomes get hijacked, and the extended virome that permeates alien planets trafficks information across the species barrier. Everything is inter-species, everything sporulates, and telekinetic parasitism abounds (something close to the rove beetle eating baby ants while the ants think it is one of them – thx Ben Woodard for reminding me of this crazy true fable), but also the dance of co-evolution.

It is also the first US SF product (with help from South Korean animators – Studio JDD) – and it is no accident that it is an animation piece that finally does justice to some authors that have never been adapted for the screen such as the exoplanetary works of Joan Lyn Slonczewski (The Children Star) or only partially so – Jeff VanderMeer (particularly Borne and The Strange Bird two of my favorite pieces of new weird & postapocalyptic post- biopunk SF).

Otherness participates here at every level – from hallucinations of even the most common kind, say your lover’s voice and image that is being somehow puppeteered by something really different (do not think Stanislaw Lem’s Solaris), a plethora of really alien creatures using human carriers via their feelings and thoughts, but these thoughts and feelings somehow animating the alien critters as well in return. To affect means to be also affected (thinking here of Deleuze, but also Whithead’s Critique of Pure Affect). Also, we should not expect alien sentience to conform to our technological imaginary – it can be really very much a creature of strange and lowly appetites, irrespective of its extra sensorial powers. So you could really imagine the corporate alien slugs from Charles Stross’s Accelerando leaving sticky marks on Scavengers Reign’s world.

Scavengers_Reign_TV_Series-268687020-large

It is also one animation that takes into account our new scientific knowledge about species being as complex communities, interplays, or choreographies of genes or societies of genes of entirely different species. This knowledge constantly reshaped our understanding of what an individual being is or offers us continuous glimpses into how tight-knit such relationships are or how human agency or artificial agency dissolves or is being constantly rerouted within these webs of agency, non-agency, and misplaced intentionality. Parasitism is pervasive but it is also just one expression of the complexity and mutualism of such an ecosystem – it’s fleas upon fleas all the way down and up. There’s also a bizarre in-betweenness, much on this planet actually thrives on cross-fertilization with non-alien, human intruders and their creations (robots). There is a great scene where Azi and Levi (a human and robot partnership that survived the crash of the Demeter 277 cargo ship) who was cultivating and gardening new earthly gardens – Azi the robot is itself a walking garden. Inside its machinery there is some kind of new hybrid semiconductor with slime molds as a partner (it seems to me), maybe something close to unconventional computing is aiming at since some time.

imdb // wiki

Scavengers_Reign_TV_Series-492282349-largeScavengers_Reign_TV_Series-909878606-large

2259 – The Artifice Girl (2022)

The Artifice Girl is a science fiction drama film directed by Franklin Ritch. Stars , , , David Girard and Franklin Ritch.

MV5BYzE1MWRkODQtNzdjZC00ODEyLWJkNDMtYzFiZjljNDIwNzRkXkEyXkFqcGdeQXVyMzQwMTY2Nzk@._V1_FMjpg_UX1000_

imdb  //  rottentomatoes

1852 – Coded Bias (documentary by Shalini Kantayya 2020)

official

When MIT Media Lab researcher Joy Buolamwini discovers that facial recognition does not see dark-skinned faces accurately, she embarks on a journey to push for the first-ever U.S. legislation against bias in algorithms that impact us all.

This is probably one of the most important documentaries to address many issues that are not any longer strictly the domain of SF. Cod Bias is definitely within the bounds of any socially inflected SF worlds u can think of. Maybe it used to be just the figment of dystopian – Cold War tinged imagination, but now it is very much part of ours. Made me actually mentally revisit theat primordial Silicon Valley 1984 promo – the ad for Apple Macintosh PC released in December 1983. Feels puzzling how this new televised technological muscle was part of a much wider and concerted Reaganite response to the -(still) Socialist East. ‘Free World’ computing as easily turned and facing off the eponymous Orwellian 1984 villain, a drab, grey, docile citizenry of the standardized monolithic solid-state, the ideological ‘other’ where a repressive & monstrous surveillance apparatus – (be it Securitate/Stasi) enforced obedience & ‘rightminding’. Only that, in retrospect, the newly competitive Silicon Valley product was a launch-pad for a much wider privacy Dragnet and much more insidious scope and certainly fancier in looks & design. Buying into a system of personal, automated & generalized consumer surveillance that also brought the pretense of neutral, un-biased coding.

Coded Bias documentary is the strongest advocacy of algorithmic justice i have seen, watched or heard of. A critical introduction to the current algo-capitalistic trends & as well as some of the ways needed to counter act AI-supported disparities & disenfranchisement. It is no mystery that you actually need people from across the board, including industry ppl (call them what u want, ex- Quants/former flash trading brokers, tech renegades, whistle-blowers, technological deserters, industry watchdogs, etc). Yes, not only EFF members, STEMs, geeks and blerds, but also people from the social housing blocks, the hood, the street corner youngsters and those with migrant-background – those that are primary targets and have been already mis-measured, data stripped and data mined and whose bodies and faces are literally the training grounds of computational modernity. Most of them, are the unwilling informants and unpaid trainers of emerging tech deployments that under-girds surveillance capitalism.

One of the most important takes from this documentary – was for me the counter-intuitive demonstration that goes against old cyberpunk sayings (paraphrasing: ‘the future is already here but it is just unequally distributed’). In the 21st c we learn time and time again, that the 1%, or 10% or the rich, powerful and wealthy are not the future’s bleeding knife- since they have mostly lived live of unfettered privacy and non data retention. They are not a tested minority, and clearly not the ones who get first unwanted access beforehand and do not suffer the effects of those things that will get distributed later one a vast scale. In fact (as one of the participants of Coded Bias points out) – the post-apocalyptic poor, the unprotected, those with previous histories of discrimination, enslavement, incarceration, abusive family background, profiling etc those already under some state of surveillance, registration and control (ID checked mostly in terms of constituting some form of risk), are the ones who suffer the blunt of these new technologies.

They are the un-glamorized testers of unequal futures, and not the privileged rich beta testers that mostly seem to opt-out of their own companies technological wonders. Accordingly, technological transformation is so important that it should not be defined just in terms of access – or left at the whim of company board members, Big Tech, Innovation hubs or ‘smart’ city planners & cheerleaders. It is not just a question of ‘users’ – since it is about the ‘used’ more than the users nowadays. It is – without nostalgia or pre-technological naivity in tow, that in spite – of these tremendous and complex planetary changes, legislation and lobbying for digital rights & accountability seems to lag behind, since both public attention and consciousnesses gets bypassed. Direct oversight and regulation or consciousness itself seems so trivial, and yet it is constantly remade into a threshold to be bypassed by the free markets & mantras hailing for ‘disruptive’ transgressions. Nonetheless, there is this incredible alliance and (as seen below) a lot of initiatives have sprung up, that espouse not just a neo-Luddite conviction, but one of tekk-savvyness, informed by the above ‘renegades’and industry insiders and/or burnouts as well, by previous historical black liberation examples as by the new empowering SF alternate histories (i see some clear signs of Wakanda there) having been written (thinking about Solomon Rivers,Nalo Hopkins and Nisi Shawl & others here) or waiting to be written in collaboration with automated text generators or not.

There is emerging calls from both government and by popular demand to at least be able to opt-out of these technologies in the US and EU (face recognition being just the most obvious case), altough I’m not sure about the vast majority of the world (which is clearly not from the Global North) or even the accelerating use & deployment of drone wars & DARPA abroad in the wake of protracted but inevitable US retreat from Afghanistan. There of course the possibility to learn how optical governance works or is put to use/abused in other parts of the world, since the West does not hold the monopoly over AI. China, in particular is an interesting divergence, since machine vision has been widely rolled out by the CCP via its social credit score, as well as being repurposed from below during the Pandemic response. SF has been historically very wary with attempts to modulate or influence behaviors such as behaviourism, to tuning or pegging controls or strong emotional responses towards a common good (Just think of swath of movies from Equilibrium 2002 to Brave New World 2020 or the new Voyagers 2021). ‘Brainwashed’, ‘the Manchurian Candidate’ etc are just a few of the inherited standard fear responses churned by both Cold War warriors, strategists, Pentagon brass and the run of the mill Hollywood movie output whenever they tried to depict or describe actual, imagined or suspected ideological traitors and US army deserters. ‘Brainwashing’ especially was made up into a sort of explain-all – to cover a whole range of ‘enemy'(past & present) responses, as the only possible logical explanation for the divergent behavior of former US troops (many of them black) who decided to opt-out of the racist US capitalist system after living as POW (during Korean War). When former army personnel decided to question, defect & live outside their bounds they must have been ‘brainwashed’, especially if they happened to be choosing Mao’s China for a while (a forgotten history detailed with tremendous wit in Julia Lowell’s fascinating book: Maoism: A Global History 2020) instead of racism back home or in the army. Change of mind and qualms about incoming orders also equals treason as we know from the case of Chelsea Elizabeth Manning or Edward Snowden.

In a rare and courageous move – The White Space (Machine/Ancestral Night duology) space opera universe of Elizabeth Bear avoids the usual ‘brainwashing’ suspicion of previous SF dystopian conventions by offering exactly what so much canonic SF eschews. It opens the possibility of a wide, non-coercive future galactic union where every human (altough the union is made by many non-sapient but sentient syster species) has the option to decide how much it alters, allows or wants to dial-down or fine-tune (what amounts to certain AI assisted ‘mindfulness’) a central nervous system evolved to automatize responses to emotional distress. Changing developmental patterns etc including universal non-coercive(!) access (called “bumping” in the novel) to what amounts to puberty blockers is not automatically a bad thing or a monstrous unnatural hybristic act(altough there’s libertarian privateers who think so in that universe like in ours)!

White Space opens up a way to modulate, discuss and deal in other ways with trauma, isolation, addiction, puberty, dysphoria, sex or gender assignment by birth etc bypassing automatic, hormonal or non-cognitive ‘habitual’ responses, being able to imaginatively limit violent behaviors at a minimum. Curbing willingly so much of what is anti-social behavior was apparently frowned upon even in that far future, but there’s room for so much more. It’s of course always important to pay attention to who decides what and when one misbehaves or when disobedience becomes accepted & when not. Of course there is a thin line, and there are those who want to skip and actively propagate opting out of the opting out. Body (non modification) extremists surely exist in that future that deem it sacrilegious to intervene or to dabble with ‘natural’ responses, while acting (on whole) quite egoistically and self-centered. In this galactic union – new forms of piratical freeports keep offshoring resources and escaping the central taxing authority, thus harboring non-mindfulness terrorism arising in response to a largely benefic mental & emotional tuning widely available. Even if coding bias into hardware based on white wetware bias is the main focus of Coded Bias, it ultimately supports a malleable wetware-hardware continuum that allows for modulation and even requires it.

Black-boxing of the operative logics of machine vision or acknowledging that machinic cognition or decisionality is essentially collaborative, not isolated, nor impervious to questioning, thus, cannot just settle for the human/nonhuman or creator/created, nonhuman/posthuman binaries. It feels very wrong, since it closes down our own sensitivity either to the same old repackaged as new, or to a newer wider & largely collaborative nonhuman ‘worldy sensiblity’ that is always risks being tipped towards whiteness and reactive toxicity if left unattended. Microsoft’s Tay 2016 chatbot that developed 24h a proclivity for hate speech is a test in case. It’s not just the simple powerful logic of trash in trash out, but of how easily this tipping point might be achieved today under trolling & targeted attacks. At the same time, one should never loose sight of other machinic bridges &conceptually as well as emotionally more progressive examples that developed as part of writing practices & modernist techniques such as automatic writing or Alan Turing’s automated Loveletter generator.

One cannot unbox anything in a straightforward way, since Shalini Kantayya’s diverse cast of protagonists and invited guests make clear that not even programmers or makers do not understand how the AI does what it does. One more thing cannot be remedied with just more data, simply more information. Even acknowledging that we can fully understand those internal processes, we can still feel trh results, see the hard facts and harsh reality whenever these AIs tend to ignore black and brown or female faces. AIs do need some deep unlearning in order to ‘re-educate'(not such a bad word) themselves and make sure they will not act out just the mathematical sums of the worst of the worst and select by default for the chosen few while deselecting everybody else.

Pushing the logic of this documentary, it is time to find out more about how decisions, ‘chance’, contingency may still be directed so as to redistribute luck on a more equal way in an increasingly unequal world economy. Economy is itself futurism served frozen & pre-cooked, and different debt ridden lives and widely different futures are being handed down, bent along pre-selected trajectories, trajectories that are being doctored (who cares if knowingly or unknowingly, intentionality is always ulterior anyway) actively make impossible the lives of a majority. A ‘pan-selectivity’ needs yo be developed that refuses yo be ‘gamed’ easily and influenced only by the influent few armed with predictive algorithms – at the tip of a capitalistic drive that actualizes every potential out there, no matter how horrific and brutal as long as it pays dividends.

Like probably any ideological formation – bias is not just invisible, it probably maybe impossible to completely eliminate, but this should not stop us trying to change it and actively imagine what’s to be done. Bias seems to work and act by being unspecified, invisibilized, left out of the loop. Again, like ideology, it is the missing mass that bends everything according to its set of preemptive expectations, almost like a constant enactment of a single, unilateral inner experience, making itself ubiquitous. Bias is not simply an apparently whimsical conceit, it is not just a pre-programmed part of the system, but something that needs to be enforced, hard-coded and programmed at every level of future decision making, at ever threshold of resistance.

Bias is made seemingly non-existent each time output and prediction is put at a premium. If if blaring, it feels like an itch you cannot scratch, because it starts to seem so intrinsic & para-systemic. Technology or AI is not neutral nor is inherently bad it gas been often said, and it is getting as bad or worse or as good as the whole context/environment allows it, or the drift promoting it keeps on pushing it, or as long as the coded ideals and values are what they are. Remember even if everything is being turned into ‘driver-less’-everything, it’s not less of driven- market economy.

We can not see it and measure it because its effects are measured on those who are made to matter less and less, on those ‘others’ that even the states, law or constitution does not seem to ‘notice’ or care for any longer. It is easier to wave bias aside, to bring undigested misconstructions on board and heap them on top of those being distributed the loosing lots, the bad seats(if any), and even if those stories just give you bad dreams, goosebumps, depression or severe need to disconnect from another’s catastrophic or already dystopian reality. So this necessitates different, collective and directed research approaches & coordinated effort to ‘black boxing’ so many current decisional processes. There’s also a different venue (not tackled in Coded Bias) – a sort of related QWERTY bias, of path dependencies whenever we have historically & incrementally built conventional (man-made) computational infrastructures. This ‘convention’ not only only stands in the way of more evolutionary – developmentally inclusive, unconventional approaches to computation & computing, but might leave out or blind us to other venues or other modes of problem solving existing or evolved (as those investigated by Andrew Adamatsky studying maze-solving slime molds). While most computation & research nowadays follows old & certainly well-tested arhitectures, it only builds upon existing & specific constraints – all too human ones we might add, moreover a very restrictive & biased account of what counts as ‘human’ (amply documented throughout Coded Bias), one that both engineering and coding seems to take as granted. ‘Worth’ – in a constantly devalorizing environment becomes constantly threatened, at the same time we should welcome the erosion of old, gendered biased and individualistic notions of singular genius(unmoved mover?) and farcical ‘great men’ through our plural AI – human interactions.

Coded Bias gets the highest marks in advocating for an A.I.X -research, attempting to build an explainable artificial intelligence, a research that should be aware of ‘artificial unintelligence'(Meredith Broussard), as well as to demands that humans hone their response-ability (Haraway), both allowing for aesthetic, epistemologic and ethical responsiveness whenever technological 21st upgrades and optimizations start pouring in.

Algorithmic Justice League (AJL)

AJL TW

AI fairness 360

Big Brother Watch UK

Algorithmic Equity Toolkit

Recidivism Risk Assessment

Association for Computing Machinery code of ethics

Silicon Valley Rising

Critical Race and Digital Studies Syllabus

No Biometric Barriers Housing Act of 2019

A Toolkit on Organizing Your Campus against ICE

stopping big data plan to flag at risk students

Responsible Computing Science Challenge

Hacking Discrimination hackaton

Protest Surveillance: Protect Yourself toolkit from Surveillance Technology Oversight Project (S.T.O.P.) for safety recommendations

AI Now Institute at New York University is a research center dedicated
to understanding the social implications of AI.

Fight for the Future is a group of artists, activists, engineers, and technologists
advocating for the use of technology as a liberating force.

Our Data Bodies is a human rights and data justice organization.

Data & Society studies the social implications of data-centric technologies & automation.

AJL logo

You do not need to be a tech expert to advocate for algorithmic justice. These basic terms are a good foundation to inform your advocacy. For a more detailed breakdown of how facial recognition works, see the guide titled Facial Recognition Technologies: A Primer from the AJL. For more on surveillance, see the Community Control Over Police Surveillance: Technology 101 guide from the ACLU.

GLOSSARY OF TERMS (extracted from Coded Bias Activist Toolkit)

Algorithm. A set of rules used to perform a task.

Algorithmic justice. Exposing the bias and harms from technical systems in order to safeguard the most marginalized and develop equitable, accountable, and just artificial intelligence.

Benchmark. Data set used to measure accuracy of an algorithm before it is released.

Bias. Implicit or explicit prejudices in favor of or against a person or groups of
people.

Artificial intelligence (AI). The quest to give computers the ability to perform
tasks that have, in the past, required human intelligence like decision making,
visual perception, speech recognition, language translation, and more.

Big data. The mass collection of information about individuals who
use personal technology, such as smartphones.

Biometric technology. Uses automated processes to recognize an individual through unique physical characteristics or behaviors

Black box. A system that can be viewed only through its inputs and outputs, not its internal process.

CCTV. Closed-circuit television cameras are used by institutions to record activity on and around their premises for security purposes.

Civil rights. A broad set of protections designed to prevent unfair treatment or
discrimination in areas such as education, employment, housing, and more.

Code. The technical language used to write algorithms and other computer programs.

Data rights. Referring to the human right to privacy, confidentiality, and
ethical use of personal information collected by governments or corporations through technology

Data set. The collection of data used to train an algorithm to make predictions.

Due process. The right not to be deprived of life, liberty, or property without
proper legal proceedings, protected by the Fifth and Fourteenth Amendments to the US Constitution.

General Data Protection Regulation
(GDPR).
A data rights law in the European Union that requires technology users consent to how their data is collected and prohibits the sale of personal data.

Facial recognition. Technologies – a catchall phrase to describe a set of technologies that process imaging data to perform a range of tasks on human
faces, including detecting a face, identifying a unique individual, and assessing demographic attributes like age and gender.

Machine learning. An approach to AI that provides systems the ability to learn
patterns from data without being explicitly programmed.

Racism. The systematic discrimination of people of color based on their social
classification of race, which disproportionately disadvantages Black and
Indigenous people of color.

Recidivism risk assessment – Automated decision making system used in
sentencing and probation to predict an individual’s risk of future criminal behavior based on a series of data inputs, such as zip code and past offenses.

Sexism. The systematic discrimination of women and girls based on their social
categorization of sex, which intersects with racism for women and girls of color.

Social credit score. An AI system designed by the Communist Party of China
that tracks and analyzes an individual’s data to assess their trustworthiness.

Surveillance. The invasive act of monitoring a population to influence its
behavior, done by a government for law and order purposes or by corporations for commercial interests.

Value-added assessments. Algorithms used most commonly to evaluate teachers by measuring student performance data.

Voice recognition. An application of AI technology that interprets and carries out spoken commands and/or aims to identify an individual based on their speech patterns.

imdb

1851 – books mentioned in the Coded Bias documentary

Weapons of Math Destruction by Cathy O’Neil

We live in the age of the algorithm. Increasingly, the decisions that affect our lives–where we go to school, whether we can get a job or a loan, how much we pay for health insurance–are being made not by humans, but by machines. In theory, this should lead to greater fairness: Everyone is judged according to the same rules.
But as mathematician and data scientist Cathy O’Neil reveals, the mathematical models being used today are unregulated and uncontestable, even when they’re wrong. Most troubling, they reinforce discrimination–propping up the lucky, punishing the downtrodden, and undermining our democracy in the process.

The Age of Surveillance Capitalism: The Fight for a Human Future at the New Frontier of Power by Shoshana Zuboff

The challenges to humanity posed by the digital future, the first detailed examination of the unprecedented form of power called “surveillance capitalism,” and the quest by powerful corporations to predict and control our behavior.

In this masterwork of original thinking and research, Shoshana Zuboff provides startling insights into the phenomenon that she has named surveillance capitalism. The stakes could not be higher: a global architecture of behavior modification threatens human nature in the twenty-first century just as industrial capitalism disfigured the natural world in the twentieth.

Zuboff vividly brings to life the consequences as surveillance capitalism advances from Silicon Valley into every economic sector. Vast wealth and power are accumulated in ominous new “behavioral futures markets,” where predictions about our behavior are bought and sold, and the production of goods and services is subordinated to a new “means of behavioral modification.”

The threat has shifted from a totalitarian Big Brother state to a ubiquitous digital architecture: a “Big Other” operating in the interests of surveillance capital. Here is the crucible of an unprecedented form of power marked by extreme concentrations of knowledge and free from democratic oversight. Zuboff’s comprehensive and moving analysis lays bare the threats to twenty-first century society: a controlled “hive” of total connection that seduces with promises of total certainty for maximum profit–at the expense of democracy, freedom, and our human future.

With little resistance from law or society, surveillance capitalism is on the verge of dominating the social order and shaping the digital future–if we let it.

Artificial Unintelligence: How Computers Misunderstand the World by Meredith Broussard

A guide to understanding the inner workings and outer limits of technology and why we should never assume that computers always get it right.

In Artificial Unintelligence, Meredith Broussard argues that our collective enthusiasm for applying computer technology to every aspect of life has resulted in a tremendous amount of poorly designed systems. We are so eager to do everything digitally—hiring, driving, paying bills, even choosing romantic partners—that we have stopped demanding that our technology actually work. Broussard, a software developer and journalist, reminds us that there are fundamental limits to what we can (and should) do with technology. With this book, she offers a guide to understanding the inner workings and outer limits of technology—and issues a warning that we should never assume that computers always get things right.

Making a case against technochauvinism—the belief that technology is always the solution—Broussard argues that it’s just not true that social problems would inevitably retreat before a digitally enabled Utopia. To prove her point, she undertakes a series of adventures in computer programming. She goes for an alarming ride in a driverless car, concluding “the cyborg future is not coming any time soon”; uses artificial intelligence to investigate why students can’t pass standardized tests; deploys machine learning to predict which passengers survived the Titanic disaster; and attempts to repair the U.S. campaign finance system by building AI software. If we understand the limits of what we can do with technology, Broussard tells us, we can make better choices about what we should do with it to make the world better for everyone.


<<   0879