“Potential Devastation from Algorithmic Technology”

In “Filterworld”, Kyle Chayka, a reputable technology and culture writer from New Yorker, expertly brings to light the infiltrative and frequently surprising ways that the algorithms of large social media platforms and recommender systems, which govern our views on applications such as Instagram, TikTok or Amazon, are increasingly bending not just our cultural consumption but its actual creation. Additionally, Madhumita Murgia, a journalist for Wired and Financial Times, analyses in the cleverly christened “Code Dependent”, the pressing topic of the day: artificial intelligence, its concerning training processes, and its imbalanced, often exploitative effects.

While the pair of subjects – culture and AI – might at first seem disjointed, they coalesce to highlight a cardinal issue in these stressful times: we are all turning into unwitting puppets of the algorithm. This theme is common across the two writers’ works, with both adopting a profound and personal stance towards their subjects, intertwining their personal experiences and reflections into their narratives. Their effective use of first-hand accounts by a few individuals provides a vivid depiction of the human impact resulting from the deployment and creation of such arcane and generally misunderstood technologies.

Chayka commences by providing an informative history of the development of algorithmic recommendation systems and subsequently delves into how what is deemed “popular” has become an escalating self-sustaining categorisation. The concept of culture is inherently varied, intriguing, complicated, challenging and unique, embodying the varied voices of a plethora of artists and creators. This brings forth the question, do we genuinely like what we consume online, which in turn impacts cultural spaces in reality? Chayka presents the argument that our preferences and interests are increasingly being homogenised into a uniform “Filterworld”, designed by algorithms whereby we are subconsciously conditioned to like and desire: “We now live in an era of algorithmic culture.”
Writer Maggie Armstrong presents a thought-provoking query: “I wanted to be a wastrel. I had no ambitions ever, for anything. Is that a symptom of the age?”

Murgia highlights the substantial reliance of most AI applications and software on data colonialism and exploitation of the ‘precariat’, despite AI’s potential benefits. He uses a harmless illustration of universally fashionable coffee shops with their identical muted hues, sleek designs, minimalist décor, trendy ambient music, strategically positioned foliage and perfect-for-Instagram flat whites. According to him, the intentional design of these spaces promotes the sharing of tweets, pictures, and videos, devoid of any real excitement.

Next, consider how algorithms of recommendation systems like Netflix (among others) nudge users towards a specific consumption behaviour. Whether you watch a movie with malevolent extraterrestrials or a film based on Jane Austen’s works, the algorithm unfailingly suggests similar content. Chayka wittily comments on the algorithm’s struggle to understand the notion of variety.

His analysis on how Amazon’s influence has detrimentally transformed publishing serves as a compelling illustration of Filterworld’s mechanics. It’s particularly persuasive because it’s underpinned by credible data and statistics, adding a personal but informed perspective. Nevertheless, the book falters slightly when he uses Sally Rooney’s work as an unclear example, which seems to be hinting that her novels are written to meet social media trending demands and appeal to online streaming demands (though her adaptations were made by BBC TV and not a streaming service).

Chayka suggests that Rooney’s novels have a complex relationship with their online presence. However, many may not have realised this, particularly those with fewer social media interactions compared to Chayka. Interestingly, his snide critique of Rooney serves as a convenient tool for fashioning a single clever, sarcastically humorous sentence, made just for touting on social media: “Could the 2020 TV portrayal of Normal People be best understood as a series of GIFs with amorous content that would have met vast popularity on Tumblr, if only it hadn’t prohibited explicit content in 2018?” Makes you wonder, doesn’t it?

(A note on AI’s potential impact on productivity in financial services).

Drawing to a close, Chayka’s chronicle of his break from social media—an all too familiar subject matter in books and articles—provides an insight into the addictiveness of such platforms. This narrative trajectory of initial desolation, followed by an explosive growth in self-awareness and finally returning to moderation and understanding, feels overdone and, frankly, unsurprising. Perhaps the critique of Rooney and this piece would have been better omitted from this scintillating probe into the unexplored particulars of how algorithms are slowly eroding the core of our humanity—our fine arts and culture.

Murgia’s perspective on artificial intelligence is both thoroughly explored and supported with substantial footnotes and a helpful index, similar to features that would enhance Filterworld. It offers a considerate gateway to the world of AI for novices, with the intricacies of the potentially intimidating technicalities subtly woven into the tapestry of personal narratives. It also makes for a stimulating read for those who, erroneously or otherwise, consider themselves experts in AI.

Chayka contends that our tastes and interests have been systematically diluted into an insipid uniformity, known as the Filterworld, dictated by algorithms that manipulate our preferences. Each chapter in Code Dependent astonishes, even as Murgia, self-proclaimed technology optimist, gently highlights potential advantages of AI. The challenge lies in harmonising these potential advantages with the existing human toll and devastating consequences.

Despite glimpses of AI’s benefits, Murgia highlights the troubling fact that most AI software exploits vast quantities of data and the precarious, an emerging term describing the unstable and unprotected workforce like gig economy participants grappling with financial and social uncertainty. These individuals and their communities are extraordinarily susceptible to exploitation through data accumulation, training AI systems with mind-numbing and monotonous tasks, and the occasional ill-planned AI trial programs, all aimed at creating AI products or services that they might neither afford nor benefit from. They provide prime examples of couriers, ride-share drivers, content moderators for social media, and trainee programmers for self-driving cars, not to mention victims of AI-engineered revenge pornography and healthcare application testers.

Attempting to delve deeper into the real-world implications of AI, Murgia embarks on a globe-trotting journey to reach those impacted by this technology, asking questions that put the human condition into focus. She communicates with individuals who are genuinely affected, their well-being and self-respect seemingly discarded for the sake of advancements like ChatGPT, facial recognition systems, and profitable AI apps crafted for wealthier people and societies. She reveals the morally uncertain dynamics in how these AI trials in certain communities can introduce new avenues for income, chances of progress, and even life-saving opportunities. However, most instances reflect how these benefits are often offset by employment instability, global workforce disparities, and the exploitation of those lacking the means to resist. Murgia’s findings make for compelling journalism.

Google may soon levy a fee for AI-based searches.

Murgia further points out an important observation: the large portion of crucial research pinpointing the injustices and misuse in AI comes from women of colour residing outside the dominion of the English-speaking West. They deserve our deep appreciation for not only their significant professional contributions but also for their resilience amidst the aggressive online backlash and professional mistreatment they face from vehemently defensive Tech enthusiasts and relentless mansplainers. Among such notable figures, Murgia commends Irish scholar and researcher Abeba Birhane. Her recent induction to the Irish Government’s AI Advisory Council is a significant accomplishment for our nation.

Murgia and her fellow researchers highlight that the widespread use of AI leaves us vulnerable to the whims of major tech corporations and their AI-based algorithms. She emphasises that we are all potential victims, as AI systems could pose a threat to our health, work, finances, family, public services, and human rights if they haven’t already started to.

In a surprising turn of events, the book concludes with a 2023 trip to the Vatican where a unique interfaith dialogue on Artificial Intelligence is held among religious leaders from Islam, Judaism, and Christianity. These prominent figures from the three major religions joined together to sign a cooperative statement, encouraging AI developers to adhere to six ethical principles in their work. The book includes a conversation with Rabbi David Rosen, formerly Ireland’s chief rabbi, who shares his views on the enormous influence exerted by today’s multinational tech companies which he likens to the formidable impact of ancient religions on societies. Despite these curious comparisons, Rosen admits the gathering provided an opportunity for these faith leaders to caution tech companies about the dangers of excessive power. Nevertheless, it’s questionable whether this warning would be heard, or indeed taken seriously enough by industry heads even though key personnel from the AI and tech sectors were present at the discussions.

These two significant books complement each other and provide the reader with a sobering view into the potential ruinous repercussions for mankind – many of which are already apparent – if the evolution and deployment of these dual algorithm-driven technologies go unchecked or exploited primarily for the advantage of large corporate bodies or the markets that can afford new services. It remains a hopeful wish that these authors’ works will be read by many and instigate change.

For those interested in delving deeper into the topic, ‘Atlas of AI: Power, Politics and the Planetary Costs of Artificial Intelligence’ by Kate Crawford (published by Yale University Press, 2021) is recommended. Crawford examines the impact of AI across various domains such as the environment, culture, society, work and politics with unquestionable expertise. Despite being a senior principal researcher at Microsoft Research among other prestigious roles, her work does not merely extol the merits of AI.

“Data Ethics: Practical Strategies for Implementing Ethical Information Management and Governance”, authored by Katherine O’Keefe and Darragh O’Brien, is a thoroughly detailed handbook that lays out the cornerstones of data ethics. Published by KoganPage in 2018 and revised in 2023, the text coherently acquaints readers with the practical application of these key principles in any professional environment. The book, crafted by two acknowledged Irish specialists in data security and global governance, also introduces real-world dilemmas in data ethics, including emerging trends in areas like artificial intelligence. Further reading suggestions at the end of each chapter expand the scope for detailed exploration of the topic.

In “AI 2041: Ten Visions for Our Future”, brought to you by Kai-fu Lee and Chen Qiufan and published by WH Allen in 2024, the distinct marriage of speculative fiction and new-age technology translates the potential long-term impacts of new technologies on humanity. This collaboration features the expertise of Taiwanese-American business capitalist and ex-president of Google China, Lee, and the celebrated Chinese science fiction writer, Chen. Chen pens down ten fascinating stories, while Lee adds factual scientific explanations for each scenario. The exciting amalgamation delivers a rewarding reading experience for all.

Written by Ireland.la Staff

“Salmon with a crispy skin served with Vierge sauce”

“Maggie Armstrong: Wastrel Ambitions or Age Symptom?”