Irene Roggero Ugues witnessed a disturbing transformation in her daughter Rossella over several months as algorithms on Instagram and TikTok inundated the girl with increasingly dark content centred on self-harm and depression. The 12-year-old, once cheerful and sociable, gradually withdrew into a digital world of despair before taking her own life. Only after Rossella's death did her parents discover the full extent of her hidden online activity, including a secret Instagram account with a coded username—'Just a dead pers0n'—that had become a repository for increasingly dark thoughts and searches.
What Irene uncovered in the months following her daughter's tragedy revealed a pattern of algorithmic amplification that appears uniquely designed to exploit adolescent vulnerability. Beginning in September 2023, Rossella began searching for content related to depression and self-harm, and rather than limiting such exposure, the platforms' recommendation systems actively fed her more of the same material. Within five months of this digital descent, the girl was dead. Speaking carefully about her loss, Irene described how the algorithms seemed to possess their own momentum, gradually overwhelming the brighter aspects of her daughter's personality until it dominated entirely. "At some point, it seemed to take on a life of its own, growing until it overwhelmed the cheerful, sociable side of her," she told journalists in her hometown of Asti in northern Italy.
Rossella's parents are now at the forefront of Italy's first collective legal action directly targeting social media platforms and their algorithmic systems. This landmark case, supported by Italian parent associations including MOIGE, seeks to impose meaningful restrictions on how these companies can market services to minors and demands algorithmic transparency in content recommendations. The lawsuit represents a significant escalation in regulatory pressure within Europe, where governments and watchdogs are increasingly viewing social media algorithm design as a public health threat rather than merely a consumer choice issue.
Both Meta, which owns Instagram and Facebook, and TikTok have dismissed the allegations, maintaining that they implement robust safeguards to shield young users from harmful material. Meta highlighted its "Teen Accounts" feature and built-in protective mechanisms, while emphasising its ongoing commitment to youth safety. TikTok countered by citing its removal of over 99 per cent of content violating mental health guidelines and investments in diversifying recommended content away from potentially damaging material. Neither company acknowledged specific responsibility for individual cases, with Meta arguing that young people's mental health is shaped by multiple factors beyond platform design and use patterns.
The legal challenge arrives as European regulators intensify scrutiny of digital platforms through enforcement of the Digital Services Act, which requires online services to better protect minors from harmful content. Britain announced this week plans to ban social media for children under 16, signalling a continental shift toward more restrictive approaches. Across the Atlantic, a United States court found Meta and Google negligent in designing platforms determined to be harmful to young people, establishing legal precedent that platforms bear responsibility for algorithmic consequences.
Lawyer Stefano Commodo, leading the Italian case alongside MOIGE, articulates a measured critique: the goal is not to eliminate social media but to remove the "technological and marketing mechanisms that make it harmful to the most vulnerable users." This framing proves crucial for Malaysian and Southeast Asian policy makers observing these developments, as it suggests regulation need not mean prohibition. Rather, it advocates for algorithmic accountability—requiring platforms to demonstrate that their systems actively avoid promoting content that could trigger or worsen mental health crises in vulnerable populations.
Parents involved in the case argue that existing safeguards are inadequate and easily circumvented. Children routinely access tutorials showing how to bypass content filters and time-limit restrictions by switching between devices or accounts. What emerges is a technological arms race in which platforms' protective measures lag behind users' ingenuity and determination. Valentina Muraglie, a board member of Italy's association of large families, highlights the realistic impossibility of parental oversight: "Monitoring social media use is a full-time job. It would require parents to spend all their time doing it, and that is simply unrealistic." Her own son abandoned deep reading for algorithmic scrolling in his teens, a loss she attributes directly to how social media platforms prioritise engagement over intellectual development.
Muraglie's observation touches on a broader concern that extends beyond acute mental health crises. Research documented in JAMA Pediatrics reveals measurable differences in brain development among heavy social media users, particularly adolescents whose neural architecture remains plastic and malleable. The World Health Organisation warns that problematic social media use—characterised by addiction-like compulsion—correlates with reduced well-being, compromised sleep quality, and wider health consequences. For young people in Malaysia and the region, where smartphone penetration and social media adoption occur earlier than in much of Europe, these developmental concerns carry particular urgency.
The Italian litigation signals a fundamental shift in how societies may regulate digital platforms: moving from content moderation alone toward algorithmic accountability. Rather than asking platforms merely to remove harmful posts after they appear, regulators increasingly demand that companies redesign systems to avoid amplifying such content in the first place. This distinction matters enormously for Malaysian stakeholders. If successful, the Italian case could establish that platforms bear legal responsibility for algorithmic consequences, not merely for the presence of prohibited material, fundamentally changing how companies design recommendation engines.
For Malaysian regulators and parents, the case illuminates how protective instincts—a company's drive to keep users engaged—can conflict with user safety when algorithmic systems optimise for time-on-platform rather than well-being. The tragedy of Rossella Roggero Ugues serves as a cautionary case study in how even well-intentioned safeguards fail when they operate within systems fundamentally structured to exploit psychological vulnerabilities. The path forward, suggested by Irene's advocacy, requires not merely removing dangerous content but reimagining platform architecture to resist amplifying it in the first place—a transformation that will reshape how social media operates globally.
