Danish researchers created a private self-harm network on the social media platform, including fake profiles of people as young as 13 years old, in which they shared 85 pieces of self-harm-related content gradually increasing in severity, including blood, razor blades and encouragement of self-harm.

The aim of the study was to test Meta’s claim that it had significantly improved its processes for removing harmful content, which it says now uses artificial intelligence (AI). The tech company claims to remove about 99% of harmful content before it is reported.

But Digitalt Ansvar (Digital Accountability), an organisation that promotes responsible digital development, found that in the month-long experiment not a single image was removed.

rather than attempt to shut down the self-harm network, Instagram’s algorithm was actively helping it to expand. The research suggested that 13-year-olds become friends with all members of the self-harm group after they were connected with one of its members.

Comments

  • ilmagico@lemmy.world
    link
    fedilink
    English
    arrow-up
    5
    arrow-down
    1
    ·
    29 days ago

    The group was private and they created fake profiles … did I miss something?

    • Darth_Mew@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      edit-2
      26 days ago

      yea you did. the “fake” profiles could’ve been made by any one and sent that to non private groups and should’ve been blocked. them being “fake accounts” doesn’t take away from the claims meta makes about 99% of this type of content being removed. please use your brain