Many of the systems and elements that platforms build into their products create safety risks for end-users. However, only a very modest selection have been identified for regulatory scrutiny. As the government reviews the Basic Online Safety Expectations and Online Safety Act, the role of all systems and elements in creating risks need to be comprehensively addressed.

This report explores the role of four systems (recommender systems, content moderation systems, ad approval systems and ad management systems) in creating risks around eating disorders. Researchers ran experiments on a range of platforms (including TikTok, Instagram, Facebook, X and/or Google) and found that:

• Content recommender systems can create risks.
• Content moderation systems can create risks.
• Ad approval systems can create risks.
• Ad management systems can create risks.

The report argues that risks to Australians’ safety and wellbeing are manifesting in numerous online systems and a regulatory framework needs to incentivise platforms to proactively identify and comprehensively mitigate these risks.