Voice technologies are rapidly being integrated into generative artificial intelligence (AI) enabled systems and applications. These developments are provoking new questions, and intensifying old ones, in a wide range of everyday contexts. This working paper surveys and historically situates these developments, reviews the current literature in relevant fields, and outlines some emerging responses to the challenges such technologies present to the issue of authenticity in real-world settings.

The next wave of AI-enabled voice technologies has the potential to be helpful and useful in many communication, media and customer service settings, and to improve digital service provision. But these technologies also carry heightened risks of deception in interpersonal communication, change how information and culture is interacted with and valued, and amplify concerns around issues such as digital inequality and AI-driven labour displacement in knowledge and creative work – all areas where ideas about and struggles over ‘authenticity’ play a central role.

The multifaceted nature of voice synthesis technology demands a correspondingly layered approach to its ethical, legal, cultural and practical implications. As synthetic voices become more widely deployed, robust frameworks and regulatory responses are necessary to mitigate potential harms and foster accountability around responsible use and development of companies that offer voice AI services.