A leaked internal video has shed light on Sony's intriguing experiments with AI-powered PlayStation characters. As reported by The Verge, the video, created by PlayStation Studios' advanced technology group, showcases an AI-driven version of Aloy from the Horizon series. This demonstration was quickly removed from YouTube due to a copyright claim by Muso, a company that lists Sony Interactive Entertainment as a client, hinting at the video's authenticity. IGN has reached out to Sony for further comment on this matter.
In the video, Sharwin Raghoebardajal, Sony Interactive Entertainment's director of software engineering, engages in a conversation with an AI-powered Aloy. The interaction leverages OpenAI's Whisper for speech-to-text conversion, GPT-4 and Llama 3 for generating dialogue and decision-making, Sony’s Emotional Voice Synthesis (EVS) system for speech, and Sony's Mockingbird technology for facial animations. During the demo, Raghoebardajal asks Aloy about her well-being, to which she responds in a robotic voice, stating she's dealing with a sore throat. This voice contrasts sharply with that of the character's usual voice actor, Ashly Burch, and Aloy's AI-generated facial expressions appear stiff and lifeless.
The conversation delves deeper into Aloy's backstory, touching on her discovery of being a clone of Dr. Elizabeth Sobeck and her reflections on this revelation. The demo transitions into the world of Horizon Forbidden West, where Raghoebardajal continues the dialogue while playing, highlighting the surreal nature of conversing with a character the player controls. This use of Aloy, considering the thematic elements of the Horizon series, adds a layer of irony to the demonstration.
This prototype, developed with the assistance of Horizon studio Guerrilla Games, is intended as an internal showcase of Sony's AI capabilities. Raghoebardajal emphasizes that the demo represents "just a glimpse of what is possible." While Sony has invested in exploring AI-powered characters, there's no confirmation yet of integrating this technology into any public PlayStation products, nor is it clear if it would be feasible for PS5 games at this point.
Sony's experimentation with AI aligns with broader industry trends, as competitors like Microsoft, with its AI tool Muse for game design, also delve into AI applications. Generative AI has become a focal point in the gaming and entertainment sectors, despite facing backlash over ethical concerns, rights issues, and the quality of AI-generated content. Notable examples include Keywords Studios' unsuccessful attempt to create an AI-generated game and EA's assertion that AI is central to its business. Capcom's experimentation with AI for in-game environments further illustrates the industry's interest.
Asad Qizilbash, head of PlayStation Productions and head of product at PlayStation Studios, highlights the importance of AI in meeting the demands of younger gamers, particularly Gen Z and Gen Alpha, who value personalization and meaningful experiences. This sentiment is echoed by Activision's recent admission of using generative AI for assets in Call of Duty: Black Ops 6, despite facing criticism for certain AI-generated content.
What's The Best PlayStation 5 Game?
Pick a winner
New duel
1ST
2ND
3RDSee your ResultsFinish playing for your personal results or see the community’s!Continue playingSee results
