Rising River

A Personal Odyssey to Your Shadow | AI-driven Self-analysis VR experience | 2024

Rising River is an AI-driven self-analysis VR experience, which integrates Jungian shadow theory and the VIA Character Strengths framework to create a novel approach to therapeutic self-analysis. It began with a fundamental question: Can gaming and virtual reality democratize the therapeutic benefits of Jungian shadow work, making them accessible to a broader audience?

VR Version Trailer

VR Version Trailer

VR Experience Screenshot

Tailored Web App Experience for Artechouse

Inspiration and Concept

The game integrates Jungian shadow theory and the VIA Character Strengths framework to create a novel approach to therapeutic self-analysis. It began with a fundamental question: Can gaming and virtual reality democratize the therapeutic benefits of Jungian shadow work, making them accessible to a broader audience?

At its core, Jung's theory of the shadow posits that within each person exists a subconscious aspect of the self that remains neglected, suppressed, and poorly understood. Traditional shadow work facilitates an encounter between an individual and their inner shadow. To translate this concept into an interactive experience, we designed a process of self-reflection to bring the shadow into view. This required careful exploration of players' fears, motivations, desires, and memories.

We realized that such exploration needed a foundation in a broader understanding of self-perception, both positive and negative. The VIA 24 Character Strengths framework provided a comprehensive taxonomy of character traits for players to assess as relative strengths or weaknesses. Our key insight was that the traits players identify as lesser strengths during gameplay could reveal areas of insecurity or overlooked aspects of the self.

To enhance this exploration, we leveraged generative AI to craft a personalized narrative journey in a virtual cave. The system dynamically generates content based on the player's responses, enabling a deeper engagement with their shadow self. With the director’s background in filmmaking, she view narrative as a powerful tool for organizing memories and psychological structures. Research shows that storytelling helps people find meaning, construct identity, and cope with trauma, making it a vital component of this interactive experience.

Through this embodied VR experience, participants are gently guided into self-exploration via a series of fixed and generative questions, leading them on a unique narrative journey. Players embark on a journey to revive a dried-up, dark river by offering words that reflect their innermost self. Through VR-based physical interactions, their responses become tangible elements within the world.

Technical Information

Platform: Unreal Engine 5

  • GPT API Integration: Generates dynamic questions and content using OpenAI's GPT, particularly for questions 5-7 and the shadow self revelation in the final scene outside the cave.

  • Prompt Engineering: Prompt design to help GPT understand player questions and frame responses in a coherent, meaningful direction.

  • Real-Time Speech-to-Text: Captures player responses and converts them into text for prompt processing.

  • Text-to-Speech: Converts GPT-generated responses into natural-sounding AI voices.

Credits

Creative Director: Lois He

Technical Consultant: Xuelong Mu

AI Integration: Vio Zhu

VR Development: Lois He, Ellen Chen

Visual Design: John Luo

Tech Art: John Luo, Lois He

UI Design: Lillian Sun, John Luo

Title Design & Animation: Xing Zhang, Jun Yang

Sound & Music Design: Kaiyang Zhao

Psychology-Guided Design: Andrew Trousdale

Special Thanks: Dan Tomasulo, Victor Morales, Jonathan Turner, Tianqi Yang, Todd Bryant, Chenyi Lee

Exhibition Highlights:

*The following exhibitions showcase the screen-based version of Rising River. The VR version is a completely new iteration, currently being submitted to film festivals. Updates on selections will be added progressively.

Previous
Previous

Between Empty | Narrative Game | Cross-media Worldcraft | In Progress

Next
Next

Neural Harmony | Installation for Neural Science Lab