Home work play about
Back

Interactive AR Museum Experience

AR LearningShipped

The Formosa: The Lost Secret project integrates Augmented Reality (AR) with interactive modules to bring museum exhibits to life. Through AR missions and virtual storytelling, the design encourages elementary students and families to embark on a fun and educational journey.

Role
UX Designer & Project Manager
Timeline
Aug 2023 - Jan 2024
Team
UX Designer (Me) Project Manager (1 & Me) Developers (3) 3D Artist (1) UI Designer (1)
Tools
Figma FigJam Illustrator
↑60%Completion Rate
5,000+Visitors
85%User Satisfaction

Conversational avatar as a learning guide

AR interactive, gamified learning

Context

How to address lack of interactivity and navigation challenges?

This project began to address the challenge of keeping students engaged in traditional museum exhibits. Many displays lacked interactivity and navigation challenges, making it harder for students to learn effectively. In collaboration with the Ministry of Education and the National Museum of Natural Science, the goal was to make the museum experience more engaging for students and families.

Research

Uncovering user’s learning needs and behaviors

I interviewed 20 elementary school students, parents, and teachers who visited the National Museum of Natural Science. My goal was to understand their experiences with digital learning and expectations regarding Augmented Reality (AR).

85% value gamified learning

Gamified learning helps students absorb knowledge and stay motivated.

80% want interactive characters

Interactive virtual characters or animals can improve learning engagement.

75% embrace digital learning

Current schools encourage digital learning, often utilizing devices like tablets or digital board.
Insights

Current museum experiences are challenging for young students to engage with

From user interviews, we also found some key pain points in the current museum experiences.

The Problem

Lack of interactivity and engagement in museum exhibits

How might we create an engaging and interactive museum experience that motivates students to learn independently and navigate exhibits with ease?

Ideation

Bringing learning to life with interactive missions

To visualize the potential experience, I developed a thematic mission route, allowing users to effortlessly engage in self-directed immersive AR learning. Users have the freedom to select stages for interactive experiences. Upon completing all stages, they can attain certification for self-directed learning and unlock a hidden mystery interaction.

Solution

01 Mission route map with rewards

Students navigate their learning journey through a mission route map, clearing levels to unlock rewards. This feature boosts motivation and turns education into an engaging and fun adventure.

Solution

02 Conversational avatar as a learning guide

The experience introduces friendly characters as learning buddies to enhance student engagement. These avatars guide students through tasks, provide hints, and answer questions, making the learning process more interactive and supportive.

Solution

03 AR interactive, gamified learning

By integrating AR technology with real-world exhibits, students engage with lively virtual elements—click arrows, find treasures, or solve puzzles—to create an immersive, memorable, and fun learning experience.

Testing

Address key usability issues to iterate on designs

In our usability testing, over 50 elementary students, teachers, field experts, and museum guides participated to evaluate the AR design. Their feedback helped us identify critical issues and make improvements to ensure a engaging and educational experience.

Guiding users to stabilize AR elements

Some 3D elements wobbled due to improper scanning. I introduced prompt text to guide users back to properly scan the images for better stability.

Improving AR visibility with directional arrows

Some AR content was hard to locate immediately after scanning. I added directional arrows to guide users to the correct location for a smoother experience.

Adding a clear exit option

Users struggled to exit during the experience. We added a "Back" button with a confirmation popup to enhance navigation and prevent accidental exits.
Impact

Improved museum learning experiences for elementary students

Collaborated with the Ministry of Education and the Science Museum to test the AR application with 50+ elementary students and teachers.

↑60%Completion Rate
5,000+Visitors
85%User Satisfaction

Reflection

AR interaction can deepen visitor engagement, bridge physical artifacts with digital contexts, and transform passive viewing into active personal discovery.

1Immersive experiences not only make learning captivating and easy to understand, but also spark curiosity to the world beyond museum walls
2Blending AR technology with storytelling, bring museum exhibits to life
3Balancing client’s expectation and managing tight timelines taught me the importance of clear communication and proactive planning
© 2026 Jolyne Wu. All rights reserved.
linkedIn phone email resume