REMAKING HISTORY
An immersive AR sound installation exploring ancestral narratives through historical fiction and spatial audio set in 1934 Kerala, India
Project Overview
Timeline
January - May 2023
Context
Graduate thesis exploring lost family history through AR technology
Skills
Spatial Audio Design, AR Development, Historical Research, Narrative Design
Budget
$100 total, self-funded
Two location-based conversations and one period-accurate radio show from 1934
Researching Kerala's complex colonial history and family connections
Custom markers embedded in ancestral house floorplan triggering spatial audio
Progressive refinement through user testing and technical improvements
"Remaking History" explores the intersection of historical fact and fiction through an immersive AR sound installation focused on my ancestral home in Kerala, India. The project addresses the gaps in my knowledge of recent ancestors by intertwining real identities, locations, and events with fictional details to create a historically plausible narrative experience. Using AR technology, visitors interact with a physical floorplan of my ancestral house, uncovering visual information and soundscapes that reveal conversations and a period-accurate radio broadcast from May 1934.
The installation invites visitors to step into a recreated moment in time, experiencing the domestic life, social dynamics, and political context of 1930s Kerala through an intimate auditory perspective. By blurring the line between documented history and speculative reconstruction, the project questions how we connect with our past when records are incomplete.
My Role & Contributions
As the sole creator of this AR installation, I performed all aspects of research, conceptualization, technical development, and implementation. This cross-disciplinary project required me to work across historical research, narrative design, audio production, and AR technology development while balancing technical constraints with creative ambitions.
Concept Development
The conceptual foundation of "Remaking History" emerged from a personal dilemma: how do we connect with our ancestral past when documentation is incomplete? I discovered that my knowledge of recent ancestors was limited to a few photographs and anecdotes, with no written records beyond a certain point. Rather than accept this limitation, I saw an opportunity to explore how historical fiction could be used to fill these gaps in a way that felt authentic and meaningful.
Core Research Questions:
• How can we responsibly reconstruct historical narratives when records are incomplete?
• What role can technology play in preserving and communicating cultural heritage?
• How do we distinguish between historical fact and fiction, and does this distinction matter?
• Can immersive experiences create meaningful connections to ancestral pasts?
I chose to focus on May 1934 in Kerala, India for several strategic reasons: This period represented a critical moment in the Indian independence movement with specific relevance to Kerala's political climate, I had confirmed that my great-grandfather, Kunju Muhammed, was alive and active during this period, and the introduction of radio broadcasting in the region created a fascinating technological and cultural touchpoint.
Design Process
My design process unfolded through multiple phases, each building on user feedback and technical discoveries to create a cohesive historical narrative experience:
Historical Research & Family Interviews
The first phase involved extensive research into both family history and the broader historical context of 1930s Kerala. I conducted interviews with family members to collect anecdotal information, photographs, and descriptions of the ancestral house that no longer exists. In parallel, I researched the political climate of the time, focusing on the Indian independence movement in Kerala, the introduction of radio broadcasting, and everyday life during this period.
Narrative Development & Script Writing
Based on my research, I developed three interrelated scripts: two conversations set in different parts of the ancestral house (segregated by gender according to period customs) and a radio broadcast from May 1934. The conversations were carefully crafted to reflect authentic domestic concerns while subtly incorporating references to the political climate and social conditions of the time.
AR Application Design & Development
I designed and built a custom AR application that could recognize visual markers and trigger spatial audio experiences and visual information on household objects of historical and personal significance. This required learning several technical skills including marker-based AR development, audio implementation, and user interface design for natural interaction. User testing revealed several key insights that shaped the technical development, including improvements in marker design and detection algorithms.
Installation Design & Integration
The final phase involved designing the physical installation, centered around the floorplan of the ancestral house. Working from a rough sketch provided by a family member, I created a more detailed and visually engaging floorplan that incorporated the AR markers at strategic locations. Integration testing revealed technical challenges with consecutive marker detection, which required modifications to both the application and the physical layout.
The Final Installation
The completed "Remaking History" installation creates a multi-layered experience that invites visitors to explore historical narratives through sound and space:
The Ancestral House Floorplan - The central element of the installation is a detailed floorplan of my ancestral house in Kara, Kodungallur, Kerala. Created from family descriptions since the original house no longer exists, the floorplan features 12 AR markers positioned in different rooms and areas.
The AR Application - Visitors use a tablet with the custom AR application to scan markers on the floorplan, triggering spatial audio experiences and visual information on household objects. The application features intuitive controls for audio playback and clear visual feedback when markers are recognized.
The Soundscapes - Three distinct audio experiences transport visitors to May 1934: a conversation among women in the Kaiyala (kitchen area), a discussion between men on the verandah about political events, and a period-accurate radio broadcast discussing the independence movement.
Below are the information cards triggered by scanning markers attached to household objects of historical and personal importance:
![]()
![]()
![]()
![]()
![]()
![]()
![]()
Technical Implementation
The technical development of "Remaking History" required balancing advanced AR capabilities with practical constraints of exhibition deployment and user accessibility. The solution evolved through three major prototypes, each addressing specific technical challenges and incorporating user feedback.
Technical Challenges
- Marker Recognition Reliability: Early prototypes struggled with consistent marker detection under variable lighting conditions and viewing angles
- Sequential Content Experience: The system needed to track which markers had been scanned and guide users through the narrative in a logical order
Technical Solutions
- Enhanced Marker Design: Developed high-contrast markers with distinctive features that improved recognition rates from multiple angles and distances
- Progressive Content System: Created a user interface with numbered markers and visual feedback indicating which content had been discovered
Prototype 1: Content & Accuracy
The first prototype focused on the narrative content and historical accuracy rather than technical implementation. I developed scripts for the three soundscapes and tested them with family members to verify cultural and historical authenticity.
Prototype 2: AR Framework & User Testing
The second prototype implemented basic AR functionality with simplified marker recognition and audio playback. User testing revealed significant usability issues, including difficulties with marker scanning and confusion about the content sequence.
Prototype 3: Refined Experience
The final prototype integrated all components into a cohesive experience, with refined AR functionality, improved spatial audio, and a more intuitive user interface. User testing confirmed that the system was now accessible to non-technical users and effectively communicated the historical narrative.
Developed using Unity with AR Foundation, creating a cross-platform solution that could be deployed on consumer tablets. Custom image recognition systems were implemented to handle the unique requirements of the historical markers.
Created with a combination of field recordings and studio production, using spatial audio techniques to position sounds accurately within the virtual space of the ancestral house.
Balanced historical authenticity with technical functionality, creating markers and interface elements that were unobtrusive yet effective. Developed the floorplan visualization based on family descriptions, maintaining period accuracy while supporting AR functionality.
Critical Reflection
"Remaking History" succeeded in creating an immersive experience that connected visitors with a specific moment in my family's past, while raising broader questions about how we construct historical narratives when documentation is incomplete. Through this project, I developed valuable insights about technology, narrative, and cultural heritage:
Key Learnings
- Balancing Fact and Fiction: The project demonstrated how carefully researched historical fiction can create meaningful connections to the past when approached with responsibility and cultural sensitivity.
- The Power of Sound: I discovered that spatial audio created more intimate and imaginative connections than visual representations would have, allowing visitors to form their own mental images of historical spaces and events.
- Technical Constraints as Creative Catalysts: Working within technical limitations led to innovative solutions and ultimately strengthened the focus on narrative and historical context rather than technical spectacle.
- Cross-Disciplinary Approaches: The project reinforced the value of bringing together historical research, narrative development, and emerging technologies to create new forms of cultural engagement.
This project raised important ethical questions about the representation of ancestral stories and the responsibility that comes with filling historical gaps. I was constantly aware of the delicate balance between creating an engaging narrative and maintaining respect for the real individuals whose lives I was partially reimagining.
From a technical perspective, I learned valuable lessons about developing AR experiences for exhibition contexts. The importance of reliability, intuitive interaction, and clear guidance emerged as central concerns, sometimes more critical than technical sophistication.
Most significantly, "Remaking History" deepened my understanding of how technology can contribute to cultural preservation and intergenerational connection. By creating a digital experience that documented both factual information and family stories, the project serves as both a creative work and a form of cultural heritage preservation for future generations.