A LiDAR hologram-based virtual memory of the elderly that family members can step back into after they die.

WHY   

In XR narratives, spaces become characters. Photogrammetry imbues those spaces with static detail, but LiDAR holograms bring them to life. The first time I combined 2.5-dimensional depth video with a photogrammetry model I was struck by how much it felt like I had stepped into a memory. Which made me ask, what do we most want to remember? One tragic, beautiful answer is: our loved ones after they die.

This project took Painting Life’s explorations into XR narrative conventions a step further: when you move through the house, you can pick up a board game and the family appears playing it together at a table. If you walk outside through the garden, you hear the sounds of the geese in the lake. You may end up in the woodshed where the grandfather is turning wooden bowls with his grandchildren. 

These holograms are videos that have been rendered into 3D meshes – they are glitchy and pixelated, imperfect like our own memories. In this liminal space, the photogrammetric walls melt into the floors and yet the sense of presence, of standing in a real space with real people, is undeniable. 

One playtester also reported learning how to carve a wooden spoon after playing through this experience, hinting at the education potential of such virtual memories.

HOW 

The tech stack and development process for this was similar to Painting Life with the added complexity of hologram 2.5D depth video. 

These are captured by:

Depth LiDAR on left, RGB Color video on right

Integration of depth holograms into Unity

CREATIVE TEAM   

Creative Director Wyatt Roy

Photogrammetry Wyatt Roy

Hologram capture Wyatt Roy

Sound Design Wyatt Roy

Unity Scripting Luis Zanforlin

BEHIND THE SCENES