Skip to content

Mixed reality experience for interacting with your smart home in a new dimension.

License

Notifications You must be signed in to change notification settings

DynamicDevices/Immersive-Home

 
 

Repository files navigation

Important Introduction

This project is called SafeAR (also known as QuestWalk), an app deployed on the stand-alone Meta Quest 3 to easily create on-boarding, safety training and instructed procedures that can be used on-site in Augmented Reality. Similar projects include The Ghent Alterpiece by AlfaVision.

It is the result of work done between 18 February 2025 and 21 March 2025 (not including time spent writing the bid application) for the 5G Ecosystem - Proof of Concept call.

We could not have attempted this project in such a short time frame without starting from the incredible open source work of Immersive-Home and Solar-XR.

Demonstration Video

This is an example of guiding someone to refill the coffee machine in the DoESLiverpool hackspace.

Making Coffee in AR

Technical components

Home Assistant

Home Assistant is a huge modular home automation system that runs on an RaspberryPI. Immersive-Home is able to log into it to access its location-based sensors and controls and overlay them into Augmented Reality.

Godot engine

The Godot engine is a free, lightweight open source Game Engine that supports Virtual Reality features such as pass-through cameras and hand-tracking.

Exoplayer plugin

The Meta Quest 3 Virtual Reality headset runs Android which means that many the of the internal features of this operating system potentially available to an application running on it. Partway through the project the Godot-ExoPlayer feature appeared, which made it suddenly very easy to download and playback videos.

Node-RED

Node-RED is an optional component of Home Assistant that provides a visual flow-based coding system. It turns out to be pretty useful for planning and drawing flow charts for walk-throughs to be deployed to the Augmented Reality app. The ability to make and plan content is in some ways more important than the software to show it.

image

Future work

SafeAR/QuestWalk is looking for real world uses and applications that could pay for and drive its future development. You could theoretically download it and try it out yourself, but given the necessary sketchiness of the prototype product made on this time scale, you will need our help. Please contact Dynamic Devices for details.

About

Mixed reality experience for interacting with your smart home in a new dimension.

Resources

License

Code of conduct

Stars

Watchers

Forks

Packages

No packages published

Languages

  • GDScript 98.9%
  • Other 1.1%