This paper introduces a holographic augmented reality (AR) system that uses a combination of inverse-designed full-colour metasurface gratings, a compact dispersion-compensating waveguide geometry, and AI-driven holography algorithms to create vibrant, full-colour, 3D AR content in a compact device. The system eliminates the need for bulky collimation optics and uses an innovative image formation model combining a physically accurate waveguide model with learned components calibrated using camera feedback. This co-design represents a significant advancement in creating visually compelling 3D AR experiences.

Manu Gopakumar, Gun-Yeal Lee, Suyeon Choi, Brian Chao, Yifan Peng, Jonghyun Kim, Gordon Wetzstein