I would like to see Virtual Desktop offer a true mixed-reality passthrough option that treats the Quest’s camera feed like a green-screen backdrop. Meta’s Passthrough API already lets developers upload a 16³ color-LUT to key out a specific hue in the camera feed. Virtual Desktop could expose that same functionality in its passthrough panel, mapping key color alpha to 0 in the LUT and leaving all other pixels opaque. Performance impact is negligible since the LUT is hardware-accelerated.

Example: https://www.linkedin.com/posts/mattsoson_passthrough-meta-unrealengine-activity-7186148255590744064-J7CJ/