Real-time plane tracking

It's already a feature to track and deform a plane, but only in post through the compositor. but with Eevee and vr controller support, it's becoming more possible for virtual production features to make their way to blender. I'm attempting to set up a simple head tracking scene with a vive controller, and this is what i've come up with.

Typically, the solution is to track the camera like normal, add a "track to" constraint pointing at the virtual screen, and then map the screen plane to the entire display in real time. I'd love to be proven wrong, but It doesn't seem to be possible given the current limits to the camera.

Maybe this could be a feature in the Viewport Compositing, if that's in real time.