REAL TIME TRACKING ?
Apparently already in the industry there is software that in combination with Unreal Engine 4 Makes it possible to track at the same time of shotting, and in real time rendering thanks to UE4. It's the dream of every cinema producer since actors and directors can correct the scenes at the moment.
Blender already has a quite good traditional tracking system and real time EEVEE,
What could be the possibilities to expand that to reach out a level like this: ?
4 Comments
Neither of these examples are software implementations, and are instead hardware tracking which requires minimal processing compared to pure software tracking.
In the YouTube video, the lack of greenscreen markers tells me that this is probably using external position tracking of the camera (IE: Something similar to room scale GPS) to relay the position of the camera to UE4.
The Halide FX website even shows the Tracker that attaches to the camera for stuff like this.
While it's certainly possible to implement support for devices like this in Blender, it would probably be better implemented as an add-on for each specific device.
* @Zach Hixson * There actually are markers on the greenscreen, but they are hard to spot in the exposure of the BTS Camera. Around 00:35-00:40 you can spot some obove the "couch cube". Though I agree that probably a pure software tracker might be not low latency enough for realtime application.
We do something like this in blender already. But with an inside out tracker with markers. (Tracker is hardware of course) blendernation.com/2018/06/25/blender-used-in-hybrid-studio-pipeline/
these guys did it in software only but the company got quickly bought - nytimes.com/2018/03/26/technology/artificial-intelligence-hollywood.html