Motion tracking into 3d scanning
Ok sorry for the bit weird title, but essentially 'm thinking that the math involved in motion tracking must be close to detect geometry of an object. So how about the next step to use blender for 3d scanning.
allready blender can track dots of objects and determine their position as relative to the camera. the thing missing seams a meshser for this data and an option to color bake this mesh with the 2d videoos.
3 Comments
There is a lot of free software to do photogrammetry. You can simply export the data there as obj with the textures and use it in blender. I don't see any reason why to put a lot of effort into creating blenders own 3d scannier.
I don't think it's that simple.. Blender's tracker just searches for the same pixel pattern withing the search area..if it finds it it corrects the marker position based on how far the camera moved(..) For 3d scanning you would need to scan the whole image and then find matching points in the images/video to first find out how the camera moved or where it was in 3D space(no big problem so far, except you need to have at least 8 same points visible in the image so blender can find out the position) but then you need to find out how the geometry is formed based on parallax and some other stuff I don't understand.. and that is complicated.. yes we could implement a library that already does that, but why not directly use such a libary without integrating it into blender like Gleb Alexandrov showed in his current video? blender can't and shouldn't do ANYTHING, especially if there are other, free solutions out there that work well
one can only know the position of the camera if one also knows the the position of the dots, in a raw way blender allready can scan 3d, but it is very rough. the positions are perfect, however what is needed more samples, areas to ignore (if camera is static and object rotates) (ea remove static background). This math is so close related that it should be part of blender. Sure you need some understanding of math (i agree), but 3d scanning isnt rocket science.
Blender is the one thing to do it all, it has always been that way.