Right-Click Select This is a read-only archive
← All ideas
  • Published 2 Aug 2023

ai masking

aftereffects has this cool new tool

aescripts.com/mask-prompter/

its based on opensource software , probably this github.com/open-mmlab/mmdetection (but there came out several others on github which do the job just as good)

it would be nice to have a clone of this tool in blender videoeditor and compositor. the workflow seems perfect

0%

Development Status: Open

Upvote 0 Downvote 3
alexmehler
2 Aug 2023

3 Comments

Lauloque

To my wild guesses, there are quite a few things that make any AI-based tools hard to get in Blender on principle:

  • i'm pretty sure the BF does not (and realistically never will) have the manpower to make such a tool themselves, so they need to use an existing one
  • needs to be well maintained for the long term
  • must be usable in c/c++ or python
  • being open-source isn't enough, it needs to be of a license compatible with Blender
  • must not require an internet connection to work
  • must have zero data collection
  • must not work from an ethically questionable data sets

and for this particular case: needs to give good results on a sequence of images to be usefull.

1
alexmehler Author

hmm im thinking about buying that plugin , then i can look into the code to find the extact library they used . should be python like all the other visual ai stuff. most stuff has apache license imo , dont know if thats compatible ..

i think all the other boxes are ticked too, minus the missing manpower of course.

This could work as an addon of course , but like with many addons, it would be better in a native implementation.

Why is there such a shortage on manpower in BF ? that isnt sometning new. isnt blender a prestigious software to work on with many possible contributers, also industry veterans and similar? the problem seems to lie somewhere else .. many things will work forever once written, no need for much maintanence either

Lauloque

many things will work forever once written, no need for much maintanence either

I wish we lived in that world, but it's not the case.