New Editor: AI Console
The new AI console would allow you to tell the computer what to do in everyday normal English. As you type, it guesses what you want to do, but you can correct it with a menu if necessary. For example, you could switch from a planar mesh to a planar curve with the menu. There could be a massive database of common operations like 3-point lighting, so the computer will automatically setup basic 3-point lighting at the 3D cursor when you type in "3 point lighting" into the AI Console and press return. The database would also have many tags for each of Blender's commands, so the computer will know you want a plane when you type in "square", "flat surface", etc. I want it to be something a person with minimal knowledge of 3D software could use, but I think complex things like text-to-3D donuts and coffee, as in, "computer, make coffee & donuts", wouldn't be possible with today's technology. I'm not sure how hard the coding would be for this, but Wolfram Alpha already does something similar by understanding math problems in loosely-worded plain English. I think something like that would be possible for Blender. :]
6 Comments
" tell the computer what to do in everyday normal English. " ...
Pretty normal English I think , as well as here - same normal English speaker. .
Go on.
* @IIIFGIII * Most English speakers can't use Python and that's a fact.
* @BlenderSplendor * The fact and so what... Not only English speakers :) Btw. good Python course and even with discount as I saw. I bought this course for 15$ when I have no ideas what is Python ( and I'm not English speaker ). Today I know enough to make my own addon for Blender > UE transfer workflow...
Good luck with this suggestion.
* @IIIFGIII * Thanks. I've heard Python is one of the easier programming languages to learn, but I still haven't been able to learn it. Also, Python commands allow little room for error. If you capitalize something wrong, use the wrong order, or use a different word, then Python won't understand you. The AI console would allow more room for error because you could use layman's terms. The early stages of the AI editor would probably be buggy, but in 10 years maybe we could tell the computer to do complex things like modeling coffee and donuts, then telling it to add bubbles and steam to the coffee. It'd be so much faster than manual modeling. Then anybody could 3D model and the profession of technical modeling skills would be phased out. The new job would be 3D artists who direct scenes.
@BlenderSplendor I love this idea, and with recent progress in large language models, this is 100% possible to do today. I'd love to chat with you about it to hear your thoughts and ideas — if you're interested, please email me at arvid@anysphere.co!
Saw your reply on BlenderArtists and though it is better to reply here.
Having something like this in Blender would be fantastic! As of today, it is not yet realistic. It would take a huge amount of time to implement something like this, followed by continuous maintenance and the results would for sure not be very good in general. I have seen research projects which sort of achieve that, but they are not much more than toys and nowhere near production ready. Wolfram Alpha on the other hand is amazing and it is literally the result of more than a decade of work where they built up a huge knowledge graph that can be used for that.