← All ideas
  • Published 7 Apr 2022

Blender Interactive

I know blender game went away (for now), as last I heard. I wanted to suggest a replacement. Blender Interactive. Maybe a step in the game direction, BUT not a full game engine, but some pluggable "inputs" and "outputs" to a real-time renderer (EEVEE) in order to be able to create interactive art works. Interactive digital art is becoming more popular. Integrating numerous types of inputs, such as a touch screen (doesn't have to be for "selections" but just pure entertainment for instance - the real-time art reflects the touch in some manner, voice input, AI user detection input, anything. Outputs could be used to do things like interactive with lighting systems in the real world, lasers, scent generators, dynamically produced sound (based on the art). anything really. Could be python scripted. Just throwing out an idea as I think it would be useful for many "installs" for them to be interactive. Interact with the GPIO pins on a Pi or Jetson, for instance, and a common scripting API. Export could even be built on top of an existing game engine with proper license or agreement.

Here's the new nvidia kit btw for embedded devices ($2,000 but pretty sick to say the least) arrow.com/en/products/945-13730-0000-000/nvidia

Just wanted to add that this post was inspired by the "Nannou" project (open source rust project), and demos.

If this direction is taken at some point, perhaps it would be easiest just to build on top of that project (export a nannou project)

Oh, another thought on input would be voice input - could do speech to text and show the text, or just use the voice input in any way needed (other examples would be to add a 'ripple effect' to the art, or lookup information online (using voice as the search parameters), or via simple programmed logic to handle those commands to display relevant information (think theme park with 10 commands you can speak to an interactive map - and it shows you the relevant info). Or the art could be programmed to launch certain animations when a certain voice command is detected.

Just wanted to add in this hologram tech (Looking Glass) that could be relevant as a destination for certain projects. They have it setup to be able to be interacted with human touch. Not sure of the API or how easy it is to build on top of, but it is "3D" - a users hand can interact with 3D objects in the space (or it appears so from a video on the site). lookingglassfactory.com/portrait

Just wanted to add that perhaps "OpenTimelineIO" could be used as the interchange format for data exported from blender during a "blender interactive export" to be read by real-time application (nannou app, game engine, or similar) to let the engine know when to do/alter various outputs. A simple example could be getting "most used" color of animation every frame, and altering colored light in the room to match that color by simply including as timelined data in opentimelineio format during export. But, plugins could do whatever is supported by the destination (most likely plugins on both sides is what a single solution would involve)

80%

Development Status: Open

Upvote 4 Downvote 1
JeffG
7 Apr 2022

0 Comments