← All ideas
  • Published 10 Dec 2021

Revision of VSE Sound Strips

Nowadays you can edit a video in VSE. The image has received some improvements in the last year, but I have searched for changes in the sound part and it looks nearly empty (draw soundwaves is the last modification)

Current Sound strips

Sound strips have

  • volume
  • "pitch" (actually, is a faster / slower sound, which at the end is pitch up/down)
  • pan
  • "convert to mono"

4n3WC7iJC6.png

If you have several sound strips, you can hear several at the same time, so there is a "mix".

At the same time, there is in Blender source code a sound specific library (Audaspace), and a generic library with filters for audio and video (ffmpeg).

Proposal

First of all, Blender is a 3d / 2d application with some extra utilities. Sound shouldn't be its priority, but, we could keep only some helpfull filters for last minute, non destructive, edition.

I studied a little about standard sound plugins like VST and others, but in the Blender guidelines of development, they say specifically that they don't want any kind of binary plugins that could make the whole Blender unstable or more difficult to debug.

Changes in Sound

So, only the most basic filters / modifiers for sound.

  • use the tab modifiers of audio, the same as the video one
  • move to this section "pan"
  • rename"pitch" to "speed"
  • add new modifiers / filters like:
    • equalizer
    • compressor
    • echo
    • reverb

New space

In order to use any simple filters, we need something to see current state and changes, so we would need 2 new visualizations:

Vumeter

One vumeter for each audio channel. OYnd5Bonql.png

Sound bars

If we want to apply some filters in the space of frequency, we should be able to see its state, so we would need to see several bands of frequency, like the ones to apply an equalizer.

N2el9MlqKA.png

Final words

Of course, we all want to get everything, but that is NOT POSSIBLE . I would like to reduce or simplify the proposal, in order to get something really useful and "achievable".

100%

Development Status: Open

Upvote 12 Downvote 0
Pistolario
10 Dec 2021

4 Comments

Pistolario Author

After some messages in devtalk, the proposal could be like this:

  • 2 new modifiers (to add to pan, volume and mono)
    1. band equalizer / parametric equalizer
    2. compressor
  • along the strip, show when the sound is saturated (some kind of "red marks" showing sound above certain thresholds)
  • nowadays a sound strip can show a static waveform. It could change to show waveform / show spectogram
bachadam48

may blender developers implement at least these filter you mentioned

Pistolario Author

Thank you for your comments Tintwotin.

Do you know who is near the development of Blender to talk about this subject? (Perhaps ISS is too near) I've tried to find any change in Blender's repository related to sound and I've only found some of your proposals.

Are there rumors about Audaspace removal? It has a lot of code related to effects in space. Ffmpeg is included, but I'm not sure if it carries all the sound stuff of a standard FFmpeg.

I only wanted to reach a minimum of changes and improvements in order to get last minute changes to audio. With a lot of consensus to get something...

tintwotin

Audaspace was originally implemented for the now removed game engine of Blender and wasn't designed to do audio sequencing, afaik.

The dev of Audaspace is just maintaining it and no further development from him or on audio can be expected.

A thing like a VU meter will take many months to implement according to him. So, unless you want to take a stab at it I don't think it will be developed any further. This add-on comes with a meter: github.com/snuq/VSEQF however the coder of Audaspace does not think it is reliable.

Even a simple thing like better exposure of the Pan function went nowhere: developer.blender.org/D11933

There has also been an audio proposal for Gsoc, but so far no student has stepped up.

Alternatively, you could try the pipe from the VSE to Audacity and back add-on: github.com/tin2tin/audacity_tools_for_blender