Help sync generative music to video

Discussion of music production, audio, equipment and any related topics, either with or without Ableton Live
Post Reply
ryjohohojyr
Posts: 6
Joined: Tue Jan 12, 2021 11:43 pm

Help sync generative music to video

Post by ryjohohojyr » Sun Feb 28, 2021 11:08 pm

Hello all :)

I'm hoping maybe someone can give me some direction to help me realize an idea I have. I make generative music using ableton and I'd like to sync it to video somehow. Layers of light and textures and stuff like that, being triggered by and regulated by the sounds. I'd like to go as far as to sync up parameters across audio and video, like for example, to have pitch in audio control hue in video, stuff like that. Essentially making a soundscape that informs it's own light show, one generative entity making light and sound

Ever hear of anything like this or have an resources you could share that might give me some direction? I imagine others are also doing this but farther along and I just don't know where to look ahah

djorno
Posts: 38
Joined: Wed Nov 21, 2007 7:36 am

Re: Help sync generative music to video

Post by djorno » Mon Mar 01, 2021 4:48 am

Yo!

I am working on an 'inter-gene-reactive' system which uses Live + Resolume Avenue to achieve what you speak of, although I'm sure what's being developed would translate to other software you might be using yourself. What program did you have in mind for the video side of things, or were you looking for Ableton specific / M4L plugins?

I'm literally working on this stuff right as I type this. Random headache-inducing errors and obstacles keep popping up which prevent me from having a polished and presentable solution for you *quite yet*, unfortunately, but will be sure to share progress as is made. In the meantime, care to elaborate a bit on the generative music aspect of things? Any particularly cool techniques ya care to share?

Cheers

chapelier fou
Posts: 5372
Joined: Mon May 15, 2006 12:15 pm

Re: Help sync generative music to video

Post by chapelier fou » Mon Mar 01, 2021 4:29 pm

One word : OSC.
MacBook Pro 13" Retina i7 2.8 GHz OS 10.13, L10.0.1, M4L.
iMac 27" Retina i5 3,2 GHz OS 10.11.3 L10.0.1 M4L.

ryjohohojyr
Posts: 6
Joined: Tue Jan 12, 2021 11:43 pm

Re: Help sync generative music to video

Post by ryjohohojyr » Tue Mar 02, 2021 1:41 pm

I'm open to any video software. It's the one aspect I'm totally open to. I have close to 0 experience with visuals other than just from knowing VJs and doing projections for a couple dj's on resolume at festivals.
So long as I can get it to interact with clips of midi in Live and maybe even map certain variables to each other across platforms if possible.

Thanks so much!

And whats OSC?

S4racen
Posts: 5512
Joined: Fri Aug 24, 2007 4:08 pm
Location: Dunstable
Contact:

Re: Help sync generative music to video

Post by S4racen » Tue Mar 02, 2021 2:43 pm

chapelier fou wrote:
Mon Mar 01, 2021 4:29 pm
One word : OSC.
This in Resolume is a dream come true!!


Cheers
D

chapelier fou
Posts: 5372
Joined: Mon May 15, 2006 12:15 pm

Re: Help sync generative music to video

Post by chapelier fou » Wed Mar 03, 2021 8:52 am

ryjohohojyr wrote:
Tue Mar 02, 2021 1:41 pm
And whats OSC?
https://en.wikipedia.org/wiki/Open_Sound_Control
Basically, a way to send a lot of info between anything and anything, in a very readable way.
MacBook Pro 13" Retina i7 2.8 GHz OS 10.13, L10.0.1, M4L.
iMac 27" Retina i5 3,2 GHz OS 10.11.3 L10.0.1 M4L.

Matties Grooten
Posts: 5
Joined: Fri Dec 22, 2017 5:42 pm

Re: Help sync generative music to video

Post by Matties Grooten » Tue Apr 20, 2021 2:40 pm

Please take a look at EboSuite

Post Reply