effect reacts to another layer / color

[5Diraptor]

Hello,

Don't groan too loud but yeah, I'm a noob to both VJ and Resolume. I video edit for my job, but haven't touched live stuff, but now I'm trying to look into it a bit for a project

So what I'm trying to do is have an effect that reacts to the color of a layer. I want an effect that can generate dots that will float randomly about over a video layer. Then I want the dots to react to any dark pixels on that video, so that if a dark grey / black color appears near the dot, it will stop or move away from it.

Is that possible? If it's even possible I'll get into the Resolume manual and work it all out a bit more, but I don't want to spend ages on something that I'm not sure is even a thing.

[5Diraptor]

So been messing around. The particle system does mostly what I want, by creating randomly generated particles from a layer. Is it possible to customize the presets at all (comfortable with scripts in a few languages) so that the color of the pixels below the particle affects it's velocity / direction etc?

[5Diraptor]

For example, can I set up a patch in Resolume Wire to sample a certain pixel from a layer beneath it? If I can do that it looks like this might be possible...?

[Arvol]

For something this complex, it would need to be done using GLSL/ISF or with software like AE using masks and FX. This is pretty advanced to be doing live. There is software out there that can do it, but you have to build it out yourself, there isn't going to be a quick drag and drop solution for something this complex.

I've written something like out out before for a few museum installs using a kinect camera and anything that is whit modify the image (in your case it would just generate particles that have gravity, collisions, and friction.

[5Diraptor]

By AE do you mean Adobe After Effects? I use this regularly and comfortable with writing my own scripts / expressions with this. Just not sure how they integrate?

[Arvol]

Correct. After Effects. You would have to bake this into your files, you wouldn't be able to use AE for generative stuff as there isn't really a physics system in place (that I know of) for all of this. So it would be something prebuilt you would just use as playback.

[Arvol]

This is far from what you requested, but if you can add your laptops camera into the bottom layer (replace the camera i put in there), this can show you a little bit of what you can expect if you can write a GLSL/ISF file to fit your needs (I'm using Snowy as an example. Notice how the snow sticks to anything white in the image.)

This is a Resolume comp, just download and open.

https://drive.google.com/open?id=1gMMSZ ... p=drive_fs

[5Diraptor]

That is very very cool

[5Diraptor]

But that is seriously helpful Arvol! It confirms to me that Resolume layers definitely can react to the color of the layer beneath it which was the main thing I wasn't sure about. As far as I'm concerned it's just a matter of coding everything in the right way now. When I originally started thinking about doing this in AE, I knew how I could make the expression work how I wanted to, but was stuck because AE doesn't support live sources.

You've been really helpful and I feel like I'm asking too much but are you able to give me a real quick run through of the process? Is the coding functionality built in AE, and exported as a GLSL/ISF file type that can be imported into Resolume as an effect / clip? I did a lot of googling yesterday on Resolume + After Effects and to be honest I didn't really find anything on it that gave me a clue as to how this could work. Will I need a special plugin to export the file from AE?

Or if there's any tutorials you know of that will help then that would be amazing!

many thanks, 5D

[5Diraptor]

Just been re-reading this. Realised you said GLSL/ISF OR After Effects! I definitely want it live but on re-reading, do you mean AE can only do a render after the event? Or I can create an effect in After Effects that can be used live in Resolume?