Page 1 of 1

Resolume does not recognize audio files played outside the software

Posted: Fri Oct 25, 2024 23:36
by defr0ke
Hello...

I hope someone can help me here. The following case:

Current state:
- Resolume Avenue
- ALL videos and loops without soundtrack
- internal sound card (Radeon audio chip)
- external USB sound card (Asus Xonar U5)
- audio/music is played from the same device via AIMP player
- external speakers connected to external sound card

Target state Home:
- all video files should run in Resolume with BPM sync
- Resolume should recognize the music from the AIMP player and synchronize BPM accordingly
- music should be heard on speakers
- Resolume video output on 2nd monitor (for preparation and testing)

Target state Live:
- the prepared video content should run via BPM sync
- music stream comes via audio cable from the Pioneer DJ mixer to the line-in of the sound card (external audio > sound card line-in > Notebook)
- Resolume should only analyze external music
- video output via 2x HDMI on 1-2 projectors

I want to play video animations in a club using a projector and screen. Since the music comes from the DJ, the audio track has been removed from all video files. So far I have always pragmatically let it run on its own using prepared compositions. I have changed things a bit now and then, but on the whole Resolume plays the content in a continuous loop while the music blares from the speakers.

But since the video animation almost never matches the music and is usually completely out of sync, I want to do it more professionally in the future. So fewer complete compositions, more manual selection of the video clips and effects and absolutely BPM sync.

My problem is that Resolume cannot recognize and analyze the music. At home I listen to the music that is played on the same device via an audio player. In live mode I can see via a recording tool that the music is coming from external sources on the device. If I connect headphones, I can hear them too.

So there is no problem with the audio software. I'm not 100% sure whether Resolume really doesn't recognize the music. But if Resolume's BPM values ​​are never adjusted to the music and the videos are constantly played too slowly and out of sync, I assume that Resolume can't access the audio files.

I'm confused and annoyed... No matter what I change in the Windows and Resolume sound settings, it just doesn't work.

How do I get Resolume to recognize and analyze external audio in my settings and automatically adjust the videos to the music accordingly?

I can use the internal and external sound card in parallel (both activated). If that's necessary...

Thank you very much for your help

Re: Resolume does not recognize audio files played outside the software

Posted: Tue Oct 29, 2024 00:37
by tijnisfijn
Hi there,

Thank you for providing such a detailed explanation of your setup and goals. Let me help clarify how to achieve your desired setup for both home and live environments.

First, regarding audio routing and BPM sync in Resolume:

1. Internal Audio Routing
- To capture audio from AIMP or any other internal audio source, you'll need to use an audio routing application like VB-Cable, Voicemeeter, or BlackHole
- These applications create virtual audio devices that allow you to route audio between applications internally
- Once set up, select this virtual audio device as the audio input in Resolume's preferences
- If you're having issues with audio input, please check our troubleshooting guide: https://resolume.com/support/en/audio-input-no-worky
* This includes important steps for checking Windows audio privacy settings

2. BPM Detection and Sync Options:
- Resolume doesn't include automatic BPM detection functionality
- For automatic BPM detection, check out Pulse. https://hybridconstructs.com/pulse/ there are also other free alternatives online.
- For syncing with DJ software and hardware, check our detailed guide: https://resolume.com/support/en/sync-with-dj
- You can also:
* Use MIDI clock sync from your DJ software/hardware
* Manually tap the tempo using the spacebar (press repeatedly to set BPM)

For your specific setups:

Home Setup:
1. Install an audio routing application
2. Route AIMP's output to both:
- Your external Asus Xonar U5 (for listening)
- The virtual audio device (for Resolume input)
3. Set Resolume's audio input to the virtual audio device
4. Either use Pulse for BPM detection or tap tempo manually

Live Setup:
1. Connect the Pioneer DJ mixer's output to your external sound card's line-in
2. Set Resolume's audio input to your external sound card
3. Use the same BPM sync methods as above
4. For video output, you can use both HDMI outputs for your projectors

Tips for Better Sync:
- Create shorter clips that are easier to resync if they drift
- Use Resolume's quantize features to ensure clips change on beat. Like Beatsnap.
- Consider using MIDI controllers for more precise control
- Set your clips to BPM sync instead of timeline

Some Helpful Tutorials:
- BPM Sync in Resolume: https://www.youtube.com/watch?v=LgInkPpePc4
- Audio Reactive in Resolume: https://www.youtube.com/watch?v=Zx1A6fPMPto

Additional Resources:
- VB-Cable: vb-audio.com/Cable/
- Voicemeeter: vb-audio.com/Voicemeeter/

If you need any clarification or run into specific issues with the setup, please don't hesitate to reach out again.

Hope this helps!

Re: Resolume does not recognize audio files played outside the software

Posted: Thu Oct 31, 2024 00:22
by defr0ke
Thank you for your detailed answer. This has definitely helped me with Resolume's audio detection.

I have installed VB-Cable and Voicemeter, two different stereo input and two hardware out channels are also detected and they work.

In the Resolume audio settings I have selected "Voicemeter Out A2" as the input device. Out A1 is the speakers and Out A2 is Cable-In.
I think that this is the right setting, but I still don't know how I can tell that Resolume is picking up the audio file. There is no display anywhere to show this.

In this case, Resolume should recognize the start of a new track, for example, and keep the set BPM synchronized? Is that correct?
I also now realize that Resolume does not automatically set the correct BPM based on the audio file being played. What I had planned was that Resolume would play the visuals to the beat and automatically reduce the speed of the video during quiet parts of the DJ set. As soon as the beat starts again in the set, the video automatically speeds up.

But since that isn't possible now, I will probably solve it using the "Random" option. The jumps in the video simulate the beat to some extent.
In live operation at the party, I will do it using the MIDI solution. I think that is the easiest option imaginable.


I have a second question... I don't want to open a new thread just for that. Unfortunately, I couldn't find anything specific about it in the manual.

Plan:
8 monitors are connected to an 8-way VGA splitter. The splitter gets its signal from 1 source (device with Resolume). Is there a way that I can play 8 different videos on the 8 monitors with 1 Resolume? So can Resolume output 8 videos to 8 receiving devices?

Thank you for your reply...

Re: Resolume does not recognize audio files played outside the software

Posted: Thu Oct 31, 2024 10:47
by Christoph
Audio input in Resolume is only for SMPTE audio timecode or FFT parameter animation, Resolume does not listen to your incoming audio and detects the BPM / Speed automatically.
There are third-party options that do that available, like Pulse that Tijn mentioned above.

So, no, Resolume does not recognize the start of a new track

For your output question - a splitter simply sends one incoming signal to different destinations, this way each destination gets the same signal. There are devices out there that can splice an incoming signal into different signals for each output. This way you would send one high-resolution video to the splicer and this sends different parts of that signal to each destination. With VGA there were for example Matrox TripleHeads that were able to split 1 output to 3 destinations. Or some old video-wall controllers might work to get more destinations but in pretty low resolution.

If you don't need VGA, with DVI/HDMI/DisplayPort there are many more devices like Datapath X4 / Fx4, Matrox QuadHead2Go, AJA HA5-4K and many other devices available from other manufacturers. Typically those can splice 1 signal in up to 4 signals, so you'd need 2 of them and 2 outputs from your computer to get 8 individual outputs.

Re: Resolume does not recognize audio files played outside the software

Posted: Fri Nov 01, 2024 03:55
by defr0ke
OK, thanks for the info

Re: Resolume does not recognize audio files played outside the software

Posted: Sun Nov 03, 2024 14:14
by mowgli
What mixer is the DJ using?
Many mixers can output MIDI clock that you can connect to Resolume.