HTC Vive - Spectator Window to Resolume for Projection Mapping

[SuperChester]

I am building an art installation (stage) that hopes to display the output of an HTC Vive Virtual Reality (VR) system. The VR application, Tilt Brush, allows you to paint in virtual space and has audio-reactive paint brushes that dance to real-time music playback. Tilt Brush also allows you to setup a spectator camera so others can view your art work from wherever the painter places the camera in virtual space. This all works lovely and I can see the spectator view in a Window on my computer's monitor.

What I would like to do is take the spectator view Window and import it in to Resolume so that it can be projection mapped to certain regions/areas of the stage. A low-latency setup is integral as the paint application's sound reaction should match, as closely as possible, to the sound from the live stage speakers.

What are my options?

• Can Spout take my Spectator window as an input and output in to Resolume? I have never used Spout and am having trouble understanding it to know if it would work for this. It's basically a video game window. Can Spout input real-time video games from a PC?
• Is there a way to screen capture my real-time playback with software and feed it in to Spout and then Resolume with low latency?
• Is it possible to output my computer's Spectator window to another computer using an HDMI capture device like the Magewell XI100DUSB-HDMI or Blackmagic Intensity Shuttle 3.0? Or do those devices not accept output from a PC video card?
• Is Resolume the right tool for this? Is there another tool that would be more appropriate?

PC Specs:
Intel Core i7-5820K 6-core
Samsung 950 PRO M.2 NVMe SSD
GeForce 980ti
64 GB DD4 RAM

I also have a decently spec'd PC laptop (i7, Raid0 SSDs, GeForce 680m, 32megs RAM) at my disposal if running output from the desktop in to a laptop would be the best solution.

Thoughts??

Thank you!!

[AdevProjects]

Ive been testing vmix for another project.
http://www.vmix.com

It can output as a direct show device which resolume can use in sources.

It can take alot of different types of inputs, one of them being a desktop or window capture.

I assume you will not want to be running resolume on the same pc as the VR game. So you could either run 2 copies of vmix and send one to the other via NDI (which vmix can send or recieve), or run the free desktop to NDI program: http://www.vmix.com/ndi/#vMixDesktopCapture

There a few different versions: http://www.vmix.com/purchase/

They give you a 60 day trial so you can try stuff and decide which version to use.

[manuelgazzo]

Is it possible to output my computer's Spectator window to another computer using an HDMI capture device like the Magewell XI100DUSB-HDMI or Blackmagic Intensity Shuttle 3.0? Or do those devices not accept output from a PC video card?

That will be your best option. Output HDMI from your computer running spectator and input it on a HDMI capture card on your Resolume's computer. I recommend you to use a Blackmagic PCIE card, like the Decklink Mini Recorder.
Using usb capture may incur on higher latency. You can give it a try though. I won't recommend the Shuttle 3.0, as it has many compatibility issues on several computers.

Dont know how your spectator view window would look like, but if you input it on Resolume. There you can scaled it, crop part of the screen or do anything you want.

Regards,
Gazzo.