3d Model Support (OBJ / FBX )

[sourcegate]

Hello,

I know many of us love to use Audio Reactive and interactive related elements in our shows.

I'm inquiring to see if there are any plans to have OBJ or FBX import support.

The ability to pull in a 3d object and manipulate their position, size, rotation, geometry would make for some very dynamic and real-time visualizations.

I know many folks have recently been using tools like TouchDesigner, Smode, or other tools to pull in a feed from these via NDI/DMX as a workaround.

I ask myself, how amazing would it be to use the new Color Palette Animation or Generators (Metaballs, Sine Wave, Spiral) to manipulate 3d objects.

Instead of a full-rendered animation from Cinema4d/After effects, etc what if we could import an object and apply transforms to it?

Please vote up if you agree or are after this feature. If enough people like it and Resolume isn't interested in putting this into core perhaps I'll build it and launch it as a plugin on Juicebar like I did with Threewave https://get-juicebar.com/detail/threewave

[MennoV]

Until this is implemented inside Resolume you may be interested in a Juicebar plugin I've made. https://get-juicebar.com/detail/gltfviewer
This plugin imports GLTF scenes. OBJ/FBX can be converted to GLTF using external tools and you'll have full support for animation and texturing etc.

It currently doesn't support applying transformations to objects without running an animation but i could add that if people would be interested.
I am curious to know how you would use video in Resolume to adjust the geometry. Are you after something that would apply displacement mapping perhaps?

[Yu HaiChuang]

Until this is implemented inside Resolume you may be interested in a Juicebar plugin I've made. https://get-juicebar.com/detail/gltfviewer
This plugin imports GLTF scenes. OBJ/FBX can be converted to GLTF using external tools and you'll have full support for animation and texturing etc.

It currently doesn't support applying transformations to objects without running an animation but i could add that if people would be interested.
I am curious to know how you would use video in Resolume to adjust the geometry. Are you after something that would apply displacement mapping perhaps?

This feature is great! I like it very much! It would be even better if it can run on the macOS platform!
I think this method can greatly reduce the mapping and alignment work on irregular surfaces.
I really like it!

[HerrNieDa]

waiting for it since it was in the feature whishlist for R4 in 15 years ago

[bennoH.]

Hello,

I know many of us love to use Audio Reactive and interactive related elements in our shows.
I'm inquiring to see if there are any plans to have OBJ or FBX import support.

The abilit... .. .

Hello Sourcegate

First of all, "Yes, I absolutely agree with you!"

But until that happens, I can already offer you a great free alternative that allows you to optimally integrate 3D in .obj or glTF formats, and you can also manipulate the 3D objects live or animate things in them in sync with the sound. The solution is TiXL, which you can easily and completely integrate into Arena or Avenue via teh nativ Spout support of TiXL to Arena/Avenue (no GPU hipe , real perfect fot taht).
Here's my post about it, including example OBJs and tutorials on how to do all this and get TiXEL to provide it, spout handling, etc.:
viewtopic.php?t=31638

This version is not only free, but I believe it will also work much better than any JuiceBar plugin ever could, since the JuiceBar plugins still have to make do with Resolume's 2D system, while TiXEL includes a fully comprehensive 3D system with vertex, geometry thesalations, and other shaders that can be processed there. Furthermore, Tixel will generally help you further with its state-of-the-art structure and correspondingly modern features. Unfortunately, I miss Vulkan there too, but at least it's based on Direct3D, which is considerably more modern than what Resolume currently offers.

But back to your message to Resolume B.V. I can add to the request: Integrating real 3D is long overdue, It would, of course, be sensational, as all effects, etc., could benefit from it! & if you look left and right, any free real-time video tools even offer integratet 3D as a standard these days, and I mentioned this to the Resolume-support about two years ago. However, according to the response from back then, it seems to involve a lot of programming effort, which Resolume avoids, and was therefore only vaguely mentioned as a distant prospect, if at all.
Resolume has been based on a pure 2D system since its inception (3D would have been unthinkable for real-time applications back then), and it would be a correspondingly large amount of work to adapt the Resolume programs, which have the corresponding source code volume; other things have much higher priority.
And yes, that certainly has something to do with the fact that Arena was created over 20 years ago, and the source code is therefore based on this version in many places. I also asked for Vulkan to be implemented, which would It would greatly support a 3D system and would go hand in hand if you have to do a lot of rewriting, especially regarding resources, with Vulkan, as I think the current versions couldn't even handle 3D using OpenGL or something similar. It also depends on which shaders are supposed to be supported. If it's just geometry and vertex and the currently supported fragment shader, then this is probably still possible. But if you really want to go into the future and consider things like mesh shaders, MaterialX, or "SPIR-V bytecode" and the like, then Vulkan is the only way to go. Vulkan would also finally enable a simplified Linux version of Arena, which is also a much-stated user request and was even promised by Resolume itself at one point.

Anyway, for now, just download TiXL for free and integrate it via the native Spout; it works perfectly: https://tixl.app/


Another interesting alternative is Coollab, which you can also integrate into Arena/Avenu via the native spout.
Coolab, like Resolume in general, is also based solely on a 2D system. However, Coollab's source code is both cutting-edge and state-of-the-art, and therefore very clever solutions have been found specifically for the problems of 3D representations and manipulation.
Coollab does not allow you to include obj or similar 3D formats, but you can use Coolab to assemble standard 3D cubes and volums direct in Coollab self into interesting, funny or even very abstract 3D objects and then edit them with 3D and 2D filters of Coollab, which is very interesting and offers certain performance advantages, thus saving the GPU-power.
You can also find a recommendation post for Coollab with the corresponding example videos and an example arena composition, etc.:
viewtopic.php?t=30764