Ghosteam Live: A New VJ Solution for Unreal Engine and Resolume

Ghosteam Live is an application for VJs that uses Off World Live to seamlessly stream 3D visuals directly from Unreal Engine to Resolume.

This technical breakthrough dissolves all traditional VJing bottlenecks and previous limitations of performing with pre-rendered visuals– removing frame rate ceilings, resolution constraints, and endless rendering time.

“Off World Live is a crucial puzzle piece, with incredible performance and fantastic customer service, it lets us use Unreal Engine full capabilities within our plugin. The setup is super quick, all there is left is creativity!”

Ghosteam LIVE: A New Approach to Real-Time Visuals

The Light Rig Live VJ Loops extension pack contains 10 light rigs, as well as various modular arrays of stage lights. The plugin allows users to dynamically control a wide range of assets for your live performance, including live video feeds, smoke FX, AutoCam, Light controls, camera controls, color controls and many more.

Core Components

The solution contains four core components:

• Unreal Engine: Real-time rendering for multiple scenes, lighting rigs, and custom blueprints
• Off World Live: Facilitating zero-latency video streaming between Resolume and UE in a packaged Windows executable
• Wire: Creating UI sliders and buttons to communicate with UE via Open Sound Control (OSC)
• Resolume Arena: Managing user interface and serving as a control hub for incoming video streams

Technical Flow Diagram

Resolume integrates two key components: Wire, a node-based patching environment for creating UI sliders and buttons, and Arena, which acts as the central hub for user interface control.

Unreal Engine complements this setup with several elements packaged into a single Windows executable: custom blueprints for dynamic control of parameters like camera position, color, lighting modes, zoom, special effects, and 3D scene components; real-time visual rendering for creating scenes; and the Off World Live Media Toolkit Plugin for capturing scenes as render targets.

Communication between Resolume and Unreal Engine is facilitated by two protocols: OSC (for transmitting control signals) and Spout (for zero-latency video streaming).

The workflow begins with Arena managing the UI and sending OSC messages to Unreal Engine’s listening blueprints, enabling dynamic visual rendering. The rendered scenes are then captured using the Off World Live Plugin, streamed via Spout, and returned to Resolume for final output and display.

Beyond dynamic control of the lighting rig, users can also explore bi-directional video streaming by outputting any visual, logo, or animation from Resolume to Unreal Engine, where it is rendered live within the 3D environment. With increasingly powerful GPUs and rapid real-time rendering capabilities, integrating customized moving images into 3D environments has never been easier.