Visual Automation Through Cues and Phrasing: MadMapper, MIDI/OSC Triggers and Adaptive Live Mapping.

Intelligent Automation and Musical Phrase Synchronisation

The biggest operational challenge for a VJ or visual-content designer is coordinating scene changes with electronic music’s narrative structure (intros, build-ups, drops and melodic passages or breakdowns).

Without a rigid timecoded show, automation relies on musical phrasing structure and contextual Cue markers embedded in the DJ’s audio files.

---

Track-Based vs. Phrase-Based Cues

                              ┌──────────────────────────────────┐
                              │  Visual Trigger Strategies       │
                              └────────────────┬─────────────────┘
                                               │
               ┌───────────────────────────────┴───────────────────────────────┐
               ▼                                                               ▼
   [ Track-Based Cues ]                                            [ Phrase-Based Cues ]
   ├── Hot Cue markers in    rekordbox/Serato                       ├── Bar Counter          (16 / 32 Bars)
   ├── Trigger specific clips directly                             ├── Scene changes on the Downbeat   
   └── Linked to the track's ID3 metadata                           └── Continuous algorithmic sync   

1. Track Marker Triggering (Track-Based Cues)

This uses information from Hot Cues and Memory Cues analysed beforehand in rekordbox, Serato DJ Pro or Engine DJ.

• Drop Mapping: Control software assigns Hot Cue A at the exact point of the track’s drop. When CDJ playback reaches that position, show-control software sends a MIDI or OSC command to the media server, switching to the clip column with maximum stroboscopic impact.
• Breakdown Mapping: CUE markers in atmospheric passages disable rhythmic layers and enable blur effects, 3D fluid generators or palette changes to cool tones (blues/violets).

2. Musical Phrasing Automation (Phrase-Based Cues)

The vast majority of electronic productions are organised into rhythmic phrases of 8, 16, 32 or 64 bars (beats).

• Algorithmic Phrase Counter: The show-control server (or scripts in TouchDesigner / Beat Link Trigger) analyses the bar position received over the network.
• Automatic Downbeat Transition: Rather than chaotically changing visual scenes mid-phrase, software schedules clip changes exactly on beat 1 of bar 1 of the next musical phrase (the 32-beat downbeat), guaranteeing a musically perfect visual transition even if the VJ misses the button timing.

---

MadMapper: Video Mapping and DMX Pixel Mapping

MadMapper (GarageCube) is the reference tool when a project requires projecting video onto complex three-dimensional architectural surfaces or mapping DMX LED strips through video samples.

DMX Pixel Mapping from the Video Canvas

Traditional Pixel Mapping through numeric DMX tables is tedious. MadMapper transforms the workflow by treating physical lights as graphical elements on the visual canvas:

1. Create a Virtual Fixture: Define the physical LED bar configuration (e.g. a 16-pixel RGB bar = 48 DMX channels).
2. Position on the Canvas: Drag the virtual bar over the video region you want to sample.
3. Real-Time Colour Mapping: MadMapper extracts live RGB values from video frames passing beneath the virtual object and immediately sends them through Art-Net or sACN to the real LED bars.
4. Result: Physical stage lights reproduce the video’s colour and motion texture without any individual channel-programming effort.

---

Integration Through MIDI Triggers and OSC

MIDI Note / CC Messages from the Mixer

Professional booth mixers (such as Pioneer DJM-900NXS2, DJM-V10 or Allen & Heath Xone:96) send standard MIDI messages through their rear USB ports:

• Fader Start / Opacity: Moving the DJ mixer’s channel 1 fader sends a Control Change (CC) message that can map directly to Resolume Layer 1’s opacity fader.
• Crossfader: Send physical crossfader values to control A/B mixing between two graphical generators in MadMapper.

OSC (Open Sound Control)

OSC replaces MIDI on Ethernet networks, offering descriptive path names and greater mathematical resolution (32-bit floating-point data rather than classic MIDI’s 128 steps at 7 bits).

Example OSC Command Syntax on Video Servers

OSC Command	Parameter	Executed Action
/composition/layers/1/clips/2/connect	1	Triggers clip 2 on layer 1 in Resolume.
/composition/layers/2/opacity	0.75	Sets layer 2 opacity to 75%.
/composition/tempo	128.0	Synchronises master tempo to 128 BPM.
/mat.madmapper.com/surface/1/opacity	1.0	Activates surface 1 in MadMapper.

---

Live Contingency Protocols

In live performances where the DJ improvises without a fixed track list or changes structure abruptly:

1. Panic Button / General Blackout: Set a global shortcut that switches all outputs to a neutral corporate-logo layer or dark background if a booth failure stops the track.
2. Generative Backup Layer: Keep a gentle audio-reactive generative graphic layer active in the background (TouchDesigner / Spout), automatically taking over if a track has no associated video or track reading fails.