SinuslabsSINUSLABS

VJ & DJ setup · Updated

How to use a gamepad as a MIDI controller in TouchDesigner

TouchDesigner can read a game controller in two ways. Its Joystick CHOP reads the pad directly, and its MIDI In CHOP reads MIDI. PadMap is for the second route: it turns a PlayStation, Xbox or generic controller into MIDI notes and CC, so the pad arrives in your network the same way a MIDI controller does. That gives you mapping layers, tilt control on PS4 and PS5 pads, and one mapping you can reuse in your DAW or VJ software.

Short answer

Run PadMap, open Dialogs → MIDI Device Mapper in TouchDesigner, add a device mapping and choose the PadMap port as its In Device. Then add a MIDI In CHOP: it outputs a channel for each button note and each stick, trigger or gyro CC, ready to export to any parameter.

Set up your gamepad in TouchDesigner

  1. 1

    Connect the controller and start PadMap

    Connect the pad over USB or Bluetooth and open PadMap. On macOS the MIDI port appears by itself as PadMap Out. On Windows PadMap sends through a free loopMIDI port: set one up and select it in PadMap. Start PadMap before TouchDesigner. Derivative notes that a device connected after TouchDesigner opened may not be listed until you save the project and restart.
    PadMap's preset menu: built-in MIDI Default, MIDI Notes and MIDI Drums presets, two saved presets and Save current as
    Built-in presets — MIDI Default, Notes and Drums — plus your own, saved with Save current as.
  2. 2

    Add the PadMap port in the MIDI Device Mapper

    Choose Dialogs → MIDI Device Mapper. Add a device mapping: a new row appears with an ID and a channel filled in. Click the row's In Device field and pick the PadMap port (PadMap Out on macOS, your loopMIDI port on Windows). Note the row's ID, because the CHOP in the next step refers to it.
  3. 3

    Read the pad with a MIDI In CHOP

    Add a MIDI In CHOP and set its Device ID to the ID from the mapper. Press buttons and move the sticks: the CHOP grows a channel for each note and each controller it hears. On the Control page, set Normalize to 0 to 1 so a stick or trigger gives you 0–1 instead of 0–127.
  4. 4

    Drive parameters from the channels

    Use the channels like any other CHOP data: export one to a parameter, reference it in an expression, or run it through a Math, Lag or Filter CHOP first to scale and smooth it. A stick rests at the middle of its range, so a Math CHOP that maps 0–1 to −1–1 gives you a control that sits at zero until you push it.

Joystick CHOP or PadMap?

Be clear about what you need before adding a tool. TouchDesigner's Joystick CHOP reads a controller's axes, buttons, sliders and POV hats with nothing else installed. If raw sticks and buttons inside one project are all you want, start there.

PadMap earns its place when you want more than that:

  • Layers. Make a button a modifier in PadMap and the rest of the pad sends a different set of notes and CCs while you hold it. In TouchDesigner each layer arrives as its own channels, with no switching logic to build.
  • Tilt. On PS4 and PS5 controllers PadMap reads the motion sensors and sends them as CC, so you can steer a parameter by leaning the pad.
  • One mapping, many hosts. The same PadMap setup feeds TouchDesigner, Resolume and Ableton Live. If your show runs sound and visuals together, the pad speaks one language to all of them.
  • Feedback in your hands. PadMap colour-codes the light bar on PS4 and PS5 pads to your mapping and adds rumble feedback.

What each control gives you

ControlIn TouchDesigner
Face buttons, D-padNote channels that go to 1 while held. Use them as triggers and toggles: cue a scene, fire an envelope, step a Count CHOP.
Left / right stickTwo CC channels per stick. Good for X/Y jobs: camera pan and tilt, a 2D position, a feedback offset.
L2 / R2 triggers (LT / RT)One CC channel each that rests at 0. Good for amounts: brightness, displacement, a mix between two looks.
Gyro (PS4 / PS5 pads)CC channels from pitch, yaw, roll and tilt. Smooth them with a Lag CHOP and they make a natural camera or light control.

Keeping it steady in a show

  • MIDI is 7-bit. A CC has 128 steps. On a slow, visible move that can show as stepping, so put a Lag or Filter CHOP after the MIDI In CHOP.
  • Filter by channel. If other MIDI gear shares the port, set the MIDI In CHOP's MIDI Channels to the channel PadMap sends on.
  • Cable for the long nights. Bluetooth frees you from the desk; USB also keeps the controller charged.

Written by Oskar Schachtschneider, who builds PadMap at Sinuslabs.

Questions

Can I use a PS5 controller in TouchDesigner?
Yes. With PadMap, the DualSense's buttons, sticks, triggers and gyro arrive as MIDI notes and CC, which TouchDesigner reads with a MIDI In CHOP. TouchDesigner's own Joystick CHOP can also read a controller's axes and buttons directly.
Why use MIDI when TouchDesigner has a Joystick CHOP?
For what the Joystick CHOP doesn't give you: mapping layers switched from the pad, tilt control from PS4 and PS5 motion sensors, and a single mapping that also works in your DAW and other visual software.
Why isn't the PadMap port listed in the MIDI Device Mapper?
Start PadMap before TouchDesigner, and on Windows make sure loopMIDI is running with a PadMap port. Derivative notes that devices connected after TouchDesigner opened may not appear until you save the project and restart TouchDesigner.
Does this work in the Non-Commercial edition?
PadMap sends ordinary MIDI on a standard port, so it needs nothing beyond TouchDesigner's built-in MIDI Device Mapper and MIDI In CHOP.