AUv3 MIDI Processor · iOS 17 & macOS 14

A live duet with a neural network.

IMPSY listens to what you play and improvises musical responses in your DAW. Load it as an AUv3 MIDI Processor in AUM, Logic Pro, Cubasis or MainStage, send MIDI from any keyboard or controller, and route IMPSY's output to any instrument.

How it works See screens On-device. No network. No telemetry.
AUv3 MIDI Processor iPhone · iPad · Mac MDRNN on-device TensorFlow Lite
IMPSY app icon — a glowing wave on a deep green ground

What it is

Jam with an AI MIDI partner.

IMPSY runs a Mixture Density Recurrent Neural Network on-device. Every note, control change or pitch-bend you send becomes input to the model, which predicts what should happen next — including the timing of the response.

The plugin works as an AUv3 MIDI Processor: it sits between your controller and your synth, listens to MIDI in, and emits MIDI out. No audio. Nothing leaves your device.

A duet between you and a neural network trained on musical performances.
IMPSY running on iPad, showing the live dashboard with the loaded model, response mode, and the per-dimension input sliders.

The live dashboard — IMPSY responding on iPad.

How it works

Four knobs shape the conversation.

Threshold

How long IMPSY waits between your input and its reply. Short for fast call-and-response, longer for breathing room.

σ

Sigma Temp

Randomness of pitch and control values. Lower stays close to what it learned, higher invites surprise.

π

Pi Temp

Randomness of which musical "idea" the model chooses from its mixture. Affects motif selection rather than note jitter.

Timescale

Speeds up or slows down the response. The same model phrase can come back faster or slower without retraining.

Parameter Range Default What it does
Threshold0.1 – 10.0 s0.1 sPause between input and reply.
Sigma Temp0.001 – 2.00.01Randomness of pitch and control values.
Pi Temp0.1 – 5.01.0Randomness of mixture-component choice.
Timescale0.1 – 4.0×1.0×Speeds up or slows down the response.
MIDI Thruon / offonPass your own MIDI through to the synth as well as into IMPSY.

Inside the plugin

Dashboard, settings, mapping.

Three screens. Designed for the compact AUv3 surface and laid out the same way on iPhone, iPad and Mac.

Dashboard screen on iPhone: loaded model, RESPONSE/ACT state, eight direct-input sliders, per-dimension IN/OUT activity, and the most recent output event.

Dashboard — live state.

Settings screen on iPhone: loaded model, four parameter sliders (Threshold, Sigma Temp, Pi Temp, Timescale), MIDI Thru toggle, and Import / Export TOML buttons.

Settings — four sliders, MIDI thru, TOML config.

Mapping screen on iPhone: input/output toggle, eight dimension rows each with a MIDI message type (CC, Note, Pitch Bend), channel selector, and CC number selector.

Mapping — assign each dimension to any MIDI message.

Mapping editor on iPad showing the eight dimensions of the loaded model laid out across the wider screen — input tab selected, each row mapped to a MIDI CC.

Mapping editor on iPad. Each model dimension is freely assignable to a MIDI CC, note or pitch-bend on any channel.

IMPSY's mapping editor on macOS, showing eight dimensions assigned to MIDI CC numbers 13–20 on channel 1.

Mapping a 9-dimensional model. macOS plugin view.

Custom models

Bring your own neural network.

IMPSY ships with a default 9-dimensional MDRNN model trained for general musical interaction, but it loads any .tflite model trained with the open-source IMPSY research toolkit.

Map each model dimension to any MIDI message — notes, CCs, pitch-bend — and use IMPSY with synths, drum machines, lighting rigs, or anything that speaks MIDI. Mappings save with your session and can be imported and exported as TOML to match the configs used by IMPSY's Python research scripts.

  • ✓ Inputs & outputs mapped independently per dimension
  • ✓ Note On / CC / Pitch Bend, any channel
  • ✓ TOML import & export, compatible with IMPSY's Python toolkit

Where it runs

An AUv3 MIDI Processor — wherever you make music.

iOS & iPadOS 17

AUM is the reference aumi host. Also loads in Loopy Pro, Drambo, apeMatrix, Cubasis 3, AudioBus 3, BeatMaker 3, Auria Pro, and Logic Pro for iPad. Plays nicely with hardware MIDI over USB or Bluetooth.

macOS 14 (Apple Silicon)

Logic Pro and MainStage load IMPSY in the MIDI FX slot. Reaper added AUv3 MIDI Processor support in 7.55 (Nov 2025). Loopy Pro, Drambo, apeMatrix and Hosting AU also work as aumi hosts on macOS.

MIDI in, MIDI out

No audio I/O. IMPSY processes MIDI events end-to-end — your DAW's signal chain stays clean.

Research background

IMPSY is research software.

IMPSY (Intelligent Musical Prediction SYstem) began as research at the ANU School of Computing into creative music-making with on-device neural networks. The underlying framework — model architecture, training code, and recording tools — is open source.

IMPSY's dashboard view inside the macOS host app — model status, RESPONSE/ACT toggle, per-dimension input sliders and activity dots.

IMPSY in the macOS container app. Same UI inside any AUv3 host.

Support

Got a question, found a bug?

Replies usually arrive within a few business days.

When reporting a problem, please include your device, OS version, the AUv3 host you're using (e.g. Logic Pro, AUM), and any custom .tflite model you loaded.

Frequently asked questions

Does IMPSY send audio?
No. IMPSY is a MIDI Processor — it has no audio inputs or outputs. Send MIDI in, get MIDI out, route the output to any synth.
Does it work offline / on a plane?
Yes. The neural network runs entirely on-device with TensorFlow Lite. No network access of any kind.
Can I use my own model?
Yes. Train a model with the IMPSY Python toolkit and tap Load Model to pick the .tflite file from Files (iOS) or Finder (macOS).
What's the difference between Sigma Temp and Pi Temp?
Sigma controls jitter within a chosen musical idea (note pitch / CC value). Pi controls how randomly the model picks which idea to produce next from its mixture.
Why is there a "MIDI Thru" toggle?
If your controller is already routed to a synth in the DAW, turn MIDI Thru off so IMPSY only adds the model's responses. If IMPSY is the only thing reaching the synth, leave it on.
Does it work in Ableton Live?
No. Live 11.2+ hosts AUv3 instruments and audio effects, but it has never hosted AU MIDI effect plugins — IMPSY is an AUv3 MIDI Processor (aumi), so Live won't see it. IMPSY is developed and tested in Logic Pro; MainStage, Reaper (7.55+), AUM, Loopy Pro, Drambo, apeMatrix, Cubasis, and AudioBus also host aumi plugins.
What about GarageBand?
GarageBand on iOS and macOS does not load AUv3 MIDI Processor plugins (it only shows AUv3 instruments and audio effects) — Apple has never added aumi hosting to it. Use AUM, Loopy Pro, or Cubasis on iOS for IMPSY instead.
Intel Mac support?
macOS support is Apple Silicon only. The TensorFlow Lite C runtime is not currently shipped as a stable Intel prebuilt.