TOSHI: The Orchestra-Synthesis Human Interface (2022 - present)

A unique feature of my orchestra piece Scattering is the custom instrument I built, to be worn like a watch on the conductor’s left hand, in order to track motion, direction, and acceleration. At key points, the expressive gestures produce a scattering of live electronic sound that, like a Greek chorus, comments on the orchestra or foretells what is to come. In these moments, the conductor has the rare opportunity to perform as a soloist with the ensemble, as in a concerto. I call the instrument The Orchestra-Synthesis Human Interface (TOSHI), in honor of Toshiyuki Shimada, the conductor who commissioned the piece in 2022.

The TOSHI tracks the conductor’s left hand gestures and allows the conductor to shape the evolution of the electronic sounds during performance, following the gestural instructions for the conductor in the score.

Communicating via WiFi, the TOSHI connects with a laptop running custom Max audio software. The Max program allows the conductor to generate sound via various synthesis, resynthesis, and granular techniques. The Max program also includes a practice/calibration module for the conductor to test and adjust the response of the TOSHI.

Based on an ESP32 microcontroller, the TOSHI has a rechargeable battery and can run up to 2.5 hours on a charge. An inertial measurement unit (IMU) provides 9 degrees of positional data that is mapped onto sound parameters by the Max program.

Both the TOSHI and MAX program are available from the composer.

The videos on this page show Gil Rose performing with the TOSHI, conducting the Boston Modern Orchestra Project in a performance of my piece Scattering.