Technology

Ongoing
Image Title People Involved Related Fields
IMU-Based Human Movement Recognition Using MINIROCKET and Application in Dance Performance
IMU-based Human Movement Recognition Using AI  Juan Pampin, Ziyu (Rose) Xu, Zoe Cai Human-computer Interaction, Interactive Media, Machine Learning, Sensing, Wearable Computing
DXARTS Sound Lab layout mockup
Ambisonics and 3-D Audio Playback Systems Joseph Anderson, Juan Pampin, Michael McCrea 3D Audio, Acoustics and Psychoacoustics, Ambisonics, Computer Music, Digital Signal Processing, Science and Technology, Software, Sound Art
An early prototype of an ultrasonic speaker array.
Ultrasonic Beamforming Michael McCrea, Juan Pampin Aural Architecture, Digital Signal Processing, Programming, Science and Technology, Software, Sound Art, Ultrasound
ATK
ATK Joseph Anderson, Michael McCrea, Juan Pampin, Daniel Peterson 3D Audio, Ambisonics, Digital Signal Processing, Electro-acoustic Music, Programming, Software
ATS: snapshot of ATSH editor
ATS Juan Pampin Composition, Computer Music, Electro-acoustic Music, Live Electronics, Programming, Software, Sound Synthesis, Spectral Modeling
Forthcoming
Image Title People Involved Related Fields
Real-time human-machine interaction during rehearsal. A dance artist performs in front of a projection controlled by our system described in the paper. The laptop screen shows the multimedia interface, while wearable IMU sensors and a smartphone are used to stream and monitor real-time data.
Human-Machine Ritual: Synergic Performance through Real-Time Motion Recognition Ziyu (Rose) Xu, Zoe Cai, Juan Pampin Algorithmic Processes, Human-computer Interaction, Interactive Media, Performance Studies, Science and Technology, Sensing, Systems
Completed/published
Image Title People Involved Related Fields
Using IMU-based motion recognition, Python pipelines, and real-time integration with TouchDesigner and SuperCollider, I designed a wand interface that lets users cast spells through gestures while experiencing synchronized visuals, sounds, and tactile feedback.
Summer Internship with ViiVAI Labs and CoMotion Makerspace Ziyu (Rose) Xu Haptics, Immersive Media, Interactive Media
Image of Rose Teaching the Workshop
Git for Everyone! Ziyu (Rose) Xu Ethics, Experimental Media, Human-computer Interaction, Science and Technology, Surveillance and Privacy, Systems
Encephalophone block diagram
Musical auditory feedback BCI Juan Pampin, Thomas Deuel Art/Science, Human-computer Interaction, Neuroaesthetics, Sensing
microphone in parts
Low-cost Ambisonic Mic Rihards Vitols 3D Audio, Ambisonics
Ambisonics & the ATK @ DXARTS Joseph Anderson, Juan Pampin, Michael McCrea, Ewa Trębacz, Daniel Peterson, Martin Jarmick 3D Audio, Acoustics and Psychoacoustics, Ambisonics, Computer Music, Digital Signal Processing, Electro-acoustic Music, Electronic Media
Encephalophone Ensemble at 9e2 Festival Thomas Deuel, Marcin Pączkowski Improvisation, Music, Neuroaesthetics
Closed-loop Brain-Computer Interface
Closed-loop Brain-Computer Interface Eberhard Fetz Science and Technology
Share