Interactive Sonification for Health and Energy using ChucK and Unity
arxiv(2024)
摘要
Sonification can provide valuable insights about data but most existing
approaches are not designed to be controlled by the user in an interactive
fashion. Interactions enable the designer of the sonification to more rapidly
experiment with sound design and allow the sonification to be modified in
real-time by interacting with various control parameters. In this paper, we
describe two case studies of interactive sonification that utilize publicly
available datasets that have been described recently in the International
Conference on Auditory Display (ICAD). They are from the health and energy
domains: electroencephalogram (EEG) alpha wave data and air pollutant data
consisting of nitrogen dioxide, sulfur dioxide, carbon monoxide, and ozone. We
show how these sonfications can be recreated to support interaction utilizing a
general interactive sonification framework built using ChucK, Unity, and
Chunity. In addition to supporting typical sonification methods that are common
in existing sonification toolkits, our framework introduces novel methods such
as supporting discrete events, interleaved playback of multiple data streams
for comparison, and using frequency modulation (FM) synthesis in terms of one
data attribute modulating another. We also describe how these new
functionalities can be used to improve the sonification experience of the two
datasets we have investigated.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要