Vocal-Diary: A Voice Command based Ground Truth Collection System for Activity Recognition

We present Vocal-Diary, a voice command based ground truth collection system that uses grammar based commands from residents to log start and end of activities. Vocal-Diary ensures robustness in the presence of sounds from different environmental noise and day-to-day conversation by using two-way acknowledgement and integrating speaker recognition in the pipeline. Vocal-Diary also utilizes the sensor data produced by the underlying activity recognition system to query residents periodically to check if they forgot to log any activity. Evaluation shows that Vocal-Diary increases precision by at least 40% and recall by at least 10% compared to a system that uses voice command recognition without any acknowledgement and speaker recognition.