Augmented Reality Flavors: Gustatory Display Based On Edible Marker And Cross-Modal Interaction

The main contribution of this paper is to realize computer generated augmented flavors and establish a method to integrate gustatory information into computer human interactions. There are several reasons for the scarcity of research on gustatory information. One reason is that taste sensations are affected by a number of factors, such as vision, olfaction and memories. This produces a complex cognition mechanism for a user's gustatory sensation, and makes it difficult to build up a gustatory display which produces a specific taste on demand.Our hypothesis is that the complexity of gustatory sensation can be applied to the realization of a "Pseudo-gustatory" display that presents the desired flavors by means of a cross-modal effect elicited by visual and olfactory augmented reality. We propose the Edible Marker system, which can detect the state [number/shape/6-degree-of-freedom (DOF) coordinate] of each piece of bitten or divided food in real time, and the "Pseudo-gustation" method to change the perceived taste of food by changing its appearance and scent. We construct "MetaCookie+" as an implementation and discuss its validity through an exploratory study.