From Chaos to Order: The Role of Content and Context of Daily Activities in Rearranging Lifelogs Data

Lifelogs is known as a set of heterogeneous data recorded daily from various types of wearable sensors from the first-person perspective. Nevertheless, getting insights from lifelogs still a journal to a mystical land where many obstacles need to be overcome. One of the exciting obstacles is to augment human memory when the chaos of memory snapshots must be rearranged chronologically to give a whole picture of a user's life moment. In this paper, a new method to tackle this challenge by leveraging the content and context of daily activities is introduced. The backbone idea of this method is, under the same context (e.g., a particular activity), one image should have at least one associative image (e.g., same content, same concepts) taken from different moments. Thus, a given set of images can be rearranged chronologically by ordering their associative images whose orders are known precisely. The proposed method is evaluated on the imageCLEFlifelog 2019 dataset and compared to participants joined this event. The experimental results confirm the high productivity of the proposed method in both stable and accuracy aspects.