Dynamic Transmission Mode Selection for Multi-Modal Services

Multi-modal services, which integrate emerging haptic signals with audio-video signals, are expected to further improve user’s immersive experience. However, traditional audio-video communication schemes fail to simultaneously meet various transmission requests of low latency, high reliability, and high throughput. To resolve this problem, based on the existing communication paradigms, a dynamic multi-modal service transmission mode selection strategy is proposed. Firstly, according to different types of multi-modal services, three transmission strategies are proposed to satisfy different transmission requests. And a rule for mode selection and resource allocation is designed. Secondly, an improved multi-objective optimization algorithm based on NSGA3 is proposed to select modes and allocate resources, which improves communication performance as much as possible, and achieves better resource utilization efficiency. Finally, simulation results show the effectiveness of proposed method.