An Advanced System-Level Testing for Roadside Multimodal Sensing and Processing in IoV

Currently, there are mature test methods for specific sensing devices or processing devices in the Internet of Vehicles (IoV). However, when a system is combined with these different types of devices and algorithms for real scenarios, the existing device-level test results cannot reflect the comprehensive functional or performance requirements of the IoV applications at the system level. Therefore, novel application-oriented system-level evaluation indexes and test methods are needed. To this end, we extract the data processing functional entities into specific and quantifiable evaluation indexes by considering the IoV application functions and performance requirements. Then, we build a roadside sensing and processing test system in a real test zone to collect and process these evaluation indexes into accurate multidimensional ground-truth. According to the actual test results of multiple manufacturers' solutions, our proposed test method is verified to effectively evaluate the performance of the system-level solutions in real IoV application scenarios. The unprecedented evaluation indexes, system-level test method, and the actual test results in this paper can provide an advanced reference for academics and industry.