Remote operation system for novice tractor drivers for situations where automatic driving is difficult

The development of automated tractors is anticipated to address the problem of a declining and aging agricultural labor force. However, there are numerous situations in which automatic driving is difficult in the field. We developed a remote operation system allowing novice tractor drivers to control a tractor remotely in situations where automatic driving is difficult and evaluated its performance on a real tractor in a field. Our challenge was to design a user interface (UI) that allows novices to comprehend the tractor's status and return the tractor situation where automatic operation is possible. The system's UI is inspired by popular video games. In experiments, even novice tractor drivers with little or no experience driving automobiles or playing video games could remotely control the tractor and till according to the goal line. In addition, the participants dealt with an invisible obstacle by viewing illustrations of the tractor sensor data. The designed UI's operation methods and operator attributes were analyzed. Through the experiment, the following facts were revealed. A method of operation that allows the analog stick to adhere to the mechanical guide results in smooth operation. In addition, the participant's preferred control method depends on his/her gaming experience. Thus, this study clarifies some of the specifications and design guidelines necessary for a novice-friendly remote UI for the remote operation of a tractor.