Image Based Classification of Methods-Time Measurement Operations in Assembly Using Recurrent Neuronal Networks

Image based classification enables the acquisition and transfer of data from manual assembly workstations into a digital environment. Based on the Methods-Time Measurement method, assembly processes are transformed into short, discrete basic operations that are recognised by means of image processing and used as input data for a multilayer neural network. A recurrent neural network algorithm is investigated for its applicability in combination with the sensor data. The five basic MTM operations reaching, grasping, bringing, releasing, and positioning are classified and additional influencing factors, as well as the implementation of an object recognition, are investigated. The following paper addresses the question of the extent to which manual assembly processes can be reliably derived from visual sensor data and classified by machine learning algorithms.