Multi-class object detection using faster R-CNN and estimation of shaking locations for automated shake-and-catch apple harvesting

•Multi-class object detection in complex orchard scenarios using deep learning models.•Establishing mathematical models of branches and trunks efficiently.•Accurate estimation of shaking locations on the tree branches in 3D space.