Adding Machine Vision to Enhance P300 BCI Speller

BCI systems can use additional intelligence such as machine vision or obstacle avoidance routines to provide a goal-oriented approach. This paper describes a P300-based BCI system to control a small robotic arm. On the robot arm's gripper a small camera was mounted continuously capturing images from the environment. The software waits for a character from the P300-based BCI speller to turn either clockwise or counterclockwise. Once turning the image detection software automatically searches for the colored object and delivers it to a preset target location. Results showed that the BCI system performed fast and accurate.