Fisher vector for scene character recognition: A comprehensive evaluation.

•We evaluate the Fisher Vector with linear classifier for character recognition.•Experimental results show that FV outperforms most methods on eight datasets.•FV could even outperform CNN based methods given limited amount of training samples.•We show that spatial information is very useful for character representation.•The results also imply the potential of FV to represent unseen categories.