Simple methods to overcome the limitations of general word representations in natural language processing tasks.

•We propose a simple method to obtain task-specific word representation.•We propose to handle out the OOV problem by subword and mapping approaches.•The proposed methods achieved performance improvement in all four Korean tasks.