Joint stroke classification and text line grouping in online handwritten documents with edge pooling attention networks

•A framework for joint text/non-text stroke classification and text line grouping in online handwritten documents is proposed.•Stroke classification and text line grouping problems are formulated as node classification/clustering problems in graph.•An edge pooling attention network (EPAT) is proposed to efficiently aggregate information of nodes and edges.•Superior performance of both stroke classification and text line grouping is achieved on public datasets.