Research on methods and key technologies of meaning extraction from mathematical formulas based on multi-modal information

We focus on building the description structure and system between image and semantics, and we will fully describe the multi-modal information, including the layout structural information, symbol syntax rules, formula syntactic rules and explanatory text, and realize the unity and fusion of the information in different types; we will also develop key technologies and realize the automatic semantic annotation of formulas. The methods proposed in this paper can reconstruct the mathematical formula and get the accurate calculational meaning of mathematical formula, and support the semantic analysis and advanced application of mathematical formula. © 2013 ICIC International.