Evaluating MIS performance: Comparison of three hierarchical evaluation types

This paper proposes a new hierarchical approach toward MIS evaluation, which emphasizes the evaluation of the strategic aspects of MIS, as well as the evaluations of the activities of MIS functions and the quality of application systems. Based on the previous studies and the preliminary field survey, concepts and contents of three hierarchical evaluation types such as system‐oriented, function‐oriented and strategy‐oriented evaluations were presented, and four propositions were drawn. The surveys of 130 Korean firms, conducted in 1991 and 1997 successively, show that majority of firms use system‐oriented or function‐oriented evaluation type, although the usage rate of strategy‐oriented type is slightly higher in 1997 than in 1991 and most MIS managers consider the strategy‐oriented evaluation as the ideal one. It is also found that the firms of higher MIS maturity use the strategy‐oriented evaluation type, and the firms with strategy‐oriented evaluation type show a higher MIS performance. Results of this study imply that strategic roles of MIS should be more emphasized and different evaluation types should be used along with MIS maturity. In addition, the design of MIS evaluation framework should be done carefully in the strategic and managerial contexts, because MIS performance can vary with evaluation type. Finally, some limitations of the study and directions for further research were suggested.