Experience with a structure, process and outcome framework for evaluating an information system

There are a number of problems in assessing the quality and performance of any information system, but these are particularly acute when it is intended for use within a developing country environment. This paper presents the case for structured evaluation of such systems, based on experience with a medical decision-aid system for developing countries. The paper provides a framework to approach the evaluation task combining work in the area of information systems and health policy analysis. The model used is built around the three concepts of a system's structure, the process it supports and the outcome of its use. This three-part analysis is then applied at three main levels: that of the system's functioning, human and user perspectives and the overall impact of the system, in this case the impact on the health care system.