Information Systems Assessment

Information Systems Assessment

NIMSAD

Method 1

Method Effectiveness - NIMSAD Method Evaluation Framework

The Normative Information Model-based, Systems Analysis and Design (NIMSAD) framework Jayaratna, 1994 rates a method's ability to formulate a problem, design a solution, and implement the design. Since a systems analysis and design method is a structured technique for solving a particular kind of problem, NIMSAD can be used to determine the effectiveness of such methods to solve business problems. The framework focuses on the context for applying the method, the method user, and the method itself (Kruchten, 2003)

The Krogstie, Sindle and Lindland quality assessment framework (Kruchten, 2003) was designed to evaluate the potential of modeling techniques to support the creation of high quality models. It recognises that models are created as part of a dialogue of participants, whose knowledge improves with the development of the models. Quality in the framework examines correspondence between statements belonging to several sets, including modeling language extension, the problem domain, the resulting externalised model, the relevant explicit knowledge of the audience, the social audience interpretation of the externalised model, and the technical audience interpretation via modeling tools. We used 3 of 5 facets of the model to help assess modeling capability. (Kruchten, 2003)

Various authors conclude that methods that are complex and large (many concepts and different model types) are more difficult to learn and apply. Where symbols in a modeling language are imprecisely defined, or overloaded (used for multiple purposes), ambiguities can arise. Where there are multiple equivalent constructs, there is redundancy, leading to wasted learning effort and possible loss of communication effectiveness. We found two techniques which provided good insight into these problems for the methods evaluated.

Castellani - has used Charts of Concepts to derive measures of size and complexity of UML both in and between models. This approach is applied to the IM for comparison. Method Points - Is a methodology, akin to the Function Point count, providing a quantitative measure of complexity by counting the components of the generic structure of a method's deliverables (Kruchten, 2003) The techniques introduced above were applied to both methods. Where available, we used the authors' own analysis for the RUP/UML. Original analysis was performed for the IM.

NIMSAD is an acronym for normative information model-based systems analysis and design. It was born out of the desire to make some sense of the many different “methodologies” being developed and advocated by both the academic and consulting communities, particularly in the domain of problem solving in information systems (Jayaratna, 1994). Although it is an evaluation framework for methodologies-in-action, we have used it to evaluate interpretative research methods, because they involve social situation, beliefs, values, and actions of people in the situations and also the researcher and the use of research methods. According to the framework, problem solving in practice, consists of four essential elements, namely: (Kruchten, 2003)

1. the problem situation;

2. the “problem-solver”;

3. the “problem-solving process”; and

4. evaluation of the these three at three time periods (t 0, t 1, t 2 (see Figure ...