Evaluation techniques for systems analysis and design modelling methods - a review and comparative analysis

Research output: Journal Publications and Reviews (RGC: 21, 22, 62)21_Publication in refereed journalpeer-review

132 Scopus Citations
View graph of relations


Related Research Unit(s)


Original languageEnglish
Pages (from-to)249-268
Journal / PublicationInformation Systems Journal
Issue number3
Publication statusPublished - May 2011


Even though hundreds of modelling methods are in existence today, practitioners and researchers are zealously 'producing' new modelling methods. The 'blooming' production of modelling methods is not the problem; the lack of standardized techniques for evaluating them is. To complicate the matter even further, most of the modelling methods have been introduced based on common sense and intuition of the methods' developers. Many of these methods lack theoretical foundations and empirical evidence to demonstrate their worthiness. With the current state of affairs, studies on evaluation of modelling methods have become necessary and critical. Comparing modelling methods provides us with the necessary knowledge and understanding of the strengths and weaknesses of each method. This knowledge can also guide us in our quest for better modelling methods. This paper reviews various evaluation techniques used by both researchers and practitioners. The evaluation techniques are categorized into three classifications: feature comparison, theoretical and conceptual evaluation, and empirical evaluation. This research also analyses the underlying philosophies and assumptions of these evaluation techniques. © 2007 The Authors. Information Systems Journal © 2007 Blackwell Publishing Ltd.

Research Area(s)

  • Action research, Cognitive modelling, Feature comparison, Metamodelling, Modelling methods, Ontology

Bibliographic Note

Publication details (e.g. title, author(s), publication statuses and dates) are captured on an “AS IS” and “AS AVAILABLE” basis at the time of record harvesting from the data source. Suggestions for further amendments or supplementary information can be sent to lbscholars@cityu.edu.hk.