Franco, L. Alberto and Lord, Ewan. (2011) Understanding multi-methodology: evaluating the perceived impact of mixing methods for group budgetary decisions. Omega-International Journal of Management Science, Vol.39 (No.3). pp. 362-372. ISSN 0305-0483

Full text not available from this repository.

Abstract

This paper reports on the design and implementation of a multi-methodology intervention intended to support a budget prioritisation decision by a multi-organisational group tasked with tackling the problem of teenage pregnancy in an English borough. The intervention approach involved the combined use of cognitive/causal mapping and a multi-criteria decision analysis method to develop and prioritise a number of projects aimed at alleviating issues associated with teenage pregnancy. The paper describes and discusses the process of developing and applying the intervention approach, and provides an evaluation of its perceived impact by the client group. Drawing on the rich seam of data gathered over the course of our work with the multi-organisational group, we explore the varying degrees of impact that the mapping and multi-criteria evaluation methods achieved during and after the intervention. Analysis of the intervention data suggests that both methods were perceived to facilitate a different way of thinking and learning. In addition, we find that the mapping and multi-criteria evaluation methods successfully addressed participants democratic and rational concerns. However, despite these reported positive effects, the full recommendations of the intervention were not implemented. An attempt is made to explain this outcome in terms of both the multi-organisational context within which the intervention took place and the nature of the group task. Directions for further research are then proposed. (C) 2010 Elsevier Ltd. All rights reserved.

Item Type:	Journal Article
Subjects:	H Social Sciences > HD Industries. Land use. Labor > HD28 Management. Industrial Management
Divisions:	Faculty of Social Sciences > Warwick Business School
Library of Congress Subject Headings (LCSH):	Group decision making, Management, Budget, Teenage pregnancy -- England -- Evaluation
Journal or Publication Title:	Omega-International Journal of Management Science
Publisher:	Pergamon-Elsevier Science Ltd
ISSN:	0305-0483
Date:	June 2011
Volume:	Vol.39
Number:	No.3
Number of Pages:	11
Page Range:	pp. 362-372
Identification Number:	10.1016/j.omega.2010.06.008
Status:	Peer Reviewed
Publication Status:	Published
References:	J. Mingers and J. Brocklesby, Multimethodology: towards a framework for mixing methodologies, Omega 25 (5) (1997), pp. 489–509. J. Mingers and A. Gill, Editors, Multimethodology: the theory and practice of combining Management Science methodologies, Wiley, Chichester (1997). M. Jackson, Present positions and future prospects in management science, Omega 15 (6) (1987), pp. 455–466. M. Pidd, Complementarity in systems modelling. In: M. Pidd, Editor, Systems Modelling: theory and practice, Wiley, Chichester (2004), pp. 1–20. A. Paucar-Caceres, Mapping the changes in management science: a review of`soft' OR/MS articles published in Omega (1973–2008), Omega: The International Journal of Management Science 38 (1–2) (2010), pp. 46–56. I. Munro and J. Mingers, The use of multimethodology in practice: results from a survey of practitioners, Journal of Operational Research Society 53 (4) (2002), pp. 369–378. J. Mingers, Multimethodology: mixing and matching methods. In: J. Rosenhead and J. Mingers, Editors, Rational analysis for a complex world revisited: problem structuring methods for complexity, uncertainty and conflict, Wiley, Chichester (2001), pp. 289–310. C. Eden, Cognitive mapping: a review, European Journal of Operational Research 36 (1) (1988), pp. 1–13. C. Eden, Analyzing cognitive maps to help structure issues or problems, European Journal of Operational Research 159 (3) (2004), pp. 673–686. J.M. Bryson et al., Visible thinking: unlocking causal mapping for practical business results, Wiley, Chichester (2004). V. Belton and T.J. Stewart, Multiple criteria decision analysis: an integrated approach, Kluwer, Dordrecht (2002). C.A. Bana e Costa et al., Facilitating bid evaluation in public calls for tenders: a socio-technical approach, Omega 30 (3) (2002), pp. 227–242. V. Belton, F. Ackermann and I. Shepherd, Integrated support from problem structuring through to alternative evaluation using COPE and VISA, Journal of Multi-Criteria Decision Analysis 6 (3) (1997), pp. 115–130. C.A. Bana e Costa et al., Decision support systems in action: integrated application in a multi-criteria aid process, European Journal of Operational Research 113 (2) (1999), pp. 315–335. A. Barcus and G. Montibeller, Supporting the allocation of software development work in distributed teams with multi-criteria decision analysis, Omega 36 (3) (2008), pp. 464–475. SEU, Bridging the gap: new opportunities for 16–18 year olds not in employment, education or training, The Stationary Office, London (1999). C. Eden and C. Huxham, Action research for the study of organizations. In: S. Clegg and C. Hardy, Editors, Studying organization: theory and method, Sage, London (1999), pp. 272–288. P. Checkland and S. Holwell, Action research: its nature and validity, Systemic Practice and Action Research 11 (1) (1998), pp. 9–21. S. Kaner, Facilitator's Guide to Participatory Decision Making, Jossey-Bass, San Francisco, CA (2007). J.E. Russo and P.J.H. Schoemaker, Decision traps: the ten barriers to brilliant decision-making and how to overcome them, Simon and Schuster, New York (1989). M. Jackson and P. Keys, Towards a system of systems methodologies, Journal of the Operational Research Society 35 (6) (1984), pp. 473–486. R.L. Flood and M. Jackson, Creative problem solving: total systems intervention, Wiley, Chichester (1991). G. Midgley, Mixing methods: developing systemic intervention. In: J. Mingers and A. Gill, Editors, Multimethodology: the theory and practice of combining management science methodologies, Wiley, Chichester (1997), pp. 249–290. S. Cropper, Variety, formality, and style: choosing amongst decision-support methods. In: C. Eden and J. Radford, Editors, Tackling strategic problems: the role of group decision support, Sage, London (1990), pp. 92–98. P.G. Bennett, On linking approaches to decision-aiding: issues and prospects, Journal of Operational Research Society 36 (8) (1985), pp. 659–669. L. White and A. Tacket, Critiquing multimethodology as metamethodology: working towards pragmatic pluralism. In: J. Mingers and A. Gill, Editors, Multimethodology: the theory and practice of combining management science methodologies, Wiley, Chichester (1997), pp. 379–405. R. Ormerod, The transformation competence perspective, Journal of the Operational Research Society 59 (11) (2008), pp. 1435–1448. P.G. Bennett et al., Analysing litigation and negotiation: using a combined methodology. In: J. Mingers and A. Gill, Editors, Multimethodology: the theory and practice of combining methodologies, Wiley, Chichester (1997), pp. 59–88. J. Mingers, A classification of the philosophical assumptions of management science methods, Journal of the Operational Research Society 54 (6) (2003), pp. 559–570. J. Mingers, Variety is the spice of life: combining soft and hard OR/MS methods, International Transactions in Operational Research 7 (6) (2000), pp. 673–691. L.A. Franco and G. Montibeller, Facilitated modelling in operational research (invited review), European Journal of Operational Research 205 (3) (2010), pp. 489–500. L. Phillips, A theory of requisite decision models, Acta Psychologica 56 (1–3) (1984), pp. 29–48. J. Brocklesby, Becoming multimethodology literature: an assessment of the cognitive difficulties of working across paradigms, Multimethodology: the theory and practice of combining management science methodologies, Wiley, Chichester (1997) p. 189–216. M. Pidd, Bringing it all together. In: M. Pidd, Editor, Systems modelling: theory and practice, John Wiley and Sons, Chichester (2004), pp. 197–207. K. Kotiadis and J. Mingers, Combining PSMs with hard OR methods: the philosophical and practical challenges, Journal of the Operational Research Society 57 (7) (2006), pp. 856–867. M. Jackson, Systems approaches to management, Kluwer, New York (2000). M.C. Jackson, Beyond problem structuring methods: reinventing the future of OR/MS, Journal of the Operational Research Society 57 (7) (2006), pp. 868–878. N. Connell, Evaluating Soft OR: some reflections on an apparently unsuccessful implementation using a Soft Systems Methodology (SSM) based approach, Journal of Operational Research Society 52 (1) (2001), pp. 150–160. P. Keys, On becoming expert in the use of problem structuring methods, Journal of the Operational Research Society 57 (7) (2006), pp. 822–829. J. Pollack, Multimethodology in series and parallel: strategic planning using hard and soft OR, Journal of the Operational Research Society 60 (2) (2009), pp. 156–167. L. Phillips and C.A. Bana e Costa, Transparent prioritisation, budgeting, and resource allocation with multi-criteria decision analysis and decision conferencing, Annals of Operations Research 154 (1) (2007), pp. 51–68. R.L. Keeney, Value-focused thinking: a path to creative decision-making, Harvard University Press, Cambridge, MA (1992). R.L. Keeney, Developing objectives and attributes. In: W. Edwards, R.F. Miles and D. von Winterfeldt, Editors, Advances in decision analysis, Cambridge University Press, Cambridge (2007), pp. 104–128. M. Poyhonen, H. Vrolijk and R.P. Hamalainen, Behavioral and procedural consequences of structural variation in value trees, European Journal of Operational Research 134 (1) (2001), pp. 216–227. M. Weber, F. Eisenführ and D. von Winterfeldt, The effects of splitting attributes on weights in multi-attribute utility measurement, Management Science 34 (4) (1988), pp. 431–445. G. Montibeller and V. Belton, Causal maps and the evaluation of decision options: a review, Journal of the Operational Research Society 57 (7) (2006), pp. 779–791. A. De Geus, Planning as learning, Harvard Business Review 66 (2) (1988), pp. 70–74. C. Eden, A framework for thinking about group decision support systems, Group Decision and Negotiation 1 (1992), pp. 199–218. A. Strauss and J. Corbin, Basics of qualitative research: techniques and procedures for developing grounded theory, Sage, London (1998). L. White, Evaluating problem structuring methods: developing an approach to show the value and effectiveness of PSM interventions, Journal of the Operational Research Society 57 (7) (2006), pp. 842–855. L.A. Franco, Facilitating collaboration with problem structuring methods: a case of an inter-organisational construction partnership, Group Decision and Negotiation 17 (4) (2008), pp. 267–286. D. Shaw, Evaluating electronic workshops through analysing the ‘brainstormed’ ideas, Journal of the Operational Research Society 54 (7) (2003), pp. 692–705. B. Turner, The use of grounded theory for the qualitative analysis of organizational behaviour, Journal of Management Studies 20 (3) (1983), pp. 333–348. C. Eden, F. Ackermann and S. Cropper, The analysis of cause maps, The Journal of Management Studies 29 (3) (1992), pp. 309–324. E.A.J.A. Rouwette, J.A.M. Vennix and A.J.A. Felling, On evaluating the performance of problem structuring methods: an attempt at formulating a conceptual model, Group Decision and Negotiation 18 (6) (2009), pp. 567–587. L.A. Franco, Forms of conversation and problem structuring methods: a conceptual development, Journal of the Operational Research Society 57 (7) (2006), pp. 813–821. L. White and H. Bourne, Voices and values: linking values with participation in OR/MS in public policy making, OMEGA: The International Journal of Management Science 35 (5) (2006), pp. 588–603. L.A. Franco, Problem structuring methods as intervention tools: reflections from their use with multi-organizational teams, Omega 37 (1) (2009), pp. 193–203. R.L. Keeney and H. Raiffa, Decisions with multiple objectives: preferences and value trade-offs (2nd ed), Cambridge University Press, Cambridge, MA (1993). P. Checkland and J. Scholes, Soft systems methodology in action, Wiley, Chichester (1990). W. Ulrich, Critical heuristics of social planning, John Wiley & Sons, Chichester (1994). L.A. Franco, Assessing the impact of problem structuring methods in multi-organisational settings: an empirical investigation, Journal of the Operational Research Society 58 (6) (2007), pp. 760–768. E.A.J.A. Rouwette, J.A.M. Vennix and T. van Mullekom, Group model building effectiveness: a review of assessment studies, System Dynamics Review 18 (1) (2002), pp. 5–45. P. Goodwin and G. Wright, Decision analysis for management judgment (3rd ed), Wiley, Chichester (2004). C. Eden and F. Ackermann, Strategy making: the journey of strategic management, Sage, London (1998). In: J. Rosenhead and J. Mingers, Editors, Rational analysis for a problematic world revisited: problem structuring methods for complexity, uncertainty and conflict, Wiley, Chichester (2001). A. Langley, In search of rationality: the purposes behind the use of formal analysis in organizations, Administrative Science Quarterly 34 (4) (1989), pp. 598–631. A. Langley, Formal analysis and strategic decision making, OMEGA: The International Journal of Management Science 2 (3) (1991), pp. 79–99. N. Brunsson, The irrationality of action and action rationality: decisions, ideologies and organizational actions, Journal of Management Studies 19 (1) (1982), pp. 29–44. P. Keys, Creativity, design and style in MS/OR, OMEGA: The International Journal of Management Science 28 (3) (2000), pp. 303–312. S. Cropper, The complexity of decision support practice. In: C. Eden and J. Radford, Editors, Tackling strategic problems: the role of group decision support, Sage, London (1990), pp. 29–39. J.-L. Denis, A. Langley and L. Rouleau, The power of numbers in strategizing, Strategic Organization 4 (4) (2006), pp. 349–377.
URI:	http://wrap.warwick.ac.uk/id/eprint/4836

Data sourced from Thomson Reuters' Web of Knowledge

Request changes to a record

Actions (login required)

View Item