SUNNY WAYS OR SOMBER WEATHER? INTERNATIONAL MANAGEMENT CONSULTANTS AND APPRAISAL OF POLICY CAPACITY
DOI:
https://doi.org/10.20319/pijss.2017.32.833855Keywords:
Management, Consultants, Judgement, Halo EffectAbstract
Nearly three hundred judgments of policy capacity within one of three Ministries of Education in a South Pacific country are closely scrutinized for their accuracy. A clearly discernable and measurable halo, or its horned converse, a less positive interpretation, was apparent when internal and external raters used a modified United Nations Development Programme scale during interviews. The scale was augmented with criteria recognizing some desirable traits for civil servants. Those criteria centered on recognizing the warranting nature of various types of evidence, professional knowledge of education policy/processes, and persuasive ability of the person. North American research in cognitive science, organizational behaviour, social psychology and pragmatic-legal theories of evidence offer four explanations. The latter two theories appear to best explain overly positive or negative views of an organization’s capacity. Implications are drawn for management consultants and researchers alike when working on international development projects.
References
Anderson, L. W., Krathwohl, D. R., & Bloom, B. S. (2001). A taxonomy for learning, teaching, and assessing: A revision of Bloom's taxonomy of educational objectives. Boston, MA: Allyn & Bacon.
Ball, S. J. (2009). Privatising education, privatising education policy, privatising educational research: Network governance and the ‘competition state’. Journal of Education Policy, 24(1), 83-99.
Barnes, E. (1995). Inference to the loveliest explanation. Synthese, 103(2), 251-277.
Beckwith, N. E., & Lehmann, D. R. (1975). The importance of halo effects in multi-attribute attitude models. Journal of Marketing Research, 265-275.
Bol, J. C. (2011). The determinants and performance effects of managers' performance evaluation biases. The Accounting Review, 86(5), 1549-1575.
Bol, J. C., & Smith, S. D. (2011). Spillover effects in subjective performance evaluation: Bias and the asymmetric influence of controllability. The Accounting Review, 86(4), 1213-1230.
Breuer, K., Nieken, P., & Sliwka, D. (2013). Social ties and subjective performance evaluations: an empirical investigation. Review of managerial Science, 7(2), 141-157.
Congo-Poottaren, N. (2017). The influence of impression management of school leaders on followers: A case study in a secondary school in Mauritius, PEOPLE: International Journal of Social Sciences, Special Issue, 3 (1), 741- 760. https://dx.doi.org/10.20319/pijss.2017.s31.741760
Conley, J. M., O'Barr, W. M., & Lind, E. A. (1979). The power of language: Presentational style in the courtroom. Duke Law Journal, 1978(6), 1375-1399.
Czarniawska-Joerges, B. (1990). Merchants of meaning: Management consulting in the Swedish public sector. In B.A. Turner (Ed.), Organizational symbolism (pp. 139-150). Berlin: Walter de Gruyter.
Dean, D. & Guild, D. (2016). Pacific benchmarking for education results: A mid-term review. Canberra, AU: Department of Foreign Affairs and Trade. Retrieved from: http://dfat.gov.au/about-us/Pages/about-us.aspx
Forgas, J. P. (2011). She just doesn't look like a philosopher…? Affective influences on the halo effect in impression formation. European Journal of Social Psychology, 41(7), 812-817.
Feeley, T. H. (2002). Comment on halo effects in rating and evaluation research. Human Communication Research, 28(4), 578-586.
Freidson, E. (2001). Professionalism, the third logic: On the practice of knowledge. Chicago: University of Chicago Press.
Goode, S., & Wellborn, O. G. (2007). Courtroom Evidence Handbook. St. Paul, MN: West Publishing Company.
Grund, C., & Przemeck, J. (2012). Subjective performance appraisal and inequality aversion. Applied Economics, 44(17), 2149-2155.
Halstead, D., Morash, E. A., & Ozment, J. (1996). Comparing objective service failures and subjective complaints: An investigation of domino and halo effects. Journal of Business Research, 36(2), 107-115.
Head, B. W. (2008). Three lenses of evidence‐based policy. Australian Journal of Public Administration, 67(1), 1-11.
Honig, M. I., & Coburn, C. (2008). Evidence-based decision making in school district central offices: Toward a policy and research agenda. Educational Policy, 22(4), 578-608.
Isaac, R. G., Zerbe, W. J., & Pitt, D. C. (2001). Leadership and motivation: The effective application of expectancy theory. Journal of Managerial Issues, 212-226.
Kassin, S. M., Dror, I. E., & Kukucka, J. (2013). The forensic confirmation bias: Problems, perspectives, and proposed solutions. Journal of Applied Research in Memory and Cognition, 2(1), 42-52.Lapsley, I., & Oldfield, R. (2001). Transforming the public sector: Management consultants as agents of change. European Accounting Review, 10(3), 523- 543.
Laudan, L. (2007). Strange bedfellows: Inference to the best explanation and the criminal standard of proof. International Journal of Evidence and Proof, 11(4), 292-306.
Lipton, P. (2003). Inference to the best explanation. London, UK: Routledge.
Marston, G., & Watts, R. (2003). Tampering with the evidence: A critical appraisal of evidence- based policy-making. The Drawing Board: An Australian Review of Public Affairs, 3(3), 143-163.
Maas, V. S., & Torres-González, R. (2011). Subjective performance evaluation and gender discrimination. Journal of Business Ethics, 101(4), 667-681.
McKenna, C. D. (1995). The origins of modern management consulting. Business and Economic History, 24(1), 51-58.
Nickerson, R. S. (1998). Confirmation bias: A ubiquitous phenomenon in many guises. Review of General Psychology, 2(2), 175-230.
Nutley, S. M., Davies, H. T., & Smith, P. C. (2000). What works?: Evidence-based policy and practice in public services. Boston, MA: MIT Press.
Parsons, W. (2002). From muddling through to muddling up-evidence based policy making and the modernisation of British Government. Public Policy and Administration, 17(3), 43-60.
Peirce, C. S. (1932–1958). Collected papers of Charles Sanders Peirce, Vols. 1–8. In P. Weiss,
C. Hartshorne, & A. W. Burk (Eds.). Cambridge, MA: Harvard University Press.
Ramos, W. (2017). Effects of result-based capability building program on the research competency, quality and productivity of public high school teachers. PEOPLE: International Journal of Social Sciences, Special Issue, 3(1), 109- 119. https://dx.doi.org/10.20319/pijss.2017.31.109119
Rosenzweig, P. (2007). Misunderstanding the nature of company performance: The halo effect and other business delusions. California Management Review, 49(4), 6-20.
Saint-Martin, D. (2004). Building the new managerialist state: Consultants and the politics of public sector reform in comparative perspective. Oxford UK: Oxford University Press.
Sanderson, I. (2002). Evaluation, policy learning and evidence‐based policy making. Public Administration, 80(1), 1-22.
Schmidt, F. L. (1973). Implications of a measurement problem for expectancy theory research.
Organizational Behavior and Human Performance, 10(2), 243-251.
Singh, P.K. & Kumar, M. (2017). A study on infrastructure and organizational learning: Rethinking knowledge performance perspective. PEOPLE: International Journal of Social Sciences, 3(2), 61-77. http://dx.doi.org/10.20319/pijss.2017.32.6177
Thomas, K. W., & Kilmann, R. H. (1975). The social desirability variable in organizational research: An alternative explanation for reported findings. Academy of Management Journal, 18(4), 741-752.
Tractinsky, N., Katz, A. S., & Ikar, D. (2000). What is beautiful is usable. Interacting with computers, 13(2), 127-145.
United Nations Development Programme. (2006). UNDP and capacity development. [PowerPoint]. Tbilisi, Georgia: Author. Retrieved from
www.jposc.org/documents/workshop_georgia_UNDP_and_CD.ppt
United Nations Development Programme. (2008a). Capacity assessment methodology user’s guide. New York, NY: Capacity Development Group. Bureau for Development Policy. Retrieved from http://www.undp.org/content/dam/aplaws/publication/en/publications/capacity-development/undp-capacity-assessment-methodology/UNDP%20Capacity%20Assessment%20Users%20Guide.pdf
United Nations Development Programme. (2008b). Capacity development practice note. New York, NY: Author. Retrieved from: http://www.unpcdc.org/media/8651/pn_capacity_development.pdf
United Nations Development Programme. (2010). Measuring capacity. New York, NY: Author. Retrieved from http://www.undp.org/content/dam/aplaws/publication/en/publications/capacity-development/undp-paper-on-measuring-capacity/UNDP_Measuring_Capacity_July_2010.pdf
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2017 Authors
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
