Academia.eduAcademia.edu

Outline

A multicriteria decision analysis model for faculty evaluation

2012

https://doi.org/10.1016/J.OMEGA.2011.08.006

Abstract

In the context of increasing demands for social and financial accountability of universities, the required implementation of transparent faculty evaluation systems constitutes a challenge and an opportunity for universities strategically aligning the activity of academic staff with the university goals. However, despite growing interest in the performance appraisal of faculty, only a few reported studies propose models that cover the

References (54)

  1. Etzkowitz H. Research groups as 'quasi-firms': the invention of the entrepre- neurial university. Research Policy 2003;32:109-21.
  2. Coccia M. Measuring scientific performance of public research units for strategic change. Journal of Informetrics 2008:183-94.
  3. Huber MT. Faculty evaluation and the development of academic careers. New Directions for Institutional Research 2002;114:73-83.
  4. Murias P, Miguel JCd, Rodrı ´guez D. A composite indicator for university quality assesment: the case of Spanish higher education system. Social Indicators Research 2008;89:29-146.
  5. Agencia Nacional de Evaluacio ´n de la Calidad y Acreditacio ´n. Programa de Evaluacio ´n de Professorado para la Contratacio ´n: Principios y Orientaciones para la Aplicacio ´n de los Criterios de Evaluacio ´n. Agencia Nacional de Evaluacio ´n de la Calidad y Acreditacio ´n; 2007.
  6. Ministe ´rio da Ciência Tecnologia e Ensino Superior. Decreto-Lei no. 205/2009. Dia ´rio da Repu ´blica. 2009;1.% a se ´rie.
  7. Elmore HW. Toward objectivity in faculty evaluation. Academe 2008;94: 38-40.
  8. Lane J. Let's make science metrics more scientific. Nature 2010;464:488-9.
  9. von Winterfeldt D, Edwards W. Decision analysis and behavioral research. Cambridge University Press; 1986.
  10. Kirkwood CW. Strategic decision making: multiobjective decision analysis with spreadsheets. Belmont, California: Duxbury Press; 1997.
  11. Arreola RA. Developing a comprehensive faculty evaluation system: a guide to designing, building, and operating large-scale faculty evaluation sys- tems, 3rd ed. Anker Publishing Company; 2007.
  12. National Academy of Engineering. Developing metrics for assessing engi- neering instruction: what gets measured is what gets improved: report from the steering committee for evaluating instructional scholarship in engineer- ing. The National Academies Press; 2009. p. 52.
  13. Mills M, Hyle AE. Faculty evaluation: a prickly pair. Higher Education. 1999;38:351-71.
  14. Adler NJ, Harzing AW. When knowledge wins: transcending the sense and nonsense of academic rankings. Academy of Management Learning and Education 2009;8:72-95.
  15. Grant J, Fogarty T. Faculty evaluation as a social dilemma: a game theoretic approach. Accounting Education 1998;7:225-48.
  16. Kao C, Pao H-L. An evaluation of research performance in management of 168 Taiwan universities. Scientometrics 2009;78:261-77.
  17. Turban E, Zhou D, Ma J. A group decision support approach to evaluating journals. Information & Management 2004;42:31-44.
  18. Campion WJ, Mason DV, Erdman H. How faculty evaluations are used in Texas Community Colleges. Community College Journal of Research and Practice 2000;24:169-79.
  19. Desselle SP, Mattei TJ, Vanderveen RP. Identifying and weighting teaching and scholarship activities among faculty members. American Journal of Pharmaceutical Education 2004;68:1-11.
  20. Donovan C. The qualitative future of research evaluation. Science and Public Policy 2007;34:555-63.
  21. Wolansky WD. A multiple approach to faculty evaluation. Education 2001; 97:81-96.
  22. Politis Y, Siskos Y. Multicriteria methodology for the evaluation of a Greek engineering department. European Journal of Operational Research 2004; 156:223-40.
  23. Gime ´nez VM, Martı ´nez JL. Cost efficiency in the university: a departmental evaluation model. Economics of Education Review 2006;25:543-53.
  24. Uzoka F-ME. A fuzzy-enhanced multicriteria decision analysis model for evaluating university academics' research output. Information Knowledge Systems Management 2008;7:273-99.
  25. Mustafa A, Goh M. Multi-criterion models for higher education administra- tion. OMEGA-The International Journal of Management Science 1996;24: 167-78.
  26. Keeney RL, See KE, von Winterfeldt D. Evaluating academic programs: with applications to U.S. graduate decision science programs. Operations Research 2006;54:813-28.
  27. Edwards W, Barron FH. SMARTS and SMARTER: improved simple methods for multiattribute utility measurement. Organizational Behavior and Human Decision Processes 1994;60:306-25.
  28. Keeney RL, Value-Focused Thinking A. Path to creative decisionmaking. Harvard University Press; 1992.
  29. Billaut J-C, Bouyssou D, Vincke P. Should you believe in the Shanghai ranking? An MCDM view Scientometrics 2010;84:237-63.
  30. Phillips L. Decision conferencing. In: Edwards W, Miles RF, von Winterfeldt D, editors. Advances in decision analysis: from foundations to applications. Cambridge University Press; 2007. p. 375-99.
  31. Phillips L. Decision conferencing/facilitated workshops. In: Melnick EL, Ever- itt BS, editors. Encyclopedia of quantitative risk analysis and assessment. Wiley; 2008. p. 451-9.
  32. Schein EH. Process consultation revisited: building the helping relationship. MA: Addison Wesley Longman; 1998.
  33. Bana e Costa CA, Ensslin L, Correa EC, Vansnick J-C. Decision support systems in action: integrated application in a multicriteria decision aid process. European Journal of Operational Research 1999;113:315-35.
  34. Phillips LD, Bana e Costa CA. Transparent prioritisation, budgeting and resource allocation with multi-criteria decision analysis and decision con- ferencing. Annals of Operations Research 2007;154:51-68.
  35. Phillips LD. A theory of requisite decision models. Acta Psychologica 1984;56: 29-48.
  36. Belton V, Stewart TJ. Multiple criteria decision analysis: an integrated approach. Springer; 2001.
  37. Bana e Costa CA, Vansnick J-C, De Corte J-M. MACBETH (measuring attrac- tiveness by a categorical based evaluation technique). In: Cochran JJ, editor. Wiley encyclopedia in operational research and management science. New York: Wiley; 2011. p. 2945-50.
  38. Bana e Costa CA, De Corte J-M, Vansnick J-C. On the mathematical founda- tions of MACBETH. In: Figueira J, Greco S, Ehrgott M, editors. Multiple criteria decision analysis: the state of the art surveys. Springer; 2005. p. 409-42.
  39. Bana e Costa CA, Lourenc -o JC, Chagas MP, Bana e Costa JC. Development of reusable bid evaluation models for the Portuguese Electric Transmission Company. Decision Analysis 2008;5:22-42.
  40. Bana e Costa CA, De Corte J-M, Vansnick J-C. MACBETH. In: Department OR, editor. Working paper LSEOR 0356. London: London School of Economics of Political Science; 2003.
  41. Keeney RL, Raiffa H. Decisions with multiple objectives: preferences and value tradeoffs New York. Wiley; 1976.
  42. Universidade Te ´cnica de Lisboa. Regulamento de Avaliac -ão de Desempenho dos Docentes do Instituto Superior Te ´cnico, 51. Dia ´rio da Repu ´blica; 2010.
  43. O ¨zt ürk M, Tsouki as A, Vincke P. Preference modelling. In: Figueira J, Greco S, Ehrgott M, editors. Multiple criteria decision analysis: state of the art surveys; 2005. p. 27-72.
  44. Bana e Costa CA, Oliveira RC. Assigning priorities for maintenance, repair and refurbishment in managing a municipal housing stock. European Journal of Operational Research 2002;138:380-91.
  45. Keeney RL. Developing objectives and attributes. In: Edwards W, Miles Jr. RF, von Winterfeldt D, editors. Advances in decision analysis: from foundations to applications. Cambridge: Cambridge University Press; 2007. p. 104-28.
  46. Meredith JR, Steward MD, Lewis BR. Knowledge dissemination in operations management: published perceptions versus academic reality. OMEGA-The International Journal of Management Science 2011;39:435-46.
  47. Althouse BM, West JD, Bergstrom CT, Bergstrom T. Differences in impact factor across fields and over time. Journal of the American Society for Information Science and Technology 2009;60:27-34.
  48. Bana e Costa CA, Corrêa EC, De Corte J-M, Vansnick J-C. Facilitating bid evaluation in public call for tenders: a socio-technical approach. OMEGA- The International Journal of Management Science 2002;30:227-42.
  49. Drucker P. Management by results. Collins 1993.
  50. Salminen P, Korhonen P, Wallenius J. Testing the form of a decision-maker's multiattribute value function based on pairwise preference information. Journal of the Operational Research Society 1989;40:299-302.
  51. Meho LI, Sonnenwald DH. Citation ranking versus peer evaluation of senior faculty research performance: a case study of Kurdish scholarship. Journal of the American Society for Information Science 2000;51:123-38.
  52. Donohue JM, Fox JB. A multi-method evaluation of journals in the decision and management sciences by US academics. OMEGA-The International Journal of Management Science 2000;28:17-36.
  53. Belton V. Multi-criteria problem structuring and analysis in a value theory framework. In: Gal T, Stewart TJ, Hanne T, editors. Multicriteria decision making: advances in MCDM models, algorithms, theory and applications. Springer; 1999. p. 12.1-12.32.
  54. Buede DM. Applied decision analysis: engineering science vs. clinical art. In: Proceedings of the international conference on cybernetics and society. Denver; 1979. p. 397-403.