R&D Project Performance Evaluation With Multiple and Interdependent Criteria

Tohumcu Z., KARASAKAL E.

IEEE TRANSACTIONS ON ENGINEERING MANAGEMENT, vol.57, no.4, pp.620-633, 2010 (SCI-Expanded) identifier identifier identifier

  • Publication Type: Article / Article
  • Volume: 57 Issue: 4
  • Publication Date: 2010
  • Doi Number: 10.1109/tem.2009.2036159
  • Journal Indexes: Science Citation Index Expanded (SCI-EXPANDED), Social Sciences Citation Index (SSCI), Scopus
  • Page Numbers: pp.620-633
  • Keywords: Analytic network process (ANP), data envelopment analysis (DEA), group decision making, multiple criteria decision making, R&D project performance evaluation, DATA ENVELOPMENT ANALYSIS, INTERVAL COMPARISON MATRICES, GOAL PROGRAMMING METHOD, ANALYTIC NETWORK PROCESS, GENERATING WEIGHTS, DECISION-MAKING, FRAMEWORK, DEA, PRIORITIES, UNITS
  • Middle East Technical University Affiliated: Yes


In this study, we develop an approach based on analytic network process (ANP) and data envelopment analysis (DEA) to evaluate the performance of Research and Development projects. We identify a set of criteria and subcriteria having interdependencies among themselves. Interdependency is treated using a hybrid ANP model consisting of both hierarchy and network. The interval pairwise comparison matrices are constructed in a group decision-making process. ANP is extended to obtain interval weights from the interval pairwise comparison matrices. Interval weights are formulated as assurance region constraints in a super-efficiency DEA model, through which the project ranking is obtained. The super-efficiency DEA model is also modified to handle missing data. The approach is applied to a real case study on performance evaluation of the ongoing projects in a Defense Research and Development Institute.