Journal of Applied Mathematics

  • J. Appl. Math.
  • Volume 2013, Special Issue (2013), Article ID 492421, 20 pages.

A Review of Ranking Models in Data Envelopment Analysis

F. Hosseinzadeh Lotfi, G. R. Jahanshahloo, M. Khodabakhshi, M. Rostamy-Malkhlifeh, Z. Moghaddas, and M. Vaez-Ghasemi

Full-text: Open access

Abstract

In the course of improving various abilities of data envelopment analysis (DEA) models, many investigations have been carried out for ranking decision-making units (DMUs). This is an important issue both in theory and practice. There exist a variety of papers which apply different ranking methods to a real data set. Here the ranking methods are divided into seven groups. As each of the existing methods can be viewed from different aspects, it is possible that somewhat these groups have an overlapping with the others. The first group conducts the evaluation by a cross-efficiency matrix where the units are self- and peer-evaluated. In the second one, the ranking units are based on the optimal weights obtained from multiplier model of DEA technique. In the third group, super-efficiency methods are dealt with which are based on the idea of excluding the unit under evaluation and analyzing the changes of frontier. The fourth group involves methods based on benchmarking, which adopts the idea of being a useful target for the inefficient units. The fourth group uses the multivariate statistical techniques, usually applied after conducting the DEA classification. The fifth research area ranks inefficient units through proportional measures of inefficiency. The sixth approach involves multiple-criteria decision methodologies with the DEA technique. In the last group, some different methods of ranking units are mentioned.

Article information

Source
J. Appl. Math., Volume 2013, Special Issue (2013), Article ID 492421, 20 pages.

Dates
First available in Project Euclid: 14 March 2014

Permanent link to this document
https://projecteuclid.org/euclid.jam/1394807422

Digital Object Identifier
doi:10.1155/2013/492421

Mathematical Reviews number (MathSciNet)
MR3082047

Zentralblatt MATH identifier
1271.62031

Citation

Hosseinzadeh Lotfi, F.; Jahanshahloo, G. R.; Khodabakhshi, M.; Rostamy-Malkhlifeh, M.; Moghaddas, Z.; Vaez-Ghasemi, M. A Review of Ranking Models in Data Envelopment Analysis. J. Appl. Math. 2013, Special Issue (2013), Article ID 492421, 20 pages. doi:10.1155/2013/492421. https://projecteuclid.org/euclid.jam/1394807422


Export citation

References

  • M. J. Farrell, “The measurement of productive efficiency,” Journal of the Royal Statistical Society A, vol. 120, pp. 253–281, 1957.
  • A. Charnes, W. W. Cooper, and E. Rhodes, “Measuring the efficiency of decision making units,” European Journal of Operational Research, vol. 2, no. 6, pp. 429–444, 1978.
  • R. D. Banker, A. Charnes, and W. W. Cooper, “Some models for estimating technical and scale inefficiencies in data envelopment analysis,” Management Science, vol. 30, no. 9, pp. 1078–1092, 1984.
  • A. Charnes, W. W. Cooper, L. Seiford, and J. Stutz, “A multiplicative model for efficiency analysis,” Socio-Economic Planning Sciences, vol. 16, no. 5, pp. 223–224, 1982.
  • A. Charnes, C. T. Clark, W. W. Cooper, and B. Golany, “A developmental study of data envelopment analysis in measuring the efficiency of maintenance units in the U.S. air forces,” Annals of Operations Research, vol. 2, no. 1, pp. 95–112, 1984.
  • A. Charnes, W. W. Cooper, B. Golany, L. Seiford, and J. Stutz, “Foundations of data envelopment analysis for Pareto-Koopmans efficient empirical production functions,” Journal of Econometrics, vol. 30, no. 1-2, pp. 91–107, 1985.
  • R. M. Thrall, “Duality, classification and slacks in DEA,” Annals of Operations Research, vol. 66, pp. 109–138, 1996.
  • N. Adler and B. Golany, “Evaluation of deregulated airline networks using data envelopment analysis combined with principal component analysis with an application to Western Europe,” European Journal of Operational Research, vol. 132, no. 2, pp. 260–273, 2001.
  • F. W. Young and R. M. Hamer, Multidimensional Scaling, History, Theory and Applications, Lawrence Erlbaum, London, UK, 1987.
  • T. R. Sexton, R. H. Silkman, and A. J. Hogan, “Data envelopment analysis: critique and extensions,” in Measuring Efficiency: An Assessment of Data Envelopment Analysis, R. H. Silkman, Ed., pp. 73–105, Jossey-Bass, San Francisco, Calif, USA, 1986.
  • W. Rödder and E. Reucher, “A consensual peer-based DEA-model with optimized cross-efficiencies: input allocation instead of radial reduction,” European Journal of Operational Research, vol. 212, no. 1, pp. 148–154, 2011.
  • H. H. Örkcü and H. Bal, “Goal programming approaches for data envelopment analysis cross efficiency evaluation,” Applied Mathematics and Computation, vol. 218, no. 2, pp. 346–356, 2011.
  • J. Wu, J. Sun, L. Liang, and Y. Zha, “Determination of weights for ultimate cross efficiency using Shannon entropy,” Expert Systems with Applications, vol. 38, no. 5, pp. 5162–5165, 2011.
  • G. R. Jahanshahloo, F. H. Lotfi, Y. Jafari, and R. Maddahi, “Selecting symmetric weights as a secondary goal in DEA cross-efficiency evaluation,” Applied Mathematical Modelling, vol. 35, no. 1, pp. 544–549, 2011.
  • Y.-M. Wang, K.-S. Chin, and Y. Luo, “Cross-efficiency evaluation based on ideal and anti-ideal decision making units,” Expert Systems with Applications, vol. 38, no. 8, pp. 10312–10319, 2011.
  • N. Ramón, J. L. Ruiz, and I. Sirvent, “Reducing differences between profiles of weights: a “peer-restricted” cross-efficiency evaluation,” Omega, vol. 39, no. 6, pp. 634–641, 2011.
  • D. Guo and J. Wu, “A complete ranking of DMUs with undesirable outputs using restrictions in DEA models,” Mathematical and Computer Modelling, 2012.
  • I. Contreras, “Optimizing the rank position of the DMU as secondary goal in DEA cross-evaluation,” Applied Mathematical Modelling, vol. 36, no. 6, pp. 2642–2648, 2012.
  • J. Wu, J. Sun, and L. Liang, “Cross efficiency evaluation method based on weight-balanced data envelopment analysis model,” Computers and Industrial Engineering, vol. 63, pp. 513–519, 2012.
  • M. Zerafat Angiz, A. Mustafa, and M. J. Kamali, “Cross-ranking of decision making units in data envelopment analysis,” Applied Mathematical Modelling, vol. 37, no. 1-2, pp. 398–405, 2013.
  • S. Washio and S. Yamada, “Evaluation method based on ranking in data envelopment analysis,” Expert Systems with Applications, vol. 40, no. 1, pp. 257–262, 2013.
  • G. R. Jahanshahloo, A. Memariani, F. H. Lotfi, and H. Z. Rezai, “A note on some of DEA models and finding efficiency and complete ranking using common set of weights,” Applied Mathematics and Computation, vol. 166, no. 2, pp. 265–281, 2005.
  • Y.-M. Wang, Y. Luo, and Z. Hua, “Aggregating preference rankings using OWA operator weights,” Information Sciences, vol. 177, no. 16, pp. 3356–3363, 2007.
  • M. R. Alirezaee and M. Afsharian, “A complete ranking of DMUs using restrictions in DEA models,” Applied Mathematics and Computation, vol. 189, no. 2, pp. 1550–1559, 2007.
  • F.-H. F. Liu and H. Hsuan Peng, “Ranking of units on the DEA frontier with common weights,” Computers and Operations Research, vol. 35, no. 5, pp. 1624–1637, 2008.
  • Y.-M. Wang, Y. Luo, and L. Liang, “Ranking decision making units by imposing a minimum weight restriction in the data envelopment analysis,” Journal of Computational and Applied Mathematics, vol. 223, no. 1, pp. 469–484, 2009.
  • S. M. Hatefi and S. A. Torabi, “A common weight MCDA-DEA approach to construct composite indicators,” Ecological Economics, vol. 70, no. 1, pp. 114–120, 2010.
  • F. Hosseinzadeh Lotfi, A. A. Noora, G. R. Jahanshahloo, and M. Reshadi, “One DEA ranking method based on applying aggregate units,” Expert Systems with Applications, vol. 38, no. 10, pp. 13468–13471, 2011.
  • Y.-M. Wang, Y. Luo, and Y.-X. Lan, “Common weights for fully ranking decision making units by regression analysis,” Expert Systems with Applications, vol. 38, no. 8, pp. 9122–9128, 2011.
  • N. Ramón, J. L. Ruiz, and I. Sirvent, “Common sets of weights as summaries of DEA profiles of weights: with an application to the ranking of professional tennis players,” Expert Systems with Applications, vol. 39, no. 5, pp. 4882–4889, 2012.
  • P. Andersen and N. C. Petersen, “A procedure for ranking efficient units in data envelopment analysis,” Management Science, vol. 39, no. 10, pp. 1261–1294, 1993.
  • S. Mehrabian, M. R. Alirezaee, and G. R. Jahanshahloo, “A complete efficiency ranking of decision making units in data envelopment analysis,” Computational Optimization and Applications, vol. 14, no. 2, pp. 261–266, 1999.
  • K. Tone, “A slacks-based measure of super-efficiency in data envelopment analysis,” European Journal of Operational Research, vol. 143, no. 1, pp. 32–41, 2002.
  • G. R. Jahanshahloo, M. Sanei, and N. Shoja, “Modified ranking models, using the concept of advantage in data envelopment analysis,” Working paper, 2004.
  • G. R. Jahanshahloo, F. Hosseinzadeh Lotfi, N. Shoja, G. Tohidi, and S. Razavyan, “Ranking using ${l}_{1}$-norm in data envelopment analysis,” Applied Mathematics and Computation, vol. 153, no. 1, pp. 215–224, 2004.
  • Y. Chen and H. D. Sherman, “The benefits of non-radial vs. radial super-efficiency DEA: an application to burden-sharing amongst NATO member nations,” Socio-Economic Planning Sciences, vol. 38, no. 4, pp. 307–320, 2004.
  • A. Amirteimoori, G. Jahanshahloo, and S. Kordrostami, “Ranking of decision making units in data envelopment analysis: a distance-based approach,” Applied Mathematics and Computation, vol. 171, no. 1, pp. 122–135, 2005.
  • G. R. Jahanshahloo, L. Pourkarimi, and M. Zarepisheh, “Modified MAJ model for ranking decision making units in data envelopment analysis,” Applied Mathematics and Computation, vol. 174, no. 2, pp. 1054–1059, 2006.
  • S. Li, G. R. Jahanshahloo, and M. Khodabakhshi, “A super-efficiency model for ranking efficient units in data envelopment analysis,” Applied Mathematics and Computation, vol. 184, no. 2, pp. 638–648, 2007.
  • S. J. Sadjadi, H. Omrani, S. Abdollahzadeh, M. Alinaghian, and H. Mohammadi, “A robust super-efficiency data envelopment analysis model for ranking of provincial gas companies in Iran,” Expert Systems with Applications, vol. 38, no. 9, pp. 10875–10881, 2011.
  • A. Gholam Abri, G. R. Jahanshahloo, F. Hosseinzadeh Lotfi, N. Shoja, and M. Fallah Jelodar, “A new method for ranking non-extreme efficient units in data envelopment analysis,” Optimization Letters, vol. 7, no. 2, pp. 309–324, 2011.
  • G. R. Jahanshahloo, M. Khodabakhshi, F. Hosseinzadeh Lotfi, and M. R. Moazami Goudarzi, “A cross-efficiency model based on super-efficiency for ranking units through the TOPSIS approach and its extension to the interval case,” Mathematical and Computer Modelling, vol. 53, no. 9-10, pp. 1946–1955, 2011.
  • A. A. Noura, F. Hosseinzadeh Lotfi, G. R. Jahanshahloo, and S. Fanati Rashidi, “Super-efficiency in DEA by effectiveness of each unit in society,” Applied Mathematics Letters, vol. 24, no. 5, pp. 623–626, 2011.
  • A. Ashrafi, A. B. Jaafar, L. S. Lee, and M. R. A. Bakar, “An enhanced russell measure of super-efficiency for ranking efficient units in data envelopment analysis,” The American Journal of Applied Sciences, vol. 8, no. 1, pp. 92–96, 2011.
  • J.-X. Chen, M. Deng, and S. Gingras, “A modified super-efficiency measure based on simultaneous input-output projection in data envelopment analysis,” Computers & Operations Research, vol. 38, no. 2, pp. 496–504, 2011.
  • F. Rezai Balf, H. Zhiani Rezai, G. R. Jahanshahloo, and F. Hosseinzadeh Lotfi, “Ranking efficient DMUs using the Tchebycheff norm,” Applied Mathematical Modelling, vol. 36, no. 1, pp. 46–56, 2012.
  • Y. Chen, J. Du, and J. Huo, “Super-efficiency based on a modified directional distance function,” Omega, vol. 41, no. 3, pp. 621–625, 2013.
  • A. M. Torgersen, F. R. Foørsund, and S. A. C. Kittelsen, “Slack-adjusted efficiency measures and ranking of efficient units,” Journal of Productivity Analysis, vol. 7, no. 4, pp. 379–398, 1996.
  • T. Sueyoshi, “DEA non-parametric ranking test and index measurement: slack-adjusted DEA and an application to Japanese agriculture cooperatives,” Omega, vol. 27, no. 3, pp. 315–326, 1999.
  • G. R. Jahanshahloo, H. V. Junior, F. H. Lotfi, and D. Akbarian, “A new DEA ranking system based on changing the reference set,” European Journal of Operational Research, vol. 181, no. 1, pp. 331–337, 2007.
  • W.-M. Lu and S.-F. Lo, “An interactive benchmark model ranking performers: application to financial holding companies,” Mathematical and Computer Modelling, vol. 49, no. 1-2, pp. 172–179, 2009.
  • J.-X. Chen and M. Deng, “A cross-dependence based ranking system for efficient and inefficient units in DEA,” Expert Systems with Applications, vol. 38, no. 8, pp. 9648–9655, 2011.
  • L. Friedman and Z. Sinuany-Stern, “Scaling units via the canonical correlation analysis in the DEA context,” European Journal of Operational Research, vol. 100, no. 3, pp. 629–637, 1997.
  • E. D. Mecit and I. Alp, “A new proposed model of restricted data envelopment analysis by correlation coefficients,” Applied Mathematical Modeling, vol. 3, no. 5, pp. 3407–3425, 2013.
  • T. Joro, P. Korhonen, and J. Wallenius, “Structural comparison of data envelopment analysis and multiple objective linear programming,” Management Science, vol. 44, no. 7, pp. 962–970, 1998.
  • X.-B. Li and G. R. Reeves, “Multiple criteria approach to data envelopment analysis,” European Journal of Operational Research, vol. 115, no. 3, pp. 507–517, 1999.
  • V. Belton and T. J. Stewart, “DEA and MCDA: Competing or complementary approaches?” in Advances in Decision Analysis, N. Meskens and M. Roubens, Eds., Kluwer Academic, Norwell, Mass, USA, 1999.
  • Z. Sinuany-Stern, A. Mehrez, and Y. Hadad, “An AHP/DEA methodology for ranking decision making units,” International Transactions in Operational Research, vol. 7, no. 2, pp. 109–124, 2000.
  • G. Strassert and T. Prato, “Selecting farming systems using a new multiple criteria decision model: the balancing and ranking method,” Ecological Economics, vol. 40, no. 2, pp. 269–277, 2002.
  • M.-C. Chen, “Ranking discovered rules from data mining with multiple criteria by data envelopment analysis,” Expert Systems with Applications, vol. 33, no. 4, pp. 1110–1116, 2007.
  • J. Jablonsky, “Multicriteria approaches for ranking of efficient units in DEA models,” Central European Journal of Operations Research, vol. 20, no. 3, pp. 435–449, 2012.
  • Y.-M. Wang and P. Jiang, “Alternative mixed integer linear programming models for identifying the most efficient decision making unit in data envelopment analysis,” Computers and Industrial Engineering, vol. 62, no. 2, pp. 546–553, 2012.
  • F. Hosseinzadeh Lotfi, M. Rostamy-Malkhalifeh, N. Aghayi, Z. Ghelej Beigi, and K. Gholami, “An improved method for ranking alternatives in multiple criteria decision analysis,” Applied Mathematical Modelling, vol. 37, no. 1-2, pp. 25–33, 2013.
  • L. M. Seiford and J. Zhu, “Context-dependent data envelopment analysis: measuring attractiveness and progress,” Omega, vol. 31, no. 5, pp. 397–408, 2003.
  • G. R. Jahanshahloo, M. Sanei, F. Hosseinzadeh Lotfi, and N. Shoja, “Using the gradient line for ranking DMUs in DEA,” Applied Mathematics and Computation, vol. 151, no. 1, pp. 209–219, 2004.
  • G. R. Jahanshahloo, F. Hosseinzadeh Lotfi, H. Zhiani Rezai, and F. Rezai Balf, “Using Monte Carlo method for ranking efficient DMUs,” Applied Mathematics and Computation, vol. 162, no. 1, pp. 371–379, 2005.
  • G. R. Jahanshahloo and M. Afzalinejad, “A ranking method based on a full-inefficient frontier,” Applied Mathematical Modelling, vol. 30, no. 3, pp. 248–260, 2006.
  • A. Amirteimoori, “DEA efficiency analysis: efficient and anti-efficient frontier,” Applied Mathematics and Computation, vol. 186, no. 1, pp. 10–16, 2007.
  • C. Kao, “Weight determination for consistently ranking alternatives in multiple criteria decision analysis,” Applied Mathematical Modelling, vol. 34, no. 7, pp. 1779–1787, 2010.
  • M. Khodabakhshi and K. Aryavash, “Ranking all units in data envelopment analysis,” Applied Mathematics Letters, vol. 25, no. 12, pp. 2066–2070, 2012.
  • M. Zerafat Angiz, A. Tajaddini, A. Mustafa, and M. Jalal Kamali, “Ranking alternatives in a preferential voting system using fuzzy concepts and data envelopment analysis,” Computers and Industrial Engineering, vol. 63, no. 4, pp. 784–790, 2012.
  • A. Charnes, W. W. Cooper, and S. Li, “Using data envelopment analysis to evaluate efficiency in the economic performance of Chinese cities,” Socio-Economic Planning Sciences, vol. 23, no. 6, pp. 325–344, 1989.
  • W. D. Cook and M. Kress, “An mth generation model for weak ranging of players in a tournament,” Journal of the Operational Research Society, vol. 41, no. 12, pp. 1111–1119, 1990.
  • W. D. Cook, J. Doyle, R. Green, and M. Kress, “Ranking players in multiple tournaments,” Computers & Operations Research, vol. 23, no. 9, pp. 869–880, 1996.
  • M. Martić and G. Savić, “An application of DEA for comparative analysis and ranking of regions in Serbia with regards to social-economic development,” European Journal of Operational Research, vol. 132, no. 2, pp. 343–356, 2001.
  • I. De Leeneer and H. Pastijn, “Selecting land mine detection strategies by means of outranking MCDM techniques,” European Journal of Operational Research, vol. 139, no. 2, pp. 327–338, 2002.
  • M. P. E. Lins, E. G. Gomes, J. C. C. B. Soares de Mello, and A. J. R. Soares de Mello, “Olympic ranking based on a zero sum gains DEA model,” European Journal of Operational Research, vol. 148, no. 2, pp. 312–322, 2003.
  • A. N. Paralikas and A. I. Lygeros, “A multi-criteria and fuzzy logic based methodology for the relative ranking of the fire hazard of chemical substances and installations,” Process Safety and Environmental Protection, vol. 83, no. 2 B, pp. 122–134, 2005.
  • A. I. Ali and R. Nakosteen, “Ranking industry performance in the US,” Socio-Economic Planning Sciences, vol. 39, no. 1, pp. 11–24, 2005.
  • J. C. Martin and C. Roman, “A benchmarking analysis of spanish commercial airports. A comparison between SMOP and DEA ranking methods,” Networks and Spatial Economics, vol. 6, no. 2, pp. 111–134, 2006.
  • R. L. Raab and E. H. Feroz, “A productivity growth accounting approach to the ranking of developing and developed nations,” International Journal of Accounting, vol. 42, no. 4, pp. 396–415, 2007.
  • R. Williams and N. Van Dyke, “Measuring the international standing of universities with an application to Australian universities,” Higher Education, vol. 53, no. 6, pp. 819–841, 2007.
  • H. Jürges and K. Schneider, “Fair ranking of teachers,” Empirical Economics, vol. 32, no. 2-3, pp. 411–431, 2007.
  • D. I. Giokas and G. C. Pentzaropoulos, “Efficiency ranking of the OECD member states in the area of telecommunications: a composite AHP/DEA study,” Telecommunications Policy, vol. 32, no. 9-10, pp. 672–685, 2008.
  • M. Darvish, M. Yasaei, and A. Saeedi, “Application of the graph theory and matrix methods to contractor ranking,” International Journal of Project Management, vol. 27, no. 6, pp. 610–619, 2009.
  • E. H. Feroz, R. L. Raab, G. T. Ulleberg, and K. Alsharif, “Global warming and environmental production efficiency ranking of the Kyoto Protocol nations,” Journal of Environmental Management, vol. 90, no. 2, pp. 1178–1183, 2009.
  • S. Sitarz, “The medal points' incenter for rankings in sport,” Applied Mathematics Letters, vol. 26, no. 4, pp. 408–412, 2013.
  • N. Adler, L. Friedman, and Z. Sinuany-Stern, “Review of ranking methods in the data envelopment analysis context,” European Journal of Operational Research, vol. 140, no. 2, pp. 249–265, 2002.
  • R. G. Thompson, F. D. Singleton, R. M. Thrall, and B. A. Smith, “Comparative site evaluations for locating a high energy physics lab in Texas,” Interfaces, vol. 16, pp. 35–49, 1986.
  • R. G. Thompson, L. N. Langemeier, C.-T. Lee, E. Lee, and R. M. Thrall, “The role of multiplier bounds in efficiency analysis with application to Kansas farming,” Journal of Econometrics, vol. 46, no. 1-2, pp. 93–108, 1990.
  • R. G. Thompson, E. Lee, and R. M. Thrall, “DEA/AR-efficiency of U.S. independent oil/gas producers over time,” Computers and Operations Research, vol. 19, no. 5, pp. 377–391, 1992.
  • R. H. Green, J. R. Doyle, and W. D. Cook, “Preference voting and project ranking using DEA and cross-evaluation,” European Journal of Operational Research, vol. 90, no. 3, pp. 461–472, 1996.
  • J. Doyle and R. Green, “Efficiency and cross-efficiency in DEA: derivations, meanings and uses,” Journal of the Operational Research Society, vol. 45, no. 5, pp. 567–578, 1994.
  • J. Zhu, “Robustness of the efficient decision-making units in data envelopment analysis,” European Journal of Operational Research, vol. 90, pp. 451–460, 1996.
  • L. M. Seiford and J. Zhu, “Infeasibility of super-efficiency data envelopment analysis models,” INFOR Journal, vol. 37, no. 2, pp. 174–187, 1999.
  • J. H. Dulá and B. L. Hickman, “Effects of excluding the column being scored from the DEA envelopment LP technology matrix,” Journal of the Operational Research Society, vol. 48, no. 10, pp. 1001–1012, 1997.
  • A. Hashimoto, “A ranked voting system using a DEA/AR exclusion model: a note,” European Journal of Operational Research, vol. 97, no. 3, pp. 600–604, 1997.
  • M. Khodabakhshi, “A super-efficiency model based on improved outputs in data envelopment analysis,” Applied Mathematics and Computation, vol. 184, no. 2, pp. 695–703, 2007.
  • M. M. Tatsuoka and P. R. Lohnes, Multivariant Analysis: Techniques For Educational and Psycologial Research, Macmillan Publishing Company, New York, NY, USA, 2nd edition, 1988.
  • Z. Sinuany-Stern, A. Mehrez, and A. Barboy, “Academic departments efficiency via DEA,” Computers and Operations Research, vol. 21, no. 5, pp. 543–556, 1994.
  • D. F. Morrison, Multivariate Statistical Methods, McGraw-Hill, New York, NY, USA, 2nd edition, 1976.
  • S. Siegel and N. J. Castellan, Nonparametric Statistics for the Behavioral Sciences, McGraw-Hill, New York, NY, USA, 1998.
  • T. Obata and H. Ishii, “A method for discriminating efficient candidates with ranked voting data,” European Journal of Operational Research, vol. 151, no. 1, pp. 233–237, 2003.
  • M. Soltanifar and F. Hosseinzadeh Lotfi, “The voting analytic hierarchy process method for discriminating among efficient decision making units in data envelopment analysis,” Computers and Industrial Engineering, vol. 60, no. 4, pp. 585–592, 2011.