Integrated approach to evaluate the risk of adverse events in hospital sector: from theory to practice
Ortiz Barrios, Miguel Angel
Herrera Fontalvo, Zulmeira
Rúa Muñoz, Javier José
Ojeda Gutierrez, Saimon De Jesus
De Felice, Fabio
Show full item record
Show full item record
Citar con el siguiente link: http://hdl.handle.net/11323/1016
AbstractPurpose: The risk of adverse events in a hospital evaluation is an important process in healthcare management. It involves several technical, social, and economical aspects. The purpose of this paper is to propose an integrated approach to evaluate the risk of adverse events in the hospital sector. Design/methodology/approach: This paper aims to provide a decision-making framework to evaluate hospital service. Three well-known methods are applied. More specifically are proposed the following methods: analytic hierarchy process (AHP), a structured technique for organizing and analyzing complex decisions, based on mathematics and psychology developed by Thomas L. Saaty in the 1970s; decision-making trial and evaluation laboratory (DEMATEL) to construct interrelations between criteria/factors and VIKOR method, a commonly used multiple-criteria decision analysis technique for determining a compromise solution and improving the quality of decision making. Findings: The example provided has demonstrated that the proposed approach is an effective and useful tool to assess the risk of adverse events in the hospital sector. The results could help the hospital identify its high performance level and take appropriate measures in advance to prevent adverse events. The authors can conclude that the promising results obtained in applying the AHP–DEMATEL–VIKOR method suggest that the hybrid method can be used to create decision aids that it simplifies the shared decision-making process. Originality/value: This paper presents a novel approach based on the integration of AHP, DEMATEL and VIKOR methods. The final aim is to propose a robust methodology to overcome disadvantages associated with each method.
Referencias:Agyepong, I.A., Anafi, P., Asiamah, E., Ansah, E.K., Ashon, D.A. and Narh‐Dometey, C. (2004), “Health worker (internal customer) satisfaction and motivation in the public sector in Ghana”, The International Journal of Health Planning and Management, Vol. 19 No. 4, pp. 319-336. Alhassan, R.K., Spieker, N., van Ostenberg, P., Ogink, A., Nketiah-Amponsah, E. and de Wit, T.F.R. (2013), “Association between health worker motivation and healthcare quality efforts in Ghana”, Human Resources for Health, Vol. 11 No. 1, pp. 11-37. Amiri, M., Sadaghiyani, J., Payani, N. and Shafieezadeh, M. (2011), “Developing a DEMATEL method to prioritize distribution centers in supply chain”, Management Science Letters, Vol. 1 No. 3, pp. 279-288. Anand, G. and Kodali, R. (2008), “Selection of lean manufacturing systems using the PROMETHEE”, Journal of Modelling in Management, Vol. 3 No. 1, pp. 40-70. Anojkumar, L., Ilangkumaran, M. and Sasirekha, V. (2014), “Comparative analysis of MCDM methods for pipe material selection in sugar industry”, Expert Systems with Applications, Vol. 41 No. 6, pp. 2964-2980. Awang, Z., Abidin, H.Z., Arshad, M.R., Habil, H. and Yahya, A.S. (2006), “Non-technical skills for engineers in the 21st century: a basis for developing a guideline”, Faculty of Management and Human Resource Development, Universiti Teknologi Malaysia, Skudai, Johor. Barrios, M.A.O., De Felice, F., Negrete, K.P., Romero, B.A., Arenas, A.Y. and Petrillo, A. (2016), “An AHP–TOPSIS integrated model for selecting the most appropriate tomography equipment”, International Journal of Information Technology & Decision Making, Vol. 15 No. 4, pp. 861-885. Barton, A. (2009), “Patient safety and quality: an evidence-based handbook for nurses”, AORN Journal, Vol. 90 No. 4, pp. 601-602. Bazzazi, A.A., Osanloo, M. and Karimi, B. (2011), “Deriving preference order of open pit mines equipment through MADM methods: application of modified VIKOR method”, Expert Systems with Applications, Vol. 38 No. 3, pp. 2550-2556. Behzadian, M., Kazemzadeh, R.B., Albadvi, A. and Aghdasi, M. (2010), “PROMETHEE: a comprehensive literature review on methodologies and applications”, European Journal of Operational Research, Vol. 200 No. 1, pp. 198-215. Behzadian, M., Otaghsara, S.K., Yazdani, M. and Ignatius, J. (2012), “A state-of the-art survey of TOPSIS applications”, Expert Systems with Applications, Vol. 39 No. 17, pp. 13051-13069. Butler, J., Jia, J. and Dyer, J. (1997), “Simulation techniques for the sensitivity analysis of multi-criteria decision models”, European Journal of Operational Research, Vol. 103 No. 3, pp. 531-546. Büyüközkan, G., Feyziogˇlu, O. and Gocer, F. (2016), “Evaluation of hospital web services using intuitionistic fuzzy AHP and intuitionistic fuzzy VIKOR”, IEEE International Conference on Industrial Engineering and Engineering Management, December, pp. 607-611. Cannavacciuolo, L., Iandoli, L., Ponsiglione, C. and Zollo, G. (2012), “An analytical framework based on AHP and activity-based costing to assess the value of competencies in production processes”, International Journal of Production Research, Vol. 50 No. 17, pp. 4877-4888. Ceballos, B., Pelta, D.A. and Lamata, M.T. (2017), “Rank reversal and the VIKOR method: an empirical evaluation”, International Journal of Information Technology & Decision Making, Vol. 17 No. 2, pp. 1-13. Chang, K.H. and Cheng, C.H. (2011), “Evaluating the risk of failure using the fuzzy OWA and DEMATEL method”, Journal of Intelligent Manufacturing, Vol. 22 No. 2, pp. 113-129. Chang, T.H. (2014), “Fuzzy VIKOR method: a case study of the hospital service evaluation in Taiwan”, Information Sciences, Vol. 271, pp. 196-212. Chauhan, A. and Vaish, R. (2014), “A comparative study on decision making methods with interval data”, Journal of Computational Engineering, Vol. 1 No. 1, pp 1-10. Cronin, C.M. (2006), “Five years of learning from analysis of clinical occurrences in pediatric care using the London Protocol”, Healthcare Quarterly, Vol. 9, pp. 16-21. De Felice, F. and Petrillo, A. (2015), “Improving Italian healthcare service quality using analytic hierarchy process methodology”, 6th European Conference of the International Federation for Medical and Biological Engineering, MBEC, Vol. 45, Dubrovnik, September 7–11, pp. 981-984. Diaby, V., Campbell, K. and Goeree, R. (2013), “Multi-criteria decision analysis (MCDA) in health care: a bibliometric analysis”, Operations Research for Health Care, Vol. 2, pp. 20-24. Dolan, J.G. (2008), “Shared decision-making – transferring research into practice: the analytic hierarchy process (AHP)”, Patient Education and Counseling, Vol. 73, pp. 418-425. Donaldson, M.S., Corrigan, J.M. and Kohn, L.T. (Eds) (2000), To Err is Human: Building a Safer Health System, Vol. 6, National Academies Press, Washington, DC. Dulmin, R. and Mininno, V. (2003), “Supplier selection using a multi-criteria decision aid method”, Journal of Purchasing and Supply Management, Vol. 9 No. 4, pp. 177-187. Ebben, R.H., Vloet, L.C., Verhofstad, M.H., Meijer, S., Mintjes-de Groot, J.A. and van Achterberg, T. (2013), “Adherence to guidelines and protocols in the prehospital and emergency care setting: a systematic review”, Scandinavian Journal of Trauma, Resuscitation and Emergency Medicine, Vol. 21 No. 1, pp. 1-9. Fontela, E. and Gabus, A. (1974), “DEMATEL, innovative methods”, Report No. 2, Structural analysis of the world problematique, Battelle Geneva Research Institute, Geneva. Forster, A.J., Kyeremanteng, K., Hooper, J., Shojania, K.G. and van Walraven, C. (2008), “The impact of adverse events in the intensive care unit on hospital mortality and length of stay”, BMC Health Services Research, Vol. 8 No. 1, pp. 251-259. García-Cascales, M.S. and Lamata, M.T. (2012), “On rank reversal and TOPSIS method”, Mathematical and Computer Modelling, Vol. 56 Nos 5/6, pp. 123-132. Govindan, K., Khodaverdi, R. and Vafadarnikjoo, A. (2015), “Intuitionistic fuzzy based DEMATEL method for developing green practices and performances in a green supply chain”, Expert Systems with Applications, Vol. 42 No. 20, pp. 7207-7220. Guitoni, A. and Martel, J.M. (1998), “Tentative guidelines to help choosing an appropriate MCDA method”, European Journal of Operation Research, Vol. 109 No. 2, pp. 501-521. Guo, D. and Wu, J. (2013), “A complete ranking of DMUs with undesirable outputs using restrictions in DEA models”, Mathematical and Computer Modelling, Vol. 58 Nos 5/6, pp. 1102-1109. Hayward, R.A. and Hofer, T.P. (2001), “Estimating hospital deaths due to medical errors: preventability is in the eye of the reviewer”, JAMA, Vol. 286 No. 4, pp. 415-420. Holmes, D., Murray, S.J., Perron, A. and Rail, G. (2006), “Deconstructing the evidence-based discourse in health sciences: truth, power and fascism”, International Journal of Evidence-Based Healthcare, Vol. 4 No. 3, pp. 180-186. Hosseini, S. and Al Khaled, A. (2016), “A hybrid ensemble and AHP approach for resilient supplier selection”, Journal of Intelligent Manufacturing, Vol. 1 No. 1, pp. 1-22. Hughes, R. (Ed.) (2008), Patient Safety and Quality: An Evidence-Based Handbook for Nurses, Vol. 3, Agency for Healthcare Research and Quality, Rockville, MD. Huszak, A. and Imre, S. (2010), “Eliminating rank reversal phenomenon in GRA-based network selection method”, IEEE International Conference on Communications (ICC), pp. 1-6. Ishizaka, A., Balkenborg, D. and Kaplan, T. (2011), “Influence of aggregation and measurement scale on ranking a compromise alternative in AHP”, Journal of the Operational Research Society, Vol. 62 No. 4, pp. 700-710. Izquierdo, N.V., Viloria, A., Gaitán-Angulo, M., Bonerg, O., Lezama, P., Erase, J.J.C. and Gutiérrez, A.S. (2016), “Methodology of application of diffuse mathematics to performance evaluation”, International Journal of Control Theory and Applications, Vol. 1 No. 1, pp. 1-6. Jaskowski, P., Biruk, S. and Bucon, R. (2010), “Assessing contractor selection criteria weights with fuzzy AHP method application in group decision environment”, Automation in Construction, Vol. 19 No. 2, pp. 120-126. Joshi, R., Banwet, D.K. and Shankar, R. (2011), “A Delphi–AHP–TOPSIS based benchmarking framework for performance improvement of a cold chain”, Expert Systems with Applications, Vol. 38 No. 8, pp. 10170-10182. Kou, G., Ergu, D. and Shang, J. (2014), “Enhancing data consistency in decision matrix: adapting Hadamard model to mitigate judgment contradiction”, European Journal of Operational Research, Vol. 236 No. 1, pp. 261-271. Kumar, S. and Haleem, A. (2015), “Evaluating bullwhip effect mitigation: an analytical network process (ANP) application”, International Journal of Advanced Research in Engineering Science and Management, Vol. 2 No. 1, pp. 1-14. Labib, A. and Read, M. (2015), “A hybrid model for learning from failures: the Hurricane Katrina disaster”, Expert Systems with Applications, Vol. 42 No. 21, pp. 7869-7881. Lee, Y. and Kozar, K.A. (2006), “Investigating the effect of website quality on e-business success: an analytic hierarchy process (AHP) approach”, Decision Support Systems, Vol. 42 No. 3, pp. 1383-1401. Lee, Y.C., Yen, T.M. and Tsai, C.H. (2008), “Using importance–performance analysis and decision making trial and evaluation laboratory to enhance order-winner criteria – a study of computer industry”, Information Technology Journal, Vol. 7 No. 3, pp. 396-408. Li, C.W. and Tzeng, G.H. (2009), “Identification of a threshold value for the DEMATEL method using the maximum mean de-entropy algorithm to find critical services provided by a semiconductor intellectual property mall”, Expert Systems with Applications, Vol. 36 No. 6, pp. 9891-9898. Li, Y., Hu, Y., Zhang, X., Deng, Y. and Mahadevan, S. (2014), “An evidential DEMATEL method to identify critical success factors in emergency management”, Applied Soft Computing Journal, Vol. 22, pp. 504-510. Liberatore, M.J. and Nydick, R.L. (2008), “The analytic hierarchy process in medical and health care decision making: a literature review”, European Journal of Operational Research, Vol. 189, pp. 194-207. Linkov, I., Bates, M.E., Canis, L.J., Seager, T.P. and Keisler, J.M. (2011), “A decision-directed approach for prioritizing research into the impact of nanomaterials on the environment and human health”, Nature Nanotechnology, Vol. 6 No. 12, pp. 777-784. Liu, H.C., You, J.X., Zhen, L. and Fan, X.J. (2014), “A novel hybrid multiple criteria decision making model for material selection with target-based criteria”, Materials & Design, Vol. 60, pp. 380-390. Maleki, H. and Zahir, S. (2013), “A comprehensive literature review of the rank reversal phenomenon in the analytic hierarchy process”, Journal of Multi-Criteria Decision Analysis, Vol. 20 Nos 3/4, pp. 141-155. Mandic, K., Bobar, V. and Delibašic, B. (2015), “Modeling interactions among criteria in MCDM methods: a review”, in Liu, S., Delibašić, B. and Oderanti, F. (Eds), First International Conference, ICDSST, Proceedings, Conference Paper in Lecture Notes in Business Information Processing, Proceedings, Belgrade, doi: 10.1007/978-3-319-18533-0_9. Martins, C.L., de Almeida, J.A., de Oliveira Bortoluzzi, M.B. and de Almeida, A.T. (2016), “Scaling issues in MCDM portfolio analysis with additive aggregation”, in Liu, S., Delibašić, B. and Oderanti, F. (Eds), International Conference on Decision Support System Technology, Springer, Cham, pp. 100-110. Meesariganda, B.R. and Ishizaka, A. (2017), “Mapping verbal AHP scale to numerical scale for cloud computing strategy selection”, Applied Soft Computing, Vol. 53, April, pp. 111-118. Morrell, K. and Learmonth, M. (2015), “Against evidence-based management, for management learning”, Academy of Management Learning & Education, Vol. 14 No. 4, pp. 520-533. O’Daniel, M. and Rosenstein, A.H. (2008), “Professional communication and team collaboration”, in Hughes, R.G. (Ed.), Patient Safety and Quality: An Evidence-Based Handbook for Nurses, Agency for Healthcare Research and Quality, Advances in Patient Safety, Rockville, MD, April. Opricovic, S. and Tzeng, G.H. (2007), “Extended VIKOR method in comparison with outranking methods”, European Journal of Operational Research, Vol. 178 No. 2, pp. 514-529. Opricovic, S. and Tzeng, G.H. (2002), “Multicriteria planning of post-earthquake sustainable reconstruction”, Computer-Aided Civil Infrastructure Engineering, Vol. 17 No. 3, pp. 211-220. Ortiz-Barrios, M.A., Aleman-Romero, B.A., Rebolledo-Rudas, J., Montes-Villa, L., De Felice, F. and Petrillo, A. (2017), “The analytic decision-making preference model to evaluate the disaster readiness in emergency departments: the ADT model”, Journal of Multi-Criteria Decision Analysis, Vol. 24 Nos 5/6, pp. 204-226. Ou Yang, Y.P., Shieh, H.M., Leu, J.D. and Tzeng, G.H. (2009), “A VIKOR-based multiple criteria decision method for improving information security risk”, International Journal of Information Technology & Decision Making, Vol. 8 No. 2, pp. 267-287. Passarelli, M.C.G., Jacob-Filho, W. and Figueras, A. (2005), “Adverse drug reactions in an elderly hospitalised population”, Drugs & Aging, Vol. 22 No. 9, pp. 767-777. Pecchia, L., Martin, J.L., Ragozzino, A., Vanzanella, C., Scognamiglio, A., Mirarchi, L. and Morgan, S.P. (2013), “User needs elicitation via analytic hierarchy process (AHP). A case study on a computed tomography (CT) scanner”, BMC Medical Informatics and Decision Making, Vol. 13 No. 2, pp. 1-11. Percin, S. (2008), “Using the ANP approach in selecting and benchmarking ERP systems”, Benchmarking: An International Journal, Vol. 15 No. 5, pp. 630-649. Pocar, M., Di Mauro, A., Passolunghi, D., Moneta, A., Alsheraei, A.M.T.A., Bregasi, A., Mattioli, R. and Donatelli, F. (2010), “Predictors of adverse events after surgical ventricular restoration for advanced ischaemic cardiomyopathy”, European Journal of Cardio-Thoracic Surgery, Vol. 37 No. 5, pp. 1093-1100. Rafter, N., Hickey, A., Condell, S., Conroy, R., O’Connor, P., Vaughan, D. and Williams, D. (2015), “Adverse events in healthcare: learning from mistakes”, QJM: An International Journal of Medicine, Vol. 108 No. 4, pp. 273-277. Rajgopal, T. (2010), “Mental well-being at the workplace”, Indian Journal of Occupational and Environmental Medicine, Vol. 14 No. 3, p. 63. Rasmussen, K., Pedersen, A.H.M., Pape, L., Mikkelsen, K.L., Madsen, M.D. and Nielsen, K.J. (2014), “Work environment influences adverse events in an emergency department”, TRIAL, Vol. 7 No. 1, pp. 10-0949. Royendegh, B.D. and Erol, S. (2009), “A DEA–ANP hybrid algorithm approach to evaluate a university’s performance”, International Journal of Basic & Applied Sciences, Vol. 9 No. 10, pp. 115-129. Saaty, T.L. (1982), Decision Making for Leaders: The Analytical Hierarchy Process for Decisions in a Complex World, Wadsworth, Belmont, CA, ISBN 0-534-97959-9; Paperback, Pittsburgh: RWS. ISBN 0-9620317-0-4. “Focuses on practical application of the AHP; briefly covers theory”. Saaty, T.L. (2008), “Decision making with the analytic hierarchy process”, International Journal of Services Sciences, Vol. 1 No. 1, pp. 83-98. Saaty, T.L. (2012), Decision Making for Leaders: The Analytic Hierarchy Process for Decisions in a Complex World, 3rd rev. ed., RWS Publications, Pittsburgh, PA. Saaty, T.L. (2013), “The modern science of multicriteria decision making and its practical applications: the AHP/ANP approach”, Operations Research, Vol. 61 No. 5, pp. 1101-1118. Saaty, T.L. and Shang, J.S. (2011), “An innovative orders-of-magnitude approach to AHP-based multicriteria decision making: prioritizing divergent intangible humane acts”, European Journal of Operational Research, Vol. 214 No. 3, pp. 703-715. Saaty, T.L. and Tran, L.T. (2007), “On the invalidity of fuzzifying numerical judgments in the analytic hierarchy process”, Mathematical and Computer Modelling, Vol. 46 Nos 7/8, pp. 962-975. Saaty, T.L. and Vargas, L.G. (2012), “How to make a decision”, Models, Methods, Concepts & Applications of the Analytic Hierarchy Process, Springer, Boston, MA, pp. 1-21. Sadok, W., Angevin, F., Bergez, J.É., Bockstaller, C., Colomb, B., Guichard, L., Reau, R. and Doré, T. (2009), “Ex ante assessment of the sustainability of alternative cropping systems: implications for using multi-criteria decision-aid methods – a review”, Sustainable Agriculture, Springer, Holland, pp. 753-767, doi: 10.1007/978-90-481-2666-8_46. Sahandri, M.G.H. and Abdullah, S.K. (2009), “Generic skills in personnel development”, European Journal of Social Sciences, Vol. 11 No. 4, pp. 484-492. San Cristóbal, J.R. (2011), “Multi-criteria decision-making in the selection of a renewable energy project in Spain: the VIKOR method”, Renewable Energy, Vol. 36 No. 2, pp. 498-502. Sayadi, M.K., Heydari, M. and Shahanaghi, K. (2009), “Extension of VIKOR method for decisionmaking problem with interval numbers”, Applied Mathematical Modelling, Vol. 33, pp. 2257-2262. Shaik, M.N. and Abdul-Kader, W. (2013), “Transportation in reverse logistics enterprise: a comprehensive performance measurement methodology”, Production Planning & Control, Vol. 24 No. 6, pp. 495-510. Shemshadi, A., Shirazi, H., Toreihi, M. and Tarokh, M.J. (2011), “A fuzzy VIKOR method for supplier selection based on entropy measure for objective weighting”, Expert Systems with Applications, Vol. 38 No. 10, pp. 12160-12167. Shieh, J.I., Wu, H.H. and Huang, K.K. (2010), “A DEMATEL method in identifying key success factors of hospital service quality”, Knowledge-Based Systems, Vol. 23 No. 3, pp. 277-282. Shih, H.S., Shyur, H.J. and Lee, E.S. (2007), “An extension of TOPSIS for group decision making”, Mathematical and Computer Modelling, Vol. 45 Nos 7/8, pp. 801-813. Shin, Y.B. (2017), “Rank reversal phenomenon in cross-efficiency evaluation of data envelopment analysis”, International Journal of Business and Economic Development, Vol. 5 No. 1, pp. 1-6. Shin, Y.B., Lee, S., Chun, S.G. and Chung, D. (2013), “A critical review of popular multi-criteria decision making methodologies”, Issues in Information Systems, Vol. 14 No. 1, pp. 358-365. Si, S.-L., You, X.-Y., Liu, H.-C. and Huang, J. (2017), “Identifying key performance indicators for holistic hospital management with a modified DEMATEL approach”, International Journal of Environmental Research and Public Health, Vol. 14 No. 8, pp. 976-934. Soltanifar, M. and Shahghobadi, S. (2014), “Survey on rank preservation and rank reversal in data envelopment analysis”, Knowledge-Based Systems, Vol. 60, pp. 10-19. Srdjevic, B. (2007), “Linking analytic hierarchy process and social choice methods to support group decision-making in water management”, Decision Support Systems, Vol. 42 No. 4, pp. 2261-2273. Supeekit, T., Somboonwiwat, T. and Kritchanchai, D. (2016), “DEMATEL-modified ANP to evaluate internal hospital supply chain performance”, Computers and Industrial Engineering, Vol. 102, pp. 318-330. Timmermans, S. and Berg, M. (2003), The Gold Standard: The Challenge of Evidence-Based Medicine and Standardization in Health Care, Temple University Press, Philadelphia, PA. Tong, L.I., Chen, C.C. and Wang, C.H. (2007), “Optimization of multi-response processes using the VIKOR method”, The International Journal of Advanced Manufacturing Technology, Vol. 31 No. 11, pp. 1049-1057. Tseng, M.L. (2011), “Using a hybrid MCDM model to evaluate firm environmental knowledge management in uncertainty”, Applied Soft Computing, Vol. 11 No. 1, pp. 1340-1352. Tzeng, G.H. and Huang, C.Y. (2012), “Combined DEMATEL technique with hybrid MCDM methods for creating the aspired intelligent global manufacturing & logistics systems”, Annals of Operations Research, Vol. 197 No. 1, pp. 159-190. Vargas, L.G. (2012), Models, Methods, Concepts & Applications of the Analytic Hierarchy Process, Springer, New York, NY. Velasquez, M. and Hester, P.T. (2013), “An analysis of multi-criteria decision making methods”, International Journal of Operations Research, Vol. 10 No. 2, pp. 56-66. Wang, C.H. and Pang, C.T. (2011), “Using VIKOR method for evaluating service quality of online auction under fuzzy environment”, International Journal of Computer Science & Engineering Technology, Vol. 1 No. 6, pp. 307-314. Wang, G., Qin, L., Li, G. and Chen, L. (2009), “Landfill site selection using spatial information technologies and AHP: a case study in Beijing, China”, Journal of Environmental Management, Vol. 90 No. 8, pp. 2414-2421. Wang, Y.M. and Luo, Y. (2009), “On rank reversal in decision analysis”, Mathematical and Computer Modelling, Vol. 49 Nos 5/6, pp. 1221-1229. Wijnmalen, D.J. and Wedley, W.C. (2008), “Non-discriminating criteria in the AHP: removal and rank reversal”, Journal of Multi-Criteria Decision Analysis, Vol. 15 Nos 5/6, pp. 143-149. World Health Organization and Funk, M. (2005), Mental Health Policies and Programmes in the Workplace, World Health Organization, Geneva. Wrenn, K., Lorenzen, B., Jones, I., Zhou, C. and Aronsky, D. (2010), “Factors affecting stress in emergency medicine residents while working in the ED”, The American Journal of Emergency Medicine, Vol. 28 No. 8, pp. 897-902. Wu, H.H. and Tsai, Y.N. (2012), “An integrated approach of AHP and DEMATEL methods in evaluating the criteria of auto spare parts industry”, International Journal of Systems Science, Vol. 43 No. 11, pp. 2114-2124. Wu, J., Yang, F. and Liang, L. (2010), “A modified complete ranking of DMUs using restrictions in DEA models”, Applied Mathematics and Computation, Vol. 217 No. 2, pp. 745-751. Yang, J.L. and Tzeng, G.H. (2011), “An integrated MCDM technique combined with DEMATEL for a novel cluster-weighted with ANP method”, Expert Systems with Applications, Vol. 38 No. 3, pp. 1417-1424. Yoo, S. (2005), “Service quality at hospitals”, in Ha, Y.U. and Yi, Y. (Eds), Asia Pacific Advances in Consumer Research, Vol. 6, Association for Consumer Research, Duluth, MN, pp. 188-193. Zavadskas, E.K., Govindan, K., Antucheviciene, J. and Turskis, Z. (2016), “Hybrid multiple criteria decision-making methods: a review of applications for sustainability issues”, Economic Research (Ekonomska istraživanja), Vol. 29 No. 1, pp. 857-887. Zhang, N. and Wei, G. (2013), “Extension of VIKOR method for decision making problem based on hesitant fuzzy set”, Applied Mathematical Modelling, Vol. 37 No. 7, pp. 4938-4947. Zhü, K. (2014), “Fuzzy analytic hierarchy process: fallacy of the popular methods”, European Journal of Operational Research, Vol. 236 No. 1, pp. 209-217.