The Impact of the Fuzzy Delphi Technique on Technology Methods Based on Design Thinking

Anshar  Daud; Sartika Lina Mulani  Sitio; Asri Ady  Bakri; Loso  Judijanto; Ridwan

doi:10.23887/jet.v8i1.69185

Authors

Anshar Daud Instititut Teknologi dan Bisnis Nobel Indonesia, Makassar, Indonesia https://orcid.org/0000-0002-1753-4266
Sartika Lina Mulani Sitio Universitas Pamulang, Tangerang Selatan, Indonesia
Asri Ady Bakri Universitas Muslim Indonesia, Makassar, Indonesia
Loso Judijanto IPOSS, Jakarta, Indonesia
Ridwan Instititut Teknologi dan Bisnis Nobel Indonesia, Makassar, Indonesia

DOI:

https://doi.org/10.23887/jet.v8i1.69185

Keywords:

Technology, design thinking, education, ICT, Fuzzy Delphi

Abstract

As technology becomes important in people's lives, there is a call to integrate technology into education. Therefore, this research aims to look at the elements needed to integrate technology as a learning platform based on design thinking. This research is quantitative research using the Fuzzy Delphi technique. The approach used to collect research data is to use a questionnaire instrument. The number of experts involved was 18 people, 8 people from the field of education, 5 people from educational technology, and 5 people from design thinking. The research results show that the eight elements are accepted by experts with a consensus percentage above 75% with a threshold value (d) ≤ 0.2. The conclusions of these eight elements are using technology or the internet, choosing technological tools or resources, assessing the credibility and relevance of sources, using technology to analyze information, using technology to support teamwork, using technology to help students share information, utilizing technology to monitor assignments, utilizing technology to interact directly with experts is necessary for integrating technology as a learning platform based on design thinking. This research implies that teachers and students have started to apply these eight elements in the classroom learning process.

References

Afanasyev, V. V., Ivanova, O. A., Rezakov, R. G., Afanasyev, I. V., & Kunitsyna, S. M. (2019). Organizational environment for the schoolchildrens’ professional identities: Establishing, modelling, efficiency expectations and long-term development. International Journal of Civil Engineering and Technology, 10(2), 1612–1637. https://www.academia.edu/download/60380560/IJCIET_10_02_15620190824-107183-1vy5o61.pdf.

Agha, R. A., Franchi, T., Sohrabi, C., Mathew, G., Kerwan, A., Thoma, A., Beamish, A. J., Noureldin, A., Rao, A., Vasudevan, B., Challacombe, B., Perakath, B., Kirshtein, B., Ekser, B., Pramesh, C. S., Laskin, D. M., Machado-Aranda, D., Miguel, D., Pagano, D., … Mei, Z. (2020). The SCARE 2020 Guideline: Updating Consensus Surgical CAse REport (SCARE) Guidelines. International Journal of Surgery, 84(November), 226–230. https://doi.org/10.1016/j.ijsu.2020.10.034.

Agustini, K., Santyasa, I. W., & Ratminingsih, N. M. (2019). Analysis of Competence on “tPACK”: 21st Century Teacher Professional Development. Journal of Physics: Conference Series, 1387(1), 1–10. https://doi.org/10.1088/1742-6596/1387/1/012035.

Andrews-Todd, J., & Forsyth, C. M. (2020). Exploring social and cognitive dimensions of collaborative problem solving in an open online simulation-based task. Computers in Human Behavior, 104(March 2020), 1-29. https://doi.org/10.1016/j.chb.2018.10.025.

Beaunoyer, E., Dupéré, S., & Guitton, M. J. (2020). COVID-19 and digital inequalities: Reciprocal impacts and mitigation strategies. Computers in Human Behavior, 111(May), 1–9. https://doi.org/10.1016/j.chb.2020.106424.

Behnamnia, N., Kamsin, A., & Ismail, M. A. B. (2020). The landscape of research on the use of digital game-based learning apps to nurture creativity among young children: A review. Thinking Skills and Creativity, 37(May), 100666.1-12. https://doi.org/10.1016/j.tsc.2020.100666.

Behnamnia, N., Kamsin, A., Ismail, M. A. B., & Hayati, A. (2020). The effective components of creativity in digital game-based learning among young children: A case study. Children and Youth Services Review, 116(March 2020), 105227.1-13. https://doi.org/10.1016/j.childyouth.2020.105227.

Beiderbeck, D., Frevel, N., von der Gracht, H. A., Schmidt, S. L., & Schweitzer, V. M. (2021). Preparing, conducting, and analyzing Delphi surveys: Cross-disciplinary practices, new directions, and advancements. MethodsX, 8(2), 101401.1-20. https://doi.org/10.1016/j.mex.2021.101401.

Calavia, M. B., Blanco, T., & Casas, R. (2021). Fostering creativity as a problem-solving competence through design: Think-Create-Learn, a tool for teachers. Thinking Skills and Creativity, 39(April 2020), 1-18. https://doi.org/10.1016/j.tsc.2020.100761.

Caldevilla-Domínguez, D., Martínez-Sala, A. M., & Barrientos-Báez, A. (2021). Tourism and ICT. Bibliometric study on digital literacy in higher education. Education Sciences, 11(4), 1-22. https://doi.org/10.3390/educsci11040172.

Cantú-Ortiz, F. J., Galeano Sánchez, N., Garrido, L., Terashima-Marin, H., & Brena, R. F. (2020). An artificial intelligence educational strategy for the digital transformation. International Journal on Interactive Design and Manufacturing, 14(4), 1195–1209. https://doi.org/10.1007/s12008-020-00702-8.

Capson-Tojo, G., Moscoviz, R., Astals, S., Robles, & Steyer, J. P. (2020). Unraveling the literature chaos around free ammonia inhibition in anaerobic digestion. Renewable and Sustainable Energy Reviews, 117(September 2019), 109487.1-16. https://doi.org/10.1016/j.rser.2019.109487.

Chen, X., Zou, D., Cheng, G., & Xie, H. (2020). Detecting latent topics and trends in educational technologies over four decades using structural topic modeling: A retrospective of all volumes of Computers & Education. Computers and Education, 151(September 2019), 103855.1-21. https://doi.org/10.1016/j.compedu.2020.103855.

Crites, K., & Rye, E. (2020). Innovating language curriculum design through design thinking: A case study of a blended learning course at a Colombian university. System, 94(November 2020), 102334.1-12. https://doi.org/10.1016/j.system.2020.102334.

Dawood, K. A., Sharif, K. Y., Ghani, A. A., Zulzalil, H., Zaidan, A. A., & Zaidan, B. B. (2021). Towards a unified criteria model for usability evaluation in the context of open source software based on a fuzzy Delphi method. Information and Software Technology, 130(February 2021), 106453.1-31. https://doi.org/10.1016/j.infsof.2020.106453.

Ejaz, H., Zeeshan, H. M., Ahmad, F., Bukhari, S. N. A., Anwar, N., Alanazi, A., Sadiq, A., Junaid, K., Atif, M., Abosalif, K. O. A., Iqbal, A., Hamza, M. A., & Younas, S. (2022). Bibliometric Analysis of Publications on the Omicron Variant from 2020 to 2022 in the Scopus Database Using R and VOSviewer. International Journal of Environmental Research and Public Health, 19(19), 1–22. https://doi.org/10.3390/ijerph191912407.

Fernández‐otoya, F. A., Raposo‐rivas, M., & Halabi‐echeverry, A. X. (2022). A Qualitative Systematic Literature Review on Phonological Awareness in Preschoolers Supported by Information and Communication Technologies. Education Sciences, 12(6), 1-20. https://doi.org/10.3390/educsci12060382.

Fromm, J., Radianti, J., Wehking, C., Stieglitz, S., & Majchrzak, T. A. (2021). More than experience ? - On the unique opportunities of virtual reality to afford a holistic experiential learning cycle. The Internet and Higher Education, 50(March), 100804.1-14. https://doi.org/10.1016/j.iheduc.2021.100804.

Gessler, M., Nägele, C., & Stalder, B. E. (2021). Scoping Review on Research at the Boundary Between Learning and Working: A Bibliometric Mapping Analysis of the Last Decade. International Journal for Research in Vocational Education and Training, 8(4), 170–206. https://doi.org/10.13152/IJRVET.8.4.8.

Ghani, N. A., Teo, P. C., Ho, T. C. F., Choo, L. S., Kelana, B. W. Y., Adam, S., & Ramliy, M. K. (2022). Bibliometric Analysis of Global Research Trends on Higher Education Internationalization Using Scopus Database: Towards Sustainability of Higher Education Institutions. Sustainability (Switzerland), 14(14), 1-15. https://doi.org/10.3390/su14148810.

Govindasamy, P., Abdullah, N., & Ibrahim, R. (2023). Employing Modified Design and Development Research (DDR) Approach to Develop Creativity Clay Module to Teach Special Educational Needs (SEN) Students with Learning Disabilities. International Journal of Academic Research in Business and Social Sciences, 13(3), 1-17. https://doi.org/10.6007/ijarbss/v13-i3/15773.

Hainora Hamzah, Mohd Isa Hamzah, & Hafizhah Zulkifli. (2022). Systematic Literature Review on the Elements of Metacognition-Based Higher Order Thinking Skills (HOTS) Teaching and Learning Modules. Sustainability (Switzerland), 14(2), 1-15. https://doi.org/https://doi.org/10.3390/su14020813.

Haleem, A., Javaid, M., Qadri, M. A., & Suman, R. (2022). Understanding the role of digital technologies in education: A review. Sustainable Operations and Computers, 3(February), 275–285. https://doi.org/10.1016/j.susoc.2022.05.004.

Halomoan, J. H. L. (2022). Difficulty of Mathematics teacher competence in applying curriculum online. Asian Journal of Educational Technology, 1(1), 44–54. https://doi.org/10.53402/ajet.v1i2.16.

Herrera-Franco, G., Montalván-Burbano, N., Carrión-Mero, P., Apolo-Masache, B., & Jaya-Montalvo, M. (2020). Research trends in geotourism: A bibliometric analysis using the scopus database. Geosciences (Switzerland), 10(10), 1–29. https://doi.org/10.3390/geosciences10100379.

Huang, J., Obracht-Prondzynska, H., Kamrowska-Zaluska, D., Sun, Y., & Li, L. (2021). The image of the City on social media: A comparative study using “Big Data” and “Small Data” methods in the Tri-City Region in Poland. Landscape and Urban Planning, 206(February 2021), 103977.1-19. https://doi.org/10.1016/j.landurbplan.2020.103977.

Iivari, N., Sharma, S., & Ventä-Olkkonen, L. (2020). Digital transformation of everyday life – How COVID-19 pandemic transformed the basic education of the young generation and why information management research should care? International Journal of Information Management, 55(June), 102183. https://doi.org/10.1016/j.ijinfomgt.2020.102183.

Jahnke, I., & Liebscher, J. (2020). Three types of integrated course designs for using mobile technologies to support creativity in higher education. Computers and Education, 146(March 2020), 103782.1-28. https://doi.org/10.1016/j.compedu.2019.103782.

Kandel, N., Chungong, S., Omaar, A., & Xing, J. (2020). Health security capacities in the context of COVID-19 outbreak: an analysis of International Health Regulations annual report data from 182 countries. The Lancet, 395(10229), 1047–1053. https://doi.org/10.1016/S0140-6736(20)30553-5.

Khakimov, J. O. (2019). Documenting procedures for implementing the process of project teachers to computer projects. International Journal of Advanced Science and Technology, 28(20), 881–889. https://www.researchgate.net/profile/Jamshid-Khakimov/publication/340429051.

Kikon, P. (2023). Research Trends in Information Literacy : Bibliometric Analysis and Network Visualisation. Qualitative and Quantitative Methods in Libraries, 12(2), 251–264. https://doi.org/https://orcid.org/0000-0001-7415-2697.

Kipper, L. M., Furstenau, L. B., Hoppe, D., Frozza, R., & Iepsen, S. (2020). Scopus scientific mapping production in industry 4.0 (2011–2018): a bibliometric analysis. International Journal of Production Research, 58(6), 1605–1627. https://doi.org/10.1080/00207543.2019.1671625.

Kumar, R., Baz, A., Alhakami, H., Alhakami, W., Agrawal, A., & Khan, R. A. (2021). A hybrid fuzzy rule-based multi-criteria framework for sustainable-security assessment of web application. Ain Shams Engineering Journal, 12(2), 2227–2240. https://doi.org/10.1016/j.asej.2021.01.003.

Lin, Y.-H., Huang, C.-J., Chao, J.-R., Chen, S.-T., Lee, S.-F., Yen, J. J.-Y., & Yang-Yen, H.-F. (2000). Coupling of Osteopontin and Its Cell Surface Receptor CD44 to the Cell Survival Response Elicited by Interleukin-3 or Granulocyte-Macrophage Colony-Stimulating Factor. Molecular and Cellular Biology, 20(8), 2734–2742. https://doi.org/10.1128/mcb.20.8.2734-2742.2000.

Liu, N., Nikitas, A., & Parkinson, S. (2020). Exploring expert perceptions about the cyber security and privacy of Connected and Autonomous Vehicles: A thematic analysis approach. Transportation Research Part F: Traffic Psychology and Behaviour, 75(November 2020), 66–86. https://doi.org/10.1016/j.trf.2020.09.019.

Liu, P., Qiu, Y., Hu, J., Tong, J., Zhao, J., & Li, Z. (2020). Expert judgments for performance shaping Factors’ multiplier design in human reliability analysis. Reliability Engineering and System Safety, 194(February 2020,), 1-76. https://doi.org/10.1016/j.ress.2018.12.022.

Lumbantoruan, J. H. (2022). Description of Difficulty of Semester VII Students of Mathematics Education Study Program in Complex Analysis Course Description of Difficulty of Semester VII Students of Mathematics Education Study Program in Complex Analysis Course. Journal of Education and Learning Mathematics Research (JELMaR), 3(1), 1–13. https://doi.org/10.37303/jelmar.v3i1.65.

Lytras, M. D., Serban, A. C., Ruiz, M. J. T., Ntanos, S., & Sarirete, A. (2022). Translating knowledge into innovation capability: An exploratory study investigating the perceptions on distance learning in higher education during the COVID-19 pandemic - the case of Mexico. Journal of Innovation and Knowledge, 7(4), 100258.1-15. https://doi.org/10.1016/j.jik.2022.100258.

Mansor, N. A., Abdullah, N., & Rahman, H. A. (2020). Towards electronic learning features in education 4.0 environment: Literature study. Indonesian Journal of Electrical Engineering and Computer Science, 19(1), 442–450. https://doi.org/10.11591/ijeecs.v19.i1.pp442-450.

Markauskaite, L., Marrone, R., Poquet, O., Knight, S., Martinez-Maldonado, R., Howard, S., Tondeur, J., De Laat, M., Buckingham Shum, S., Gašević, D., & Siemens, G. (2022). Rethinking the entwinement between artificial intelligence and human learning: What capabilities do learners need for a world with AI? Computers and Education: Artificial Intelligence, 3(July 2021), 1-16. https://doi.org/10.1016/j.caeai.2022.100056.

McWilliams, A., Reilly, C., Gupta, J., Hadji-Michael, M., Srinivasan, R., & Heyman, I. (2019). Autism spectrum disorder in children and young people with non-epileptic seizures. Seizure, 73(October 2019), 51–55. https://doi.org/10.1016/j.seizure.2019.10.022.

Milara, I. S., Pitkänen, K., Laru, J., Iwata, M., Orduña, M. C., & Riekki, J. (2020). STEAM in Oulu: Scaffolding the development of a Community of Practice for local educators around STEAM and digital fabrication. International Journal of Child-Computer Interaction, 26(December 2020), 100197.1-14. https://doi.org/10.1016/j.ijcci.2020.100197.

Mitter, H., Techen, A. K., Sinabell, F., Helming, K., Schmid, E., Bodirsky, B. L., Holman, I., Kok, K., Lehtonen, H., Leip, A., Le Mouël, C., Mathijs, E., Mehdi, B., Mittenzwei, K., Mora, O., Øistad, K., Øygarden, L., Priess, J. A., Reidsma, P., … Schönhart, M. (2020). Shared Socio-economic Pathways for European agriculture and food systems: The Eur-Agri-SSPs. Global Environmental Change, 65(December 2019), 102159.1-13. https://doi.org/10.1016/j.gloenvcha.2020.102159.

Moskalewicz, A., & Oremus, M. (2020). No clear choice between Newcastle–Ottawa Scale and Appraisal Tool for Cross-Sectional Studies to assess methodological quality in cross-sectional studies of health-related quality of life and breast cancer. Journal of Clinical Epidemiology, 120(April 2020), 94–103. https://doi.org/10.1016/j.jclinepi.2019.12.013.

Oke, A., & Fernandes, F. A. P. (2020). Innovations in Teaching and Learning: Exploring the Perceptions of the Education Sector on the 4th Industrial Revolution (4IR). Journal of Open Innovation: Technology, Market, and Complexity, 6(2), 31. https://doi.org/10.3390/joitmc6020031.

Okonkwo, C. W., & Ade-Ibijola, A. (2021). Chatbots applications in education: A systematic review. Computers and Education: Artificial Intelligence, 2, 100033. https://doi.org/10.1016/j.caeai.2021.100033.

Pacheco-Velázquez, E. A., Vázquez-Parra, J. C., Cruz-Sandoval, M., Salinas-Navarro, D. E., & Carlos-Arroyo, M. (2023). Business Decision-Making and Complex Thinking: A Bibliometric Study. Administrative Sciences, 13(3), 1-20. https://doi.org/10.3390/admsci13030080.

Pal, D., & Vanijja, V. (2020). Perceived usability evaluation of Microsoft Teams as an online learning platform during COVID-19 using system usability scale and technology acceptance model in India. Children and Youth Services Review, 119. https://doi.org/10.1016/j.childyouth.2020.105535.

Pande, M., & Bharathi, S. V. (2020). Theoretical foundations of design thinking – A constructivism learning approach to design thinking. Thinking Skills and Creativity, 36(October 2019), 100637.1-17. https://doi.org/10.1016/j.tsc.2020.100637.

Pranckutė, R. (2021). Web of science (Wos) and scopus: The titans of bibliographic information in today’s academic world. Publications, 9(1), 1–20. https://doi.org/10.3390/publications9010012.

Radbruch, L., De Lima, L., Knaul, F., Wenk, R., Ali, Z., Bhatnaghar, S., Blanchard, C., Bruera, E., Buitrago, R., Burla, C., Callaway, M., Munyoro, E. C., Centeno, C., Cleary, J., Connor, S., Davaasuren, O., Downing, J., Foley, K., Goh, C., … Pastrana, T. (2020). Redefining Palliative Care—A New Consensus-Based Definition. Journal of Pain and Symptom Management, 60(4), 754–764. https://doi.org/10.1016/j.jpainsymman.2020.04.027.

Rafiq, A. A., Triyono, M. B., Djatmiko, I. W., Wardani, R., & Köhler, T. (2023). Mapping the Evolution of Computational Thinking in Education: A Bibliometrics Analysis of Scopus Database from 1987 to 2023. Informatics in Education, 00(00), 1–33. https://doi.org/10.15388/infedu.2023.29.

Ryan, B., Johnston, K. A., Taylor, M., & McAndrew, R. (2020). Community engagement for disaster preparedness: A systematic literature review. International Journal of Disaster Risk Reduction, 49(May), 101655.1-13. https://doi.org/10.1016/j.ijdrr.2020.101655.

Saarikko, T., Westergren, U. H., & Blomquist, T. (2020). Digital transformation: Five recommendations for the digitally conscious firm. Business Horizons, 63(6), 825–839. https://doi.org/10.1016/j.bushor.2020.07.005.

Sailer, M., Stadler, M., Schultz-Pernice, F., Franke, U., Schöffmann, C., Paniotova, V., Husagic, L., & Fischer, F. (2021). Technology-Related Teaching Skills and Attitudes: Validation of a Scenario-Based Self-Assessment Instrument for Teachers. Computers in Human Behavior, 115(1), 1–12. https://doi.org/10.1016/j.chb.2020.106625.

Salmerón, L., Sampietro, A., & Delgado, P. (2020). Using Internet videos to learn about controversies: Evaluation and integration of multiple and multimodal documents by primary school students. Computers and Education, 148(January 2019), 1-14. https://doi.org/10.1016/j.compedu.2019.103796.

Schreck, C. M., Weilbach, J. T., & Reitsma, G. M. (2020). Improving graduate attributes by implementing an experiential learning teaching approach: A case study in recreation education. Journal of Hospitality, Leisure, Sport and Tourism Education, 26(October), 100214.1-11. https://doi.org/10.1016/j.jhlste.2019.100214.

Shin, D. shin, Cimasko, T., & Yi, Y. (2020). Development of metalanguage for multimodal composing: A case study of an L2 writer’s design of multimedia texts. Journal of Second Language Writing, 47(April 2019), 100714.1-14. https://doi.org/10.1016/j.jslw.2020.100714.

Smutny, P., & Schreiberova, P. (2020). Computers & Education Chatbots for learning : A review of educational chatbots for the Facebook Messenger. Computers & Education, 151(June 2019), 103862.1-11. https://doi.org/10.1016/j.compedu.2020.103862.

Spranger, J., Homberg, A., Sonnberger, M., & Niederberger, M. (2022). Reporting guidelines for Delphi techniques in health sciences: A methodological review. Zeitschrift Fur Evidenz, Fortbildung Und Qualitat Im Gesundheitswesen, 172(August 2022), 1–11. https://doi.org/10.1016/j.zefq.2022.04.025.

Tapingkae, P., Panjaburee, P., Hwang, G. J., & Srisawasdi, N. (2020). Effects of a formative assessment-based contextual gaming approach on students’ digital citizenship behaviours, learning motivations, and perceptions. Computers and Education, 159(August 2019), 103998.1-16. https://doi.org/10.1016/j.compedu.2020.103998.

Tuzun, U. (2020). Introduction to systems engineering and sustainability PART I: Student-centred learning for chemical and biological engineers. Education for Chemical Engineers, 31(April 2020), 85–93. https://doi.org/10.1016/j.ece.2020.04.004.

Urdan, T., & Kaplan, A. (2020). The origins, evolution, and future directions of achievement goal theory. Contemporary Educational Psychology, 61(xxxx), 101862.1-10. https://doi.org/10.1016/j.cedpsych.2020.101862.

Zabolotna, K., Malmberg, J., & Järvenoja, H. (2023). Examining the interplay of knowledge construction and group-level regulation in a computer-supported collaborative learning physics task. Computers in Human Behavior, 138(August 2022), 1-17. https://doi.org/10.1016/j.chb.2022.107494.