Analysis of UT Student Satisfaction with the Tuweb system using CSI, IPA & SEM-PLS

Kadek  Masakazu; Agus Tatang  Sopandi; I Gusti Ngurah Satria Wijaya; Gede  Suwardika; I Ketut Putu   Suniantara

doi:10.23887/jere.v7i3.66621

Authors

Kadek Masakazu Universitas Terbuka, Denpasar, Indonesia https://orcid.org/0000-0002-8081-4535
Agus Tatang Sopandi Universitas Terbuka, Denpasar, Indonesia
I Gusti Ngurah Satria Wijaya Institut Teknologi dan Bisnis STIKOM Bali, Denpasar, Indonesia https://orcid.org/0000-0001-6479-4346
Gede Suwardika Universitas Terbuka, Denpasar, Indonesia https://orcid.org/0000-0002-2307-5182
I Ketut Putu Suniantara Institut Teknologi dan Bisnis STIKOM Bali, Denpasar, Indonesia https://orcid.org/0000-0002-7003-2126

DOI:

https://doi.org/10.23887/jere.v7i3.66621

Keywords:

CSI, IPA, SEM-PLS, Satisfaction, Tuweb

Abstract

One form of development in the world of learning as a result of developments in information and communication technology (ICT) is that distance learning is possible. The Open University, a public university, uses various modes of learning has also experienced changes in the modes of learning for students who decide to study in person during class. Coupled with the Covid-19 pandemic, this change is a change in the learning system from the TTM mode which is replaced by Tuweb (blended learning that is held online). This study aims to analyze user or UT student satisfaction with the Tuweb system using the Servqual dimension. The data source came from the UT student population at UPBJJ UT Denpasar, where the determination of respondents was carried out using a purposive sampling technique. The Customer Satisfaction Index (CSI), Importance Performance Analysis (IPA), and Structural Equation Modeling (SEM) using Partial Least Squares (PLS-SEM) are the analytical techniques used. The results of the slices of the three methods (CSI, IPA and SEM-PLS) is that Tuweb UT's services get quite satisfied ratings from students, where the variable that gives excellence to Tuweb UT is empathy. As a note for improving the tuweb service from UT, the Tuweb service has the availability of a learning service response at any time and place (responsiveness variable) and the Tuweb service has better speed accuracy than the promised speed accuracy (reliability variable).

References

Abidin, Z., Rokhman, F., & Mathrani, A. (2021). Exploring the influencing factors of learning management systems continuance intention in a blended learning environment. International Journal of Innovation and Learning, 30(2), 175–187. https://doi.org/https://doi.org/10.1504/IJIL.2021.117221 PDF.

Afthanorhan, A., Ghazali, P. L., & Rashid, N. (2021). Discriminant Validity: A Comparison of CBSEM and Consistent PLS using Fornell & Larcker and HTMT Approaches. Journal of Physics: Conference Series, 1874(1). https://doi.org/10.1088/1742-6596/1874/1/012085.

Alawamleh, M., Al-Twait, L. M., & Al-Saht, G. R. (2022). The effect of online learning on communication between instructors and students during Covid-19 pandemic. Asian Education and Development Studies, 11(2), 380–400. https://doi.org/10.1108/AEDS-06-2020-0131.

Alhamad, A. Q. M., Akour, I., Alshurideh, M., Al-Hamad, A. Q., Kurdi, B. Al, & Alzoubi, H. (2021). Predicting the intention to use google glass: A comparative approach using machine learning models and PLS-SEM. International Journal of Data and Network Science, 5(3), 311–320. https://doi.org/10.5267/j.ijdns.2021.6.002.

Anurrasyid, A., & Sumitra, I. D. (2019). Elementary School Learning Media Application Based on Android with Customer Satisfaction Index Method. IOP Conference Series: Materials Science and Engineering, 662(2). https://doi.org/10.1088/1757-899X/662/2/022017.

Apriyanti, C. (2020). Distance Learning and Obstacles During Covid-19 Outbreak. Jurnal Ilmiah Pendidikan Dasar, 7(2), 68. https://doi.org/10.30659/pendas.7.2.68-83.

Azlan, C. A., Wong, J. H. D., Tan, L. K., Muhammad Shahrun, M. S. N., Ung, N. M., Pallath, V., Tan, C. P. L., Yeong, C. H., & Ng, K. H. (2020). Teaching and learning of postgraduate medical physics using Internet-based e-learning during the COVID-19 pandemic – A case study from Malaysia. Physica Medica, 80(October), 10–16. https://doi.org/10.1016/j.ejmp.2020.10.002.

Budiarso, I., Muchtar, H. S., Soro, S. H., & Mardiana, D. (2022). Online Tutorial And Webinar Tutorial Management On Distence Learning Process At Indonesia Open University. International Journal of Educational Research & Social Sciences, 3(4), 1708–1714. https://doi.org/10.51601/ijersc.v3i4.470.

Fisher, R., Perényi, Á., & Birdthistle, N. (2021). The positive relationship between flipped and blended learning and student engagement, performance and satisfaction. Active Learning in Higher Education, 22(2), 97–113. https://doi.org/10.1177/1469787418801702.

Gandhy, A., & Hairuddin, J. A. (2018). Analysis of Promotion and Product Differentiation of Jukajo on Consumer Purchase Decision. Binus Business Review, 9(1), 9. https://doi.org/10.21512/bbr.v9i1.3901.

Goh, E., & Sigala, M. (2020). Integrating Information & Communication Technologies (ICT) into classroom instruction: teaching tips for hospitality educators from a diffusion of innovation approach. Journal of Teaching in Travel and Tourism, 20(2), 156–165. https://doi.org/10.1080/15313220.2020.1740636.

Hair, J., & Alamer, A. (2022). Partial Least Squares Structural Equation Modeling (PLS-SEM) in second language and education research: Guidelines using an applied example. Research Methods in Applied Linguistics, 1(3), 100027. https://doi.org/10.1016/j.rmal.2022.100027.

Hair, J. F., Risher, J. J., Sarstedt, M., & Ringle, C. M. (2019). When to use and how to report the results of PLS-SEM. European Business Review, 31(1), 2–24. https://doi.org/10.1108/EBR-11-2018-0203.

Huang, C. H. (2021). Using pls-sem model to explore the influencing factors of learning satisfaction in blended learning. Education Sciences, 11(5). https://doi.org/10.3390/educsci11050249.

Irving, K. E. (2006). The impact of technology on the 21st century. Teaching Science in the 21st Century, March 1981, 3–19. https://cmapsconverted.ihmc.us/rid=1JVHR9TKT-1VMCFZP-SHW/21st century.pdf.

Islam, M. K., Sarker, M. F. H., & Islam, M. S. (2022). Promoting student-centred blended learning in higher education: A model. E-Learning and Digital Media, 19(1), 36–54. https://doi.org/10.1177/20427530211027721.

Kanojiya, A. R. (2020). The Impact of Online Learning during Covid-19 Pandemic: Students Perspective Maharashtra, India. International Journal for Research in Applied Science and Engineering Technology, 8(11), 686–690. https://doi.org/10.22214/ijraset.2020.32277.

Lassoued, Z., Alhendawi, M., & Bashitialshaaer, R. (2020). An exploratory study of the obstacles for achieving quality in distance learning during the covid-19 pandemic. Education Sciences, 10(9), 1–13. https://doi.org/10.3390/educsci10090232.

Mahsun, M., Ibad, T. N., & Nurissurur, A. (2021). Model Belajar Synchronous dan Ansynchronous Dalam Menghadapi Learning Loss. Bidayatuna Jurnal Pendidikan Guru Mandrasah Ibtidaiyah, 4(1), 123. https://doi.org/10.54471/bidayatuna.v4i1.1274.

Matukhin, D., & Zhitkova, E. (2015). Implementing Blended Learning Technology in Higher Professional Education. Procedia - Social and Behavioral Sciences, 206(November), 183–188. https://doi.org/10.1016/j.sbspro.2015.10.051.

Mimbs, B. P., Boley, B. B., Bowker, J. M., Woosnam, K. M., & Green, G. T. (2020). Importance-performance analysis of residents’ and tourists’ preferences for water-based recreation in the Southeastern United States. Journal of Outdoor Recreation and Tourism, 31, 100324. https://doi.org/10.1016/j.jort.2020.100324.

Misra, F., & Mazelfi, I. (2021). Long-Distance Online Learning During Pandemic: The Role of Communication, Working in Group, and Self- Directed Learning in Developing Student’s Confidence. Proceedings of the 3rd International Conference on Educational Development and Quality Assurance (ICED-QA 2020), 506, 225–234. https://doi.org/10.2991/assehr.k.210202.042.

Müller, C., & Mildenberger, T. (2021). Facilitating flexible learning by replacing classroom time with an online learning environment: A systematic review of blended learning in higher education. Educational Research Review, 34(June), 100394. https://doi.org/10.1016/j.edurev.2021.100394.

Nispi, F., Kurniawati, A., & Wulandari, L. (2023). Analysis of User Satisfaction Level on Study Abroad Guidance Website Using Customer Satisfaction Index ( CSI ) and Importance Performance Analysis ( IPA ) Methods. 8(3), 1–7. https://doi.org/https://doi.org/10.1016/j.jort.2020.100324.

Oliveira, G., Grenha Teixeira, J., Torres, A., & Morais, C. (2021). An exploratory study on the emergency remote education experience of higher education students and teachers during the COVID-19 pandemic. British Journal of Educational Technology, 52(4), 1357–1376. https://doi.org/10.1111/bjet.13112.

Purwanto, A., & Sudargini, Y. (2021). Partial Least Squares Structural Squation Modeling ( PLS-SEM ) Analysis for Social and Management Research : A Literature Review. Journal of Industrial Engineering & Management Research, 2(4), 114–123. https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3982764.

Putri, E., & Sari, F. M. (2020). Indonesian Efl Students’ Perspectives Towards Learning Management System Software. Journal of English Language Teaching and Learning, 1(1), 20–24. https://doi.org/10.33365/jeltl.v1i1.244.

Rasheed, R. A., Kamsin, A., & Abdullah, N. A. (2020). Computers & Education Challenges in the online component of blended learning : A systematic review. Computers & Education, 144(September 2019), 103701. https://doi.org/10.1016/j.compedu.2019.103701.

Sarkar, S., Sharma, S., & Raheja, S. (2021). Implementation of blended learning approach for improving anatomy lectures of phase i mbbs students – learner satisfaction survey. Advances in Medical Education and Practice, 12, 413–420. https://doi.org/10.2147/AMEP.S301634.

Schmid, M., Brianza, E., & Petko, D. (2020). Developing a short assessment instrument for Technological Pedagogical Content Knowledge (TPACK.xs) and comparing the factor structure of an integrative and a transformative model. Computers and Education, 157(June), 103967. https://doi.org/10.1016/j.compedu.2020.103967.

Sembiring, M. G. (2018). Validating student satisfaction with a blended learning scheme in Universitas Terbuka setting. International Journal of Mobile Learning and Organisation, 12(4), 394–413. https://doi.org/10.1504/IJMLO.2018.095166.

Sembiring, M. G., & Rahayu, G. (2020). Verifying the moderating role of satisfaction on service quality and students’ accomplishment in ODL perspective. Asian Association of Open Universities Journal, 15(1), 1–12. https://doi.org/10.1108/AAOUJ-08-2019-0035.

Sidik, W. A., Sunardi, & Supriyanto. (2019). Importance-Performance Analysis and Student Satisfaction Index on Laboratory Services in the Faculty Mathematics and Natural Sciences, Universitas Jenderal Soedirman. IOP Conference Series: Earth and Environmental Science, 255(1). https://doi.org/10.1088/1755-1315/255/1/012031.

Sperling, D. (2021). Ethical dilemmas, perceived risk, and motivation among nurses during the COVID-19 pandemic. Nursing Ethics, 28(1), 9–22. https://doi.org/10.1177/0969733020956376.

Torres-Gastelú, C. A., & Kiss, G. (2016). Perceptions of students towards ICT competencies at the University. Informatics in Education, 15(2), 319–338. https://doi.org/10.15388/infedu.2016.16.

Verdinelli, S., & Scagnoli, N. I. (2013). Data display in qualitative research. International Journal of Qualitative Methods, 12(1), 359–381. https://doi.org/10.1177/160940691301200117.

Wijaya, I. G. N. S., Triandini, E., Kabnani, E. T. G., & Arifin, S. (2021). E-commerce website service quality and customer loyalty using WebQual 4.0 with importance performances analysis, and structural equation model: An empirical study in shopee. Register: Jurnal Ilmiah Teknologi Sistem Informasi, 7(2), 107–124. https://doi.org/10.26594/register.v7i2.2266.

Xie, X., Siau, K., & Nah, F. F. H. (2020). COVID-19 pandemic–online education in the new normal and the next normal. Journal of Information Technology Case and Application Research, 22(3), 175–187. https://doi.org/10.1080/15228053.2020.1824884.

Yudatama, U., Hidayanto, A. N., Nazief, B. A. A., & Phusavat, K. (2019). Data to model the effect of awareness on the success of IT Governance implementation: A partial least squares structural equation modeling approach (PLS-SEM). Data in Brief, 25, 104333. https://doi.org/https://doi.org/10.1016/j.dib.2019.104333.

Zaato, S. G., Ismail, M., & Uthamaputhran, S. (2023). SmartPLS-SEM Analyses Approach in Validity and Reliability of Entrepreneurial Orientation , Social Capital and Government Support Policies on SMEs Performance Instrument. Journal of Critical Reviews, 44(5). https://www.jcreview.com/admin/Uploads/Files/61c89399d88cc4.27968962.pdf.

Zhang, Y. G., & Dang, M. Y. (2020). Understanding essential factors in influencing technology-supported learning: A model toward blended learning success. Journal of Information Technology Education: Research, 19, 489–510. https://doi.org/10.28945/4597.

Zuhairi, A., Karthikeyan, N., & Priyadarshana, S. T. (2019). Supporting students to succeed in open and distance learning in the Open University of Sri Lanka and Universitas Terbuka Indonesia. Asian Association of Open Universities Journal, 15(1), 13–35. https://doi.org/10.1108/AAOUJ-09-2019-0038/full/html.

Zuppo, C. M. (2012). Defining ICT in a Boundaryless World : The Development of a Working Hierarchy. International Journal of Managing Information Technology, 4(3), 13–22. https://doi.org/10.5121/ijmit.2012.4302.