Differential item functioning analysis on UCLA Loneliness Scale 8 using Rasch model

Dito Aryo Prabowo

doi:10.58959/cjss.v2i1.18

Authors

Dito Aryo Prabowo Faculty of Psychology, Universitas Diponegoro

DOI:

https://doi.org/10.58959/cjss.v2i1.18

Keywords:

Loneliness, UCLA Loneliness Scale 8, Differential item functioning, Rasch Model

Abstract

Background: Loneliness measurement is profound to assess inidividuals in enforced social isolation from government due to the COVID-19 pandemic. Major scales including UCLA Loneliness Scale 8 or ULS-8 have been employed for this reason. However, comprehensive validation study, including differential item functioning (DIF) to sought different estimation between groups are seldomly studied in adaptation study. Study aims: This study aims to analyze DIF of ULS-8 using Rasch model detection method. Method: 1500 Indonesian respondents data were obtained with online questionnaire inspecting three different subgroups; age group (young and middle adult age group), gender (male and female), and marital statuses (married or not married). Result and Conclusion: Based on probability (p < .05) and t-value higher than 2 (|t|>2), it was found that one item was different significantly in age group comparison, two items were differed in gender subgroup, and no DIF detected in marital statuses subgroup.

References

Beutel, M. E., Klein, E. M., Brähler, E., Reiner, I., Jünger, C., Michal, M., Wiltink, J., Wild, P. S., Münzel, T., Lackner, K. J., & Tibubos, A. N. (2017). Loneliness in the general population: Prevalence, determinants and relations to mental health. BMC Psychiatry, 17(1). https://doi.org/10.1186/s12888-017-1262-x

Cecilio-Fernandes, D., Medema, H., Collares, C. F., Schuwirth, L., Cohen-Schotanus, J., & Tio, R. A. (2017). Comparison of formula and number-right scoring in undergraduate medical training: a Rasch model analysis. BMC Medical Education, 17(1), 192. https://doi.org/10.1186/s12909-017-1051-8

Fathoni, A. B., & Listiyandini, R. A. (2021). KEBERSYUKURAN, KESEPIAN, DAN DISTRES PSIKOLOGIS PADA MAHASISWA DI MASA PANDEMI COVID-19. Journal of Psychological Science and Profession, 5(1), 11–19. https://doi.org/10.24198/jpsp.v5i1.29212

Franssen, T., Stijnen, M., Hamers, F., & Schneider, F. (2020). Age differences in demographic, social and health-related factors associated with loneliness across the adult life span (19–65 years): a cross-sectional study in the Netherlands. BMC Public Health, 20(1), 1118. https://doi.org/10.1186/s12889-020-09208-0

Gómez-Benito, J., Sireci, S., Padilla, J. L., Dolores Hidalgo, M., & Benítez, I. (2018). Differential item functioning: Beyond validity evidence based on internal structure. Psicothema, 30(1). https://doi.org/10.7334/psicothema2017.183

Gonzalez-de Paz, L., Kostov, B., Lopez-Pina, J. A., Solans-Julian, P., Navarro-Rubio, M. D., & Siso-Almirall, A. (2015). A Rasch analysis of patients’ opinions of primary health care professionals’ ethical behaviour with respect to communication issues. Family Practice, 32(2), 237–243. https://doi.org/10.1093/fampra/cmu073

Hays, R. D., & Dimatteo, M. R. (1987). A Short-Form Measure of Loneliness. Journal of Personality Assessment, 51(1). https://doi.org/10.1207/s15327752jpa5101_6

Holster, T. A., & Lake, J. (2016). Guessing and the Rasch Model. In Language Assessment Quarterly (Vol. 13, Issue 2). https://doi.org/10.1080/15434303.2016.1160096

Karami, H. (2012). An Introduction to Differential Item Functioning. The International Journal of Eductional and Psychological Assessment, 11(2).

Kumar, R. (2011). Research methodology : a step-by-step guide for beginners / Ranjit Kumar (3rd ed.). SAGE.

Linacre, J. M. (2011). A User’s Guide to Winsteps Ministep Rasch-Model Computer Programs. Winsteps.

Martinková, P., Drabinová, A., Liaw, Y.-L., Sanders, E. A., McFarland, J. L., & Price, R. M. (2017). Checking Equity: Why Differential Item Functioning Analysis Should Be a Routine Part of Developing Conceptual Assessments. CBE—Life Sciences Education, 16(2), rm2. https://doi.org/10.1187/cbe.16-10-0307

Office for National Statistics. (2018). Measuring loneliness : Guidance for use of the national indicators on surveys. In Office for National Statistics.

Papalia, D., & Martorell, G. (2013). Experience Human Development. In Journal of Chemical Information and Modeling (Vol. 53, Issue 9).

Rahayah Ariffin, S., Omar, B., Isa, A., & Sharif, S. (2010). Validity and reliability Multiple Intelligent item using Rasch measurement model. Procedia - Social and Behavioral Sciences, 9. https://doi.org/10.1016/j.sbspro.2010.12.225

Sagita, D. D., & Hermawan, D. (2020). Kesepian Remaja Pada Masa Pandemi COVID-19. ENLIGHTEN (Jurnal Bimbingan Dan Konseling Islam), 3(2), 122–130. https://doi.org/10.32505/enlighten.v3i2.1892

Sari, D. P., & Hamidah, H. (2021). Hubungan antara Kecemasan dan Kesepian dengan Insomnia pada Lansia. Buletin Riset Psikologi Dan Kesehatan Mental (BRPKM), 1(1), 595. https://doi.org/10.20473/brpkm.v1i1.26779

Sugianto, N. F. (2020). Pengaruh disregulasi emosi, kesepian, dan religiusitas terhadap perilaku self-injury pada remaja. State Islamic University Syarif Hidayatullah Jakarta.

Swami, V. (2009). Psychometric analysis of the Malay version of the UCLA Loneliness Scale (ULS-8) and a comparison of loneliness among sojourning and non-sojourning Malaysian students. International Journal of Culture and Mental Health, 2(1). https://doi.org/10.1080/17542860802560397

Virdhani, M. H. (2020, October 20). Separo Masyarakat yang Datang ke Psikolog Merasa Kesepian saat Pandemi. Jawa Pos. https://www.jawapos.com/kesehatan/20/10/2020/separo-masyarakat-yang-datang-ke-psikolog-merasa-kesepian-saat-pandemi/

Wu, C. huei, & Yao, G. (2008). Psychometric analysis of the short-form UCLA Loneliness Scale (ULS-8) in Taiwanese undergraduate students. Personality and Individual Differences, 44(8). https://doi.org/10.1016/j.paid.2008.02.003

Xu, S., Qiu, D., Hahne, J., Zhao, M., & Hu, M. (2018). Psychometric properties of the short-form UCLA Loneliness Scale (ULS-8) among Chinese adolescents. Medicine, 97(38), e12373. https://doi.org/10.1097/MD.0000000000012373

Yanguas, J., Pinazo-Henandis, S., & Tarazona-Santabalbina, F. J. (2018). The complexity of loneliness. In Acta Biomedica (Vol. 89, Issue 2). https://doi.org/10.23750/abm.v89i2.7404

Yildiz, M. A., & Duy, B. (2014). Adaptation of the short-form of the UCLA loneliness scale (ULS-8) to turkish for the adolescents. Dusunen Adam, 27(3). https://doi.org/10.5350/DAJPN2014270302