Best Practices for Developing and Validating Scales for Health, Social, and Behavioral Research: A Primer
- PMID: 29942800
- PMCID: PMC6004510
- DOI: 10.3389/fpubh.2018.00149
Best Practices for Developing and Validating Scales for Health, Social, and Behavioral Research: A Primer
Abstract
Scale development and validation are critical to much of the work in the health, social, and behavioral sciences. However, the constellation of techniques required for scale development and evaluation can be onerous, jargon-filled, unfamiliar, and resource-intensive. Further, it is often not a part of graduate training. Therefore, our goal was to concisely review the process of scale development in as straightforward a manner as possible, both to facilitate the development of new, valid, and reliable scales, and to help improve existing ones. To do this, we have created a primer for best practices for scale development in measuring complex phenomena. This is not a systematic review, but rather the amalgamation of technical literature and lessons learned from our experiences spent creating or adapting a number of scales over the past several decades. We identified three phases that span nine steps. In the first phase, items are generated and the validity of their content is assessed. In the second phase, the scale is constructed. Steps in scale construction include pre-testing the questions, administering the survey, reducing the number of items, and understanding how many factors the scale captures. In the third phase, scale evaluation, the number of dimensions is tested, reliability is tested, and validity is assessed. We have also added examples of best practices to each step. In sum, this primer will equip both scientists and practitioners to understand the ontology and methodology of scale development and validation, thereby facilitating the advancement of our understanding of a range of health, social, and behavioral outcomes.
Keywords: content validity; factor analysis; item reduction; psychometric evaluation; scale development; tests of dimensionality; tests of reliability; tests of validity.
Figures
Similar articles
-
Psychometric properties of self-report concussion scales and checklists.J Athl Train. 2012 Mar-Apr;47(2):221-3. doi: 10.4085/1062-6050-47.2.221. J Athl Train. 2012. PMID: 22488289 Free PMC article.
-
Development and psychometric validation of the hospitalized older adults' dignity scale for measuring dignity during acute hospitalization.J Adv Nurs. 2023 Oct;79(10):4058-4073. doi: 10.1111/jan.15714. Epub 2023 May 24. J Adv Nurs. 2023. PMID: 37226570
-
The future of Cochrane Neonatal.Early Hum Dev. 2020 Nov;150:105191. doi: 10.1016/j.earlhumdev.2020.105191. Epub 2020 Sep 12. Early Hum Dev. 2020. PMID: 33036834
-
Development and initial validation of an instrument to measure physicians' use of, knowledge about, and attitudes toward computers.J Am Med Inform Assoc. 1998 Mar-Apr;5(2):164-76. doi: 10.1136/jamia.1998.0050164. J Am Med Inform Assoc. 1998. PMID: 9524349 Free PMC article. Review.
-
The measurement of collaboration within healthcare settings: a systematic review of measurement properties of instruments.JBI Database System Rev Implement Rep. 2016 Apr;14(4):138-97. doi: 10.11124/JBISRIR-2016-2159. JBI Database System Rev Implement Rep. 2016. PMID: 27532315 Review.
Cited by
-
Constructing a measure for self-perceived open organizational culture in a university hospital pharmacy.Front Med (Lausanne). 2024 Oct 16;11:1428941. doi: 10.3389/fmed.2024.1428941. eCollection 2024. Front Med (Lausanne). 2024. PMID: 39478817 Free PMC article.
-
Psychometric properties of the family assessment task parental monitoring scenario among adolescents receiving substance use treatment.J Subst Use Addict Treat. 2024 Mar;158:209232. doi: 10.1016/j.josat.2023.209232. Epub 2023 Dec 6. J Subst Use Addict Treat. 2024. PMID: 38061631
-
Development and Validation of an Educational Book on Self-Management in Inflammatory Bowel Disease Based on Patient Preferences and Expert Opinions: A Methodological Study.J Clin Med. 2023 Dec 13;12(24):7659. doi: 10.3390/jcm12247659. J Clin Med. 2023. PMID: 38137727 Free PMC article.
-
Australian adaptation and external validation of Commissioning for Quality in Rheumatoid Arthritis-RA-Patient Reported Experience Measure (CQRA-RA-PREM).Rheumatol Adv Pract. 2024 Aug 17;8(4):rkae099. doi: 10.1093/rap/rkae099. eCollection 2024. Rheumatol Adv Pract. 2024. PMID: 39376963 Free PMC article.
-
Development of a scale to measure selection, optimization, compensation (SOC) strategy in late middle-aged women: a methodological study.Womens Health Nurs. 2024 Sep;30(3):216-225. doi: 10.4069/whn.2024.08.10. Epub 2024 Sep 30. Womens Health Nurs. 2024. PMID: 39385548 Free PMC article.
References
-
- DeVellis RF. Scale Development: Theory and Application. Los Angeles, CA: Sage; Publications (2012).
-
- Raykov T, Marcoulides GA. Introduction to Psychometric Theory. New York, NY: Routledge, Taylor & Francis Group; (2011).
-
- Streiner DL, Norman GR, Cairney J. Health Measurement Scales: A Practical Guide to Their Development and Use. Oxford University Press; (2015).
-
- McCoach DB, Gable RK, Madura JP. Instrument Development in the Affective Domain. School and Corporate Applications, 3rd Edn. New York, NY: Springer; (2013).
Publication types
Grants and funding
LinkOut - more resources
Full Text Sources
Other Literature Sources
Miscellaneous