The future of outcomes measurement: item banking, tailored short-forms, and computerized adaptive assessment
- PMID: 17401637
- DOI: 10.1007/s11136-007-9204-6
The future of outcomes measurement: item banking, tailored short-forms, and computerized adaptive assessment
Abstract
The use of item banks and computerized adaptive testing (CAT) begins with clear definitions of important outcomes, and references those definitions to specific questions gathered into large and well-studied pools, or "banks" of items. Items can be selected from the bank to form customized short scales, or can be administered in a sequence and length determined by a computer programmed for precision and clinical relevance. Although far from perfect, such item banks can form a common definition and understanding of human symptoms and functional problems such as fatigue, pain, depression, mobility, social function, sensory function, and many other health concepts that we can only measure by asking people directly. The support of the National Institutes of Health (NIH), as witnessed by its cooperative agreement with measurement experts through the NIH Roadmap Initiative known as PROMIS (www.nihpromis.org), is a big step in that direction. Our approach to item banking and CAT is practical; as focused on application as it is on science or theory. From a practical perspective, we frequently must decide whether to re-write and retest an item, add more items to fill gaps (often at the ceiling of the measure), re-test a bank after some modifications, or split up a bank into units that are more unidimensional, yet less clinically relevant or complete. These decisions are not easy, and yet they are rarely unforgiving. We encourage people to build practical tools that are capable of producing multiple short form measures and CAT administrations from common banks, and to further our understanding of these banks with various clinical populations and ages, so that with time the scores that emerge from these many activities begin to have not only a common metric and range, but a shared meaning and understanding across users. In this paper, we provide an overview of item banking and CAT, discuss our approach to item banking and its byproducts, describe testing options, discuss an example of CAT for fatigue, and discuss models for long term sustainability of an entity such as PROMIS. Some barriers to success include limitations in the methods themselves, controversies and disagreements across approaches, and end-user reluctance to move away from the familiar.
Similar articles
-
Developing tailored instruments: item banking and computerized adaptive assessment.Qual Life Res. 2007;16 Suppl 1:95-108. doi: 10.1007/s11136-007-9168-6. Epub 2007 Feb 15. Qual Life Res. 2007. PMID: 17530450
-
The promise of PROMIS: using item response theory to improve assessment of patient-reported outcomes.Clin Exp Rheumatol. 2005 Sep-Oct;23(5 Suppl 39):S53-7. Clin Exp Rheumatol. 2005. PMID: 16273785
-
Item response theory, computerized adaptive testing, and PROMIS: assessment of physical function.J Rheumatol. 2014 Jan;41(1):153-8. doi: 10.3899/jrheum.130813. Epub 2013 Nov 15. J Rheumatol. 2014. PMID: 24241485
-
Item banking: a generational change in patient-reported outcome measurement.Optom Vis Sci. 2010 Apr;87(4):285-93. doi: 10.1097/OPX.0b013e3181d408d7. Optom Vis Sci. 2010. PMID: 20142792 Review.
-
Item banks and their potential applications to health status assessment in diverse populations.Med Care. 2006 Nov;44(11 Suppl 3):S189-97. doi: 10.1097/01.mlr.0000245145.21869.5b. Med Care. 2006. PMID: 17060827 Review.
Cited by
-
Dutch-Flemish translation of nine pediatric item banks from the Patient-Reported Outcomes Measurement Information System (PROMIS)®.Qual Life Res. 2016 Mar;25(3):761-5. doi: 10.1007/s11136-015-0966-y. Epub 2015 Mar 28. Qual Life Res. 2016. PMID: 25820548 Free PMC article.
-
Contributions of physical function and satisfaction with social roles to emotional distress in chronic pain: a Collaborative Health Outcomes Information Registry (CHOIR) study.Pain. 2015 Dec;156(12):2627-2633. doi: 10.1097/j.pain.0000000000000313. Pain. 2015. PMID: 26230739 Free PMC article.
-
Collecting, Integrating, and Disseminating Patient-Reported Outcomes for Research in a Learning Healthcare System.EGEMS (Wash DC). 2016 Jul 7;4(1):1240. doi: 10.13063/2327-9214.1240. eCollection 2016. EGEMS (Wash DC). 2016. PMID: 27563683 Free PMC article.
-
Pragmatic characteristics of patient-reported outcome measures are important for use in clinical practice.J Clin Epidemiol. 2015 Sep;68(9):1085-92. doi: 10.1016/j.jclinepi.2015.03.023. Epub 2015 Apr 11. J Clin Epidemiol. 2015. PMID: 25962972 Free PMC article. Review.
-
Emotional support from social media and face-to-face relationships: Associations with depression risk among young adults.J Affect Disord. 2020 Jan 1;260:38-44. doi: 10.1016/j.jad.2019.08.092. Epub 2019 Aug 29. J Affect Disord. 2020. PMID: 31493637 Free PMC article.
References
MeSH terms
LinkOut - more resources
Full Text Sources
Miscellaneous