- Surveys & Programs
- Data & Tools
- Fast Facts
- News & Events
- Publications & Products
- About Us
Technical Documentation
Technical Documentation is written for researchers and assumes knowledge of educational measurement and testing. Since 1969, NAEP has continued to evolve in its technical approaches, processes, and methodology to ensure a representative accurate, and robust assessment of our nation's student achievement. To review the contents available, click on the tabs below or use the "Table of Contents" link above. From the Table of Contents, you can select, compile, and print. To print pages, click the printer-friendly version link.
Instruments
Transition to Digital Administration Testing Instruments
NCES has explored the transition to digital administration since the late 1990s to reflect the growing use of technology in education. A variety of new question and task types have been administered in the NAEP assessments to capture student achievement in more authentic or direct ways. In 2017, the NAEP program officially transitioned from paper-based assessments to digitally based assessments in mathematics and reading.
Sample Design
Ensuring Student Representation: Probability Sample Design
Since 1969, NCES has created and refined an assessment sampling plan to ensure the reporting of representative student samples at the national, state, and district level without requiring participation from every student in every school. From an early concept of matrix sampling to the present use of probability sample design, the NAEP sample design ensures representative sampling of the nation’s students.
Data Collection
Data Collection: Transitioning from Print to Digital Assessments
NAEP data collection requires the highest levels of consistency and accuracy. The reliability of NAEP results include a standardization of field procedures, a test environment without distractions, testing accommodations, robust quality control, and protecting testing materials and student information. In 2018, NAEP began providing specialized digital assessment data collection teams for national-year assessments.
Processing Materials
Coordination of Logistics and Process to Ensure Successful Assessment
In each assessment cycle, NAEP materials must be printed, packaged, distributed, received, and processed, test materials must be delivered to schools for the paper-based (PBA) and digitally based (DBA) NAEP assessments. Since 2017, this process began transitioning to support the loading, shipment, distribution, and collection of digitally based assessments on tablets.
Scoring
From High-Speed Scanners to Electronic Image-Processing Scoring Systems
NCES has moved from using high-speed scanners for processing student booklet at paper-based assessments to processing scores electronically at digitally based assessments for test items that do not need human scoring.
Database
Comprehensive Database Facilitates NAEP Data Analysis
Before the analysis of NAEP assessment data can be performed, the data must be integrated into a coherent and comprehensive database. The NAEP database contains not only responses to cognitive test items but also responses that relate to or describe students or students’ characteristics collected from students, teachers, and school administrators.
Weighting
Statistically Weighting Assessment Responses to Ensure Representation of NAEP Results
Before the data are analyzed, sampled groups of students are statistically weighted to ensure that their representation in NAEP results parallel the actual percentage of the school population for major reporting groups in the grades assessed. Weighting of sampled students ensures NAEP results are representative of the performance of the student population.
Analysis and Scaling
Analysis of Data To Produce Comprehensive, Accurate, and Timely Reporting of Assessment Results
The primary goal of the analysis of NAEP data is to summarize the performance of groups of students. NAEP analysis consists of initial activities such as the calculation of summary statistics for contextual variables and classical test statistics, scaling activities using item response theory, and estimation of population and student group distributions.
NAEP Style Guide
The look and feel of the NAEP DBAs is informed by the NAEP Style Guide, which helps ensure that students have parallel visual experiences across assessment administrations. The style guide is interactive, open sourced, and available to the public.
LEARN MORELast updated 01 May 2024 (AA)
