Validation of the Sleep-Wake Scoring of a New Wrist-Worn Sleep Monitoring Device
- PMID: 29852899
- PMCID: PMC5991960
- DOI: 10.5664/jcsm.7180
Validation of the Sleep-Wake Scoring of a New Wrist-Worn Sleep Monitoring Device
Abstract
Study objectives: To test the sleep-wake scoring reliability of a new wrist-worn sleep monitoring device.
Methods: Twenty-seven adult good sleepers underwent 1 night of polysomnography (PSG) while wearing both the new device (myCadian [MC]; CurAegis Technologies, Rochester, New York, United States) and commercially available actigraphy (Actiwatch 2 [AW]; Philips Respironics, Murrysville, Pennsylvania, United States) on their nondominant wrist. PSG tests were manually stage scored. After excluding missing data, 20 participants had full-night data on all three devices with 17,734 total 30-second epochs. Using PSG as the gold standard, pooled epoch-by-epoch agreement for sleep and wake was calculated for each device using percent agreement and Cohen kappa statistic. Positive predictive values for both sleep and wake epochs, as well as sleep continuity statistics, were calculated.
Results: Percent agreement with PSG-scored wake and sleep was 91.3% for MC (kappa = 0.67) and 87.7% for AW (kappa = 0.50). Positive predictive values for sleep epochs were 94.4% and 90.8% for MC and AW, respectively, and 74.5% and 65.6% for wake. Both devices underestimated wake and overestimated sleep compared to PSG. Descriptively, compared to PSG, sleep latency was higher with MC and wake after sleep onset higher with AW. Total sleep time and sleep efficiency were more similar across devices.
Conclusions: The kappa statistic for MC is consistent with a high level of agreement with PSG. Overall, the reliability of MC compared to PSG scoring was slightly more favorable than that of AW. Findings suggest that MC provides reliable sleep-wake scoring during a nocturnal sleep period for good sleepers.
Keywords: actigraphy; polysomnography; reliability; sleep-wake scoring; validation; wearable device.
© 2018 American Academy of Sleep Medicine.
Similar articles
-
Improving Sleep Quality Assessment Using Wearable Sensors by Including Information From Postural/Sleep Position Changes and Body Acceleration: A Comparison of Chest-Worn Sensors, Wrist Actigraphy, and Polysomnography.J Clin Sleep Med. 2017 Nov 15;13(11):1301-1310. doi: 10.5664/jcsm.6802. J Clin Sleep Med. 2017. PMID: 28992827 Free PMC article.
-
Utility of the Fitbit Flex to evaluate sleep in major depressive disorder: A comparison against polysomnography and wrist-worn actigraphy.J Affect Disord. 2017 Aug 1;217:299-305. doi: 10.1016/j.jad.2017.04.030. Epub 2017 Apr 19. J Affect Disord. 2017. PMID: 28448949 Free PMC article.
-
The Validity of a New Consumer-Targeted Wrist Device in Sleep Measurement: An Overnight Comparison Against Polysomnography in Children and Adolescents.J Clin Sleep Med. 2018 Apr 15;14(4):585-591. doi: 10.5664/jcsm.7050. J Clin Sleep Med. 2018. PMID: 29609722 Free PMC article.
-
Effectiveness of Portable Monitoring Devices for Diagnosing Obstructive Sleep Apnea: Update of a Systematic Review [Internet].Rockville (MD): Agency for Healthcare Research and Quality (US); 2004 Sep 1. Rockville (MD): Agency for Healthcare Research and Quality (US); 2004 Sep 1. PMID: 26065047 Free Books & Documents. Review.
-
The Visual Scoring of Sleep in Infants 0 to 2 Months of Age.J Clin Sleep Med. 2016 Mar;12(3):429-45. doi: 10.5664/jcsm.5600. J Clin Sleep Med. 2016. PMID: 26951412 Free PMC article. Review.
Cited by
-
Evaluating reliability in wearable devices for sleep staging.NPJ Digit Med. 2024 Mar 18;7(1):74. doi: 10.1038/s41746-024-01016-9. NPJ Digit Med. 2024. PMID: 38499793 Free PMC article. Review.
-
Comparison of sleep parameters from wrist-worn ActiGraph and Actiwatch devices.Sleep. 2024 Feb 8;47(2):zsad155. doi: 10.1093/sleep/zsad155. Sleep. 2024. PMID: 37257489 Free PMC article.
-
Creating an algorithm to identify indices of sleep quantity and quality from a wearable armband in adults.Sleep Sci. 2022 Jul-Sep;15(3):279-287. doi: 10.5935/1984-0063.20220052. Sleep Sci. 2022. PMID: 36158722 Free PMC article.
-
Sleep Measurement Using Wrist-Worn Accelerometer Data Compared with Polysomnography.Sensors (Basel). 2022 Jul 4;22(13):5041. doi: 10.3390/s22135041. Sensors (Basel). 2022. PMID: 35808535 Free PMC article.
-
Measurement Methods of Fatigue, Sleepiness, and Sleep Behaviour Aboard Ships: A Systematic Review.Int J Environ Res Public Health. 2021 Dec 23;19(1):120. doi: 10.3390/ijerph19010120. Int J Environ Res Public Health. 2021. PMID: 35010383 Free PMC article. Review.
References
-
- Ancoli-Israel S, Martin JL, Blackwell T, et al. The SBSM guide to actigraphy monitoring: clinical and research applications. Behav Sleep Med. 2015;13(sup1):S4–S38. - PubMed
-
- Silber MH, Ancoli-Israel S, Bonnet MH, et al. The visual scoring of sleep in adults. J Clin Sleep Med. 2007;3(2):121–131. - PubMed
-
- Mullaney DJ, Kripke DF, Messin S. Wrist-actigraphic estimation of sleep time. Sleep. 1980;3(1):83–92. - PubMed
-
- Hauri P, Wisbey J. Wrist actigraphy in insomnia. Sleep. 1992;15(4):293–300. - PubMed
-
- Sadeh A, Acebo C. The role of actigraphy in sleep medicine. Sleep Med Rev. 2002;6(2):113–124. - PubMed
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Other Literature Sources