Document Type
Article
Publication Date
5-12-2026
Abstract
We aimed to statefully validate Retinopathy of Prematurity (ROP) grading by evaluating intergrader variability over age-matched simulated exams. In a prospective retinal photographic grading cohort study, both eyes of twenty patients with five images per eye per visit were graded by twelve expert graders across six weekly visits. For each eye visit, ROP experts graded the Zone, Stage, and Plus, from which the Telemedicine ROP Severity Score (tROP-SS) was calculated. Graders retained knowledge of prior assessments for a given eye and followed International Classification of ROP rules. Intergrader coefficient of variation (CoV) for Zone, Stage, Plus, and tROP-SS remained below 20% across six weeks of age-matched visits. Zone showed the most changes in CoV (p < 0.001) with a minimum at week three of 6.0% (95% CI: 3.0-8.9%). Stage (9.2-13.1%) did not significantly vary over time. CoV of Plus gradually increased (p = 0.002) from week 1 (1.2%, 95% CI: 0.3-2.0%) to week 6 (3.3%, 95% CI: 1.7-4.9%). Agreement for tROP-SS varied over time (p < 0.001) and reached a local minimum at week three (10.5%, 95% CI: 7.3-13.8%). High intergrader agreement in a stateful data set validates the use of tROP-SS as a scoring system to capture week-to-week ROP progression.
Recommended Citation
Pratt, Harrison W.; Shah, Sarthak V.; Zhao, Cindy S.; Brant, Arthur R.; Baumal, Caroline R.; Besirli, Cagri G.; Berrocal, Audina M.; Drenser, Kimberley A.; Ells, Anna L.; Harper, Clio Armitage; Hubbard, G. Baker; Nudleman, Eric D.; Quiram, Polly; Tsui, Irena; Wood, Edward; Yonekawa, Yoshihiro; Rosenblatt, Tatiana; Kumm, Jochen; and Moshfeghi, Darius M., "Multi-Grader Validation of the Telemedicine Retinopathy of Prematurity Severity Score" (2026). Wills Eye Hospital Papers. Paper 306.
https://jdc.jefferson.edu/willsfp/306
Creative Commons License

This work is licensed under a Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 License.
PubMed ID
42120460
Language
English
Included in
Congenital, Hereditary, and Neonatal Diseases and Abnormalities Commons, Eye Diseases Commons, Investigative Techniques Commons, Ophthalmology Commons

Comments
This article is the author’s final published version in Scientific Reports, Volume 16, Issue 1, 2026, Article number 21740.
The published version is available at https://doi.org/10.1038/s41598-026-51824-0. Copyright © The Author(s) 2026.