0
We're unable to sign you in at this time. Please try again in a few minutes.
Retry
We were able to sign you in, but your subscription(s) could not be found. Please try again in a few minutes.
Retry
There may be a problem with your account. Please contact the AMA Service Center to resolve this issue.
Contact the AMA Service Center:
Telephone: 1 (800) 262-2350 or 1 (312) 670-7827  *   Email: subscriptions@jamanetwork.com
Error Message ......
Research Letters |

Plus Disease in Retinopathy of Prematurity: Quantitative Analysis of Standard Published Photograph FREE

Susan K. Gelman, MD; Rony Gelman, MD; Alison B. Callahan, MD; M. Elena Martinez-Perez, PhD; Daniel S. Casper, MD, PhD; John T. Flynn, MD; Michael F. Chiang, MD
[+] Author Affiliations

Author Affiliations: Departments of Ophthalmology (Drs S. K. Gelman, R. Gelman, Callahan, Casper, Flynn, and Chiang) and Biomedical Informatics (Dr Chiang), Columbia University College of Physicians and Surgeons, New York, New York; and Department of Computer Science, Institute of Research in Applied Mathematics and Systems, National Autonomous University of Mexico, Mexico City, Mexico (Dr Martinez-Perez).


Arch Ophthalmol. 2010;128(9):1217-1220. doi:10.1001/archophthalmol.2010.186.
Text Size: A A A
Published online

Plus disease is defined as abnormality of the posterior retinal vessels in which the arterial tortuosity and venous dilation meet or exceed those of a standard photograph selected by expert consensus in the 1980s.1,2 This method has limitations, and studies have suggested that interexpert agreement in plus disease diagnosis is variable.3 Magnification of the standard photograph is larger than that of indirect ophthalmoscopy, and peripheral vessels are not visible in the narrow field of view. It is also unclear which vessels clinicians should focus on while evaluating tortuosity and dilation. This study seeks to quantify vascular characteristics of the standard photograph compared with expert interpretations of plus disease. Such data could help assess clinical applicability of the standard photograph and contribute to development of objective disease definitions based on quantitative principles.

Thirty-four wide-angle retinal images were interpreted by 22 retinopathy of prematurity experts for presence of plus disease.3 For each wide-angle image, a reference standard diagnosis (plus disease or not plus disease) was defined using majority vote among experts.

Vessels from wide-angle images and from the standard photograph1 were analyzed by a computer-based system to calculate the mean arterial tortuosity index (ATI) (length of vessel segment divided by length of straight line connecting vessel ends) and the venous diameter (VD) (area divided by length of vessel) among all vessels in each image as described previously.4,5 Because ATI is a ratio, it is independent of magnification and resolution. However, comparison of VD values among different images required adjustments for magnification differences. This was done by normalizing all optic disc diameters to 1015 μm based on prior literature.6

Sensitivity and specificity of the computer-based system for detecting plus disease were plotted as a function of cutoff values of ATI and VD that were used to separate plus disease from not plus disease (Figure 1) based on this reference standard. For example, the number of missed cases of plus disease (ie, false-negatives) would be expected to increase as the cutoff value of ATI (or VD) increases; therefore, sensitivity decreases as ATI (or VD) increases.

Place holder to copy figure label and caption
Figure 1.

Sensitivity and specificity of plus disease diagnosis based on quantitative parameters of the standard published photograph. A, Arterial tortuosity index (ATI). B, Venous diameter (VD). Solid curves display sensitivity and dashed curves display specificity of plus disease diagnosis as a function of the quantitative parameter value, compared with the reference standard of majority vote among 22 retinopathy of prematurity experts. Vertical lines denote the parameter values from the standard published photograph and corresponding sensitivity and specificity based on expert opinions.

Graphic Jump Location

The mean ATI of the standard photograph was 1.15, which was significantly lower than the ATI in wide-angle images that were diagnosed as plus disease (mean, 1.26; P = .003) and not plus disease (mean, 1.19; P = .001). The mean VD of the standard photograph was 66.88 μm, which was significantly lower than both plus disease in wide-angle images (mean, 81.63 μm; P = .002) and not plus disease in wide-angle images (mean, 78.95 μm; P < .001).

If the standard photograph parameter values were used as the cutoff for plus disease, the mean ATI of 1.15 would result in 85% sensitivity and 38% specificity, while the mean VD of 66.88 μm would result in 85% sensitivity and 14% specificity (Figure 1).

Anecdotally, we feel that some experts regard the standard photograph as showing plus disease appearing more severe than their personal cutoffs for plus disease. This is inconsistent with findings from our study. To investigate, we compared the standard photograph with representative examples from 34 wide-angle images. This confirmed that the ATI in the standard photograph did appear low and suggested that after adjusting for magnification, the VD appeared visually similar to that seen in several wide-angle images diagnosed as not plus disease by experts (Figure 2). Therefore, we feel a possible explanation is that magnification and field of view in the standard photograph may cause difficulty for ophthalmologists.

Place holder to copy figure label and caption
Figure 2.

Representative images demonstrating the spectrum of quantitative vascular characteristics in the study images. A, Arterial tortuosity index (ATI) of all analyzed arteries. Image I had a mean ATI of 1.09 and was classified as not plus disease by expert reference standard. Image II had a mean ATI of 1.15 and is the standard photograph. Image III had a mean ATI of 1.15 and was classified as not plus disease. Image IV had a mean ATI of 1.48 and was classified as plus disease. B, Venous diameter (VD) of all analyzed veins. Image I had a mean VD of 57 μm and was classified as not plus disease by expert reference standard. Image II had a mean VD of 67 μm and is the standard photograph. Image III had a mean VD of 79 μm and was classified as not plus disease. Image IV had a mean VD of 82 μm and was classified as plus disease.

Graphic Jump Location

A study limitation is that it was often difficult to identify precise disc margins during image normalization (although a consensus was reached among us), and infants may have true differences in disc size. Also, tortuosity as defined in this study was a gross measure, and future research involving other metrics for calculating tortuosity may be warranted.

These findings suggest that using the standard photograph as the cutoff definition for plus disease results in high sensitivity and low specificity compared with expert diagnoses from an independent set of wide-angle images. In other words, arterial tortuosity and venous dilation in the standard photograph may be less severe than what experts are considering to be plus disease. This raises questions about whether the current published photograph requires modification to represent true expert opinion or whether strategies are required to recalibrate ophthalmologists to the standard photograph.

ARTICLE INFORMATION

Correspondence: Dr Chiang, Columbia University College of Physicians and Surgeons, 635 W 165th St, Box 92, New York, NY 10032 (chiang@dbmi.columbia.edu).

Financial Disclosure: None reported.

Funding/Support: This work was supported by a Career Development Award from Research to Prevent Blindness and by grant EY13972 from the National Eye Institute, National Institutes of Health (Dr Chiang).

Role of the Sponsors: The sponsors had no role in the design and conduct of the study; in the collection, analysis, and interpretation of the data; or in the preparation, review, or approval of the manuscript.

Additional Information: Dr Chiang is an unpaid member of the scientific advisory board for Clarity Medical Systems, Pleasanton, California.

Additional Contributions: Earl Palmer, MD, provided a digital copy of the standard photograph.

Cryotherapy for Retinopathy of Prematurity Cooperative Group, Multicenter trial of cryotherapy for retinopathy of prematurity: preliminary results. Arch Ophthalmol 1988;106 (4) 471- 479
PubMed Link to Article
International Committee for the Classification of Retinopathy of Prematurity, The International Classification of Retinopathy of Prematurity revisited. Arch Ophthalmol 2005;123 (7) 991- 999
PubMed Link to Article
Chiang  MFJiang  LGelman  RDu  YEFlynn  JT Interexpert agreement of plus disease diagnosis in retinopathy of prematurity. Arch Ophthalmol 2007;125 (7) 875- 880
PubMed Link to Article
Gelman  RMartinez-Perez  MEVanderveen  DKMoskowitz  AFulton  AB Diagnosis of plus disease in retinopathy of prematurity using Retinal Image multiScale Analysis. Invest Ophthalmol Vis Sci 2005;46 (12) 4734- 4738
PubMed Link to Article
Gelman  RJiang  LDu  YEMartinez-Perez  MEFlynn  JTChiang  MF Plus disease in retinopathy of prematurity: pilot study of computer-based and expert diagnosis. J AAPOS 2007;11 (6) 532- 540
PubMed Link to Article
Rimmer  SKeating  CChou  T  et al.  Growth of the human optic disk and nerve during gestation, childhood, and early adulthood. Am J Ophthalmol 1993;116 (6) 748- 753
PubMed

Figures

Place holder to copy figure label and caption
Figure 1.

Sensitivity and specificity of plus disease diagnosis based on quantitative parameters of the standard published photograph. A, Arterial tortuosity index (ATI). B, Venous diameter (VD). Solid curves display sensitivity and dashed curves display specificity of plus disease diagnosis as a function of the quantitative parameter value, compared with the reference standard of majority vote among 22 retinopathy of prematurity experts. Vertical lines denote the parameter values from the standard published photograph and corresponding sensitivity and specificity based on expert opinions.

Graphic Jump Location
Place holder to copy figure label and caption
Figure 2.

Representative images demonstrating the spectrum of quantitative vascular characteristics in the study images. A, Arterial tortuosity index (ATI) of all analyzed arteries. Image I had a mean ATI of 1.09 and was classified as not plus disease by expert reference standard. Image II had a mean ATI of 1.15 and is the standard photograph. Image III had a mean ATI of 1.15 and was classified as not plus disease. Image IV had a mean ATI of 1.48 and was classified as plus disease. B, Venous diameter (VD) of all analyzed veins. Image I had a mean VD of 57 μm and was classified as not plus disease by expert reference standard. Image II had a mean VD of 67 μm and is the standard photograph. Image III had a mean VD of 79 μm and was classified as not plus disease. Image IV had a mean VD of 82 μm and was classified as plus disease.

Graphic Jump Location

Tables

References

Cryotherapy for Retinopathy of Prematurity Cooperative Group, Multicenter trial of cryotherapy for retinopathy of prematurity: preliminary results. Arch Ophthalmol 1988;106 (4) 471- 479
PubMed Link to Article
International Committee for the Classification of Retinopathy of Prematurity, The International Classification of Retinopathy of Prematurity revisited. Arch Ophthalmol 2005;123 (7) 991- 999
PubMed Link to Article
Chiang  MFJiang  LGelman  RDu  YEFlynn  JT Interexpert agreement of plus disease diagnosis in retinopathy of prematurity. Arch Ophthalmol 2007;125 (7) 875- 880
PubMed Link to Article
Gelman  RMartinez-Perez  MEVanderveen  DKMoskowitz  AFulton  AB Diagnosis of plus disease in retinopathy of prematurity using Retinal Image multiScale Analysis. Invest Ophthalmol Vis Sci 2005;46 (12) 4734- 4738
PubMed Link to Article
Gelman  RJiang  LDu  YEMartinez-Perez  MEFlynn  JTChiang  MF Plus disease in retinopathy of prematurity: pilot study of computer-based and expert diagnosis. J AAPOS 2007;11 (6) 532- 540
PubMed Link to Article
Rimmer  SKeating  CChou  T  et al.  Growth of the human optic disk and nerve during gestation, childhood, and early adulthood. Am J Ophthalmol 1993;116 (6) 748- 753
PubMed

Correspondence

CME
Also Meets CME requirements for:
Browse CME for all U.S. States
Accreditation Information
The American Medical Association is accredited by the Accreditation Council for Continuing Medical Education to provide continuing medical education for physicians. The AMA designates this journal-based CME activity for a maximum of 1 AMA PRA Category 1 CreditTM per course. Physicians should claim only the credit commensurate with the extent of their participation in the activity. Physicians who complete the CME course and score at least 80% correct on the quiz are eligible for AMA PRA Category 1 CreditTM.
Note: You must get at least of the answers correct to pass this quiz.
Please click the checkbox indicating that you have read the full article in order to submit your answers.
Your answers have been saved for later.
You have not filled in all the answers to complete this quiz
The following questions were not answered:
Sorry, you have unsuccessfully completed this CME quiz with a score of
The following questions were not answered correctly:
Commitment to Change (optional):
Indicate what change(s) you will implement in your practice, if any, based on this CME course.
Your quiz results:
The filled radio buttons indicate your responses. The preferred responses are highlighted
For CME Course: A Proposed Model for Initial Assessment and Management of Acute Heart Failure Syndromes
Indicate what changes(s) you will implement in your practice, if any, based on this CME course.

Multimedia

Some tools below are only available to our subscribers or users with an online account.

714 Views
8 Citations
×

Related Content

Customize your page view by dragging & repositioning the boxes below.

Articles Related By Topic
Related Collections
PubMed Articles
Jobs