FDT Visual Field Simulation Results using Barramundi

A. Turpin, A.M. McKendrick, C.A. Johnson, and A.J. Vingrys.

This site accompanies the paper "Development of efficient threshold strategies for Frequency Doubling Technology perimetry using computer simulation". Invest Ophthalmol Vis Sci 43, Jan 2002. Pages 308-313.

Introduction

This www page details results of experiments simulating the performance of the MOBS and ZEST visual field algorithms in normal and glaucomatous patients for Frequency Doubling Technology Perimetry. It is a detailed list of our simulation of 1080 test procedures on 6 groups of patients, and 3 artificial patients. A first time reader is referred to a much more accessible summary of the main results that have been published as...

The simulations were carried out using Barramundi, software written in Java by Andrew Turpin while working as a postdoc at Discoveries In Sight, Portland, OR.

Barramundi has also been used to simulate SWAP (blue-on-yellow) and SAP (white-on-white) perimetry, but those results are not reported here.

Methods

Barramundi accepts three inputs:

  1. a list of patient thresholds, in this case 21 dB values;
  2. a test procedure coded as a Java class; and
  3. a description of the patients behaviour as a false neagative rate, a false positive rate, and the distribution of other errors.
It then takes each input threshold from the patient and runs the specified test procedure on that location, applying suitable random modifications, as described by the third set of parameters, for each stimulus "presentation".

A more detailed overview of Barramundi can be found by clicking on this Barramundi, link.

The following tables decribe the patient sets and test procedures used in this study.

Patient sets

Table 1: Patient sets
Source False False Gaussian
Data n PostiveNegativestd dev
1.IdealN Normals 506 0% 0%0 dB
2.TypicalNNormals 506 10% 10%1 dB
3.BadN Normals 506 30% 30%2 dB
4.IdealG Glaucoma352 0% 0%0 dB
5.TypicalGGlaucoma352 10% 10%1 dB
6.BadG Glaucoma352 30% 30%2 dB
7.IdealInc Increasing500 0% 0%0 dB
8.TypicalIncIncreasing500 10% 10%1 dB
9.BadInc Increasing500 30% 30%2 dB
where
Source data Type of VF data used in the patient set
n Number of patients
Gaussian Std dev The threshold used for comparison with the stimulus value was randomly drawn from a Gaussian distribution with a mean equal to the input threshold (the patients "true" threshold) and a standard deviation equal to this column.
False +/- A response was randomly correct or incorrect at these rates irrespective of the sample
Increasing 17 thresholds equal to 0 2 4 6 8 10 12 14 16 18 20 0 0 0 0 0 0.

Test procedures

Source code for the MOBS Java class is available. Source code for the ZEST Java class is available.
Table 2: MOBS Test Procedures
M-0-20Stopping after 0 reversals and a maximum range of 20 dB.
M-0-3 Stopping after 0 reversals and a maximum range of 3 dB.
M-0-2 Stopping after 0 reversals and a maximum range of 2 dB.
M-0-1 Stopping after 0 reversals and a maximum range of 1 dB.
M-2-20Stopping after 2 reversals and a maximum range of 20 dB.
M-2-3 Stopping after 2 reversals and a maximum range of 3 dB.
M-2-2 Stopping after 2 reversals and a maximum range of 2 dB.
M-2-1 Stopping after 2 reversals and a maximum range of 1 dB.
M-4-20Stopping after 4 reversals and a maximum range of 20 dB.
M-4-3 Stopping after 4 reversals and a maximum range of 3 dB.
M-4-2 Stopping after 4 reversals and a maximum range of 2 dB.
M-4-1 Stopping after 4 reversals and a maximum range of 1 dB.
Table 3: ZEST Probability Density Functions
n Histogram of normal source data used for patient sets 1, 2 and 3.
g Histogram of glaucomatous source data used for patient sets 4, 5 and 6.
nn Histogram of glaucomatous source data used for patient sets 4, 5 and 6, but with only the bottom 5% of thresholds included for each location.
c1 1*n + nn and renormalised
c2 2*n + nn and renormalised
c3 3*n + nn and renormalised
c4 4*n + nn and renormalised
c5 5*n + nn and renormalised
c6 6*n + nn and renormalised
c7 7*n + nn and renormalised
c8 8*n + nn and renormalised
c9 9*n + nn and renormalised
c1010*n + nn and renormalised
c1111*n + nn and renormalised
uA uniform pdf where all thresholds are equally likely
Table 4: ZEST Maximum Likelihood Functions
99_10.99 0.99 0.99 0.99 0.99 0.99 0.99 0.99 0.99 0.5 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
99_30.99 0.99 0.99 0.99 0.99 0.99 0.99 0.99 0.75 0.5 0.25 0.01 0.01 0.01 0.01 0.01 0.01 0.01 0.01
99_50.99 0.99 0.99 0.99 0.99 0.99 0.99 0.83 0.67 0.5 0.33 0.17 0.01 0.01 0.01 0.01 0.01 0.01 0.01
99_70.99 0.99 0.99 0.99 0.99 0.99 0.875 0.75 0.625 0.5 0.375 0.25 0.125 0.01 0.01 0.01 0.01 0.01 0.01
95_10.95 0.95 0.95 0.95 0.95 0.95 0.95 0.95 0.95 0.5 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05
95_30.95 0.95 0.95 0.95 0.95 0.95 0.95 0.95 0.75 0.5 0.25 0.05 0.05 0.05 0.05 0.05 0.05 0.05 0.05
95_50.95 0.95 0.95 0.95 0.95 0.95 0.95 0.83 0.67 0.5 0.33 0.17 0.05 0.05 0.05 0.05 0.05 0.05 0.05
95_70.95 0.95 0.95 0.95 0.95 0.95 0.875 0.75 0.625 0.5 0.375 0.25 0.125 0.05 0.05 0.05 0.05 0.05 0.05
90_10.9 0.9 0.9 0.9 0.9 0.9 0.9 0.9 0.9 0.5 0.1 0.1 0.1 0.1 0.1 0.1 0.1 0.1 0.1
90_30.9 0.9 0.9 0.9 0.9 0.9 0.9 0.9 0.75 0.5 0.25 0.1 0.1 0.1 0.1 0.1 0.1 0.1 0.1
90_50.9 0.9 0.9 0.9 0.9 0.9 0.9 0.83 0.67 0.5 0.33 0.17 0.1 0.1 0.1 0.1 0.1 0.1 0.1
90_70.9 0.9 0.9 0.9 0.9 0.9 0.875 0.75 0.625 0.5 0.375 0.25 0.125 0.1 0.1 0.1 0.1 0.1 0.1
Table 5: ZEST Stopping conditions
sd1Stop when the pdf reaches a standard deviation of less than 1 dB.
sd2Stop when the pdf reaches a standard deviation of less than 2 dB.
sd3Stop when the pdf reaches a standard deviation of less than 3 dB.
n3 Stop after 3 presentations.
n4 Stop after 4 presentations.
n5 Stop after 5 presentations.

A ZEST procedure is described by four components: a letter Z, a pdf code from Table 3, a mlf code from Table 4, and a stopping condition from Table 5. For example, the code Z-n-99_3-n3 describes the ZEST procedure using the normal pdf, a steep mlf with 99% asymptotes, and stopping after 3 presentations. Given that there are 15 possible pdfs, 12 possible mls, and 6 possible stopping conditions, there are a total 0f 15*12*6 = 1080 ZEST procedures availalble for testing.

Results

The results reported are

  1. the number of presentations required by a method on a patient set,
  2. the difference between the input threshold and determined threshold, and
  3. the absolute value of the difference between the input threshold and determined threshold.
For the first 6 patient sets, the mean and standard deviation is calculated across all 17 locations for a patient. For the artificial patient sets (7, 8 and 9) the mean and standard deviation is calculated across the 500 values of the first 11 locations (ie input thresholds of 0 through 20 dB).

Raw data in space delimited format for the following 9 tables can be downloaded by clicking on the link at the beginning of this sentence. The download file is a zip archive of 9 files, one per table.

Table 6: All test procedures on perfect normals (patient set 1)

Note most of the ZEST procedures based on the 99_1 mlf are excluded as they obviously are not practical.

Table 7: All test procedures on perfect glaucomas (patient set 4)

Table 8: All test procedures on typical normals (patient set 2)

Table 9: All test procedures on typical glaucomas (patient set 5)

Table 10: All test procedures on bad normals (patient set 3)

Table 11: All test procedures on bad glaucomas (patient set 6)

Table 12: All test procedures on artifical patient sets (7, 8 and 9)


Created Aug 30 2001 by Andrew Turpin

Last updated Mon Sep 3 12:46:02 WST 2001