TY - JOUR
T1 - The importance of work-up (verification) bias correction in assessing the accuracy of SPECT thallium-201 testing for the diagnosis of coronary artery disease
AU - Cecil, Michael P.
AU - Kosinski, Andrzej S.
AU - Jones, Michael T.
AU - Taylor, Andrew
AU - Alazraki, Naomi P.
AU - Pettigrew, Roderic I.
AU - Weintraub, William S.
PY - 1996/7
Y1 - 1996/7
N2 - Noninvasive testing is often evaluated by the sensitivity and specificity in comparison with a more invasive, but more definitive 'gold' standard. However, work-up or verification bias, which occurs when the results of a noninvasive test impact the decision to perform the gold standard invasive test, increases the 'observed' sensitivity and decreases the 'observed' specificity of the noninvasive test. Most large clinical studies utilizing a noninvasive technique to diagnose coronary artery disease have biases, particularly workup bias. To obtain more accurate measurements of sensitivity and specificity, we determined the observed sensitivity and specificity of stress (exercise and dipyridamole) single photon emission computed tomographic (SPECT) thallium testing for the detection of coronary artery disease by angiography, and then applied previously published equations to correct for work up bias. From a computerized data base, reports of 4354 stress SPECT thallium studies from January 1, 1986 through December 31, 1992 were reviewed. All patients with a known history of myocardial infarction or prior coronary angiography were excluded, leaving 2688 patients. From this total, 471 patients underwent coronary angiography within 90 days following stress SPECT thallium testing. Coronary artery disease was defined as a visually assessed stenosis of a coronary artery or a major branch > 50%. Of the 2688 stress SPECT thallium studies, 1265 were normal and 1423 were abnormal. For the 471 patients who underwent catheterization within 90 days following stress SPECT thallium testing, the 'observed' sensitivity and specificity were 98 and 14%, respectively. After correction for work-up bias, the corrected sensitivity and specificity were 82 ± 6% and 59 ± 2%, respectively. Most studies utilizing noninvasive technologies for the detection of coronary artery disease include patients with known coronary artery disease and have work-up bias as well. By knowing the thallium results of patients with and without catheterization, we were able to correct for work up bias. These data provide a better estimate of the sensitivity and specificity of stress SPECT thallium testing.
AB - Noninvasive testing is often evaluated by the sensitivity and specificity in comparison with a more invasive, but more definitive 'gold' standard. However, work-up or verification bias, which occurs when the results of a noninvasive test impact the decision to perform the gold standard invasive test, increases the 'observed' sensitivity and decreases the 'observed' specificity of the noninvasive test. Most large clinical studies utilizing a noninvasive technique to diagnose coronary artery disease have biases, particularly workup bias. To obtain more accurate measurements of sensitivity and specificity, we determined the observed sensitivity and specificity of stress (exercise and dipyridamole) single photon emission computed tomographic (SPECT) thallium testing for the detection of coronary artery disease by angiography, and then applied previously published equations to correct for work up bias. From a computerized data base, reports of 4354 stress SPECT thallium studies from January 1, 1986 through December 31, 1992 were reviewed. All patients with a known history of myocardial infarction or prior coronary angiography were excluded, leaving 2688 patients. From this total, 471 patients underwent coronary angiography within 90 days following stress SPECT thallium testing. Coronary artery disease was defined as a visually assessed stenosis of a coronary artery or a major branch > 50%. Of the 2688 stress SPECT thallium studies, 1265 were normal and 1423 were abnormal. For the 471 patients who underwent catheterization within 90 days following stress SPECT thallium testing, the 'observed' sensitivity and specificity were 98 and 14%, respectively. After correction for work-up bias, the corrected sensitivity and specificity were 82 ± 6% and 59 ± 2%, respectively. Most studies utilizing noninvasive technologies for the detection of coronary artery disease include patients with known coronary artery disease and have work-up bias as well. By knowing the thallium results of patients with and without catheterization, we were able to correct for work up bias. These data provide a better estimate of the sensitivity and specificity of stress SPECT thallium testing.
KW - Sensitivity
KW - Specificity
KW - Thallium-201
KW - Verification bias
KW - Work-up bias
UR - http://www.scopus.com/inward/record.url?scp=0030198310&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=0030198310&partnerID=8YFLogxK
U2 - 10.1016/0895-4356(96)00014-5
DO - 10.1016/0895-4356(96)00014-5
M3 - Article
C2 - 8691222
AN - SCOPUS:0030198310
SN - 0895-4356
VL - 49
SP - 735
EP - 742
JO - Journal of Clinical Epidemiology
JF - Journal of Clinical Epidemiology
IS - 7
ER -