|
Selected publications by date
Selected publications by category
|
|   |
An Empirical Investigation of the Correlation Between
Fault-Revealing Test Behavior and Differences in Program Spectra
Technical Report GIT-CC-99-27, Georgia Institute of Technology (Also Technical Report 99-60-12, Oregon State University) December 1999
Mary Jean Harrold, Gregg Rothermel, Kent Sayre, Rui Wu, Liu Yi
Abstract
Many software maintenance and testing tasks require comparisons of the behaviors of program versions. Program spectra have recently been proposed as a heuristic for use in
performing such comparisons. To assess the potential usefulness of spectra in this context, we conducted an experiment that examined the relationship between differences in
program spectra and the existence of faults in programs, and empirically compared several types of spectra. Our results reveal that certain types of spectra differences correlate
with high frequency --- at least in one direction --- with the presence of faults. That is, when program failures exist on particular inputs, spectra differences are likely also to
exist on those inputs, though the reverse is not true. Our results also suggest that several types of spectra that appear, analytically, to offer greater precision in predicting
failure behavior than other cheaper spectra provide no greater precision in practice. These results are important in any consideration of the practical uses of program spectra.
|