Coverage criteria for GUI testing

Download: PDF.

“Coverage criteria for GUI testing” by Atif M. Memon, Mary Lou Soffa, and Martha E. Pollack. In ESEC/FSE-9: Proceedings of the 8th European software engineering conference held jointly with 9th ACM SIGSOFT international symposium on Foundations of software engineering, (New York, NY, USA), 2001, pp. 256-267.

Abstract

A widespread recognition of the usefulness of graphical user interfaces (GUIs) has established their importance as critical components of today's software. GUIs have characteristics different from traditional software, and conventional testing techniques do not directly apply to GUIs. This paper's focus is on coverage critieria for GUIs, important rules that provide an objective measure of test quality. We present new coverage criteria to help determine whether a GUI has been adequately tested. These coverage criteria use events and event sequences to specify a measure of test adequacy. Since the total number of permutations of event sequences in any non-trivial GUI is extremely large, the GUI's hierarchical structure is exploited to identify the important event sequences to be tested. A GUI is decomposed into GUI components, each of which is used as a basic unit of testing. A representation of a GUI component, called an event-flow graph, identifies the interaction of events within a component and intra-component criteria are used to evaluate the adequacy of tests on these events. The hierarchical relationship among components is represented by an integration tree, and inter-component coverage criteria are used to evaluate the adequacy of test sequences that cross components. Algorithms are given to construct event-flow graphs and an integration tree for a given GUI, and to evaluate the coverage of a given test suite with respect to the new coverage criteria. A case study illustrates the usefulness of the coverage report to guide further testing and an important correlation between event-based coverage of a GUI and statement coverage of its software's underlying code.

Download: PDF.

BibTeX entry:

@inproceedings{MemonFSE2001,
   author = {Atif M. Memon and Mary Lou Soffa and Martha E. Pollack},
   title = {Coverage criteria for {GUI} testing},
   booktitle = {ESEC/FSE-9: Proceedings of the 8th European software
	engineering conference held jointly with 9th ACM SIGSOFT
	international symposium on Foundations of software engineering},
   pages = {256--267},
   publisher = {ACM Press},
   address = {New York, NY, USA},
   year = {2001},
   isbn = {1-58113-390-1}
}

Back to Atif Memon's Publications.