M. Hutchins, H. Foster, T. Goradia, and T. Ostrand, "Experiments on the Effectiveness of Dataflow- and Controlflow-Based Test Adequacy Criteria," Proc. Int'l Conf. Software Eng., pp. 191-200, May 1994.  Home/Search   Document Not in Database   Summary   Related Articles   Check

....seeding We wished to evaluate the performance of web testing techniques with respect to the detection of faults. Such faults were not available with our subject application; thus, to obtain them, we followed a procedure similar to one defined and employed in previous studies of testing techniques [6, 8, 22]. We recruited two graduate students of computer science, each with at least two years of programming experience, and instructed them to insert faults that were as realistic as possible based on their experience. To direct their efforts we gave them a random generator that indicated the ....

M. Hutchins, H. Foster, T. Goradia, and T. Ostrand. Experiments on the effectiveness of dataflow- and controlflowbased test adequacy criteria. In Proceedings of the International Conference on Software Engineering, pages 191--200, May 1994.

....Calculate Based on the boundary value coverage information collected for each test case execution, we calculate the reward value for each test case and order them based on these reward values. An experiment is conducted on seven small size siemens programs created by Siemens researchers [15] and one medium size space program originally created by Vokolos and Frankl [27] Our initial results show that incorporating boundary value coverage information in prioritization can improve the effectiveness of structural coverage techniques in average. This work is tackling strategic SQA ....

M. Hutchins, H. Foster, T. Goradia, and T. Ostrand. Experiments on the effectiveness of dataflow- and controlflow-based test adequacy criteria. In Proceedings of the 16 ICSE, pages 191-200, May 1994

....version still need to be instrumented and run to collect comparison data points a priori or posterior. 4.1.2. Subject programs. Seven C programs are used as subjects in the experiment. The researchers at Siemens Research created these seven programs with faulty versions and a pool of test cases [12]; these programs are popularly referred as the Siemens programs and are broadly used in regression testing empirical studies [10] The researchers constructed the faulty versions by manually seeding faults that were as realistic as possible. Each faulty version differs from the original program by ....

M. Hutchins, H. Foster, T. Goradia, and T. Ostrand. Experiments on the effectiveness of dataflow- and controlflowbased test adequacy criteria. In Proc. Int'l Conf. Softw. Eng., pp. 191-200, May 1994

....test adequacy criteria provide help in selecting test data and in deciding whether a program has been tested enough by relating testing effort to coverage of code components. Such criteria have been well researched for imperative languages (e.g. 8, 12, 18] and several empirical studies (e.g. [7, 9, 25]) have demonstrated their usefulness. Our methodology incorporates a test adequacy criterion adapted from the output influencing all du pairs dataflow adequacy criterion defined originally for imperative programs [6] This criterion, which we call du adequacy for brevity, focuses on the ....

....that are hidden or off screen are considered exercised It is not always possible to exercise all du association; those that cannot be exercised are called nonexecutable. Determining whether a du association is executable is provably impossible in general and frequently infeasible in practice [9, 25]; thus, data flow test adequacy criteria typically require that test data exercise (cover) only executable du associations. Our criterion does the same. Figure 1: Pizza sales spreadsheet simply by applying test inputs; instead, the du association must participate in producing a visible result ....

M. Hutchins, H. Foster, T. Goradia, and T. Ostrand, "Experiments on the effectiveness of dataflow and control flow-based test adequacy criteria", In 16th Intl. Conf. Softw. Eng., pages 191-200, May 1994.

....Such tools should also provide data which lead to improvements in the quality and effectiveness of a software test as well as information about its adequacy when deciding product release times. There are two types of coverage definitions in literature: control flow and data flow coverage[2, 6, 7, 16]. Each coverage criterion proposed in the literature captures some important aspect of a program s structure. In general, test coverage is a measure of how well a test covers all the potential faultsites in a software product under test. It should be obvious that how one defines a potential ....

M. Hutchins, H. Foster, T. Goradia and T. Ostrand, " Experiments on the Effectiveness of Dataflow-and Control-flowbased Test Adequacy Criteria," Proc. of Intl. Conference on Software Engineering, 1994.

....test suite reduction techniques have been proposed (e.g. 2, 6, 8, 13] in this work we utilize the technique of Harrold, Gupta, and Sofia [6] 2.2 Previous empirical work Many empirical studies of software testing have been performed. Some ofthese studies, such as those reported in References [3, 9, 18], provide indirect data about the effects of test suite reduction through consideration of the effects of test suite size on costs and benefits of testing. Other studies, such as the study reported in Reference [5] provide indirect data about the effects of test suite reduction through a ....

....has several faulty versions, each containing a single fault. Each program also has a large test pool. The programs, versions, and test pools were assembled by researchers at Siemens Corporate Research for a study of the fault detection capabilities of control flow and data flow coverage criteria [9]. We refer to these programs collectively as the Siemens programs. The researchers at Siemens sought to study the fault detecting effectiveness of coverage criteria. There fore, they created faulty versions of the seven base programs by manually seeding those programs with faults, usually by ....

M. Hutchins, H. Foster, T. Goradia, and T. Ostrand. Experiments on the effectiveness of dataflow- and controlflow-based test adequacy criteria. In Proceedings of the 16th International Conference on Software Eng., pages 191-200, May 1994.

....building an appropriately instrumented binary B fl , and running the test suite T fl . A vendor who undertakes the cost of developing an adequate set T fl for some stringent fl can reasonably expect that the system is less likely to fail in the field due to undetected faults in in system X [16]. Often, in fields with exacting reliability requirements (such as transportation, telecommunications, energy or health) software users demand high quality standards, and expect vendors to use testing processes that achieve high levels of coverage with stringent coverage criteria. In such ....

....processes is beyond the scope of this paper. In practical software projects, the most common approaches are basic block coverage testing and branch coverage testing. These will form the primary focus of our discussion. These approaches have been justified by empirical work. Experimental work [16, 22] indicates that branch coverage levels in the range of 80 90 have a high likelihood of exposing remaining faults in the software. 2.2 Current Approaches to Coverage Verification Currently, test coverage verification is done by a third party testing which is trusted by both the vendor and ....

[Article contains additional citation context not shown here]

M. Hutchins, H. Foster, T. Goradia, and T. Ostrand. Experiments on the effectiveness of dataflow- and controlflow-based test adequacy criteria. In Proceedings of the 16th International Conference on Software Engineering. IEEE Computer Society, May 1994.

.... of branch testing for a suite of nine small programs [2] We subsequently refined the experiment design and used it to compare all uses to mutation testing on the same suite [3] Hutchins et al. used a similar design to study branch and data flow testing on a suite of programs with seeded faults [7]. There are several plausible probabilistic measures of the effectiveness of an adequacy criterion. The measure considered here is Eff(P;C;D) the probability that a C adequate test set for program P , selected according to distribution D on the space of all such test sets, will detect at least ....

....experiments indicates that the benefit of using these coverage criterion often does not kick in until quite high coverage levels are achieved. Comparison to Related Work The experiments most closely related to the work reported here are our previous work [2] and the study by Hutchins, et al. [7]. Both of these studies compared effectiveness of a data flow based criterion, branch testing, and random testing without an adequacy criterion by sampling the space of adequate test sets in a meaningful way. 0.02 0.04 0.06 0.08 0.1 0.12 0.14 0.5 0.55 0.6 0.65 0.7 0.75 0.8 0.85 0.9 0.95 1 ....

M. Hutchins, H. Foster, T. Goradia, and T. Ostrand. Experiments on the effectiveness of dataflowand controlflow-based test adequacy criteria. In Proceedings 16th International Conference on Software Engineering. IEEE Computer Society Press, May 1994.

No context found.

M. Hutchins, H. Foster, T. Goradia, and T. Ostrand, "Experiments on the Effectiveness of Dataflow- and Controlflow-Based Test Adequacy Criteria," Proc. Int'l Conf. Software Eng., pp. 191-200, May 1994.

No context found.

M. Hutchins, H. Foster, T. Goradia, and T. Ostrand. Experiments on the effectiveness of dataflow- and controlflow-based test adequacy criteria. In Int'l. Conf. Softw. Eng., pages 191--200, May 1994.

No context found.

M. Hutchins, H. Foster, T. Goradia, and T. Ostrand. Experiments on the effectiveness of dataflow- and controlflowbased test adequacy criteria. In Proceedings of the International Conference on Software Engineering, pages 191--200, May 1994.

No context found.

Monica Hutchins, Herb Foster, Tarak Goradia, and Thomas Ostrand. Experiments on the effectiveness of dataflowand controlflow-based test adequacy criteria. In Proceedings pages 191--200, Sorrento, Italy, May 16--21, 1994.

No context found.

Hutchins, M., Foster, H., Goradia, T., Ostrand, T. Experiments on the effectiveness of dataflow- and control-flowbased test adequacy criteria. Proceedings of 16th International Conference on Software Engineering (ICSE-16), 1994, pp. 191--200.

No context found.

M. Hutchins, H. Foster, T. Goradia, and T. Ostrand. Experiments on the effectiveness of dataflow- and controlflowbased test adequacy criteria. In ICSE, pages 191--200, May 1994.

No context found.

M. Hutchins, H. Foster, T. Goradia, and T. Ostrand. Experiments on the effectiveness of dataflowand controlflow-based test adequacy criteria. In Proceedings of the 16th International Conference on Software Eng., pages 191--200, May 1994.

No context found.

M. Hutchins, H. Foster, T. Goradia, and T. Ostrand. Experiments on the effectiveness of dataflow- and controlflowbased test adequacy criteria. In Proceedings of the 16th International Conference on Software Engineering, pages 191--200, May 1994.

No context found.

Monica Hutchins, Herb Foster, Tarak Goradia, and Thomas Ostrand. Experiments on the effectiveness of dataflow- and controlflow-based test adequacy criteria. In Proceedings of the 16th International Conference on Software Engineering, pages 191--200, 1994.

No context found.

M. Hutchins, H. Foster, T. Goradia, and T. Ostrand. Experiments on the effectiveness of dataflow- and controlflow-based test adequacy criteria. In 16th International Conference on Software Engineering, pages 191--200, May 1994. 32

No context found.

M. Hutchins, H. Foster, T. Goradia, and T. Ostrand. Experiments on the effectiveness of dataflow and control-flow based test adequacy criteria. In 16th International Conference on Software Engineering (ICSE-16), pages 191--200, 1994.

No context found.

M. Hutchins, H. Foster, T. Goradia, and T. Ostrand. Experiments on the effectiveness of dataflow and control-flow based test adequacy criteria. In 16th International Conference on Software Engineering (ICSE-16), pages 191--200, 1994.

No context found.

Monica Hutchins, Herb Foster, Tarak Goradia, and Thomas Ostrand. Experiments on the effectiveness of dataflowand controlflow-based test adequacy criteria. In Proceedings of the 16th International Conference on Software Engineering, pages 191--200, Sorrento, Italy, May 16--21, 1994.

No context found.

M. Hutchins, H. Foster, T. Goradia, and T. Ostrand. Experiments on the effectiveness of dataflow- and controlflow-based test adequacy criteria. In Int'l. Conf. Softw. Eng., pages 191--200, May 1994.

No context found.

M. Hutchins, H. Foster, T. Goradia, and T. Ostrand. Experiments on the effectiveness of dataflow- and controlflow-based test adequacy criteria. In Int'l. Conf. Softw. Eng., pages 191--200, May 1994. 20

No context found.

Hutchins, M., Foster, H., Goradia, T., Ostrand, T. Experiments on the effectiveness of dataflow- and control-flowbased test adequacy criteria. Proceedings of 16th International Conference on Software Engineering (ICSE-16), 1994, pp. 191--200.

No context found.

M. Hutchins, H. Foster, T. Goradia, and T. Ostrand, "Experiments on the Effectiveness of Dataflow- and Controlflow-Based Test Adequacy Criteria," Proc. 16th Int'l. Conf. Software Eng., pp. 1912.

First 50 documents  Next 50

Online articles have much greater impact   More about CiteSeer.IST   Add search form to your site   Submit documents   Feedback  

CiteSeer.IST - Copyright Penn State and NEC