P. Ammann and P. Black. A specification-based coverage metric to evaluate test sets. In Proceedings of the 4th IEEE International Symposium on High Assurance Systems and Engineering, 1999.  Home/Search   Document Details and Download   Summary   Related Articles   Check

....also has the ability to automatically detect equivalent mutants (using this Literature review 2.5 Summary technique if a mutant is equivalent, then no counter examples can be found) This work was based on specifications written using SCR [Hen80] tables. The same authors later extended the work [AB99] to evaluate the mutation coverage of particular test cases specified as properties to be proven in the model. If an inconsistency was found between the specification of the test case and the mutated model, the test case was said to kill the mutant. Provided a tractable abstraction of ....

P. Ammann and P. Black. A specification-based coverage metric to evaluate test sets. In Proceedings of Fourth IEEE International High-Assurance Systems Engineering Symposium (HASE 99), November 1999.

....et al. 34] use specifications to generate controlflow and data flow diagrams. They then define three criteria for control flow testing: all statements, all branches and all paths; and three criteria for data flow testing: all definitions, all uses and all definition use paths. Ammann et al. [2] discuss the application of mutation analysis to specifications to generate test data sets. They apply slight syntactical changes to a specification to generate mutants, and use model checking to detect equivalent mutants and to detect counter examples that are then used as test cases. In a ....

P. Ammann and P. Black. A specification-based coverage metric to evaluate test suites. In 4th IEEE Int. High-Assurnce Systems Engineering Symposium, pages 239--248, 1999.

....specifications have been used to generate test cases. The existing specification based testing methods have limitations. For example, Offutt s method [OXL99, OL99] generates tests only from state based specifications. Ammann and Black s specification based mutation testing technique [AB99a, AB99b, ABM98] also relies on the type of specification the specification has to be translated into a language that a model checker can recognize. However, in practice not many specifications are written using languages that can be model checked or languages that are state based. Software ....

Paul E. Ammann and Paul E. Black. A specification-based coverage metric to evaluate test sets. In Proceedings HASE99, 1999.

....of our method via application to a small example. To proceed, we must develop a notion of potentially dangerous yet plausible behavior. We have selected syntactic mutations of the descriptions of state machines for this purpose; related mutation approaches not tailored to safety are presented in [2, 3]. The basic idea behind mutation analysis is that if some variation is made to an artifact traditionally code, but in this case a specification then test data should be comprehensive enough to notice the variation and distinguish it from the original. In this case, we use mutations to model ....

.... Sigma derive test reqs . check model reduce Test Set Figure 1: Test Set Generation with a Model Checker model checker corresponds to a test case that satisfies a given test requirement. These test cases are collected and reduced to eliminate various types of redundancy [2, 5]. The result is a test set that satisfies all feasible test requirements implied by the selected test criterion with respect to the finite system specification. Recognition that a given test set satisfies a particular test coverage criterion is also possible by turning each test case into a ....

[Article contains additional citation context not shown here]

P. Ammann and P. E. Black. A specification-based coverage metric to evaluate test sets. In Proceedings HASE99: 4th IEEE International Symposium on High Assurance Systems, pages 239--248, Washington, DC, November 1999.

....program development, and the created tests apply to all implementations of the specification, e.g. ports. Ammann and Black described a novel method using a combination of model checking and mutation analysis to automatically produce tests from formal specifications [2] and measure test coverage [1]. The test cases considered in the method constitute a complete test suite, that is, all test cases include both inputs and expected results. Model checking is a formal technique for verifying that temporal logic expressions are consistent with all executions of a state machine. Mutation analysis ....

....begins with selection of a test criterion [12] that is, a decision about what properties of a specification must be exercised to constitute a thorough test. Some specification based test criteria are conjunctive com plementary closure partitions [6] branch coverage [11] and mutation adequacy [1]. The chosen test criterion is applied to the specification to derive test requirements, i.e. a set of individual properties to be tested. To use a model checker, these requirements are represented as temporal logic formulas. To evaluate coverage of a test set, each test is turned into an ....

[Article contains additional citation context not shown here]

P. E. Ammann and P. E. Black. A specification-based coverage metric to evaluate test sets. In Proceedings of Fourth IEEE International High-Assurance Systems Engineering Symposium (HASE 99), pages 239--248. IEEE Computer Society, November 1999. Also NIST IR 6403.

....program development, and the created tests apply to all implementations of the specification, e.g. ports. Ammann and Black described a novel method using a combination of model checking and mutation analysis to automatically produce tests from formal specifications [2] and measure test coverage [1]. The test cases considered in the method constitute a complete test suite, that is, all test cases include both inputs and expected results. Model checking is a formal technique for verifying that temporal logic expressions are consistent with all executions of a state machine. Mutation analysis ....

....begins with selection of a test criterion [12] that is, a decision about what properties of a specification must be exercised to constitute a thorough test. Some specification based test criteria are conjunctive com plementary closure partitions [6] branch coverage [11] and mutation adequacy [1]. The chosen test criterion is applied to the specification to derive test requirements, i.e. a set of individual properties to be tested. To use a model checker, these requirements are represented as temporal logic formulas. To evaluate coverage of a test set, each test is turned into an ....

[Article contains additional citation context not shown here]

P. E. Ammann and P. E. Black. A specification-based coverage metric to evaluate test sets. In Proceedings of Fourth IEEE International High-Assurance Systems Engineering Symposium (HASE 99), pages 239--248. IEEE Computer Society, November 1999. Also NIST IR 6403.

....development, and any results should apply to all implementations of the specification, e.g. ports to other systems. Model checking and specification based mutation analysis are combined in a novel method to automatically produce tests from formal specifications [3] and measure test coverage [2]. We briefly introduce model checking here. 1.1 Model Checking Model checking is a formal technique based on state exploration. Input to a model checker has two parts. One part is a state machine defined in terms of variables, initial values for the variables, environmental assumptions, and a ....

....4 we present some open questions and the research directions we have planned to take to address them. 2 Mutations for Test Generation Ammann and Black used mutation analysis, along with model checking, to automatically produce tests from formal specifications [3] and measure test coverage [2]. Since our work has been in the framework of this approach, we briefly explain it here. One begins with a finite state machine representation, or specification, of the system to be tested. Each transition of the state machine is reflected as a CTL clause. For instance, the first case of the ....

[Article contains additional citation context not shown here]

P. E. Ammann and P. E. Black. A specification-based coverage metric to evaluate test sets. In Proceedings of Fourth IEEE International High-Assurance Systems Engineering Symposium (HASE 99), pages 239--248. IEEE Computer Society, November 1999. Also NIST IR 6403.

No context found.

P. Ammann and P. Black. A specification-based coverage metric to evaluate test sets. In Proceedings of the 4th IEEE International Symposium on High Assurance Systems and Engineering, 1999.

No context found.

P. E. Ammann and P. E. Black. A specification-based coverage metric to evaluate test sets. In Proceedings of the Fourth IEEE International Symposium on High-Assurance Systems Engineering. IEEE Computer Society, Nov. 1999.

Online articles have much greater impact   More about CiteSeer.IST   Add search form to your site   Submit documents   Feedback  

CiteSeer.IST - Copyright Penn State and NEC