K. J. Rothermel, et al., "WYSIWYT testing in the spreadsheet paradigm: an empirical evaluation," at Proceedings of the 22nd international conference on Software engineering, Limerick, Ireland, pp. 230 - 239, 2000.  Home/Search   Document Details and Download   Summary   Related Articles   Check

....1996] Agentsheets [Repenning and Sumner, 1995] and VIPR [Citrin et al. 1998] are just three examples of this approach. There has been some work on specialised visualisation of visual programs, however. Burnett has applied software visualisation techniqes to support testing of Forms 3 programs [Rothermel et al. 2000], and Grundy and Hosking have applied some program visualisation techniques to software engineering modelling languages [Grundy and Hosking, 2000, Grundy et al. 1996] in one case, successfully visualising a gedanken notation that was never designed to be executed [Grundy and Hosking, ....

.... 1995] Probably because most visual languages do not have a large user base, the practice of the visual languages community has been to adopt empirical usability evaluations to understand how languages are used, or to measure the effectiveness of individual small details of language designs [Rothermel et al. 2000, Blackwell, 2001] or researchers may participate in programming communities to evaluate their use of langauges [Carroll and Rosson, 1987, Nardi, 1993] input osc lfo seq filter env audio mixer output Figure 8: Module Position by Category Figure 9: Module Category by Position Because they ....

Rothermel, K. J., Cook, C. R., Burnett, M. M., Schonfeld, J., Green, T. R. G., and Rothermel, G. (2000). Wysiwyt testing in the spreadsheet paradigm: An empirical evaluation. In Proceedings of the 22nd International Conference on Software Engineering, pages 230--239.

....a program runs it is visualised: Toontalk [16] Agentsheets [23] and VIPR [5] are just three examples of this approach. There has been some work on specialised visualisation of visual programs, however. Burnett has applied software visualisation techniqes to support testing of Forms 3 programs [24], and Grundy and Hosking have applied some program visualisation techniques to software engineering modelling languages [11, 12] in one case, successfully visualising a gedanken notation that was never designed to be executed [10] Probably because most visual languages do not have a large ....

.... [10] Probably because most visual languages do not have a large user base, the practice of the visual languages community has been to adopt empirical usability evaluations to understand how languages are used, or to measure the effectiveness of individual small de tails of language designs [24, 3], or researchers may participate in programming communities to evaluate their use of langauges [4, 18] Because they are time consuming, usability evaluations or participant observation are generally limited to tens of subjects working on tens of programs. Surveys can provide information from ....

K. J. Rothermel, C. R. Cook, M. M. Burnett, J. Schonfeld, T. R. G. Green, and G. Rothermel. Wysiwyt testing in the spreadsheet paradigm: An empirical evaluation. In Proceedings of the 22nd International Conference on Software Engineering, pages 230-239, June 2000.

No context found.

Rothermel, K., C. Cook, M. Burnett, J. Schonfeld, T.R.G. Green, and G. Rothermel. WYSIWYT Testing in the Spreadsheet Paradigm: An Empirical Evaluation. Proc. of the 22nd International Conference on Software Engineering. Kyoto, Japan. June 2000: 230-239.

No context found.

K. Rothermel, C. Cook, M. Burnett, J. Schonfeld, T. Green, and G. Rothermel, "WYSIWYT Testing in the Spreadsheet Paradigm: An Empirical Evaluation," TR 99-60-08, Oregon State University, Computer Science Department, December 1999.

No context found.

K. J. Rothermel, C. R. Cook, M. M. Burnett, J. Schonfeld, T. R. G. Green, and G. Rothermel. WYSIWYT testing in the spreadsheet paradigm: An empirical evaluation. In Proceedings of the 22nd International Conference on Software Engineering, June 2000.

....Test (WYSIWYT) methodology lets spreadsheet users incrementally apply test inputs and validate outputs, and provides visual feedback about the e ectiveness of their testing. Empirical studies have shown that this methodology can help users test their spreadsheets more adequately and more eciently [25]. As presented to date, the WYSIWYT methodology has relied solely on the intuitions of spreadsheet users to identify test cases for their spreadsheets. In general, the process of manually identifying appropriate test cases is laborious, and its success depends on the experience of the tester. ....

....cells are not restricted to grids. Also, in the gure cell formulas are displayed, but in general the user can display or hide formulas. ###### ## ####### ########### ######### 2. 1 The WYSIWYT Methodology In our What You See Is What You Test (WYSIWYT) methodology for testing spreadsheets [22, 24, 25], as a user incrementally develops a spreadsheet, he or she can also test that spreadsheet incrementally. As the user changes cell formulas and values, the underlying engine automatically evaluates cells, and the user validates the results displayed in those cells. Behind the scenes these ....

K. J. Rothermel, C. R. Cook, M. M. Burnett, J. Schonfeld, T. R. G. Green, and G. Rothermel. WYSIWYT testing in the spreadsheet paradigm: An empirical evaluation. In Proceedings of the 22nd International Conferenceon Software Engineering, June 2000.

....methodology provides feedback about the testedness of cells in spreadsheets in a way that is incremental, responsive, and entirely visual. Empirical studies have shown that this methodology can help users test their spreadsheets more adequately and efficiently, and reduce end user overconfidence [15, 26]. In subsequent work, we extended this approach to large grids of cells [6, 7] and to incorporate automated test input generation [12] The incremental, responsive nature of the spreadsheet paradigm makes spreadsheets highly malleable, and spreadsheet users often make small changes to formulas ....

....an employee s weekly pay given a payrate and the hours they worked during that week. As the figure shows, in Forms 3, cells aren t restricted to grids, and the user can display or hide formulas as desired. In our What You See Is What You Test (WYSIWYT) methodology for testing spreadsheets [22, 25, 26], as a user incrementally develops a spreadsheet, he or she can also test 2 Figure 3. Spreadsheet GrossPay with testing information displayed after a user validation. that spreadsheet incrementally. As the user changes cell formulas and values, the underlying engine automatically evaluates ....

K. J. Rothermel, C. R. Cook, M. M. Burnett, J. Schonfeld, T. R. G. Green, and G. Rothermel. WYSIWYT testing in the spreadsheet paradigm: An empirical evaluation. In Proceedings of the 22nd International Conference on Software Engineering, June 2000.

.... and King 1993] Once developed, even experienced spreadsheet users have difficulty comprehending and debugging spreadsheets [Hendry and Green 1994] To make matters worse, spreadsheet creators are overconfident in the reliability of their spreadsheets [Brown and Gould 1987; Wilcox et al. 1997; Rothermel et al. 2000] In an effort to improve spreadsheet reliability, the Forms 3 research group at Oregon State University has been developing the concept of end user software engineering. In end user software engineering, we recognize that while end users cannot be expected to learn and use traditional software ....

.... (2) fault localization methods [Reichwein et al. 1999] and (3) automatic test case generation techniques [Cao 2000] The results of empirical studies show that users of our testing methods were able to detect more errors [Cook et al. 1999] and were less overconfident about their spreadsheets [Rothermel et al. 2000]. Due to the success of this previous work, we have continued to explore ways in which the benefits of formal software engineering techniques can be brought to endusers. Our goal is to develop methodologies that allow end users to receive the benefits of the use of formal software engineering ....

Rothermel, K., Cook, C., Burnett, M., Schonfeld, J., Green, T.R.G., Rothermel, G., WYSIWYT Testing in the Spreadsheet Paradigm: An Empirical Evaluation. International Conference on Software Engineering, Limerick, Ireland, June 2000, 230-239.

....further supports the differences in results; for instance, in the first row, the power computed for the test of the simple main effect, WYSIWYT versus Ad Hoc, was improved from 0.11 to 0.84. Space forbids extensive statistical discussion here; details of the after version are given elsewhere [15]. 6. Discussion In this section we return to the questions posed in the introduction. HYPOTHESIS BEFORE AFTER more effective NS WYSIWYT participants more efficient: Number of edits to achieve coverage NS Number of redundant tests NS WYSIWYT participants less ....

K. J. Rothermel, C. Cook, M. Burnett, J. Schonfeld, T. R. G. Green and G. Rothermel. WYSIWYT Testing in the Spreadsheet Paradigm: An Empirical Evaluation. Intl. Conf. Software Engineering, Limerick, Ireland, June 2000, 230-239.

....deleted from, and modified in a spreadsheet, using impact analysis to determine where revalidation is needed. Thus, the methodology is expected to support not just the initial development of spreadsheets, but also their evolution and maintenance. To date, our studies of the WYSIWYT methodology [20, 21] have focused on its application to complete spreadsheets. These studies have shown that the methodology can help spreadsheet users test their spreadsheets more effectively and more efficiently. Thus far, however, we have not empirically investigated the methodology in the context of spreadsheet ....

K. Rothermel , C. Cook, M. Burnett, J. Schonfeld, T.R.G. Green, and G. Rothermel. "WYSIWYT testing in the spreadsheet paradigm: An empirical evaluation", 22 Intl. Conf. on Softw. Eng., Limerick, pp. 230-239, June 2000.

....to be redone. A primary goal of this approach is to reduce overconfidence about the correctness of spreadsheet formulas. In an empirical study, the methodology significantly reduced overconfidence about how tested spreadsheets were, as well as improving effectiveness and efficiency of testing [17]. 8 1040EZ calculations: Presidential election yes 1. Total wages 5,132 2. Taxable interest 297 3. Adjusted gross 5,429 4. Parents 1,500 Line E 1,500 5. Taxable income 3,929 (a) 1040EZ calculations: Presidential election yes 1. Total wages 5,132 2. Taxable interest 297 ....

K. Rothermel, C. Cook, M. Burnett, J. Schonfeld, T. Green, and G. Rothermel, WYSIWYT Testing in the Spreadsheet Paradigm: An Empirical Evaluation, International Conference on Software Engineering (June 2000).

....the approach. Without this feature, the user may not realize that the testing she did before became irrelevant with her formula change and now needs to be redone. A primary goal of this approach is to reduce overconfidence about the correctness of spreadsheet formulas. Our empirical work (e.g. [Rothermel et al. 1999]) shows that the methodology does significantly reduce overconfidence about how tested the spreadsheet is, as well as improving effectiveness and efficiency of testing and debugging. 1040EZ calculations: Presidential election yes 1. Total wages 5,132 2. Taxable interest 297 3. Adjusted ....

K. Rothermel, C. Cook, M. Burnett, J. Schonfeld, T. Green, and G. Rothermel, "WYSIWYT Testing in the Spreadsheet Paradigm: An Empirical Evaluation," TR 99-60-08, Oregon State University, Computer Science Department, December 1999.

No context found.

K. J. Rothermel, et al., "WYSIWYT testing in the spreadsheet paradigm: an empirical evaluation," at Proceedings of the 22nd international conference on Software engineering, Limerick, Ireland, pp. 230 - 239, 2000.

No context found.

K. J. Rothermel, et al., "WYSIWYT testing in the spreadsheet paradigm: an empirical evaluation," at Proceedings of the 22nd international conference on Software engineering, Limerick, Ireland, pp. 230 - 239, 2000.

Online articles have much greater impact   More about CiteSeer.IST   Add search form to your site   Submit documents   Feedback  

CiteSeer.IST - Copyright Penn State and NEC