Resubmission of #109922 to IEEE Transactions on Software Engineering A Controlled Experiment Measuring the Effects of Personal Software Process (PSP) Training
Abstract:
The Personal Software Process is a process improvement methodology aiming at individual software engineers. It claims to improve software quality (in particular defect content), effort estimation capability, and process adaptation and improvement capabilities. We have tested some of these claims in a controlled experiment comparing the performance of participants who had just previously received a PSP course to a control group of participants who had received other technical training instead. Each participant of both groups performed the same task. The results indicate that the improvements are smaller than the PSP proponents usually assume. We could not find improved effort estimation capabilities and only a small improvement of program reliability. Further important observations are the low actual usage of PSP techniques in the PSP group and the group's smaller variability in performance compared to the control group. We conjecture that PSP training does not typically realize its potential benefits (as seen in some industrial PSP success stories) when programmers are left alone with motivating themselves to actually use the PSP techniques.
Citations
| 274 | A Discipline For Software Engineering – Humphrey - 1995 |
| 38 | Using a Defined and Measured Personal Software Process – Humphrey - 1996 |
| 34 | An introduction to the bootstrap. Monographs on statistics and applied probability ; 57 – Efron, Tibshirani |
| 27 | The Personal Software Process (PSP): An Empirical Study of the Impact – Hayes, Over - 1997 |
| 19 | Experimental Methodology. Allyn and – Christensen - 1994 |
| 16 | A controlled experiment on the effects of psp training: Detailed description and evaluation – Prechelt, Unger - 1999 |
| 15 | Introducing the personal software process: Three industry cases – Ferguson, Humphrey, et al. - 1997 |
| 14 | The personal software process: A cautionary case study – Johnson, Disney - 1998 |
| 10 | Accelerating learning from experience: Avoiding defects faster – Prechelt, Grutter - 1999 |
| 9 | What happened at Hawthorne – Parsons - 1974 |
| 2 | How does individual variability influence schedule risk?: A small simulation with experiment data – Prechelt, Unger - 1999 |

