logo

Verification and Validation

People | Demos/applications | Courses | Publications | Master Thesis

Verification and validation (V&V) of software systems take a substantial share of project efforts. Shares up to 50% of the total project budget spent on V&V are often reported. Further, for certain application domains, particularly for embedded systems, the software quality may be crucial. Hence, the efficiency and effectiveness of the V&V process is important. This project aims at understanding the current practice and improving the verification and validation processes. These needs are identified in surveys conducted among LUCAS partners, ending up in the following research issues:
• Inspection and testing techniques are investigated in empirical studies, both with respect to effectiveness and efficiency of reading methods used in the inspection, and prediction models for estimation of remaining defects after an inspection.
• Test selection techniques for system test are developed and evaluated for characteristics of software systems.
• Methods for understanding and planning of V&V activities, based on building and running simulation models.
• Tools support is developed and evaluated for statistical usage testing.

People
Dr. Carina Andersson, Dr. Tomas Berling, Ph.D. Stud. Emelie Engström, Dr. Martin Höst, Prof. Per Runeson, Dr. Thomas Thelin

Contact: Prof. Per Runeson

Funded projects	1999	2000	2001	2002	2003	2004	2005	2006	2007	2008	Funder
REVEAL	x	x									VINNOVA
MaTeLo				x	x	x					EU
Rådsforskare programvaruteknik							x	x	x		Vetenskapsrådet
UPPREPA								x	x	x	VINNOVA

Demos and applications
Matelo

Postgraduate or industry courses
LUCAS Test Academy (2004/2005)
Software Engineering for Technical Managers at SEMC (2002)

Related undergraduate courses
Software Testing

Publications

2006

Per Runeson A Survey of Unit Testing Practices SW - IEEE Software, June 2006

Andersson, Carina Managing Software Quality through Empirical Analysis of Fault Detection Ph D Thesis ISSN 1101-3931,ISRN LUTEDX/TETS--1079--SE+216P
Per Runeson, Carina Andersson, Anneliese Andrews, Tomas Berling, Thomas Thelin What Do We Know about Defect Detection Methods? SW - IEEE Software, May/June 2006, pp82-90

2005

Daniel Karlström Per Runeson Sara Nordén A Minimal Test Practice Framework for Emerging Software Organisations STVR - Software Testing, Verification and Reliability
Mats Skoglund, Per Runeson A case study of the class firewall regression test selection technique on a large scale distributed software system Proceedings of the International Symposium on Empirical Software Engineering (ISESE), Australia, 2005
Robert Nilsson, Dan Henriksson Test Case Generation for Flexible Real-Time Control Systems In Proceedings of the 10th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA05), Catania, Sicily, Italy, September 2005.

2004

Thomas Thelin Håkan Petersson Per Runeson Claes Wohlin Applying Sampling to Improve Software Inspections JSS'04 - Journal of Systems and Software, 73(2):257-269, 2004
Håkan Petersson Thomas Thelin Per Runeson Claes Wohlin Capture-Recapture in Software Inspections after 10 Years Research - Theory, Evaluation and Application JSS'04 - Journal of Systems and Software, 72(2):249-264, 2004.
Magnus C Ohlsson Thomas Ericson Thomas Thelin Effective Inspections - Are They Achievable? ICSTEST’04 - International Conference on Software Testing
Hélène LeGuen Raymond Marie Thomas Thelin Reliability Estimation for Statistical Usage Testing using Markov Chains ISSRE'04 - International Symposium on Software Reliability Engineering
Thomas Thelin Team-based Fault Content Estimation in the Software Inspection Process ICSE'04 - to appear in International Conference on Software Engineering, 2004
Thomas Thelin Per Andersson Jeremy Harrell Tool Support for Usage-Based Reading SE'04 - IASTED International Conference on Software Engineering
Tomas Berling Thomas Thelin A Case Study of Reading Techniques in a Software Company ISESE’04 - International Symposium on Empirical Software Engineering
Mats Skoglund Per Runeson A Case Study on Regression Test Suite Maintenance in System Evolution ICSM'04 - The 20th IEEE International Conference on Software Maintenance, pp. 438-442, 2004
Thomas Thelin Carina Andersson Per Runeson Nina Dzamashvili-Fogelström A Replicated Experiment of Usage-Based and Checklist-Based Reading METRICS’04 - International Symposium on Software Metrics, pp 246-256, 2004
Per Runeson Måns Holmstedt-Jönsson Fredrik Scheja Are Found Defects an Indicator of Software Correctness? - An Investigation in a Controlled Case Study ISSRE04 - International Symposium on Software Reliability Engineering, pp. 91-100, 2004
Thomas Thelin Per Runeson Claes Wohlin Thomas Olsson Carina Andersson Evaluation of Usage-Based Reading - Conclusions after Three Experiments ESE - Empirical Software Engineering: An International Journal, 9(1):77-110, 2004.

2003

Berling, T., Höst, M. A Case Study Investigating the Characteristics of Verification and Validation Activities in the Software Development Process Track on software process and product improvement at Euromicro 03, 2003
Berling, T., Andersson, C., Höst, M., Nyberg , C. Adaptation of a System Dynamics Model Template for Code Development and Testing to an Industrial Project ProSim03 - Software Process Simulation Modeling workshop, Portland, USA, May 3-4, 2003, Co-located with ICSE 03
Thelin, T., Runeson, P. and Wohlin, C. An Experimental Comparison of Usage-Based and Checklist-Based Reading IEEE Transactions on Software Engineering, 29(8):687-704, 2003
Andersson, C., Thelin, T., Runeson, P. and Dzamashvili, D. An Experimental Evaluation of Inspection and Testing for Detection of Design Faults Proceedings of the International Symposium on Empirical Software Engineering, pp. 174-184, 2003
Berling, T. and Thelin, T. An Industrial Case Study of the Verification and Validation Activities Proceedings International Software Metrics Symposium, pp. 226-238, 2003
Runeson, P. and Thelin, T. Case Study Using Sampling to Improve Software Inspection Effectiveness Proceedings of the International Symposium on Empirical Software Engineering, pp. 252-260, 2003
Runeson, P. and Andrews, A. Detection or Isolation of Defects? An Experimental Comparison of Unit Testing and Code Inspection ISSRE’03 - Proceedings 14th International Symposium on Software Reliability Engineering
Runeson, P and Andrews, A. Detection or Isolation of Defects? An Experimental Comparison of Unit Testing and Code Inspection Proceedings 14th International Symposium on Software Reliability Engineering, pp 3-13, 2003
Berling, T., and Runeson, P. Efficient Evaluation of Multifactor Dependent System Performance Using Fractional Factorial Design IEEE Transactions on Software Engineering, 29(9):769-781, 2003
Thelin, T. Empirical Evaluations of Usage-Based Reading and Fault Content Estimation for Software Inspections Empirical Software Engineering: An International Journal, 8(3):309-313, 2003
Berling, T. and Runeson, P. Evaluation of a Perspective Based Review Method Applied in an Industrial Setting IEE proceedings Software, Vol. 150, No. 3, pp. 177-184, June, 2003
Thelin, T., Erlansson, M., Höst, M. and Wohlin, C. Experimentation with Usage-Based Reading Book chapter in Empirical Methods and Studies in Software Engineering – Experiences from ESERNET (chapter 11)
Andersson, C. Exploring the Software Verification and Validation Process with Focus on Efficient Fault Detection Lic. Thesis ISSN 1101-3931, ISRN LUTEDX/TETS--1062--SE+134P, 2003
Berling, T. Increasing Product Quality by Verification and Validation Improvements in an Industrial Setting Doc. thesis dissertation, ISSN 1101-3931, ISRN LUTEDX/TETS--1065--SE+208p, December 2003
Le Guen, H. and Thelin T. Practical Experieces about Statistical Usage Testing Software Technology and Engineering Practice – Workshop on Software Test and Reliability Estimation Process, 2003
Thelin, T., Runeson, P. and Wohlin, C. Prioritized Use Cases as a Vehicle for Software Inspections IEEE Software, 20(4):30-33, 2003
Thelin, T. Statistical Usage Testing using the MaTeLo Tool Proceedings 11th European International Conference on Software Testing, Analysis & Review, 2003
Runeson, P. and Andersson, C., Höst, M. Test Processes in Software Product Evolution - A Qualitative Survey on the State of Practice Journal of Software Maintenance and Evolution, Vol. 15, Issue 1, 2003

2002

Petersson, H., Thelin, T., Runeson, P. and Wohlin, C., Capture-Recapture in Software Inspections after 10 Years Research – Theory, Evaluation and Application to appear in Journal of Systems and Software
Thelin, T., Empirical Evaluations of Usage-Based Reading and Fault Content Estimation for Software Inspections Ph.D. Thesis: ISSN 1101-3931, ISRN LUTEDX/TETS--1056--SE+210P, Dept. of Communication Systems, Lund University, 2002
Stringfellow, C., von Mayrhauser, A., Wohlin, C., Petersson, H., Estimating the Number of Components with Defects Post-release that Showed No Defects in Testing STVR - Software Testing, Verification and Reliability Vol. 12, No.2, pp. 93-122, 2002
Karlström, D., Nordén., S., Incremental Introduction of a Structured Test Practice Framework Emerging Software Development Organisations Proceedings of the Second Conference on Software Engineering Research and Practice in Sweden, 2002
Wohlin, C., Aurum, A., Petersson, H., Shull, F., Ciolkowski, M., Software inspection benchmarking-a qualitative and quantitative comparative opportunity METRICS 2002 - Proceedings of the Eighth IEEE Symposium on Software Metrics, 2002, pp. 118-127, 2002
Aurum, A., Petersson, H. and Wohlin, C., State-of-the-Art: Software Inspections After 25 Years STVR - Software Testing, Verification and Reliability, Vol. 12, No. 3, pp. 133-154, 2002
Petersson, H., Supporting Software Inspections through Fault Content Estimation and Effectiveness Analysis Doc. Thesis, Dept. of Communication Systems, report number ISRN LUTEDX/TETS-1055-SE+237P, 2002
Runeson, P., Andersson, C. and Höst, M. Test Processes in Software Product Evolution - A Qualitative Survey on the State of Practice JSME - Journal of Software Maintenance and Evolution, 2002
Thelin,T., Runeson, P. and Regnell, B., Usage-Based Reading - An Experiment to Guide Reviewers with Use Cases Information and Software Technology, 43(15):925-938, 2002
Andersson, C. and Runeson P. Verification and Validation in Industry -A Qualitative Survey on the State of Practice ISESE'02 - International Symposium on Empirical Software Engineering, pp 37-47, 2002

2001

Petersson H. and Thelin T., A Survey of Capture-Recapture in Software Inspections In Proc. of the first Swedish Conference on Software Engineering Research and Practice, Ronneby, Sweden 2001
Olsson, T., Bauer, N., Runeson, P. and Bratthall, L., An Experiment on Lead-Time Impact in Testing of Distributed Real-Time Systems International Symposium on Software Metrics, London UK, pp. 159-168, 2001
Thelin, T., Runeson, P. and Wohlin, C., An Experimental Comparison of Usage-Based and Checklist-Based Reading In Prceedings of 1st Workshop on Inspection sin Software Engineering, Paris, France, pp. 136-144, 2001
Olsson, T. and Runeson, Per, Baselining Software Processes as a Starting Point for Research and Improvement In Proc. of the first Swedish Conference on Software Engineering Research and Practice, Ronneby, Sweden 2001
Wohlin C., Petersson H., Höst, M. and Runeson, P., Defect Content Estimation for Two Reviewers 12th International Symposium on Software Reliability Engineering, Hong Kong, China, November 2001
Berling, T. and Runeson, P., Evaluation of a Perspective Based Review Method Performed in an Industrial Setting Proceedings 5th International Conference on Empirical Assessment & Evaluation in Software Engineering, (EASE) Keele University, Staffordshire, UK, 2001
Berling, T., Improving Product Quality through Effective Validation Methods Licentiate Thesis ISRN LUTEDX/TETS-1050-SE+136P
Petersson, H, Individual Reviewer Contribution to the Effectiveness of Software Inspection Teams In Proc. of the 13th Australian Software Engineering Conference, Canberra, Australia, 2001
Olsson, T. and Runeson, P., Information Refinement using Hierarchical Structures Workshop on Living with Inconsistency, International Conference on Software Engineering, Toronto, May 2001
Thelin, T., Petersson, H. and Wohlin, C., Sample-Driven Inspections Proceedings Workshop on Inspection in Software Engineering (WISE'01), pp. 81-91, Paris, France July 2001
Olsson, T. and Runeson, P., System Level Mutation Analysis Applied to a State-Based Language International Conference and Workshop on the Engineering of Computer Based Systems (ECBS), April 2001
Thelin, T., Runeson, P. and Regnell, B., Usage-Based Reading - An Experiment to Guide Reviewers with Use Cases Accepted for publication in Information and Software Technology, special issue on Controlled Experiments in Software Engineering, 2001

2000

Bratthall, L., Adelswärd, K., Eriksson, W. and Runeson, P., A Survey of Lead-Time Challenges in the Development and Evolution of Distributed Real-Time Systems Information and Software Technology, Vol. 42, No. 13, pp. 947-958, 2000
Wesslén, A., Runeson, P. and Regnell, B., Analyzing the Sensitivity to Usage Profile Changes in test Planning Proceedings 11th International Symposium on Software Reliability Engineering (ISSRE00), pp 317-326, 2000
Berling, T. and Runeson, P., Application of Factorial Design to Validation of System Performance Proceedings of the 7th Annual IEEE International Conference and Workshop on the Engineering of Computer Based Systems (ECBS), pp. 318-326, Edinburgh, Scotland, UK, April, 2000
Regnell, B., Runeson, P. and Thelin, T., Are the Perspectives Really Different? Further Experimentation on Scenario-Based Reading on Requirement Empirical Software Engineering: An International Journal, December 2000
Olsson, T., Johan Nilsson, Baseline of Current Practise at ABB APR Technical report, November 2000
Thelin, T., Controlling Software Quality through Software Inspections and Testing Licentiate Thesis ISRN LUTEDX/TETS-1045-SE+146P
Petersson, H. and Wohlin, C., Evaluating Defect Content Estimation Rules in Software Inspections Proceedings EASE: Empirical Assessment and Evaluation in Software Engineering, Keele University, Staffordshire, UK, April, 2000
Thelin, T. and Runeson, P., Fault Content Estimations using Extended Curve Fitting Models and Model Selection Proceedings 4th International Conference on Empirical Assessment & Evaluation in Software Engineering, (EASE00) Keele University, Staffordshire, UK, 2000
Petersson, H., On Fault Content Estimations Applied to Software Inspections and Testing Licentiate Thesis ISRN LUTEDX/TETS-1046-SE+144P
Thelin, T. and Runeson, P., Robust Estimations of Fault Content with Capture-Recapture and Detection Profile Estimators Journal of Systems and Software, Vol. 52, No. 2-3, pp. 139-148, June 2000
Wohlin, Claes, Höst, M., Ohlsson, M. C., Understanding the Sources of Software Defects: A Filtering Approach In proceedings of 8th International Workshop on Program Comprehension, pp. 9-17, Limerick, Ireland, 10-11 June 2000

Master Thesis Projects

2006

Development and evaluation of support for requirements engineering and testing by Linda Andersson, Mariana Chevez at Conveneer

2005

Development of a suitable framework for Unit Testing precompiled components using Java by Johan Lundquist and Einar Boson at SonyEricsson
Hardware simulation for testing IEC 61131-3 by Adrian Ulander and Johan Holmqvist at Alfa Laval,Tumba
Utvärdering av testverktyg för B2B-lösningar by Albin Kjellin at Connecta AB
Using Simulations to Estimate Software Inspection Performance by Mattias Wiberg

2004

Test Automation at ABB Automation Technologies AB - implementation and Evaluation by Elin Alwall and Ardina Tkalcevic at ABB

Last update: Wednesday, 04-Apr-2007 11:45:45 CEST