Software complexity and testing effectiveness : an empirical study

K. Kevrekidis; S. Albers; P.J.M. Sonnemans; G.M. Stollman

doi:10.1109/RAMS.2009.4914733

Software complexity and testing effectiveness : an empirical study

K. Kevrekidis
, S. Albers
, P.J.M. Sonnemans
, G.M. Stollman

Onderzoeksoutput: Hoofdstuk in Boek/Rapport/Congresprocedure › Conferentiebijdrage › Academic › peer review

8 Citaten (Scopus)

8 Downloads (Pure)

Samenvatting

This paper presents a simple method for evaluating the effectiveness of testing strategies by using the relation between software reliability and software complexity. A wide range of metrics from the literature are being tested for their suitability in measuring changes in software complexity of software code at different levels of system partitioning. Reliability data from software tests and operational data of professional systems from the field are examined for their dependency on software complexity. Does more complex software require more rigorous testing? Is current testing adequate for taking the complexity factor out of the equation or does it still remain relevant for software reliability in the field? The results of the statistical analysis show that software complexity is relevant during testing, affecting the amount of discovered errors. It does not affect software field reliability once the code has been debugged. In addition it is suggested that software complexity metrics when used to measure software changes, should be applied to low level software partitioning before integration

Originele taal-2	Engels
Titel	Proceedings of the 55th Annual Reliability and Maintainability Symposium 2009 (RAMS 2009), January 26-29, 2009, Fort Worth
Plaats van productie	Piscataway
Uitgeverij	Institute of Electrical and Electronics Engineers
Pagina's	539-543
ISBN van geprinte versie	978-1-4244-2508-2
DOI's	https://doi.org/10.1109/RAMS.2009.4914733
Status	Gepubliceerd - 2009
Evenement	conference; RAMS 2009 Annual Reliability and Maintainability Symposium RAMS : January 26-29, 2009, Fort Worth TX, USA; 2009-01-26; 2009-01-29 - Duur: 26 jan. 2009 → 29 jan. 2009

Congres

Congres	conference; RAMS 2009 Annual Reliability and Maintainability Symposium RAMS : January 26-29, 2009, Fort Worth TX, USA; 2009-01-26; 2009-01-29
Periode	26/01/09 → 29/01/09
Ander	RAMS 2009 Annual Reliability and Maintainability Symposium RAMS : January 26-29, 2009, Fort Worth TX, USA

Toegang tot document

10.1109/RAMS.2009.4914733

Citeer dit

Kevrekidis, K., Albers, S., Sonnemans, P. J. M., & Stollman, G. M. (2009). Software complexity and testing effectiveness : an empirical study. In Proceedings of the 55th Annual Reliability and Maintainability Symposium 2009 (RAMS 2009), January 26-29, 2009, Fort Worth (blz. 539-543). Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/RAMS.2009.4914733

@inproceedings{fc9310cf557f430ca51ef464a73f45f5,

title = "Software complexity and testing effectiveness : an empirical study",

abstract = "This paper presents a simple method for evaluating the effectiveness of testing strategies by using the relation between software reliability and software complexity. A wide range of metrics from the literature are being tested for their suitability in measuring changes in software complexity of software code at different levels of system partitioning. Reliability data from software tests and operational data of professional systems from the field are examined for their dependency on software complexity. Does more complex software require more rigorous testing? Is current testing adequate for taking the complexity factor out of the equation or does it still remain relevant for software reliability in the field? The results of the statistical analysis show that software complexity is relevant during testing, affecting the amount of discovered errors. It does not affect software field reliability once the code has been debugged. In addition it is suggested that software complexity metrics when used to measure software changes, should be applied to low level software partitioning before integration",

author = "K. Kevrekidis and S. Albers and P.J.M. Sonnemans and G.M. Stollman",

year = "2009",

doi = "10.1109/RAMS.2009.4914733",

language = "English",

isbn = "978-1-4244-2508-2",

pages = "539--543",

booktitle = "Proceedings of the 55th Annual Reliability and Maintainability Symposium 2009 (RAMS 2009), January 26-29, 2009, Fort Worth",

publisher = "Institute of Electrical and Electronics Engineers",

address = "United States",

note = "conference; RAMS 2009 Annual Reliability and Maintainability Symposium RAMS : January 26-29, 2009, Fort Worth TX, USA; 2009-01-26; 2009-01-29 ; Conference date: 26-01-2009 Through 29-01-2009",

}

Kevrekidis, K, Albers, S, Sonnemans, PJM & Stollman, GM 2009, Software complexity and testing effectiveness : an empirical study. in Proceedings of the 55th Annual Reliability and Maintainability Symposium 2009 (RAMS 2009), January 26-29, 2009, Fort Worth. Institute of Electrical and Electronics Engineers, Piscataway, blz. 539-543, conference; RAMS 2009 Annual Reliability and Maintainability Symposium RAMS : January 26-29, 2009, Fort Worth TX, USA; 2009-01-26; 2009-01-29, 26/01/09. https://doi.org/10.1109/RAMS.2009.4914733

Software complexity and testing effectiveness : an empirical study. / Kevrekidis, K.; Albers, S.; Sonnemans, P.J.M. et al.
Proceedings of the 55th Annual Reliability and Maintainability Symposium 2009 (RAMS 2009), January 26-29, 2009, Fort Worth. Piscataway: Institute of Electrical and Electronics Engineers, 2009. blz. 539-543.

Onderzoeksoutput: Hoofdstuk in Boek/Rapport/Congresprocedure › Conferentiebijdrage › Academic › peer review

TY - GEN

T1 - Software complexity and testing effectiveness : an empirical study

AU - Kevrekidis, K.

AU - Albers, S.

AU - Sonnemans, P.J.M.

AU - Stollman, G.M.

PY - 2009

Y1 - 2009

N2 - This paper presents a simple method for evaluating the effectiveness of testing strategies by using the relation between software reliability and software complexity. A wide range of metrics from the literature are being tested for their suitability in measuring changes in software complexity of software code at different levels of system partitioning. Reliability data from software tests and operational data of professional systems from the field are examined for their dependency on software complexity. Does more complex software require more rigorous testing? Is current testing adequate for taking the complexity factor out of the equation or does it still remain relevant for software reliability in the field? The results of the statistical analysis show that software complexity is relevant during testing, affecting the amount of discovered errors. It does not affect software field reliability once the code has been debugged. In addition it is suggested that software complexity metrics when used to measure software changes, should be applied to low level software partitioning before integration

AB - This paper presents a simple method for evaluating the effectiveness of testing strategies by using the relation between software reliability and software complexity. A wide range of metrics from the literature are being tested for their suitability in measuring changes in software complexity of software code at different levels of system partitioning. Reliability data from software tests and operational data of professional systems from the field are examined for their dependency on software complexity. Does more complex software require more rigorous testing? Is current testing adequate for taking the complexity factor out of the equation or does it still remain relevant for software reliability in the field? The results of the statistical analysis show that software complexity is relevant during testing, affecting the amount of discovered errors. It does not affect software field reliability once the code has been debugged. In addition it is suggested that software complexity metrics when used to measure software changes, should be applied to low level software partitioning before integration

U2 - 10.1109/RAMS.2009.4914733

DO - 10.1109/RAMS.2009.4914733

M3 - Conference contribution

SN - 978-1-4244-2508-2

SP - 539

EP - 543

BT - Proceedings of the 55th Annual Reliability and Maintainability Symposium 2009 (RAMS 2009), January 26-29, 2009, Fort Worth

PB - Institute of Electrical and Electronics Engineers

CY - Piscataway

T2 - conference; RAMS 2009 Annual Reliability and Maintainability Symposium RAMS : January 26-29, 2009, Fort Worth TX, USA; 2009-01-26; 2009-01-29

Y2 - 26 January 2009 through 29 January 2009

ER -

Software complexity and testing effectiveness : an empirical study

Samenvatting

Congres

Toegang tot document

Vingerafdruk

Citeer dit