[Context and motivation] It is desirable that requirement engineering methods are reliable, that is, that methods can be repeated with the same results. Risk assessments methods, however, often have low reliability when they identify risk mitigations for a system based on expert judgement.
[Question/problem] Our goal is to assess the reliability of an availability risk assessment method for telecominfrastructures, and to identify possibilities for improvement of its reliability.
[Principal ideas/results] We propose an experimental validation of reliability, and report on its application. We give a detailed analysis of sources of variation, explain how we controlled them and validated their mitigations, and motivate the statistical procedure used to analyse the outcome.
[Contribution] Our results can be used to improve the reliability of risk assessment methods. Our approach to validating reliability can be useful for the assessment of the reliability of other methods.
Keywords: Reliability; Risk assessment; Expert judgement; Experiment design; Telecommunications
|Title of host publication||Requirements Engineering (21st International Working Conference, REFSQ 2015, Essen, Germany, March 23-26, 2015. Proceedings)|
|Editors||S.A. Fricker, K. Schneider|
|Publication status||Published - 2015|
|Event||21st International Working Conference Requirements Engineering: Foundation for Software Quality (REFSQ 2015), March 23-26, 2015, Essen, Germany - Essen, Germany|
Duration: 23 Mar 2015 → 26 Mar 2015
|Name||Lecture Notes in Computer Science|
|Conference||21st International Working Conference Requirements Engineering: Foundation for Software Quality (REFSQ 2015), March 23-26, 2015, Essen, Germany|
|Abbreviated title||REFSQ 2015|
|Period||23/03/15 → 26/03/15|