Metrics design for safety assessment

Research output: Contribution to journalArticleAcademicpeer-review

6 Citations (Scopus)
12 Downloads (Pure)

Abstract

Context:In the safety domain, safety assessment is used to show that safety-critical systems meet the required safety objectives. This process is also referred to as safety assurance and certification. During this procedure, safety standards are used as development guidelines to keep the risk at an acceptable level. Safety-critical systems can be assessed according to those safety standards. Objective:Due to the manual work, safety assessment processes are costly, time consuming, and hard to be estimated. The goal of this paper is to design metrics for safety assessment. These metrics can, for instance, identify costly processes in the safety assessment process. In this paper we propose a methodology to design metrics for safety assessment from different perspectives. For the demonstration and validation of our method, we focus on safety assessment in the automotive domain (ISO 26262). Method:Metrics can be identified by answering three questions. Three different sources of information have been identified for obtaining metrics: industrial interests, safety standards, and available data. For each of these sources appropriate methods have been proposed and used for obtaining the relevant metrics. These methods include GQM-based surveys, PSM-based procedure, and brainstorming. For the validation, the ISO 26262 standard has been studied for obtaining safety standard related metrics. Results:A case study in the context of the European project OPENCOSS is carried out to demonstrate the method. Finally, there are 76 metrics obtained and a validation of these metrics has been done by means of a survey amongst 24 experts from 13 project partners. Conclusion:It can be concluded that metrics for safety assessment can be derived from three sources. Different methods for designing metrics have to be used for each source. The validation shows that most of the relevant metrics are useful for industry.

Original languageEnglish
Pages (from-to)151-163
JournalInformation and Software Technology
Volume73
DOIs
Publication statusPublished - 24 Mar 2016

Fingerprint

Demonstrations
Industry

Keywords

  • Functional safety
  • ISO 26262
  • Metrics
  • Practical Software and Systems Measurement
  • Safety assessment

Cite this

@article{ba701f6e81f04a2e8d12b277bc85da54,
title = "Metrics design for safety assessment",
abstract = "Context:In the safety domain, safety assessment is used to show that safety-critical systems meet the required safety objectives. This process is also referred to as safety assurance and certification. During this procedure, safety standards are used as development guidelines to keep the risk at an acceptable level. Safety-critical systems can be assessed according to those safety standards. Objective:Due to the manual work, safety assessment processes are costly, time consuming, and hard to be estimated. The goal of this paper is to design metrics for safety assessment. These metrics can, for instance, identify costly processes in the safety assessment process. In this paper we propose a methodology to design metrics for safety assessment from different perspectives. For the demonstration and validation of our method, we focus on safety assessment in the automotive domain (ISO 26262). Method:Metrics can be identified by answering three questions. Three different sources of information have been identified for obtaining metrics: industrial interests, safety standards, and available data. For each of these sources appropriate methods have been proposed and used for obtaining the relevant metrics. These methods include GQM-based surveys, PSM-based procedure, and brainstorming. For the validation, the ISO 26262 standard has been studied for obtaining safety standard related metrics. Results:A case study in the context of the European project OPENCOSS is carried out to demonstrate the method. Finally, there are 76 metrics obtained and a validation of these metrics has been done by means of a survey amongst 24 experts from 13 project partners. Conclusion:It can be concluded that metrics for safety assessment can be derived from three sources. Different methods for designing metrics have to be used for each source. The validation shows that most of the relevant metrics are useful for industry.",
keywords = "Functional safety, ISO 26262, Metrics, Practical Software and Systems Measurement, Safety assessment",
author = "Yaping Luo and {van den Brand}, M.G.J.",
year = "2016",
month = "3",
day = "24",
doi = "10.1016/j.infsof.2015.12.012",
language = "English",
volume = "73",
pages = "151--163",
journal = "Information and Software Technology",
issn = "0950-5849",
publisher = "Elsevier",

}

Metrics design for safety assessment. / Luo, Yaping; van den Brand, M.G.J.

In: Information and Software Technology, Vol. 73, 24.03.2016, p. 151-163.

Research output: Contribution to journalArticleAcademicpeer-review

TY - JOUR

T1 - Metrics design for safety assessment

AU - Luo, Yaping

AU - van den Brand, M.G.J.

PY - 2016/3/24

Y1 - 2016/3/24

N2 - Context:In the safety domain, safety assessment is used to show that safety-critical systems meet the required safety objectives. This process is also referred to as safety assurance and certification. During this procedure, safety standards are used as development guidelines to keep the risk at an acceptable level. Safety-critical systems can be assessed according to those safety standards. Objective:Due to the manual work, safety assessment processes are costly, time consuming, and hard to be estimated. The goal of this paper is to design metrics for safety assessment. These metrics can, for instance, identify costly processes in the safety assessment process. In this paper we propose a methodology to design metrics for safety assessment from different perspectives. For the demonstration and validation of our method, we focus on safety assessment in the automotive domain (ISO 26262). Method:Metrics can be identified by answering three questions. Three different sources of information have been identified for obtaining metrics: industrial interests, safety standards, and available data. For each of these sources appropriate methods have been proposed and used for obtaining the relevant metrics. These methods include GQM-based surveys, PSM-based procedure, and brainstorming. For the validation, the ISO 26262 standard has been studied for obtaining safety standard related metrics. Results:A case study in the context of the European project OPENCOSS is carried out to demonstrate the method. Finally, there are 76 metrics obtained and a validation of these metrics has been done by means of a survey amongst 24 experts from 13 project partners. Conclusion:It can be concluded that metrics for safety assessment can be derived from three sources. Different methods for designing metrics have to be used for each source. The validation shows that most of the relevant metrics are useful for industry.

AB - Context:In the safety domain, safety assessment is used to show that safety-critical systems meet the required safety objectives. This process is also referred to as safety assurance and certification. During this procedure, safety standards are used as development guidelines to keep the risk at an acceptable level. Safety-critical systems can be assessed according to those safety standards. Objective:Due to the manual work, safety assessment processes are costly, time consuming, and hard to be estimated. The goal of this paper is to design metrics for safety assessment. These metrics can, for instance, identify costly processes in the safety assessment process. In this paper we propose a methodology to design metrics for safety assessment from different perspectives. For the demonstration and validation of our method, we focus on safety assessment in the automotive domain (ISO 26262). Method:Metrics can be identified by answering three questions. Three different sources of information have been identified for obtaining metrics: industrial interests, safety standards, and available data. For each of these sources appropriate methods have been proposed and used for obtaining the relevant metrics. These methods include GQM-based surveys, PSM-based procedure, and brainstorming. For the validation, the ISO 26262 standard has been studied for obtaining safety standard related metrics. Results:A case study in the context of the European project OPENCOSS is carried out to demonstrate the method. Finally, there are 76 metrics obtained and a validation of these metrics has been done by means of a survey amongst 24 experts from 13 project partners. Conclusion:It can be concluded that metrics for safety assessment can be derived from three sources. Different methods for designing metrics have to be used for each source. The validation shows that most of the relevant metrics are useful for industry.

KW - Functional safety

KW - ISO 26262

KW - Metrics

KW - Practical Software and Systems Measurement

KW - Safety assessment

UR - http://www.scopus.com/inward/record.url?scp=84961286869&partnerID=8YFLogxK

U2 - 10.1016/j.infsof.2015.12.012

DO - 10.1016/j.infsof.2015.12.012

M3 - Article

AN - SCOPUS:84961286869

VL - 73

SP - 151

EP - 163

JO - Information and Software Technology

JF - Information and Software Technology

SN - 0950-5849

ER -