A framework for qualitative assessment of domain-specific languages

Kahraman G., Bilgen S.

SOFTWARE AND SYSTEMS MODELING, vol.14, no.4, pp.1505-1526, 2015 (SCI-Expanded) identifier identifier

  • Publication Type: Article / Article
  • Volume: 14 Issue: 4
  • Publication Date: 2015
  • Doi Number: 10.1007/s10270-013-0387-8
  • Journal Name: SOFTWARE AND SYSTEMS MODELING
  • Journal Indexes: Science Citation Index Expanded (SCI-EXPANDED), Scopus
  • Page Numbers: pp.1505-1526
  • Keywords: Domain-specific languages, Quality measures, Qualitative assessment, ISO/IEC 25010, CMMI
  • Middle East Technical University Affiliated: Yes

Abstract

Domain-specific languages (DSLs) are used for improving many facets of software development, but whether and to what extent this aim is achieved is an important issue that must be addressed. This paper presents a proposal for a Framework for Qualitative Assessment of DSLs (FQAD). FQAD is used for determining the perspective of the evaluator, understanding the goal of the assessment and selecting fundamental DSL quality characteristics to guide the evaluator in the process. This framework adapts and integrates the ISO/IEC 25010: 2011 standard, CMMImaturity level evaluation approach and the scaling approach used inDESMETinto a perspective-based assessment. A detailed list of domain-specific language quality characteristics is elaborated, and a novel assessment method is proposed. Two case studies through which FQAD is matured and evaluated are reported. The case studies have shown that stakeholders find the FQAD process beneficial.