Please use this identifier to cite or link to this item:
doi:10.22028/D291-42137
Title: | Performance evolution of configurable software systems: an empirical study |
Author(s): | Kaltenecker, Christian Mühlbauer, Stefan Grebhahn, Alexander Siegmund, Norbert Apel, Sven |
Language: | English |
Title: | Empirical Software Engineering |
Volume: | 28 |
Issue: | 6 |
Publisher/Platform: | Springer Nature |
Year of Publication: | 2023 |
Free key words: | Configurable software systems Performance Evolution Performance changes |
DDC notations: | 004 Computer science, internet |
Publikation type: | Journal Article |
Abstract: | As a software system evolves, its performance can improve or degrade over time. Performance evolution is especially delicate in configurable software systems, where performance degradation may manifest only for specific configurations, making it especially hard to spot and fix. Problem. Prior work concentrated mainly on performance-bug detection and rootcause analysis of a single version of a system. The big picture of how performance co-evolves with a system and what role configurability plays is largely unclear. Approach. In an empirical study, we investigate the relation between configurability and performance evolution. Specifically, we analyze a total of 190 releases of 12 configurable real-world systems and examine the extent to which performance changes are specific to particular configurations and whether few or many configuration options cause performance changes. We triangulate our findings by analyzing change logs and commit messages of the respective projects to pin down causes of performance changes. Results. We found that almost every release of every subject system exhibits performance changes in some of their configurations. Notably, the majority of performance changes affects only a subset of the configuration space, and most performance changes are triggered by multiple options (up to 6). In a deeper analysis, we found that a considerable number of releases mention performance changes in the change log and commits: performance changes are reported in 45% and 69% of the releases in the change log and the commit messages, respectively, but only a fraction report the involved configuration options. |
DOI of the first publication: | 10.1007/s10664-023-10338-3 |
URL of the first publication: | https://link.springer.com/article/10.1007/s10664-023-10338-3 |
Link to this record: | urn:nbn:de:bsz:291--ds-421370 hdl:20.500.11880/37775 http://dx.doi.org/10.22028/D291-42137 |
ISSN: | 1573-7616 1382-3256 |
Date of registration: | 4-Jun-2024 |
Faculty: | MI - Fakultät für Mathematik und Informatik |
Department: | MI - Informatik |
Professorship: | MI - Prof. Dr. Sven Apel |
Collections: | SciDok - Der Wissenschaftsserver der Universität des Saarlandes |
Files for this record:
File | Description | Size | Format | |
---|---|---|---|---|
s10664-023-10338-3.pdf | 3,05 MB | Adobe PDF | View/Open |
This item is licensed under a Creative Commons License