Call for challenge solutions

We are currently in Phase 2 of the challenge track, and the Call for Solutions is open. The following cases have been selected as representative and timely research challenges in the area of software and system product line engineering.

Check the complete information of the challenges at:

The newly accepted challenges are:

Variability Fault Localization: A Benchmark.
Kien-Tuan Ngo, Thu-Trang Nguyen, Son Nguyen and Hieu Vo Dinh

Managing Systems Evolving in Space and Time: Four Challenges for Maintenance, Evolution and Composition of Variants
Gabriela Karoline Michelon, David Obermann, Wesley K. G. Assunção, Lukas Linsbauer, Paul Grünbacher and Alexander Egyed

Challenges accepted in previous years (i.e., SPLC 2018, SPLC 2019, SPLC 2020):

Testing Configurable Software Systems: The Failure Observation Challenge.
Fischer Ferreira, Markos Viggiato, MaurÍcio Souza and Eduardo Figueiredo.

Variability Management meets Microservices: Six Challenges of Re-Engineering Microservice-Based Webshops.
Wesley K. G. Assunção, Jacob Krüger and Willian D. F. Mendonça.

A BDD for Linux? The Knowledge Compilation Challenge for Variability.
Thomas Thüm.

Applying Product Line Engineering Concepts to Deep Neural Networks
Javad Ghofrani, Ehsan Kozegar, Anna Lena Fehlhaber, and Mohammad Divband Soorati

Product Sampling for Product Lines: The Scalability Challenge
Tobias Pett, Thomas Thüm, Tobias Runge, Sebastian Krieter, Malte Lochau, and Ina Schaefer

Apo-Games – A Case Study for Reverse Engineering Variability from Cloned Java Variants
Jacob Krüger, Wolfram Fenske, Thomas Thüm, Dirk Aporius, Gunter Saake, and Thomas Leich

Feature Location Benchmark with ArgoUML SPL
Jabier Martinez, Nicolas Ordoñez, Xhevahire Tërnava, Tewfik Ziadi, Jairo Aponte, Eduardo Figueiredo, and Marco Tulio Valente

Interoperability of Software Product Line Variants
Ferruccio Damiani, Reiner Hähnle, Eduard Kamburjan, and Michael Lienhardt

Localizing Configurations in Highly-Configurable Systems
Paul Gazzillo, Ugur Koc, Thanhvu Nguyen, and Shiyi Wei

Each of these cases presents a set of concrete tasks (some of which may be optional) which are to be solved by the participants. The case descriptions, which typically include pointers to additional resources, are available through the respective links above.

The SPLC 2021 Challenge Track now seeks your solutions to all of these interesting problems of various natures. To participate, select a case you are interested in and submit a paper that tackles the tasks and challenges described in that challenge case. You are welcome to submit multiple papers, where each paper is related to one case. Papers should be accompanied by solution artifacts as necessary, depending on the case study and the concrete tasks which are to be solved. Thus, solution artifacts may range from hand-crafted sketches or models to fully automatically generated development artifacts or analysis results. Wherever possible, solution artifacts should be made available in a public repository or be hosted on a publicly available website to ensure the reproducibility of the results. The paper should include a description of your solution and include an evaluation according to the evaluation criteria stated by the respective case description. Note that early ideas, early results, and partial solutions are welcome. Also, note that submissions that apply existing tools and techniques to address a given challenge are also welcome.

Solutions will be evaluated by program committees, one separate committee per case, which are comprised of reviewers who have the expertise required to evaluate submitted solutions. Typically, one or two case authors are part of a case’s PC. Accepted solutions will be presented and discussed at the conference and their corresponding papers will be published in the official conference proceedings. Please note that case authors cannot submit a solution to their own case study in the same year that they present the case. For example, case authors of this edition of SPLC willing to provide solutions to their challenge can only submit to their own cases in the subsequent SPLC editions, but case authors of the previous SPLC edition can submit solutions to their own challenges.


If you have a solution for a challenge from the list above, please submit it through EasyChair (Challenge Solutions). Solutions have a maximum of 4 pages including all text, figures etc. One additional page containing only references may be included. Accepted papers will be presented during the conference. At least one author of each accepted solution must register to the conference.

Submissions must follow the ACM Master Article Template:

Latex users are indicated to use the “sigconf” option, so they are recommended to use the template that can be found in “sample-sigconf.tex”. In this way, the following latex code can be placed at the start of the latex document:


\acmConference[SPLC'21]{25th ACM International Systems and Software Product Line Conference}{6--11 September, 2021}{Leicester, United Kingdom}


The following describes the important dates for the whole timeline of the challenge track.

  • Case Submission Deadline: March 5, 2021
  • Case Notification: March 19, 2021
  • Case Camera Ready, Solution Call Released: March 28, 2021
  • Solution Submission Deadline: June 11, 2021
  • Solution Notification Deadline: June 25, 2021
  • Camera-ready Solution Papers: July 9, 2021


Iris Reinhartz-Berger

University of Haifa, IL

Paul Temple

University of Namur, BE


  • Angel Jesus Varela Vaca,  University of Seville,  Spain
  • Clement Quinton, University of Lille,  France
  • Danny Weyns, KU Leuven,  Belgium
  • Edson OliveiraJr, State University of Maringá,  Brazil
  • Goetz Botterweck,  Lero and Trinity College Dublin, Ireland
  • Jabier Martinez,  Tecnalia,  Spain
  • Jessie Galasso-Carbonnel,  Université de Montréal,  Canada
  • Jose Galindo,  University of Seville,  Spain
  • Lea Gerling,  University of Hildesheim,  Germany
  • Lukas Linsbauer,  Technical University of Braunschweig, Germany
  • Matthias Galster, University of Canterbury,  New Zealand
  • Sandra Greiner,  University of Bayreuth,  Germany
  • Sofia Ananieva,  FZI Research Center for Information Technology,  Germany
  • Stefan Fischer,  Software Competence Center Hagenberg,  Austria
  • Tewfik Ziadi, Sorbonne University, Paris,  France
  • Wesley Assuncao,  Federal University of Technology – Paraná,  Brazil