ContinuITy: Automated Performance Testing in Continuous Software Engineering

Follow us on GitHub

Press Releases

  • ContinuITY: New Research Project (SPEC RG Newsletter, vol. 2, issue 3, 2018)
    Dušan Okanović, André van Hoorn, Henning Schulz, and Christoph Heger


Research Publications

  • Scalability Assessment of Microservice Architecture Deployment Configurations: A Domain-based Approach Leveraging Operational Profiles and Load Tests. (full paper)
    Alberto Avritzer, Vincenzo Ferme, Andrea Janes, Barbara Russo, André van Hoorn, Henning Schulz, Daniel Menasché, and Vilc Rufino
    Journal of Systems and Software, 2020
  • Can a chatbot support software engineers with load testing? Approach and experiences. (full paper)
    Dusan Okanovic, Samuel Beck, Lasse Merz, Christoph Zorn, Leonel Merino, Andre van Hoorn, and Fabian Beck
    Proceedings of the 11th ACM/SPEC International Conference on Performance Engineering (ICPE 2020), 2020
  • Microservices: A performance tester’s dream or nightmare? (full paper)
    Simon Eismann, Cor-Paul Bezemer, Weiyi Shang, André van Hoorn, and Dušan Okanović
    Proceedings of the 11th ACM/SPEC International Conference on Performance Engineering (ICPE 2020), 2020
  • Reducing the maintenance effort for parameterization of representative load tests using annotations (full paper)
    Henning Schulz, André van Hoorn, and Alexander Wert
    Software Testing, Verification & Reliability, 2020
  • Agile scalability engineering: The ScrumScale method (in press)
    Gunnar Brataas, Geir Kjetil Hanssen, Nikolas Herbst, and André van Hoorn
    IEEE Software, 2019.
  • Microservice-tailored generation of session-based workload models for representative load testing (full paper, slides)
    Henning Schulz, Tobias Angerstein, Dušan Okanović, and André van Hoorn
    Proceedings of the 27th IEEE International Symposium on the Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS 2019), 2019
  • Behavior-driven Load Testing Using Contextual Knowledge: Approach and Experiences (full paper, slides)
    Henning Schulz, Dusan Okanovic, Andre van Hoorn, Vincenzo Ferme, and Cesare Pautasso
    Proceedings of the 10th ACM/SPEC International Conference on Performance Engineering (ICPE) 2019, Mumbai, India
  • Concern-driven Reporting of Software Performance Analysis Results (full paper, slides)
    Dusan Okanovic, Andre van Hoorn, Christoph Zorn, Fabian Beck, Vincenzo Ferme, and Jürgen Walter
    Proceedings of the 10th ACM/SPEC International Conference on Performance Engineering (ICPE) 2019, Mumbai, India
  • How is Performance Addressed in DevOps? A Survey on Industrial Practices (full paper, slides)
    Cor-Paul Bezemer, Simon Eismann, Vincenzo Ferme, Johannes Grohmann, Robert Heinrich, Pooyan Jamshidi, Weiyi Shang, Andre van Hoorn, Monica Villaviencio, Jürgen Walter, and Felix Willnecker
    Proceedings of the 10th ACM/SPEC International Conference on Performance Engineering (ICPE) 2019, Mumbai, India
  • PPTAM: Production and Performance Testing Based Application Monitoring (tool paper, poster)
    Alberto Avritzer, Daniel Sadoc Menasche, Vilc Rufino, Barbara Russo, Andrea Janes, Vincenzo Ferme, Andre van Hoorn, and Henning Schulz
    Proceedings of the 10th ACM/SPEC International Conference on Performance Engineering (ICPE) 2019, Mumbai, India
  • Application Performance Management: Measuring and Optimizing the Digital Customer Experience (e-Book (open-access version))
    André van Hoorn and Stefan Siegl
    e-Book, SIGS DATACOM GmbH, 2018, Troisdorf, Germany
  • A Quantitative Approach for the Assessment of Microservice Architecture Deployment Alternatives by Automated Performance Testing (full paper)
    Alberto Avritzer, Vincenzo Ferme, Andrea Janes, Barbara Russo, Henning Schulz, and André van Hoorn
    Proceedings of the 12th European Conference on Software Architecture (ECSA) 2018, Madrid, Spain
  • Towards Automating Representative Load Testing in Continuous Software Engineering (full paper)
    Henning Schulz, Tobias Angerstein, and André van Hoorn
    Companion of the International Conference on Performance Engineering (ICPE) 2018, Berlin, Germany
  • Exploiting load testing and profiling for Performance Antipattern Detection (full paper)
    Catia Trubiani, Alexander Bran, André van Hoorn, Alberto Avritzer, and Holger Knoche
    Information & Software Technology, vol. 95 (2018)


Talks

Talks for conference papers are included in the list above.

  • Representative Load Testing in Continuous Software Engineering: Automation and Maintenance Support (extended abstract, slides)
    Henning Schulz and André van Hoorn
    Software Engineering (SE 20), February 28, 2020, Innsbruck, Austria
  • “PerformoBot, please help me!” - Chatbot-supported Performance Evaluation (abstract, slides)
    Samuel Beck, Lasse Merz, Christoph Zorn, Fabian Beck, Leonel Merino, Dušan Okanović, and André van Hoorn
    10th Symposium on Software Performance (SSP '19), Würzburg, Germany
  • Test-based Scalability and Resilience Assessment of Microservice-based Software Systems (slides)
    André van Hoorn
    Keynote at International Workshop on Governing Adaptive and Unplanned Systems of Systems (GAUSS) @ ISSRE 2019, October 28, 2019, Berlin Germany
  • Automated Load Testing in Continuous Software Engineering
    André van Hoorn
    ScrumScale meeting, Oslo, Norway
  • Continuous Performance Testing for Microservices (slides, recording)
    Vincenzo Ferme
    HPI Future SOC Lab Day - Spring 2018, Potsdam, Germany
  • ContinuITy: Automated Performance Testing in Continuous Software Engineering (talk abstract)
    Henning Schulz, André van Hoorn, Christoph Heger, and Alexander Wert
    8th Symposium on Software Performance (SSP '17), Karlsruhe, Germany

Posters

  • ContinuITy: Automated Load Testing in DevOps (poster)
    Presented at the 10th ACM/SPEC International Conference on Performance Engineering (ICPE) 2019, Mumbai, India
    Updated at January 28, 2020
  • PPTAM: Production and Performance Testing Based Application Monitoring (poster)
    Presented at the 10th ACM/SPEC International Conference on Performance Engineering (ICPE) 2019, Mumbai, India


Student Theses

Completed Theses

  • Using Chatbots to Facilitate Performance Evaluations
    Samuel Beck, Lasse Merz, Christoph Zorn
    Guided Research Project, University of Stuttgart, 2019
  • Context-Aware Load Testing in Continuous Software Engineering
    Alper Hidiroglu
    Master’s Thesis, University of Stuttgart, 2019
  • Declarative User Experience Regression Analysis in Continuous Performance Engineering
    Manuel Palenga
    Master’s Thesis, University of Stuttgart, 2018
  • Modularization of Representative Load Tests for Microservice Applications
    Tobias Angerstein
    Master’s Thesis, University of Stuttgart, 2018
  • Concern-driven Reporting of Declarative Performance Analysis Results Using Natural Language and Visualization
    Christoph Zorn
    Bachelor’s Thesis, University of Stuttgart, 2018