The Journey from Offline to Online Conformance Checking for Microservice Applications

Ricardo Andrade has successfully defended his master thesis “Real-Time Conformance Checking for Microservice Applications“. This thesis was done in the context of the ArchViews project together with Thales. The academic supervisor was ESI colleague and TU/e professor Johan Lukkien and the daily supervision at ESI was done by myself and Ben Pronk.

The thesis addresses the shift from monolithic architectures to microservice architectures in order to manage the complexities and dependencies that emerge as systems grow and incorporate new features. A significant gap identified in the management of microservice applications is the lack of effective conformance checking techniques that can verify whether the execution of microservices aligns with their specification. To address this, the thesis proposes an innovative solution by developing an online conformance checker specifically designed for microservice applications. The project begins with the creation of an offline conformance checker that evaluates conformance using execution traces and sequence diagrams. The work then progresses to an online conformance checker, significantly improving performance and delivering conformance results within approximately 30 seconds per trace. This rapid response time meets the requirement for swift identification and correction of non-conforming sequences, thereby offering a practical and effective tool for managing microservice applications.

Ricardo presented his work very well using beautifully prepared slides. He confidently answered questions from the audience and the examination committee and left the session with a good grade. Ricardo is now moving on from his studies to start his career at CGI. We wish him the best of luck in his future career.

MasCot Program: Bridging Academia and Industry for High-Tech Innovation in Bits & Chips Feature

An article about strategic academic programming at TNO-ESI has appeared in Bits & Chips. The MasCot program, a collaboration co-funded by ESI and the Dutch research council NWO, is designed to tackle the increasing complexity of high-tech equipment.  The program addresses the pressing need for advanced engineering methodologies through four projects covering essential topics, such as design space exploration during early system design, scheduling, verification, and restructuring of evolving software. In the article, I explain how the 3-million-euro program facilitates the transition of academic research into practical industrial applications, creating an innovation funnel that spans from academic research through applied research to industrial embedding. The program’s strategic approach not only mitigates the risks associated with high-reward, complex projects but also fosters a symbiotic relationship between academia, industry, and TNO, allowing for a continuous exchange of knowledge, challenges, and innovations.

Master Thesis Shines Light on Hardware Dimensioning for Cyber-Physical Systems

On Wednesday, Marijn Vollaard defended his master thesis “Hardware Dimensioning for Microservice-based Cyber-Physical Systems: A Profiling and Performance Prediction Method” at the University of Amsterdam. This research has been supervised by Ben Pronk and myself as a part of a project with TNO-ESI.

The thesis addresses the problem of determining the number of homogeneous compute nodes needed for a particular variant of a cyber-physical system to meet its timing requirements. This is important in early discussions with customers and bidding processes, since it affects the size and cost of the resulting system. To this end, the thesis proposes a structured hardware dimensioning methodology comprising a profiling method and a performance prediction method. The four novel contributions of the thesis are: 1) A component-based profiling method, 2) a performance prediction method, 3) a structured hardware dimensioning methodology, and 4) validation of the approach, using a case study that represents a prototype of a CPS. Experimental evaluations on the case study show that the predicted performance differs from measurements on the application by at most 20%, which is satisfactory for hardware dimensioning decisions for new product variants.

The defense went well and Marijn confidently presented his story and convincingly answered the questions of the audience. The examination committee, impressed by his work, awarded his thesis a well-deserved grade of 8. As we bid farewell to Marijn, embarking on his next career adventure, we also extend our heartfelt congratulations. He certainly has much to be proud of. We wish him all the best on his travels and in his future pursuits.

Mastering Complexity at ICT Open 2024

TNO-ESI is hosting a Mastering Complexity for Cyber-Physical Systems track at ICT Open 2024. The event will take place in Utrecht on April 10-11. My colleague Rosilde Corvino will be the track chair of this event, together with myself. Submit an abstract, poster, or demo now and share with the community how your work addresses the challenge of increasing complexity in cyber-physical systems. Contributions in areas including system architecting, system dependability, system evolvability, systems of systems, and system performance are welcome.

Call for abstracts, posters, and demos:
https://ictopen.nl/track-mastering-complexity-for-cyber-physical-systems-cpshttps://lnkd.in/enBaRjNZ

Submission link:
https://www.ictopen2024.nl/submit-an-abstract/https://lnkd.in/etghmm8F

Master’s Student Marijn Vollaard Shines with Study on Hardware Dimensioning for Microservice Applications in Cyber-Physical Systems

Our master’s student, Marijn Vollaard, has achieved a significant milestone by completing and presenting his literature study titled “Hardware Dimensioning for Microservice Applications in Cyber-Physical Systems: Current Directions and Challenges” The study addresses the challenge of dimensioning the number of compute nodes required to meet the performance demands of microservice-based applications in cyber-physical systems. It thoroughly reviews an extensive body of literature on application and system profiling, performance prediction, and design-space exploration to establish the current state of knowledge in this field. The survey culminates in a discussion about how the surveyed literature applies to microservice applications, the cyber-physical systems context, and the problem of hardware dimensioning. Overall, this is a nice piece of work with a lot of references presented in a systematic way. Congratulations to Marijn for his great effort!”

Master Thesis Tackles Architectural Anti-patterns in Microservice Applications

Today, we are delighted to announce the successful defense of the outstanding master’s thesis titled “Architectural Anti-Pattern Identification and Mitigation in Microservice Applications Based on Telemetry” by our master student, Amund Lunke Rohne from the University of Amsterdam. This master’s project was a collaborative effort involving TNO-ESI and Thales.

The thesis addresses the problem that microservices offer benefits like scalability and separation of concerns, but also introduce many complex service dependencies. The decomposition of microservice applications can impact system performance and maintainability and can lead to architectural anti-patterns over time. While simple anti-patterns can be detected using analysis of service dependencies, there is a lack of formal mathematical definitions which prevents more complex anti-patterns from being automatically detected by tools. The thesis introduces a novel model called Granular Hardware Utilization-Based Service Dependency Graph (GHUBS), a fine-grained model that captures the interactions dependencies between services at the level of individual requests. The GHUBS model can be manually specified in early design phases to validate a microservice decomposition, or automatically created using telemetry data from a running application. Mathematical formalizations are introduced for four common architectural anti-patterns and methods for automatically detecting them using the GHUBS model is presented. A method for recommending how to mitigate the identified anti-patterns based on the service dependencies in the GHUBS model, as well as resource utilization metrics for the services, is also presented. The approach is implemented in a tool called Televisor and validated through case studies on open-source microservice benchmarking applications, revealing instances of these anti-patterns.

We thank Amund for his work and a fruitful collaboration, and wish him the best of luck in his future career.

3rd Annual MasCot Program Day 2023 Focuses on Technology Transfer and Industry-Academia Collaboration

In a bid to spearhead advancements in engineering methodologies and manage the increasing complexity of industrial systems, the third annual Mastering Complexity (MasCot) Program Day was successfully held on Tuesday, October 10, 2023. The MasCot program, a six-year strategic academic initiative jointly funded by TNO-ESI and NWO, has brought together leading universities and research organizations to pioneer the next generation of engineering methods, promoting cost-effective and high-quality development of industrial systems. The program consists of four key projects: 1) Scheduling Adaptive Modular Flexible Manufacturing Systems (TU/e, TU Delft, Radboud University), 2) Programming and Validating Software Restructurings (TU Delft, TU/e), 3) Testing in Times of Continuous Change (Radboud University, Twente University), and 4) Design Space Exploration 2.0: Towards Optimal Design of Complex, Distributed Cyber Physical Systems (UvA, Leiden University).

This year, Radboud University hosted the event at Hotel Van der Valk Nijmegen-Lent, drawing a crowd of 38 attendees from academia, industry, NWO, and TNO-ESI. With the first MasCot projects set to conclude in 2024, the theme of this year's gathering revolved around technology transfer. The event commenced with project updates from each of the four projects. During breaks, attendees had the opportunity to engage in technical dialogues with PhD students, who presented their work on posters. A highlight of the day was the keynote address delivered by Sjoerd Verduyn Lunel, head of ASML research (a.i.). Verduyn. A key message of his presentation was the required improvement of productivity of design engineers by a factor of 2.5 in the next ten years to keep up the pace of innovation. ASML is therefore engaging in defining road maps and establishing long-term collaborations with academic partners and research organization, such as TNO. He also described how ASML are differentiating projects at different levels of maturity, from fundamental research to proofs-of-concept, and how they scale up and transfer knowledge between these phases. This keynote was well-appreciated and many participants were inspired by this structured approach to programming and managing research and innovation.

The afternoon was dedicated to breakout sessions where participants shared their perspectives on technology transfer and discussed the roles that various MasCot stakeholders—universities, industry, NWO, and ESI—can concretely play in facilitating this critical process. The day concluded with a networking session and dinner, marking another successful edition of the MasCot Program Day.

Bridging the Gap: Rethinking Real-Time Systems for Industry Success and Model-Driven Performance Engineering

The real-time systems community is shrinking and needs to bridge the gap between academic research an industry practice. In my pitch at ECRTS, I shared our view on model-driven system performance engineering for cyber-physical systems and encouraged the community increase its scope and take a broader responsibility for timing-related issues in systems to achieve those goals. This means working in more of the focus areas that we have identified in our vision and validated with our industry partners, but also reconsidering some directions in areas where work is already taking place. This means less focus on hard real-time requirements and formal methods and more focus on:

• system-level KPIs instead of meeting deadlines in subsystems
• soft real-time requirements
• timing requirements beyond software
• system performance modelling, model calibration, and model learning
• data-driven performance analysis, optimization, verification, and diagnostics, e.g. using traces

I encouraged the community to have a look at our vision for model-based system performance engineering for industrial cyber-physical systems and asked to think about how they could contribute through their current and future work.

Please have a look at our vision here.

Thanks to Bram van der Sanden, Kuan-Hsun Chen, Mitra Nasri, Geoffrey Nelissen, and Twan Basten for their help preparing the pitch.

Keynote Address Explores Performance Engineering in Cloud-Connected Cyber-Physical Systems

I had the honor of being invited as keynote speaker at RT-Cloud 2023. The keynote discussed the increasing complexity of cyber-physical systems (CPS) in the Dutch high-tech systems industry and a gradual transition towards microservice architectures and cloud-connected systems. This transition challenges our experience with performance engineering in the CPS domain, as we adapt our methods to embrace new tools and technologies. To make the presentation concrete, I discussed two projects that I am currently working on, a project on performance verification of microservice architectures together with Thales, and a project about performance engineering and service continuity in the compute continuum, together with Philips and TU/e and other TRANSACT partners. I would like to thank Johan Eker and Luca Abeni for the invitation and all participants for their attention and questions.

TNO-ESI Cloud Continuum Workshop Connects Researchers and Promotes Collaboration in the Netherlands

The TNO-ESI Cloud Continuum workshop, an informal hybrid event that attracted just over twenty participants, took place at ESI on February 21. The goals of this workshop were to: 1) connect applied and academic researchers in the area of cloud continuum in the Netherlands, 2) disseminate research results from ongoing research projects, and 3) identify possibilities for collaboration. Benny Akesson, the organizer of the event, opened the workshop by presenting some drivers for cloud adoption/integration in the high-tech industry, as well as the work done by ESI in the ArchViews and TRANSACT projects related to performance observability. This was followed by four invited speakers from Eindhoven University of Technology and Vrije Universiteit Amsterdam. The topics of the presentations ranged from reference architectures for the cloud continuum, root-cause analysis in the continuum, modelling and calibration of cyber-physical systems deployed in the continuum, to performance variability of cloud/edge systems. All in all, it was a nice and successful event that showcased parts of the body of work currently going on in this exciting area. Thank you Matthijs Jansen, Jeroen Voeten, Mahtab Modaber, and Panagiotis Giannakopoulos for your presentations.