Benny Akesson

Senior Research Fellow @ TNO-ESI | Endowed Professor @ University of Amsterdam

Reflections on RTAS 2024: A Successful Symposium in Hong Kong

The 30th IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS 2024) is over. As I am enjoying a last local beer at Hong Kong airport before getting on my flight home, it feels like a good opportunity to reflect on this years successful edition of the conference.

The preparation of this conference has taken me, as the Program Chair, about one year. While it was a lot of work, I enjoyed it a lot because I got to work with dedicated, clever, and proactive people from the real-time systems community to make it happen. This year, we received 124 paper submissions from around the world, marking a 40% increase from last year. This suggests that the community is recovering well post-pandemic and there is a clear interest in the topics covered by the conference.

The Program Committee comprised 61 reviewers, supported by 87 sub-reviewers, blending expertise from a diverse group of experts in both academia and industry. Each submission was evaluated through at least four reviews, resulting in a total of nearly 500 double-anonymous expert reviews. Based on these reviews, a brief author response to the reviews to clarify misunderstandings, and online discussions, 29 papers This resulted in an acceptance rate of 23.3%, which means it was very competitive! The accepted papers formed the basis for the outstanding technical program.

Having spent so much time preparing the conference, I really wanted the execution to go smoothly, giving all 100 registered participants a good experience of the technical program. I was happy to see that the preparation had paid off and that there was very little work for me during the conference itself. The session chairs did an excellent job introducing the speakers and managing the sessions. The only curve ball was that one author did not get their visa on time, so we had to quickly improvise a setup for giving remote presentations. This was handled beautifully by the local organizers and I would like to thank Nan Guan and his colleagues for their hard work and attentiveness. From my perspective, the local arrangements worked perfectly!

I was impressed with the quality of the presentations of this edition. Despite the theoretical nature of much of the research, I was pleased to see that presenters managed to focus on their main messages and used lots of figures and animations to get high-level concepts across and referring to the papers for the details. I am asking myself if we, as a community, are getting better at presenting or if this is a side-effect of that we had to reduce the presentation time of the papers from 25 minutes to 18 minutes to fit the increased number of papers in the sessions. Whatever it was, I liked it and hope that this sets the bar for next time!

There were many excellent contributions in the technical program. From Marco Caccamo’s Outstanding Technical Achievement and Leadership Award lecture, we learned that there are many software-based memory management techniques and execution models that can improve the predictability of commercial-of-the-shelf (COTS) multi-processor systems-on-chip and make them suitable for hard real-time or mixed-criticality applications. This is an area where I feel we are making good progress. COTS systems are getting increasingly configurable and observable, allowing our community to propose solutions for real-time systems that do not require custom hardware. This lowers the threshold for transferring our research results to industry significantly.

Looking at the topics addressed at the conference, I was surprised by the large number of papers looking at the intersection of real-time systems and security, so many we needed two sessions to fit all of them! I particularly remember work considering how to ensure control-flow integrity when faced with malicious actors. Two papers looked into how this could be addressed leveraging features recently introduced in COTS platforms. There were also works looking at the effects of performance interference, such as random delays, on cyber-physical systems and how they could be mitigated using robust control strategies in stochastic control systems.

Considering the technical solutions that were presented, I really enjoyed the work by Soni et al. that addressed the scalability of timing analysis of AFDX networks in the avionics domain. The paper proposed a hybrid approach that combined an exact analysis using model checking with a faster and more pessimistic analysis using network calculus. The key idea was to use the bounds provided by network calculus to prune the state space for the model checker to reduce analysis time. I really liked that this hybrid approach worked both ways and allowed the exact analysis done so far by the model checker, to be leveraged by the network calculus to reduce its pessimism. This allowed the proposed analysis to scale to large industrial use cases with more than 1000 network flows.

There is of course a lot more to say about the conference and the papers featured in it, but it is time to fly home.
I want to conclude by thanking all the people that contributed to the organization of the conference. I also want to thank all authors who submitted their work to RTAS 2024. Lastly, I want to thank all conference participants for coming to Hong Kong to listen, learn, discuss, and network. That is what the community is all about!

For more information about RTAS 2024 and the papers featured in its program, please refer to the RTAS 2024 website.

ESI Symposium 2024: A Showcase of Cutting-Edge Research in High-tech Equipment

I had a blast at the ESI Symposium in Veldhoven! It may have been the best ESI Symposium I have visited so far! It is great to see the innovation chain for Dutch high-tech equipment come together and share challenges, exciting new research results, as well as success stories from our implementation partners.

The Symposium also showcased the progress of our academic programs. The Mastering Complexity (MasCot) program, now a veteran at the ESI Symposium, contributes new engineering methodologies to help us manage increasing system complexity and develop next-gen high-tech equipment efficiently and cost-effectively through all development phases, from early architecting to implementation, testing, and evolution. As the program enters its fourth year, the current focus is on rounding off much of the research and transfer developed knowledge and proof-of-concepts to ESI and the industry partners.

The Symposium also introduced our recently started ZORRO project, which is set to change the way we handle system malfunctions in cyber-physical systems. With intelligent diagnostics, ZORRO is on a mission to significantly reduce downtime costs and enhance system reliability. Interested to learn more? Reach out or stay tuned to hear more as the research develops!

Mastering Complexity at ICT.Open

This week saw another edition of NWO ICT.OPEN, a yearly event that brings scientists from all ICT research disciplines and industries together to learn, share ideas, and network.

My colleague Rosilde Corvino and I from TNO-ESI chaired the Mastering Complexity for Cyber-Physical Systems track. This track was kicked off with a keynote about software architecture for strategic advantage, given by Erik Schepers, Chief Software Architect at Thales. Two presentations followed about using large language models to manage software legacy and task-oriented programming for the Internet of Things, respectively. Approximately 30 participants attended the track, highlighting its relevance and the keen interest in cyber-physical systems. The event also saw a few projects from ESI’s Mastering Complexity (MasCot) academic program, DSE2.0 and Software Restructuring, being present with posters.

Lastly, the poster “Models for Legacy Software Systems,” authored by ESI colleagues Joe Reynolds, Nan Yang, Rosilde Corvino, Anca-Maria Lichiardopol, and Joost van Zwam, won the best poster award at the ICT.Open conference. The work has been prized for its innovation, applicability, and clarity of presentation. Congratulations to the team for this achievement, and kudos to Joe Reynolds for his outstanding presentation, demo, and poster explanation.

Next Tuesday, it is time for the next event, the crown jewel of ESI, the ESI Symposium 2024. It is still possible to register for free. I hope to see you there!

Keynote on Managing Variability and Evolution in High-tech Equipment at FOSD Meeting 2024

I had the distinct honor of opening this year’s Meeting on Feature-Oriented Software Development (FOSD Meeting) with a keynote titled “Managing Variability and Evolution in High-tech Equipment”. FOSD Meeting is a yearly informal meeting to bring together the community of researchers working on feature-oriented software development. This year, the event was hosted by TU/e between April 9 – 12.

The keynote covered complexity trends in the high-tech equipment domain, ESI and its role in the high-tech innovation eco-system, and two examples of how variability and evolution were tackled using model-based methodologies at the level of the software architecture in our projects with Thales. The keynote was appreciated by the organizers of the event and the group of 35 participants, mostly from (German) universities but also from ESI’s international applied research partner DLR.

Reflecting on my experience, I was pleasantly surprised at the broad expertise in this community, which covered modelling, software engineering, and performance and I wished I could have stayed around to enjoy the rest of the event. I am happy to see that the keynote triggered some concrete follow ups that can help us link members of this academic community to research in the high-tech equipment ecosystem.

PhD Defense on Governance of Complex Cyber-infrastructure

Today, I chaired a PhD committee at the University of Amsterdam. The PhD candidate Mostafa Mohajeri Parizi defended his dissertation “An Agent-based Approach to the Governance of Complex Cyber-Infrastructures”. The dissertation explores the impact of digitization on society and the need for engineering approaches to ensure that digital systems comply with regulations. Mostafa did his PhD research in the Complex Cyber-Infrastructure (CCI) group under the supervision of TNO colleague Tom van Engers (Principal Scientist ISP DS). The work centers on the use of computational agents and norms to develop tools and methodologies for governing socio-technical systems. The study introduces ASC2, an agent-based programming framework built on the belief-desire-intention model, alongside a scalable multi-agent system environment. It emphasizes the integration of mainstream software development tools into agent-based programming and enhances transparency and decision-making in agents by incorporating context-dependent preferences. Furthermore, the dissertation proposes a modular architecture for integrating norms into multi-agent systems, allowing for the flexible adoption and reasoning of norms without compromising agent autonomy. This is illustrated through two case studies demonstrating the framework’s application in coordinating agent actions and aligning them with encoded laws. The research highlights the potential of agent and norm models in improving the design and policy-making of digital infrastructures.

Mostafa did a good job presenting and defending his work and the committee were impressed by the breadth of the research. We hope the newly minted Dr. Mohajeri Parizi enjoyed the ceremony and the celebration with his friends and family and wish him all the best of luck in his future career.

Performance Engineering in High-Tech Systems: A Visit to CISTER Research Center

I recently had the opportunity to visit the CISTER Research Center for Real-time and Embedded Computing in Porto. It was a great chance to reconnect with former colleagues from my previous tenure there. During my visit, I was invited give a presentation focusing on the complexity challenges in high-tech equipment and ESI’s vision on model-driven performance engineering in this field. The talk also highlighted the growing use of microservice architectures in cyber-physical systems to address the complexity drivers. I explained that while there are good open source tools for instrumenting applications and gathering telemetry data, such as metrics, logs, and traces, new automated analysis methods are needed to reduce the effort of optimizing, verifying, and diagnosing system performance. In this context, I introduced a framework for telemetry-based performance engineering that can be used to address a number of performance challenges. In particular, I explained how it could be used to check whether the system implementation conforms to a UML specification, both in terms of timing and behavior, and to perform performance prediction.

The presentation, which was attended by a group of approximately 15 staff members and PhD students, was well-received and led to fruitful discussions about the relation between real-time systems research and performance engineering. . The visit concluded wonderfully with a delightful dinner with the institute’s director, Prof. Eduardo Tovar, in Matosinhos.

Automatic Workload Inference Improves Scalability of DSE in Complex Systems

I am happy to announce that the paper “Automated Derivation of Application Workload Models for Design Space Exploration of Industrial Distributed Cyber-Physical Systems” has been accepted for publication at the 7th IEEE International Conference on Industrial Cyber-Physical Systems (ICPS). The paper is first-authored by Faezeh Saadatmand in the context of the DSE2.0 project, a part of the academic research program MasCot, co-funded by TNO-ESI and NWO. Congratulations Faezeh!

The paper addresses challenges with respect to designing their next-generation distributed cyber-physical systems (dCPS). Efficient Design Space Exploration (DSE) techniques are needed to evaluate possible design decisions and their consequences on non-functional aspects of the systems. To enable scalable and efficient DSE of complex dCPS, it is essential to have abstract and coarse-grained models that are both accurate and capable of capturing dynamic application workloads. However, manually creating such models is time-consuming and error-prone, and they need to be continuously updated as the system evolves. This research addresses this need by introducing an automatic method for deriving an application workload model. This model, based on trace analysis, captures computation and communication activities within an application in a timing-agnostic manner. The approach has been validated through a case study on an ASML Twinscan lithography machine, demonstrating high accuracy in capturing real application workloads. Next steps in this research involves combining this model with an automatically inferred hardware platform model to enable DSE exploring different hardware, software, and mapping alternatives.

The Journey from Offline to Online Conformance Checking for Microservice Applications

Ricardo Andrade has successfully defended his master thesis “Real-Time Conformance Checking for Microservice Applications“. This thesis was done in the context of the ArchViews project together with Thales. The academic supervisor was ESI colleague and TU/e professor Johan Lukkien and the daily supervision at ESI was done by myself and Ben Pronk.

The thesis addresses the shift from monolithic architectures to microservice architectures in order to manage the complexities and dependencies that emerge as systems grow and incorporate new features. A significant gap identified in the management of microservice applications is the lack of effective conformance checking techniques that can verify whether the execution of microservices aligns with their specification. To address this, the thesis proposes an innovative solution by developing an online conformance checker specifically designed for microservice applications. The project begins with the creation of an offline conformance checker that evaluates conformance using execution traces and sequence diagrams. The work then progresses to an online conformance checker, significantly improving performance and delivering conformance results within approximately 30 seconds per trace. This rapid response time meets the requirement for swift identification and correction of non-conforming sequences, thereby offering a practical and effective tool for managing microservice applications.

Ricardo presented his work very well using beautifully prepared slides. He confidently answered questions from the audience and the examination committee and left the session with a good grade. Ricardo is now moving on from his studies to start his career at CGI. We wish him the best of luck in his future career.

Jesse Liauw-A-Fong Defends Master’s Thesis on Local Anomaly Detection in Smart Public Transport Vehicles

Yesterday, Jesse Liauw-A-Fong, a student of the Master of Software Engineering program at UvA, defended his thesis Local Anomaly Detection in Smart Public Transport Vehicles. This research was conducted externally at a company called Ximedes. Jessie’s research is addressing the problem of detecting anomalies, such as a loss of cloud connection, in Smart Public Transport Vehicles (SPTV), such as buses, trams, and metros, comprising many complex heterogeneous systems. It emphasizes the importance of local, context-aware anomaly detection due to the dynamic nature of SPTVs and explores the generalization of anomaly detection, particularly addressing performance, normal region, and quality challenges. The research proposes a unified data collection framework comparing agent-based and agent-less methods, advocating for an agent-based approach for its adaptability and integration ease. It also quantitatively evaluates three local anomaly detection algorithms on real data from a specific bus line. We thank Jessie for his contributions to our research and wish him the best of luck in his future career.

MasCot Program: Bridging Academia and Industry for High-Tech Innovation in Bits & Chips Feature

An article about strategic academic programming at TNO-ESI has appeared in Bits & Chips. The MasCot program, a collaboration co-funded by ESI and the Dutch research council NWO, is designed to tackle the increasing complexity of high-tech equipment.  The program addresses the pressing need for advanced engineering methodologies through four projects covering essential topics, such as design space exploration during early system design, scheduling, verification, and restructuring of evolving software. In the article, I explain how the 3-million-euro program facilitates the transition of academic research into practical industrial applications, creating an innovation funnel that spans from academic research through applied research to industrial embedding. The program’s strategic approach not only mitigates the risks associated with high-reward, complex projects but also fosters a symbiotic relationship between academia, industry, and TNO, allowing for a continuous exchange of knowledge, challenges, and innovations.