Prestigious Test Of Time Award at ESWEEK 2023 for Memory Controller Research

I am happy to announce that we received the Test Of Time Award for CODES+ISSS at ACM/IEEE Embedded Systems Week (ESWEEK) 2023 in Hamburg, Germany. The Test of Time Award is the most prestigious award of ESWEEK and honors the authors of papers of previous editions of the co-located conferences (CASES 2008, CODES+ISSS 2007, and EMSOFT 2007) that had the highest impact. We received this award for my first paper as a PhD student “Predator: a predictable SDRAM memory controller“, which written with co-authors Kees Goossens and Markus Ringhofer and published in CODES+ISSS 2007.

The paper addressed the problem of providing guarantees on bandwidth and latency to ports on an SDRAM memory controller, a key component of a system-on-chip. Previously, this was only done for statically scheduled memory controllers that assumed the workload of memory requests was known a priori. While this limitation was acceptable for simple systems, increasing integration of functionality in consumer electronics products like set-top boxes challenged this assumption, requiring more dynamic solutions. To this end, the paper presented concepts, hardware architecture, and performance analysis for a more dynamic SDRAM memory controller for real-time systems.

This work formed the base for my memory research, which evolved into a research line that would continue for over a decade and in which six PhD students eventually graduated. In total, this research resulted in a body of work of 30+ papers and two books, which together have been cited more than 2000 times. It also resulted in the open-source tool DRAMPower, which is used to estimate energy consumption of memories. This tool has been integrated in the popular Gem5 simulator and is widely used by the computer architecture community.

The paper was impactful because it was one of the first papers about memory controllers for real-time systems. More papers would follow from Barcelona Supercomputing Center, UC Berkley, and University of Waterloo. Step by step, the proposed memory controllers would become more dynamic and the analysis more sophisticated. This continued until the middle of the previous decade, at which the field moved more from proposing and analyzing new memory controller architectures for systems-on-chips to configuring and analyzing commercial-of-the-shelf memory controllers. This is still an active field of research in the real-time systems community today.

“Receiving this award is an unexpected honor, and I extend my heartfelt thanks to my co-authors and everyone that contributed to subsequent advancements in this field, in particular my former PhD students Karthik Chandrasekar, Manil Dev Gomony, Sven Goossens, Yonghui Li, and Anna Minaeva. Together, we created, developed, and matured the research field of memory controllers for real-time systems.”

Call for Papers and Experts – 30th IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS 2024) in Hong Kong

I have the honor of being the Program Chair of the 30th IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS 2024), located in Hong Kong May 13-16 next year. Please see the Call for Papers below.

Soon, it will be time to put together the Technical Program Committee (TPC) that will review and select the papers that will appear in the conference program. If you are interested in joining the TPC of this conference, or any other conference (co-)sponsored by the Technical Community of Real-Time Systems (TCRTS), please fill out the TPC self-nomination form as soon as possible. We always welcome self-nominations from our own community, but this year we especially encourage self-nominations from the academic performance engineering community, as well as members of the industry that work with real-time requirements or performance engineering, defined in a broad sense.

If you have any questions, please feel to reach out to me. If want to self-nominate, click this link. A self-nomination is not a firm commitment, it is just a declaration of interest that may result in an invitation.

———————————————————————————————————————

30th IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS 2024)

Hong Kong, May 13-16, 2024

———————————————————————————————————————

CALL FOR PAPERS

———————————————————————————————————————

RTAS is a top-tier conference with a focus on time-sensitive systems. RTAS’24 invites papers describing case studies, applications, methodologies, and algorithms that contribute to the state of practice in design, implementation, verification, validation, and evolution of time-sensitive systems. RTAS’24 consists of two tracks:

  • Track 1. Systems and Applications;
  • Track 2. Applied Methodologies and Foundations.

In both tracks, papers must consider some kind of timing requirements. The timing requirements of interest are broadly defined and include not only classical hard real-time constraints, but also soft real-time, probabilistic, quality-of-service (QoS), throughput or latency requirements. The application area can be any type of time-sensitive systems, ranging from resource-constrained embedded systems to cyber-physical systems (CPS), cloud/edge/fog computing systems, cloud data centers, Internet of Things (IoT), mobile computing, robotics,  smart grid, and smart cities, as well as middleware and frameworks, machine learning in or for time-sensitive systems and signal processing algorithms that execute in real time. RTAS welcomes both papers backed by formal proofs, as well as papers that focus exclusively on empirical validation of timing requirements, e.g., using traces or performance models inferred from operational data. Research results from fundamental research, (case-driven) applied research, and (pragmatic) industry practice are all in scope.

RTAS’24 follows a double-anonymous peer reviewing process: author identities and affiliations will not be revealed to reviewers. Authors will have the opportunity to provide a response to reviews before acceptance decisions are made, solely to provide clarifications and correct misconceptions. The response will not allow authors to introduce new material beyond the original submission, or promise such material for the camera-ready version. There will be an optional evaluation process for accepted papers that assesses the reproducibility of the work.

Track 1: Systems and Applications

This track focuses on research of an empirical nature pertaining to (system- or component-) level analysis, optimization, and verification, as well as applications, runtime software, and hardware architectures for time-sensitive systems.

Topics relevant to this track include, but are not limited to:

  • time-sensitive applications
  • real-time and embedded operating systems,
  • hypervisors and runtime frameworks,
  • hardware architectures, memory hierarchies, FPGAs, GPUs and accelerators,
  • time-sensitive networks, CPS/IoT infrastructure,
  • microservice technologies, cloud and edge computing, real-time artificial intelligence and machine learning,
  • application profiling, WCET analysis, compilers, tools, benchmarks and case studies.

Papers discussing design and implementation experiences on real industrial systems are especially encouraged. Papers submitted to this track should focus on specific systems and implementations. Authors must include a section with experimental results performed on a real implementation, or demonstrate applicability to an industrial case study or working system. The experiment or case study discussions must highlight the key lessons learned. Simulation-based results are acceptable for architectural simulation, or other cases where authors clearly motivate why it is not feasible to develop and evaluate a real system.

Empirical survey-based research focused on the real-time systems field is also welcome in this track. This type of research uses surveys, questionnaires, interviews, use cases or other empirical techniques to obtain information about the past / current / future state of play in the research, design, development, verification, validation, and deployment of time-sensitive systems.

Track 2: Applied Methodologies and Foundations

This track focuses on fundamental models, and analysis techniques/methods that are applicable to time-sensitive systems to solve specific problems. The track welcomes knowledge-based models, models built from operational data, as well as a combination, and different types of analysis methods, including analytical, statistical, or probabilistic methods. Topics relevant to this track include, but are not limited to:

  • modelling languages, modelling methods, model learning, model validation and calibration,
  • scheduling and resource allocation,
  • system-level optimization and co-design techniques,
  • design space exploration,
  • verification and validation methodologies.

Papers must describe the main context or use case for the proposed methods giving clear motivating examples based on real systems. The system models and any assumptions used in the derivation of the methods must be applicable to real systems, and reflect actual needs. Papers must include a section on experimental results, preferably including a case study based on information from a real system. The use of synthetic workloads and models is acceptable if appropriately motivated and used to provide a systematic evaluation.

Important Dates

Submission Deadline (firm): October 31, 2023
Author Response Period: January 8-12, 2024
Author Notification: January 19, 2024
Conference Date: May 13-16, 2024

 

Bridging the Gap: Rethinking Real-Time Systems for Industry Success and Model-Driven Performance Engineering

The real-time systems community is shrinking and needs to bridge the gap between academic research an industry practice. In my pitch at ECRTS, I shared our view on model-driven system performance engineering for cyber-physical systems and encouraged the community increase its scope and take a broader responsibility for timing-related issues in systems to achieve those goals. This means working in more of the focus areas that we have identified in our vision and validated with our industry partners, but also reconsidering some directions in areas where work is already taking place. This means less focus on hard real-time requirements and formal methods and more focus on:

• system-level KPIs instead of meeting deadlines in subsystems
• soft real-time requirements
• timing requirements beyond software
• system performance modelling, model calibration, and model learning
• data-driven performance analysis, optimization, verification, and diagnostics, e.g. using traces

I encouraged the community to have a look at our vision for model-based system performance engineering for industrial cyber-physical systems and asked to think about how they could contribute through their current and future work.

Please have a look at our vision here.

Thanks to Bram van der Sanden, Kuan-Hsun Chen, Mitra Nasri, Geoffrey Nelissen, and Twan Basten for their help preparing the pitch.

Scaling the Future: Master Thesis Defense on Scalability in Simulation Environments for Distributed Cyber-Physical Systems

Today, we celebrate that Herman Kelder successfully defended his master thesis “Scalability in System-Level Simulation Environments for Distributed Cyber-Physical Systems“. This work was carried out in the context of the DSE2.0 project, where we address the complex scientific challenges involved in performing design-space exploration (DSE) for complex distributed cyber-physical systems (dCPS), such as lithography machines. Three key challenges in this context are: 1) automatically modelling the application and platform based on data from the running system, 2) scalable search and pruning algorithms that help navigate large design spaces efficiently, and 3) scalable simulation environments that allow many design points to be efficiently evaluated concurrently.

Herman’s thesis addresses the last of these three challenges. To facilitate scalable and efficient DSE for dCPS, an evaluation environment is proposed, implemented, and evaluated. The research considers key design considerations for developing a distributed evaluation workflow that can dynamically be adapted to enable efficient and scalable exploration of the vast design space of complex, distributed cyber-physical systems. Evaluation of the proposed environment employs a set of system models, representing design points within a DSE process, to assess the solution and its behavior, performance, capability, and applicability in addressing the scalability challenge in the context of DSE for dCPS. During the evaluation, the performance and behavior are investigated in three areas: (i) Simulation Campaign, (ii) Task Management Configuration, and (iii) Parallel Discrete-Event Simulation (PDES). Throughout the evaluation, it is demonstrated that the proposed environment is capable of providing scalable and efficient evaluation of design points in the context of DSE for dCPS. Furthermore, the proposed solution enables designers and researchers to tailor it to their environment through dynamic complex workflows and interactions, workload-level and task-level parallelism, and simulator and compute environment agnosticism.

Herman executed his project meticulously and delivered excellent research results, both in terms of concepts and implementation. Thank you very much for your contributions Herman and we hope to work with you again at some point.

Keynote Address Explores Performance Engineering in Cloud-Connected Cyber-Physical Systems

I had the honor of being invited as keynote speaker at RT-Cloud 2023. The keynote discussed the increasing complexity of cyber-physical systems (CPS) in the Dutch high-tech systems industry and a gradual transition towards microservice architectures and cloud-connected systems. This transition challenges our experience with performance engineering in the CPS domain, as we adapt our methods to embrace new tools and technologies. To make the presentation concrete, I discussed two projects that I am currently working on, a project on performance verification of microservice architectures together with Thales, and a project about performance engineering and service continuity in the compute continuum, together with Philips and TU/e and other TRANSACT partners. I would like to thank Johan Eker and Luca Abeni for the invitation and all participants for their attention and questions.

Advancing Sustainability: Paper Accepted on Estimating Energy Consumption of Applications in the Computing Continuum

I am happy to please that the paper “Estimating the Energy Consumption of Applications in the Computing Continuum with iFogSim” was accepted at the International Workshop on Converged Computing (WOCC). The paper is first-authored by Saaedeh Baneshi and is the first publication to come out of the project Energy Labels for Digital Services. Congratulations Saaedeh!

The paper explains how digital services – applications that often span the entire computing continuum – have become an essential part of our daily lives, but they can have a significant energy cost, raising sustainability concerns. Measuring the energy consumption of such applications is challenging due to the distributed nature of the system and the application. As such, simulation techniques are promising solutions to estimate energy consumption, and several simulators are available for modeling the cloud and fog computing environment. The paper investigates iFogSim’s effectiveness in analyzing the end-to-end energy consumption of applications in the computing continuum through two case studies. We design different scenarios for each case study to map application modules to devices along the continuum, including the Edge-Cloud collaboration architecture, and compare them with the two placement policies native to iFogSim: Cloud-only and Edge-ward policies. We observe iFogSim’s limitations in reporting energy consumption, and improve its ability to report energy consumption from an application’s perspective; this enables additional insight into an application’s energy consumption, thus enhancing the usability of iFogSim in evaluating the end-to-end energy consumption of digital services.

Inaugural Lecture Explores Managing Complexity of High-Tech Systems

Today, I finally gave my inaugural lecture “Managing Complexity in High-tech Systems” to celebrate my appointment as Endowed Professor at the University of Amsterdam, which happened back in 2019.

The academic ceremony started at 16:00 with a small reception for fellow professors and members of the curatorium. Together, this group walked in a procession into the beautiful auditorium of the University of Amsterdam, where an audience of colleagues, family, and friends, where waiting in anticipation. The lecture discussed the challenge of increasing complexity in the high-tech equipment industry and how new (model-based) development methodologies leveraging abstraction, boundedness, and composition, are required to address it. I argued that the required innovation should come from collaboration in an innovation chain, where universities, applied research organizations, and industry work together in strategic partnerships. The presentation was concluded with a number of concrete examples of what this collaboration could look like, based on examples from my education and research at TNO and the University of Amsterdam. The inaugural lecture was followed by a reception full of networking and congratulations. I would like to thank everybody that showed up for the event, physically and online. Together, we created a memory that I will treasure for a lifetime.

If you did not manage to attend the lecture, or see it online, there is a recording available. Pop some popcorn, take a seat, and click the link below:

https://webcolleges.uva.nl/Mediasite/Play/99497b81432a49acb57f0ae7a32050d11d

Optimizing Efficiency and Performance: PhD Thesis Defense on Energy- and Time-aware Scheduling for High-Performance Embedded Systems

Yesterday, I participated in the PhD defense committee of Julius Röder, a PhD student in the Parallel Computing Systems group at the University of Amsterdam. The thesis “Energy- and Time-aware Scheduling for Heterogeneous High-Performance Embedded Systems” addresses the relevant problem of optimizing non-functional behavior, such as timing and energy consumption, of heterogeneous high-performance embedded systems. The goal of this optimization Is to reduce energy consumption, thereby also reducing carbon footprint and extending battery-life, as well as ensuring that real-time requirements of applications are satisfied, even at high resource utilizations. To this end, the thesis contributes a discussion on setups used for energy measurements, as well as experiments and a statistical analysis that demonstrate the Importance of sampling frequency on the accuracy of such measurements. The bulk of the thesis proposes heuristic algorithms, both conventional and based on reinforcement learning, for mapping and scheduling applications modelled as directed acyclic graphs (DAG) on heterogeneous platforms. The applications are assumed to be available In different versions, with different non-functional behavior, for the different types of processing elements In the heterogeneous architecture, which enables trade-offs between timing and energy. A key strength of the thesis is that theory is combined with a practical component; the scheduling algorithms are implemented and evaluated on a heterogeneous multi-core systems, where timing and energy behavior are carefully measured and analyzed.

In presence of family, friends, and colleagues, Julius confidently defended his PhD thesis and earned the right to call himself a doctor. Congratulations Julius with this great achievement!

Advancing Design Space Exploration: Literature Review Explores Network Delay Models for Distributed Cyber-Physical Systems

Another literature review has been completed in the context of the DSE2.0 research project. William Ford completed his review entitled “Network Delay Model Creation and Validation for Design Space Exploration of Distributed Cyber-Physical Systems“.

Design-space exploration (DSE) in early phases of design of a distributed cyber-physical system (dCPS) requires models. In the DSE2.0 project, we are particularly interested in models that capture the timing behavior of hardware and software, allowing temporal system performance to be evaluated for different design points. One important part of the system to model is the network that connects the subsystems of the CPS. This study reviews previous work in the fields of analytical network modeling, network simulation, and network model validation. In addition, a recommended plan is presented to create and validate such a network model for the DSE2.0 project, based on this previous work. Two main directions are recommended at different levels of abstraction. For the lower level of abstraction, we will make a model using the existing INET framework that models each network element explicitly. At a higher level of abstraction, we will use a latency-rate server to capture the behavior of the network using only two parameters, latency and rate.

Having delivered his literature review. William has started his master project to pursue this research along these directions. The team looks forward to working with him.

Driving Innovation and Collaboration: Dutch Real-time Days Event Sparks Ideas for Future Research and Industry Relevance

I recently co-organized a Dutch Real-time Days event together with real-time systems researchers from TU/e and UT. The event was funded through a 4TU.NIRICT Call Community Funding and its goals were to:

1) share and develop new ideas for real-time systems research,
2) stimulate new collaborations, and
3) networking.

In addition to the four organizers from the Netherlands, Mitra Nasri (TU/e), Geoffrey Nelissen (TU/e), Kuan-Hsun Chen (UT), and myself, four well-established European researchers in the area of real-time systems were invited to the event. Everybody was invited to pitch their current work, ideas for future directions, and appropriate mechanisms to support collaborations. This was followed by brainstorming sessions were these ideas were creatively improved, as well as a working session where some of the ideas were discussed in more detail and made actionable. At the end of the first day, there was a lovely dinner at Restaurant Giornale in Eindhoven, providing further room for discussions and networking.

The outcome of the two days was a mix of technical ideas that can be pursued in future research papers or project proposals, and actions to shape direction of the academic real-time systems community and further increase its industrial relevance. For example, we agreed to propose that the Technical Community on Real-time Systems (TCRTS) adds an award for industry impact/technology transfer and propose a special issue on industry challenges/visions in the Journal of Real-time Systems.