Hi Aditi,
Thank you for reaching us! What we are working on is to build a benchmarking framework that developers can use to measure some metrics (like context-switching time) on a RTOS with their own application. The metrics we choose are: - Context-switching time and interrupt latency - Memory usage - Energy efficiency Currently, we are working on the context-switching time metric. We have build a module on the RIOT OS to compute the elapsed time between two threads. Source of the module: https://github.com/Derwaan/RIOT/blob/6e006b113032e5645acf906984a984dcd6afaf8f/sys/bench_context_switching/bench_context_switching.c Example that uses the module: https://github.com/Derwaan/bench-os/blob/context_switching/tasks/riot/context_switching/main.c It is a very simple example that demonstrates what we are trying to do. Now, we will try to do the same with the Apache Mynewt OS and see what are the results between these two OSes. Questions, advices and feedbacks are welcome! Regards, Julien ________________________________ De : aditi hilbert <[email protected]> Envoyé : lundi 10 décembre 2018 08:36:56 À : Julien Gomez Cc : Trong-Vu Tran; [email protected] Objet : Re: Benchmarking of Real-Time Operating Systems for Internet of Things Devices Hi Julien, Just curious how your project is coming along. Have you decided on the benchmark metrics? thanks, Aditi > On Sep 21, 2018, at 1:08 AM, Julien Gomez <[email protected]> > wrote: > > Hello Aditi, > > Thank you for your advices. I've already joined the Slack ;-) It's nice to > see a dev community with a modern communication channel. > > Can you give more information or references about HAL performance - latency > and throughput of peripheral access? > > Regards, > > Julien > > > Le 20/09/18 à 19:00, aditi hilbert a écrit : >> Hi Julien and Trong-Vu, >> >> Thanks for wanting to include Apache Mynewt in a comparative benchmarking >> across different RTOS! >> >> There are lots of standard metrics that benchmark an OS kernel. Commercial >> RTOS such as ThreadX or Micrium tout these stats often - interrupt latency, >> context switching time, memory allocation/deallocation etc. These are >> interesting, but going beyond the kernel is probably more useful such as HAL >> performance - latency and throughput of peripheral access. People are also >> interested in power consumption/current draws for some basic operations both >> at kernel level and esp. at network protocol level e.g. message tx/rx etc. I >> am sure others in the community would have a lot of suggestions. >> >> Have you joined the Mynewt workspace on Slack? >> https://join.slack.com/t/mynewt/shared_invite/enQtMTkwMTg1ODM1NTg5LTY0ZjgxNmFjNzBjZmRlZDdlYmM4MGUzNDdkNDQ1NDE0OWRlYWE4ODM1OWQ1Mjg1YmM1NDJmODNkNDA4NGJmODY >> >> thanks, >> aditi >> >>> On Sep 20, 2018, at 7:45 AM, Julien Gomez >>> <[email protected]> wrote: >>> >>> Hello Apache Mynewt community ! >>> >>> We are two students of the Université catholique de Louvain from Belgium >>> and we work on our master thesis. The thesis is called "Benchmarking of >>> Real-Time Operating Systems for Internet of Things Devices" and is about >>> comparing the different implementations of open-source RTOS's currently >>> available on the market. >>> >>> In broad outline, we are planning to analyze the scheduling, switching >>> context, memory management and/or any relevant metric dependant of the >>> operating system. >>> >>> Another goal is to compare networking performances or implementations of >>> the various stacks available. We have currently no concrete planning for >>> this part. >>> >>> This project will be open source (because we <3 the open source). >>> >>> Here are some questions we have for you: >>> - "What would you like to see in this benchmarking project?"; >>> - "What RTOS should we benchmark?"; >>> - "What metric should we consider?". >>> >>> We'd love to hear your recommandations or any help you can provide us with. >>> >>> Also if you are interested about how the project will evolve, we'll be glad >>> to update you on our progress. >>> >>> If the project gain lot of interests, we will probably create a >>> communication channel like Slack or Gitter. >>> >>> Sincerely, >>> Julien Gomez and Trong-Vu Tran >>> >
