szafonimateusz-mi opened a new issue, #17717: URL: https://github.com/apache/nuttx/issues/17717
### Is your feature request related to a problem? Please describe. NTFC is a new testing tool based on test cases for NuttX from Xiaomi that allows you to automate NuttX tests for various targets (sim, qemu, hw with serial port). All features of currently used in CI tool (`tools/ci/testrun`) are supported (and much more). Here is a discussion on mailing list: https://lists.apache.org/thread/618konqxrl38oq7049njgks2y0x5mllq At the moment, the repositories with NTFC and test cases are on my Github account: - https://github.com/szafonimateusz-mi/nuttx-ntfc - https://github.com/szafonimateusz-mi/nuttx-testing They will eventually go to the Apache Foundation account if the proposal is accepted, but at the moment it's easier for me to develop the project in a private repo. Once NTFC is running stably on NuttX CI, I think it will be a good time to move the repositories to Apache. Initial plan to add NTFC support in NuttX CI: - [ ] Migrate `sim/citest` to NTFC and observe if everything works. - [ ] Migrating the rest of `citest`: - `rv-virt/citest` - `rv-virt/citest64` - `sabre-6quad/citest` - [ ] Add support for `citest` for x86_64 and arm64 if the CI limit allows it. We can also try with other qemu targets. - [ ] Enabling more test cases for `citest` targets The tool automatically detects which tests can be run based on the provided ELF. We just have to enable the appropriate applications in defconfig. - [ ] Migrate nuttx-ntfc and nuttx-testing repositories to Apache repositories - [ ] Official release of NTFC as Python package - [ ] Add stable NTFC package to the Docker image. I already have a patch ready to enable support for `sim/citest` with NTFC. The main problem I see is the CI limits imposed by Apache. Due to these limits, we'll likely be forced to select only certain platforms for testing and forgo some test cases. It may be possible to get around this by running tests in parallel on multiple host machine cores, but this is not yet supported in NTFC and I don't know how many cores are available when we run something in Github CI. ### Describe the solution you'd like . ### Describe alternatives you've considered _No response_ ### Verification - [x] I have verified before submitting the report. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
