TTSP(TOPPERS Test Suite Package) integrates test tools, test programs, test data and documents for the TOPPERS New Generation Kernels.
TTSP development context
In recent years, due to the increasing importance of embedded systems, defects caused by bugs in embedded software have become a problem. Guaranteeing the quality of the RTOS, an important software component that sustains the quality of embedded systems, is an important problem.
However, open source RTOSs – such as the TOPPERS kernels – usually go through a series of transformations and extensions by the user side when they are embedded into a specific product. For that reason, in order to guarantee the quality of a product, users must not only test their applications but also the RTOS used in that product. Having to test the RTOS certainly introduces an extra cost which damages the benefits of open source. Furthermore, there is a problem in the fact that there is no well established verification method for RTOSs with memory protection or multi-processor support.
Taking that into account, the Center for Embedded Computing Systems (NCES) at Nagoya University, with the participation of several companies, has devised a method for RTOS testing, and carried out the development of a test suite. One of the results of that collaboration is TTSP.
Characteristics of TTSP
Comprehensive API testing
Support for static API testing
Support for testing CPU exceptions, hardware interrupts, and system time management (once the target-dependent part of the test is prepared).
Specification conformance testing for the API exposed by the SIL (System Interface Layer).
100% source code coverage test cases for the target-independent part of the RTOS (*excluding paths that depend on the actual timing).
Automatic generation of test programs suitable for a specific target system through test program generation tools (*excluding special test cases).
TTG (TOPPERS Test Generator), a test program generation tool.
By splitting test programs through TTG, it is possible to change the size of execution modules for making them more suitable for the target system.
Tools with support for the implementation of tests based on CUI.
Remembering to operate TTG is not necessary.
Released under a open source software license based on the TOPPERS license.
Supported kernels
TOPPERS/ASP kernel Release 1.7.0
TOPPERS/FMP kernel Release 1.2.0 *
*However, only the following targets are supported in Release 1.2.1
at91skyeye_armcc
at91skyeye_gcc
naviengine_armcc
naviengine_gcc
Execution environment
Environment in which ASP kernel and FMP kernel can be built.
