FAT: A framework for automated regression testing of protocol stacks

Abstract

Software systems today are becoming larger and more complex, resulting in a growing need for good and efficient testing routines. An approach used by several software developers is to automate the test process. Test automation has the benefits that it reduces the time of the testing process and that automated tests are more accurate and precise than manual tests. <br /><br /> Manufacturers who wish to develop products using the Bluetooth technology, the Bluetooth logo and trademark has to go through a qualification program. This program is expensive, thus the manufacturer has incentives to make sure that the product is well tested before sending it to qualification. A Bluetooth stack is an example of a product that must be qualified. An automated tool for testing of Bluetooth stacks is therefore desired. <br /><br /> FAT is a framework that provides functionality to write and execute tests on a Bluetooth stack. The framework makes use of the ability to stitch generic test layers in-between the layers of the stack. These test layers can operate on messages passing through the stack. Our test layers provide an API to insert, modify, copy and delete messages. FAT introduces a test system client (TSC) where a tester can write tests and choose tests for execution. The tests are written in Java, where each test is a single method. The tester uses the test layer’s API to interface with the stack. The communication mechanism between the TSC and the test layer is XML-RPC. The TSC may therefore be executed on a different node than the stack itself.

This thesis motivates FAT, and describes how the framework is designed and implemented.