ESP: Testing and the JUMBL

Testing and the JUMBL

The SQRL promotes the adoption and use of automated, model-based, statistical testing.

automated	Large numbers of tests can be executed with little or no intervention. Automated testing requires a greater up-front investment, but pays significant dividends in the long run.
model-based	Models are constructed to represent the kind of testing desired. From these models test cases are generated. Instead of maintaining many test cases, one maintains the model. The use of models also promotes automated testing, and early creation of usage models can help promote testability.
statistical	The models are a source of statistical information about how the software will be used. This information can be used to intelligently plan testing, validate models, and infer reliability and expected cost information based on a test record. This provides for better management of the test effort.

The JUMBL supports this process in several ways.

Libraries of common model components can be developed and reused easily.
Statistical analyses of models can be performed.
Test cases can be generated in several ways, including randomly, by weight, based on coverage of the model, or even in a manual test case editor.
Complex tests can be generated by combining events from multiple models using TGL, a language for test generation.
Models can be augmented with automated test information to connect them to third-party, legacy, or specialized test equipment.
Test cases are organized into test records for easier management.
Analyses of test records can be generated to determine expected reliability, cost, and failure rates.

The JUMBL strongly promotes interoperability. It is written entirely in Java and runs on any platform with a suitable Java virtual machine. The JUMBL provides XML extensions for reading and writing models, test cases, and entire test records, as well as several specialized formats for communicating with common tools. Features are available from the command line, for easy scripting.

The JUMBL comes with a comprehensive user's guide of over 100 pages. Contact the SQRL if you wish to license or evaluate the JUMBL.