Introduction
In this project we're using Skoll, a community-based distributed process, to test MySQL 5.1 across a configuration space of about 48 million different configurations.
Skoll test clients connect to our server and receive instructions to build MySQL in a specific configuration. The client then compiles MySQL and runs a set of about 750 standard MySQL installation tests. Finally, the client sends a summary of the test results back to our server.
Configuration Space Modeling
To efficiently test MySQL 5.1 in various configurations, we built a configuration space model with MySQL compile- and run-time configuration variables. With the model, Skoll server can intelligently assign test configurations to clients in order to cover the configuration space.
Test Results
The combined results of all clients are processed on the server side to isolate where configuration-related bugs are hiding.
You can see the current test results online. The results are ordered by MySQL build IDs. For each build, you can view the overall status of testing and test failure classification tree for each MySQL test. The classification trees are visualized as TreeMaps.
Contribute:
We hope you'll be interested in helping us improve MySQL by contributing resources to our community-based, distributed test initiative.
Please see our contribute page to find out how to join our community.
The Skoll team thanks you for your participation. Please send any comments or questions to skoll@cs.umd.edu. Thanks again!