In 2007, Dominique Hazael-Massieux created a CGI-based harness for the Mobile Web Initiative's test suites. One of the very neat things about the MWI test harness is that it associates the results with a user agent string. This means there's no need for users to log in or to select their UA. They just load a test and click Pass/Fail/Can't Tell.
An easy-to-use harness for reporting tests like this would be useful across all of W3C's Interaction Domain working groups. It has the potential to make the process of creating implementation reports much, much easier, and it would allow more involvement from the community outside W3C.
The CSS Working Group planned to extend this harness and use it for the CSS conformance tests and implementation reports. HP took Dominique's source code, created a more flexible back-end and implementing some of the improvements we felt were needed. Dominique posted the results of HP's work on the W3C site, along with a working prototype. But HP then disengaged from the project after a company reorganization.
The current state of the project is that nobody here knows how the harness works, whether it's reliable, or how to set it up with a new set of tests. The reporting half of the improvements were not implemented, and the output is mostly unhelpful in its current state.
The source code, bug database, and prototype URL are all listed below. If you are interested in taking ownership of this project, and have any questions, please contact the public-css-testuite or public-test-infra mailing list.
These are the improvements we'd like to see, numbered roughly by priority.
<object> to contain the test and pass/fail buttons on the containing page rather than inside the test file. (This format is good for browsers.) The <object> will contain a hypertext link to the test as fallback.In both cases the test itself should be referenced as a link, not fed through the CGI script. (This avoids tampering with the HTTP headers that normally get served up with the tests.)