[OpenLayers-Dev] manual acceptance tests
tschaub at openplans.org
Fri Nov 9 15:48:54 EST 2007
Erik Uzureau wrote:
> Also, I think its probably a good time to start looking into a
> post-commit hook (only on trunk, of course) that runs the unit tests.
> I don't personally have the first clue as to how to do that but
> someone out there must? I think it would be a helpful addition to our
> process and (realistically) wouldn't hinder the dev process hardly at
Smartypants Schmidt just pointed out that this could be done in a much
simpler way than I proposed.
Buy a machine dedicated to testing (or multiple machines if you care
about OS), open up all browsers we care about, run a modified version of
run-tests.html (on a timeout to refresh every hour), and have it create
a XMLHttpRequest with any failure results. Then set up some service
that sits around and listens for these failure requests and have it post
these results somewhere. So fancy!
> On 11/9/07, Tim Schaub <tschaub at openplans.org> wrote:
>> Our automated tests are a mix of acceptance and unit tests. These are
>> nice (because they are automated), but we need more (manual) acceptance
>> tests to fully test things like the renderers.
>> Instead of scattering manual acceptance tests in the examples directory,
>> I'd like to have an "acceptance" directory in our "tests" directory (or
>> "manual" if that makes more sense to folks). This would make it clear
>> for developers what acceptance tests needed to be run manually, and
>> would make it less confusing to users who poke around the examples
>> directory and stumble into the weird examples that are actually tests
>> (speaking for myself here).
>> Anyone opposed? Or got a better idea?
>> Barring feedback, I think I'll make such a change on Monday. (This will
>> only involve adding a directory to the tests directory and starting to
>> compile regular manual acceptance tests there.)
>> Dev mailing list
>> Dev at openlayers.org
More information about the Dev