[OpenLayers-Dev] manual acceptance tests

[Tim Schaub]

Hey-

Erik Uzureau wrote:
> This sounds like a brilliant idea to me and I am heavily in favour.

Cool.

> 
> It seems like just adding one directory might be a little short though
> maybe we could do something like:
> 
> openlayers/trunk/tests/acceptance
> and
> openlayers/trunk/tests/unit (for the current file-by-file tests?)

I agree more structure would make things a bit nicer.  However, being 
the semantic cop, our Test.AnotherWay stuff is not really all unit 
tests.  There are plenty of acceptance tests in there.

Maybe we could divide them up like this

trunk/tests/automated
trunk/tests/automated/index.html [the current run-tests.html]
...

trunk/tests/manual
trunk/tests/manual/index.html [list with links to test pages]
...

Anybody opposed?  I'm happy to set this up.

> 
> Also, I think its probably a good time to start looking into a
> post-commit hook (only on trunk, of course) that runs the unit tests.
> I don't personally have the first clue as to how to do that but
> someone out there must? I think it would be a helpful addition to our
> process and (realistically) wouldn't hinder the dev process hardly at
> all.

Unfortunately, since we rely on testing in multiple browsers, this isn't 
all that simple.  I know there are libraries to control IE with Python. 
  Don't know about Firefox.  Since our test output is huge and ugly 
HTML, I wouldn't want to be the one that had to scrape that and make 
sense of it.  I think to make this reasonable, we'd have to change test 
frameworks (to something that had an embedded browser) - but who wants 
to pay for that?

Tim

> 
> e
> 
> 
> 
> On 11/9/07, Tim Schaub <tschaub at openplans.org> wrote:
>> Hey-
>>
>> Our automated tests are a mix of acceptance and unit tests.  These are
>> nice (because they are automated), but we need more (manual) acceptance
>> tests to fully test things like the renderers.
>>
>> Instead of scattering manual acceptance tests in the examples directory,
>> I'd like to have an "acceptance" directory in our "tests" directory (or
>> "manual" if that makes more sense to folks).  This would make it clear
>> for developers what acceptance tests needed to be run manually, and
>> would make it less confusing to users who poke around the examples
>> directory and stumble into the weird examples that are actually tests
>> (speaking for myself here).
>>
>> Anyone opposed?  Or got a better idea?
>>
>> Barring feedback, I think I'll make such a change on Monday.  (This will
>> only involve adding a directory to the tests directory and starting to
>> compile regular manual acceptance tests there.)
>>
>> Tim
>> _______________________________________________
>> Dev mailing list
>> Dev at openlayers.org
>> http://openlayers.org/mailman/listinfo/dev
>>
> 
> !DSPAM:4033,4734c31d13012090977483!
>