[mapserver-users] Documentation for serving large rasterimagesusing tile cache.

Wed Jul 1 11:27:53 EDT 2009

Hi Asif,

I don't know of any specific applications or methods to stress test
MapServer.  However, I would think that you could use some web-based tools
such as Selenium (possibly) to exercise a web-based setup, or write a
test-script which does the same.  Sean Gillies has an excellent set of unit
tests written to exercise Python Mapscript.  You can view them here -
http://kentuckykarst.org/mapserver/mapscript/python/tests/cases/.  It might
be possible to adapt some of these to suit your needs, but I would think
that a utility which exercises your installation in the same way a user does
would be better.

There is a good, generic description of how to approach load testing of web
applications here - http://msdn.microsoft.com/en-us/library/bb924374.aspx.

Best of luck,

Roger
--

On Tue, Jun 30, 2009 at 10:15 PM, Asif Memon <mmemon at sdsc.edu> wrote:

> Hello,
>
> We have started using Map Server to serve large size images. Now we want to
> do a performance/stress test on Map Server. Do you have any documentation
> that explains the performance/stress test on a Map Server? If not, could you
> please suggest what shall I do?
>
> Sincerely,
> Asif Memon
>
>
> -----Original Message-----
> From: Bob Basques [mailto:Bob.Basques at ci.stpaul.mn.us]
> Sent: Monday, November 10, 2008 1:27 PM
> To: randre at gmail.com; Asif Memon
> Cc: mapserver-users at lists.osgeo.org
> Subject: RE: [mapserver-users] Documentation for serving large
> rasterimagesusing tile cache.
>
> Asif,
>
> While it may be a bit of overhead to implement just for testing, the
> GeoMoose client would definitely help with your performance testing.  If
> you combine it with FireBug/FireFox, you should be able to extract all
> the performance information you need (from the client end).
>
> From the server side, you can run the MapServer requests on the
> commandline.  In my experience though, the web side of the equation is
> usually the bottleneck for most performance issues.
>
> bobb
>
>
>
> >>> "Asif Memon" <mmemon at sdsc.edu> 11/10/08 3:21 PM >>>
> Thanks Roger,
>
>
>
> I have tiled a large mosaic(2 GB) by using the GDAL utility(gdal_convert
> "TILED=YES"). I want to test the performance for querying the mosaic
> with the zoom functionality. Do I need to write a client or is there
> anything readily available with which I can check the performance?
>
>
>
> Sincerely,
>
> Asif Memon
>
>
>
>
>
> From: Roger André [mailto:randre at gmail.com]
> Sent: Monday, November 10, 2008 9:35 AM
> To: Asif Memon
> Cc: mapserver-users at lists.osgeo.org
> Subject: Re: [mapserver-users] Documentation for serving large raster
> images using tile cache.
>
>
>
> Hi Asif,
>
> My apologies.  I saw your message Friday evening but forgot about it
> over the weekend in the course of reinstalling my Linux OS.  If time is
> of the essence, posting your question to the entire list should ensure a
> speedier response.
>
> Regarding your questions:
>
> 1) I am not aware of any applications that will act as viewers for
> Mapserver operating in "map" mode.  They may exist, but I'm not familiar
> with them.  I tend to use Mapserver in only one of two ways at the
> moment; in "map" mode to generate static maps, in "wms" mode with a
> connection to it via OpenLayers (or TileCache).
>
> 2) Regarding the path to your mapfile, I believe there are several
> solutions that you can try if your goal is to shorten the URL string.
> They are well-explained here -
>
> http://mapserver.gis.umn.edu/docs/howto/wms_server/#more-about-the-online-resource-url
> .
>  As far as why the 1st URL doesn't actually work, it's because the path
> should be relative to the mapserv.exe location in cgi-bin, not to
> htdocs.  So try this instead:
>
> -
>
> http://localhost:9090/cgi-bin/mapserv.exe?map=../htdocs/mapdemo/itasca_demo.map&mode=map
> <
> http://localhost:9090/cgi-bin/mapserv.exe?map=/mapdemo/itasca_demo.map&mode=map
> >
>
>
> Roger
> --
>
> On Mon, Nov 10, 2008 at 1:58 AM, Asif Memon <mmemon at sdsc.edu> wrote:
>
> Hi All,
>
>
>
> I have couple of question, could you please take a look at it :
>
>
>
> 1)      Do you know any Map Server Client that allows viewing the image
> service (created on the Minnesota Map Server) if I give the URL listed
> below:
>
> http://localhost:9090/cgi-bin/mapserv.exe?map=/path/to/itasca.map&mode=map
> "
>
>
>
> 2)      I am using Windows XP on my PC. When I give the URL in this
> format -
>
> http://localhost:9090/cgi-bin/mapserv.exe?map=/mapdemo/itasca_demo.map&mode=map
> ",
> it doesn't work. But if I give it in format -
> http://localhost:9090/cgi-bin/mapserv.exe?map=C
> :\Asif\work\devtools\MMS\ms4w\Apache\htdocs\mapdemo\itasca_demo.map&mode=map
> <
> http://localhost:9090/cgi-bin/mapserv.exe?map=C:%5CAsif%5Cwork%5Cdevtools%5CMMS%5Cms4w%5CApache%5Chtdocs%5Cmapdemo%5Citasca_demo.map&mode=map
> >
> , it works. The problem in giving the URL is this format is I have to
> put the complete path starting with "C: drive" and if I have to run it
> on the server, I cannot give it like that.
>
>
>
> Could you please help me with both the above issues? Thanks!
>
>
>
> Sincerely,
>
> Asif Memon
>
>
>
>
>
> From: Roger André [mailto:randre at gmail.com]
> Sent: Tuesday, October 28, 2008 8:11 PM
> To: Asif Memon
> Cc: mapserver-users at lists.osgeo.org
> Subject: Re: [mapserver-users] RE: Documentation for serving large
> raster images using tile cache.
>
>
>
> Hi Asif,
>
> I downloaded the demo.tif file that you sent earlier, and the
> itasca_demo.map from you rprevious email.  I changed the path in the
> DATA portion of the LAYER section to point to my filesystem,
>    DATA "/var/www/mapfiles/itasca/demo.tif"
>
> and also changed the EXTThis matches the extent of the file when you run
> gdalinfo against it
> (min_x min_y max_x Max_y).
>
> With these changes, I'm able to view the file with the following URL:
>
> http://localhost/cgi-bin/mapserv?map=/var/www/mapfiles/itasca/itasca_demo.map&mode=map
>
> (Note, I'm running this in Linux, so paths and URLs are going to be
> slightly different than yours)
>
> Try changing your EXTENT entry to match mine, that might do the trick.
> --
>
> On Tue, Oct 28, 2008 at 3:45 PM, Asif Memon <mmemon at sdsc.edu> wrote:
>
> Thanks Roger.
>
>
>
> I don't see any errors now, but no image appears in the browser(the
> browser is blank). I made minor changes to the map file that you sent me
> (about the paths, attached is the file).
>
>
>
> The URL that I am using in the browser is
> http://localhost:9090/cgi-bin/mapserv.exe?map=C
> :\Asif\work\devtools\MMS\ms4w\Apache\htdocs\mapdemo\itasca_demo.map&mode=map
> <
> http://localhost:9090/cgi-bin/mapserv.exe?map=C:%5CAsif%5Cwork%5Cdevtools%5CMMS%5Cms4w%5CApache%5Chtdocs%5Cmapdemo%5Citasca_demo.map&mode=map
> >
>
>
>
>
> Please correct me if anything is wrong in the URL or in the map file.
>
>
>
> Sincerely,
>
> Asif Memon
>
>
>
>
>
> From: Roger André [mailto:randre at gmail.com]
> Sent: Tuesday, October 28, 2008 3:17 PM
>
>
> To: Asif Memon
> Cc: mapserver-users at lists.osgeo.org
> Subject: Re: [mapserver-users] RE: Documentation for serving large
> raster images using tile cache.
>
>
>
> Hi Asif,
>
> Ok, here's a new mapfile that you can try.  Change your request to point
> to this one, and see if you get an image back in your browser.
>
> Roger
> --
>
> On Tue, Oct 28, 2008 at 2:06 PM, Asif Memon <mmemon at sdsc.edu> wrote:
>
> I believe one of the "END" was missing at the end of the file, I have
> added that. This resolves the earlier error and generated a new one -
> msDrawMap(): Image handling error. Unable to initialize image.
> msPrepareImage(): General error message. Image dimensions not specified.
> msCalculateScale(): General error message. Invalid image extent,
> minx=-1.000000, miny=-1.000000, maxx=-1.000000, maxy=-1.000000.
> mapserv(): Web application error. No way to generate map extent.
>
>
>
> Any help is much appreciated?
>
>
>
> Sincerely,
>
> Asif Memon
>
>
>
> From: Asif Memon
> Sent: Tuesday, October 28, 2008 1:48 PM
> To: 'Roger André'
>
>
> Cc: 'mapserver-users at lists.osgeo.org'
>
> Subject: RE: [mapserver-users] RE: Documentation for serving large
> raster images using tile cache.
>
>
>
> No, TileCache didn't come with that. I am trying to view any image right
> now to see an example of serving an image into Mapserver.
>
>
>
> I changed the path of the WMS
> URL(http://localhost:9090/cgi-bin/mapserv.exe?map=C
> :\Asif\work\devtools\MMS\ms4w\Apache\htdocs\mapdemo\demo.map&mode=map
> <
> http://localhost:9090/cgi-bin/mapserv.exe?map=C:%5CAsif%5Cwork%5Cdevtools%5CMMS%5Cms4w%5CApache%5Chtdocs%5Cmapdemo%5Cdemo.map&mode=map
> >
> ) and the error I am getting now is - msLoadMap(): Premature
> End-of-File.
>
>
>
> I ran the GDAL tile cache command on a .tif image to create the shape
> files using (gdaltindex doq_index.shp doq/*.tif). Also, I made some
> changes in the map file. Attached is the most updated map file along
> with the shape files.
>
>
>
> Could you please take a look at it.
>
>
>
> Sincerely,
>
> Asif Memon
>
>
>
> From: Roger André [mailto:randre at gmail.com]
>
> Sent: Tuesday, October 28, 2008 1:22 PM
> To: Asif Memon
>
> Subject: Re: [mapserver-users] RE: Documentation for serving large
> raster images using tile cache.
>
>
>
> Sorry I assumed that the index.html file was the one that came with
> TileCache.  Is that not correct?
> --
>
> On Tue, Oct 28, 2008 at 1:02 PM, Asif Memon <mmemon at sdsc.edu> wrote:
>
> Thanks for your reply.
>
>
>
> Attached is the map file. I do not have the any tilecache.cfg file. From
> the error(msLoadMap(): Unable to access file. (/path/to/demo.map)), it
> appears the map file is not accessible.
>
>
>
> Sincerely,
>
> Asif Memon
>
>
>
>
>
> From: Roger André [mailto:randre at gmail.com]
>
> Sent: Tuesday, October 28, 2008 12:53 PM
> To: Asif Memon
>
> Cc: mapserver-users at lists.osgeo.org
>
>
> Are you able to view a map when you go to
> "
> http://localhost:9090/cgi-bin/mapserv.exe?map=/path/to/itasca.map&mode=map
> "
> ?  Also, can you send a copy of your mapfile, and of your tilecache.cfg
> files?
>
> Roger
> --
>
> On Tue, Oct 28, 2008 at 11:15 AM, Asif Memon <mmemon at sdsc.edu> wrote:
>
> Hi Roger,
>
>
>
> I followed the instructions on the documentation and setup the map
> server and demo, when I try to execute the index.html, I get this error
> - msLoadMap(): Unable to access file.
> (http://localhost:9090/mapdemo/itasca.map)
>
>
>
> Do you know what could be it?
>
>
>
> Sincerely,
>
> Asif Memon
>
>
>
> From: Roger André [mailto:randre at gmail.com]
> Sent: Monday, October 20, 2008 1:38 PM
> To: Gregor Mosheh
> Cc: Asif Memon; mapserver-users at lists.osgeo.org
> Subject: Re: [mapserver-users] RE: Documentation for serving large
> raster images using tile cache.
>
>
>
> Hi Asif,
>
> Best thing to do is take a look at these 2 docs first:
> - http://mapserver.gis.umn.edu/docs/howto/raster_data
> - http://tilecache.org/readme.html
>
> Once you have the ability to see your raster in MapServer via a
> "mode=map" request, then you will have to decide how you wish to view
> your data afterwards.  There are different things to do in TileCache
> depending on whether you wish to view the data in OpenLayers, or over
> Google Maps/MS VE.
> --
>
> On Mon, Oct 20, 2008 at 12:01 PM, Gregor Mosheh <gregor at hostgis.com>
> wrote:
>
> Asif Memon wrote:
>
> Could someone please point me to the documentation for serving large
> (2GB to 3GB) raster images using tile cache. I want to use Minnesota Map
> Server and GDAL to achieve this.
>
>
>
> You'll want to ask the TileCache list about that, likely. Once you have
> MapServer actually serving up the imagery, get your client using
> MapServer or WMS (I like OpenLayers, myself). Then install TileCache and
> change the OL app to use TC's URL instead of MapServer's. Easy.
>
> But you may want to install OpenLayers and get it working with MapServer
> first, then hit up the OL and TC mailing lists.
>
> --
> Gregor Mosheh / Greg Allensworth    BS, A+, Network+, Security+, Server+
> System Administrator, Lead Programmer
> HostGIS development & hosting services, http://www.HostGIS.com/
>
> "Remember that no one cares if you can back up,
>  only if you can restore." - AMANDA
> _______________________________________________
> mapserver-users mailing list
> mapserver-users at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.osgeo.org/pipermail/mapserver-users/attachments/20090701/e0a5e1d1/attachment-0001.html