[MapProxy] Tile Locks

[Keith Moss]

Olivier,

Yup, the servers are accessing the tiles via the UNC paths. What's the preferred method of storing the tiles in a setup where there are multiple MapProxy instances hitting the same cache?

We're accessing the sources via the WMS source, which itself is pointing at http://localhost/cgi-bin/mapserv.exe via Apache on each server.

Cheers,

Keith

__________________________________
Keith Moss
Satellite Remote Sensing Services
Operations
Landgate
65 Brockway Road, FLOREAT WA 6014
PO Box 741 Wembley WA 6913
Ph. (08) 9387 0332 | Fx. (08) 9383 7142
keith.moss at landgate.wa.gov.au
http://www.landgate.wa.gov.au/

________________________________________
From: Oliver Tonnhofer [olt at omniscale.de]
Sent: Wednesday, 16 January 2013 9:01 PM
To: Keith Moss
Cc: mapproxy at lists.osgeo.org
Subject: Re: [MapProxy] Tile Locks

On 07.01.2013, at 05:33, Keith Moss wrote:

> Hi list,
>
> I've got a bit of a bizarre issue with MapServer holding locks on MapProxy tiles.
>
> Our setup is: 4 x Windows Server 2008 running MapProxy 1.5.0 via WSGI in Apache, 1 x Windows Server 2008 running mapproxy-seed.exe in scheduled tasks, 1 x Windows Server 2008 storing the .yaml config files.
>
> Our four MapProxy instances are using sources of the WMS type that point back to the MapServer .exe locally i.e. http://localhost/cgi-bin/mapserv.exe?map=something.map
>
> In our log files from MapProxy and from mapproxy-seed we're periodically getting errors from lock.py line 124, e.g.
> [...]
> WindowsError: [Error 32] The process cannot access the file because it is being
> used by another process: '\\\\10.0.0.70\\c_drive\\mapproxy\\cache\\layer7_fhs_la
> st_0_72.shp_EPSG900913\\tile_locks\\1d5b8827382a79fba940cc62e989aead-14883-6072-
> 14.lck'

And all servers access the same tiles via a remote share?
The locking does not work well with most networked file systems.


> Using Process Explorer I've managed to track the file locks down to the mapserv.exe process. In a typical case mapserv.exe will have locks on a PNG and a few of the .lck files. My understanding was that there's no link between the sources and the PNG tiles that MapProxy creates, so I'm at somewhat of a loss as to how mapserv.exe can come to have any knowledge of these PNG and .lck files.

MapProxy starts mapserv.exe when using the mapserver source and (I assume that) this process inherits the open file handles. This is what you see in the process explorer, but the MapProxy process actually handles the lock files.


Regards,
Oliver

--
Oliver Tonnhofer    | Omniscale GmbH & Co KG    | http://omniscale.com
http://mapproxy.org | https://github.com/olt    | @oltonn







This e-mail and any files transmitted with it are intended only for the use of the addressee(s). It may contain information that is confidential and privileged, in which case neither is intended to be waived or lost by mistaken delivery to you. If you are not an intended recipient, any use, interference with, disclosure, distribution or copying of this material is unauthorised and prohibited. If you receive this e-mail in error, please notify the sender by return e-mail and delete the message and any attachments from your system. Unless specifically indicated, this e-mail does not constitute formal advice or commitment by the sender or the Western Australian Land Information Authority (Landgate). Information in this message not relating to the official business of Landgate shall be understood as neither given nor endorsed by it. It is your responsibility to check any attachments for viruses and defects before opening or sending them on. Landgate’s liability is limited to re-supplying affected attachments.