[MapProxy] Caches: performance and conversion?

[Immanuel Hayden]

Pretty sure that little bit of locking is rather insignificant compared to
how long arcgis server actually takes to render these images 😅. At least
from my observations mapproxy doesn't seem to hold a global db lock while
waiting for the pics in the seeding process to materialise ... if it did,
that would be a _major_ bug.

On Tue, 23 Mar 2021 at 13:20, Travis Kirstine <traviskirstine at gmail.com>
wrote:

> My experience is that all the sqlite based caches work great once the data
> is cached, however caching can be a bit slow.  I'm not sure how or if it is
> possible but try to ensure MapProxy is exporting / converting multiple
> tiles per transaction or you could be in for a very long wait.
>
> On Mon, 22 Mar 2021 at 17:58, Immanuel Hayden <immanuel.hayden at gmail.com>
> wrote:
>
>> Oooh that looks like just what I'm looking for. Thanks a lot for pointing
>> that out. Still concerned about performance though, but let's just see :D
>>
>> On Mon, 22 Mar 2021 at 21:37, Travis Kirstine <traviskirstine at gmail.com>
>> wrote:
>>
>>>
>>> Immanuel,
>>>
>>> I haven't done this with MapProxy but have done something similar with
>>> MapCache.  I believe the command you are looking for can be found here:
>>>
>>> https://mapproxy.org/docs/1.13.0/mapproxy_util.html#export
>>>
>>>
>>>
>>>
>>>
>>> On Wed, 17 Mar 2021 at 11:18, Immanuel Hayden <immanuel.hayden at gmail.com>
>>> wrote:
>>>
>>>> Hi!
>>>>
>>>> Short summary of my situation: I have about 1 TB of tiles between 100+
>>>> projects (mostly file-cache based ... the horrors) and would like to
>>>> migrate away to a different cache format. So far I've found geopackage to
>>>> work rather nicely and also seemingly uses considerably less disk space
>>>> (about half in my trials). However this leads to two questions:
>>>>
>>>> 1. Did anyone ever do a performance comparison between the different
>>>> local caches? I am concerned with running into performance problems halfway
>>>> through converting the data. This also includes resource consumption (i.e.
>>>> does for example loading a geopackage cache stress memory more than a file
>>>> cache?)
>>>> 2. Is there some way to convert between cache types? Re-rendering takes
>>>> a _long_ time due to the complexity of our maps, so while this was a good
>>>> option for my test projects, it isn't for the bulk of the tile cache. If
>>>> there is an option, how would I actually set that up? Maybe adding the
>>>> existing cache as a WMS soure or something?
>>>>
>>>> Thanks for your inputs :)
>>>> _______________________________________________
>>>> MapProxy mailing list
>>>> MapProxy at lists.osgeo.org
>>>> https://lists.osgeo.org/mailman/listinfo/mapproxy
>>>>
>>>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/mapproxy/attachments/20210323/cff8f291/attachment-0001.html>