[MapProxy] FW: Which cache is better

[Travis Kirstine]

David,

According to the doc you could try using the ArcGIS tiles as a source which
may increase your caching performance.

https://mapproxy.org/docs/nightly/sources.html#tiles
see arcgiscache_path


We are using riak in a 5 node cluster N=3 with a leveldb backend, we found
that the bitcask memory footprint was unrealistic.  We went with the
default 64 partitions which maybe should have been increased to 128. We've
found that debugging issues and simply accessing the data a little more
difficult than expected and required scripting to perform basic queries /
tasks.  That being said the cluster is performing very well on both read /
writes

We did also briefly test couchdb and found that it worked well, I would
have preferred it over riak but outside factors forced our decision.

If I was you I would still try a sqlite based cache first to see if it
meets your need.




On 8 June 2017 at 17:53, Andrew, David (DPFEM) <
David.Andrew at dpfem.tas.gov.au> wrote:

> Hi Travis,
>
> I need to supply a selection of base maps in a 24/7 configuration from the
> same datacentre as the applications servers.
>
> The application reading htem is an olderversion of geoserver, which cannot
> directly connect to arcgis.
>
> The source is
>
> http://services.thelist.tas.gov.au/arcgis/rest/services/
> Basemaps/Orthophoto/ImageServer
>
>
>
> yes to ARCGIS as a WMS source for MapProxy.
>
>
>
> *David Andrew*
>
> IT Services – Enterprise Systems
>
> Business and Executive Services
>
>
>
> Department of Police, Fire and Emergency Management
>
> Cnr Argyle and Melville Streets, Hobart TAS 7000
>
> David.Andrew at police.tas.gov.au| www.dpfem.tas.gov.au
>
>
>
> *From:* Travis Kirstine [mailto:traviskirstine at gmail.com]
> *Sent:* 08 June 2017 22:26
> *To:* Andrew, David (DPFEM) <David.Andrew at dpfem.tas.gov.au>
> *Cc:* mapproxy at lists.osgeo.org
> *Subject:* Re: [MapProxy] FW: Which cache is better
>
>
>
> David,
>
>
>
> If your primary concern is interoperability and portability I would look
> at mbtiles or geopackage.  Both cache types store the tiles in a single
> file which could be used in a few platforms and easily backed up.  The only
> issue with these caches (sqlite) it a tendency to lock up during heavy
> concurrent writes, mapproxy has implemented bulk writing to help address
> this issue for mbtiles (not sure about geopackage).  If your users are
> using a fully seeded cache this won't be a big issue.
>
>
>
> When you indicate that it takes 2 weeks to download the cache from ArcGIS
> do you me that you are using ArcGIS as a WMS source for MapProxy?
>
>
>
> Regards
>
>
>
>
>
>
>
> On 8 June 2017 at 00:29, Andrew, David (DPFEM) <
> David.Andrew at dpfem.tas.gov.au> wrote:
>
> Hi all,
>
> Totally a newbie regarding all things GIS
>
> I’m trying to establish which cache type is better for a photo cache.
>
>
>
> I’m looking to cache the orthographic photo maps for the state of Tasmania
> Australia, to a zoom level of 18
>
> This will then be used by the new emergency services application to have
> an offline pre seeded copy.
>
> Around 30 clients, up to 50 in a peak load like New Years eve.
>
>
>
> I cannot seem to find anything that defines which cache style would be
> better or worse.
>
> CouchDB seems interesting and replicatable
>
> Riak seem like very fast fetch
>
> Geopackage looks like we can copy the flat file once we get it.
>
>
>
> If anyone has any numbers around which is better that would be great.
>
> At the moment to download the cache takes a week or 2 for levels 17-18
> from an arcgis server(10.31 newer than the cache option allow)
>
>
>
> Thanks in advance
>
>
>
> *David Andrew*
>
> IT Services – Enterprise Systems
>
> Business and Executive Services
>
>
>
> Department of Police, Fire and Emergency Management
>
> Cnr Argyle and Melville Streets, Hobart TAS 7000
>
> David.Andrew at police.tas.gov.au| www.dpfem.tas.gov.au
>
>
>
>
> ------------------------------
>
>
> CONFIDENTIALITY NOTICE AND DISCLAIMER
> The information in this transmission may be confidential and/or protected
> by legal professional privilege, and is intended only for the person or
> persons to whom it is addressed. If you are not such a person, you are
> warned that any disclosure, copying or dissemination of the information is
> unauthorised. If you have received the transmission in error, please
> immediately contact this office by telephone, fax or email, to inform us of
> the error and to enable arrangements to be made for the destruction of the
> transmission, or its return at our cost. No liability is accepted for any
> unauthorised use of the information contained in this transmission.
>
>
> _______________________________________________
> MapProxy mailing list
> MapProxy at lists.osgeo.org
> https://lists.osgeo.org/mailman/listinfo/mapproxy
>
>
>
> ------------------------------
>
> CONFIDENTIALITY NOTICE AND DISCLAIMER
> The information in this transmission may be confidential and/or protected
> by legal professional privilege, and is intended only for the person or
> persons to whom it is addressed. If you are not such a person, you are
> warned that any disclosure, copying or dissemination of the information is
> unauthorised. If you have received the transmission in error, please
> immediately contact this office by telephone, fax or email, to inform us of
> the error and to enable arrangements to be made for the destruction of the
> transmission, or its return at our cost. No liability is accepted for any
> unauthorised use of the information contained in this transmission.
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/mapproxy/attachments/20170609/683c3eaf/attachment-0001.html>