Hi Oliver and list,<div><br></div><div>I misspelled my previous question. I was not stating the actual size limit of an sqlite database, but the "performance limit" for sqlite dbs, as I stated in some sqlite users foruns some concerns on dbs above 2Gb.</div>
<div>I guess we will have to do some performance testing in order to check if this behaviour is true.</div><div><br></div><div>On the other hand, of course we don't want the full 2Tb of data in a single database... we are thinking on a db "switch" scenario for some given zoom values and on minor scales by regions, as MapProxy deals great with these features...but this is only a scenario</div>
<div><br></div><div>Looking forward to hear from the new partition system!</div><div><br></div><div>Another question;</div><div>Is it safe to install your PIL modification package side-by-side with the "official" PIL package? Should I uninstall it first?</div>
<div><br></div><div>Regards,</div><div><br><br><div class="gmail_quote">2011/11/7 Oliver Tonnhofer <span dir="ltr"><<a href="mailto:olt@omniscale.de">olt@omniscale.de</a>></span><br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">
<div class="im"><br>
On 04.11.2011, at 19:17, Fernando Ribeiro wrote:<br>
> Currently my company holds about 2Tb of tiles (increasing) and we are evaluating upgrading our current tilecache based service, to mapproxy, preferably with mbtiles support.<br>
> Our current major concern is the actual limit of an sqlite database, which is stated around 2Gb. If this is true, we would need a lot of partitioning...in other words, managing a lot of partitions, would be very annoying.<br>
<br>
</div>The file size limit of SQLite is 2TB and not 2 GB, but I'm not suggesting to use a single file. SQLite locks the whole database for all write operations. Adding a single tile is fast and should lock the file only for a few ms, but when you remove larger blocks of tiles, you need to do a vacuum and this will block the file for much longer. So, having smaller files is still advisable.<br>
<br>
Partitioning would be done automatically by MapProxy (DB partitioning, not FS), but that is not yet implemented.<br>
<br>
Regards,<br>
Oliver<br>
<span class="HOEnZb"><font color="#888888"><br>
--<br>
Oliver Tonnhofer | Omniscale GmbH & Co KG | <a href="http://omniscale.de" target="_blank">http://omniscale.de</a><br>
<a href="http://mapproxy.org" target="_blank">http://mapproxy.org</a> | <a href="https://bitbucket.org/olt" target="_blank">https://bitbucket.org/olt</a> | @oltonn<br>
<br>
<br>
<br>
<br>
</font></span></blockquote></div><br><br clear="all"><div><br></div>-- <br><div>Fernando Ribeiro</div><br>
</div>