<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<style type="text/css" style="display:none;"><!-- P {margin-top:0;margin-bottom:0;} --></style>
</head>
<body dir="ltr">
<div id="divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Helvetica,sans-serif;" dir="ltr">
<p style="margin-top:0;margin-bottom:0">Not that I saw - nothing from Patrick beyond the original post - at least not to the list.</p>
</div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> mapserver-dev <mapserver-dev-bounces@lists.osgeo.org> on behalf of Stephen Woodbridge <stephenwoodbridge37@gmail.com><br>
<b>Sent:</b> Wednesday, May 15, 2019 1:33:08 PM<br>
<b>To:</b> mapserver-dev@lists.osgeo.org<br>
<b>Subject:</b> Re: [mapserver-dev] Memory leak in mapcache</font>
<div> </div>
</div>
<div class="BodyFragment"><font size="2"><span style="font-size:11pt;">
<div class="PlainText">Was there a followup on this? I don't remember seeing one.<br>
<br>
Thanks,<br>
-Steve W<br>
<br>
On 4/15/2019 4:36 AM, Patrick Valsecchi wrote:<br>
> Hi Thomas, Long time no see!<br>
><br>
> Every kind of request leaks. Even a WMS GetCapabilities (done by the <br>
> health-check) leaks, but at a lesser rate than a GetMap. The web UI <br>
> does requests in //, but the ingress limits at 10 connection in //.<br>
><br>
> And it's not just that it allocates a big chunk of memory and stays <br>
> there. It leaks continuously until the OOM wakes up and kills one of <br>
> apache's worker. I had to set a limit of 100 requests (every 100 <br>
> requests the worker process is killed and a new one is forked) per <br>
> worker to keep memory usage at bay.<br>
><br>
> Thanks<br>
><br>
> On Fri, Apr 12, 2019 at 7:12 PM thomas bonfort <br>
> <thomas.bonfort@gmail.com <<a href="mailto:thomas.bonfort@gmail.com">mailto:thomas.bonfort@gmail.com</a>>> wrote:<br>
><br>
> Hi Patrick,<br>
> What kind of requests is mapcache responding to, and at what<br>
> concurrency? Serving multiple large wms requests is typically an<br>
> example where large chunks of memory will be allocated.<br>
><br>
> --<br>
> thomas<br>
><br>
> On Fri, Apr 12, 2019 at 12:42 AM Patrick Valsecchi<br>
> <patrick.valsecchi@camptocamp.com<br>
> <<a href="mailto:patrick.valsecchi@camptocamp.com">mailto:patrick.valsecchi@camptocamp.com</a>>> wrote:<br>
><br>
> Hi,<br>
><br>
> I'm using mapcache v1.6.1 (tested as well with a master build)<br>
> in docker and I can see huge memory increases in the apache<br>
> process memory usage when mapcache is used (it's the only<br>
> thing this apache instance is serving). The thing is<br>
> configured like that:<br>
><br>
> <mapcache><br>
> <cache name="default" type="memcache"><br>
> <server><br>
> <host>prod-2-4-c2cgeoportal-memcached</host><br>
> <port>11211</port><br>
> </server><br>
> </cache><br>
><br>
> ...<br>
><br>
> <tileset name="map"><br>
> <source>map</source><br>
> <cache>default</cache><br>
> <grid>swissgrid_005</grid><br>
> <metatile>5 5</metatile><br>
> <metabuffer>128</metabuffer><br>
> <format>image/png</format><br>
> <expires>3600</expires> <!-- 1 hour --><br>
> <auto_expire>13800</auto_expire> <!-- 4 hours --><br>
> </tileset><br>
><br>
><br>
> I can see that memcached is used in it's stats and only<br>
> mapcache uses it.<br>
><br>
> But the the memory usage of the whole mapcache container looks<br>
> like that:<br>
> image.png<br>
><br>
> Each dip in usage is when the OOM kills one of the apache<br>
> workers (out of a maximum of 3 workers). I have configured a<br>
> memory limit in docker at 512MB.<br>
> Nothing shows up in the apache logs.<br>
><br>
> Are there any known memory leaks? Do I have a bad<br>
> configuration? I could have the apache workers restarted every<br>
> 10 queries, but that would be utterly ugly and inefficient...<br>
><br>
> Thanks for your help.<br>
> _______________________________________________<br>
> mapserver-dev mailing list<br>
> mapserver-dev@lists.osgeo.org<br>
> <<a href="mailto:mapserver-dev@lists.osgeo.org">mailto:mapserver-dev@lists.osgeo.org</a>><br>
> <a href="https://gcc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.osgeo.org%2Fmailman%2Flistinfo%2Fmapserver-dev&data=02%7C01%7Csteve.lime%40state.mn.us%7C02d7dd2a7ef94ad9b92908d6d963ca9a%7Ceb14b04624c445198f26b89c2159828c%7C0%7C0%7C636935419954290965&sdata=5rn3C0cRHGeVg9yzj0rTpNsrh%2BKnUkqVJzgz2lbipt4%3D&reserved=0">
https://gcc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.osgeo.org%2Fmailman%2Flistinfo%2Fmapserver-dev&data=02%7C01%7Csteve.lime%40state.mn.us%7C02d7dd2a7ef94ad9b92908d6d963ca9a%7Ceb14b04624c445198f26b89c2159828c%7C0%7C0%7C636935419954290965&sdata=5rn3C0cRHGeVg9yzj0rTpNsrh%2BKnUkqVJzgz2lbipt4%3D&reserved=0</a><br>
><br>
><br>
> _______________________________________________<br>
> mapserver-dev mailing list<br>
> mapserver-dev@lists.osgeo.org<br>
> <a href="https://gcc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.osgeo.org%2Fmailman%2Flistinfo%2Fmapserver-dev&data=02%7C01%7Csteve.lime%40state.mn.us%7C02d7dd2a7ef94ad9b92908d6d963ca9a%7Ceb14b04624c445198f26b89c2159828c%7C0%7C0%7C636935419954300979&sdata=pNYEzd1InZ8gm%2B74ZG%2BgIsCHCXC1L90NDRks6eqcMh0%3D&reserved=0">
https://gcc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.osgeo.org%2Fmailman%2Flistinfo%2Fmapserver-dev&data=02%7C01%7Csteve.lime%40state.mn.us%7C02d7dd2a7ef94ad9b92908d6d963ca9a%7Ceb14b04624c445198f26b89c2159828c%7C0%7C0%7C636935419954300979&sdata=pNYEzd1InZ8gm%2B74ZG%2BgIsCHCXC1L90NDRks6eqcMh0%3D&reserved=0</a><br>
<br>
<br>
---<br>
This email has been checked for viruses by Avast antivirus software.<br>
<a href="https://gcc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.avast.com%2Fantivirus&data=02%7C01%7Csteve.lime%40state.mn.us%7C02d7dd2a7ef94ad9b92908d6d963ca9a%7Ceb14b04624c445198f26b89c2159828c%7C0%7C0%7C636935419954300979&sdata=XonCwE%2BUrOoxN1frcUO6sZmDyO0rxGBTkvd27uj9OxA%3D&reserved=0">https://gcc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.avast.com%2Fantivirus&data=02%7C01%7Csteve.lime%40state.mn.us%7C02d7dd2a7ef94ad9b92908d6d963ca9a%7Ceb14b04624c445198f26b89c2159828c%7C0%7C0%7C636935419954300979&sdata=XonCwE%2BUrOoxN1frcUO6sZmDyO0rxGBTkvd27uj9OxA%3D&reserved=0</a><br>
<br>
_______________________________________________<br>
mapserver-dev mailing list<br>
mapserver-dev@lists.osgeo.org<br>
<a href="https://gcc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.osgeo.org%2Fmailman%2Flistinfo%2Fmapserver-dev&data=02%7C01%7Csteve.lime%40state.mn.us%7C02d7dd2a7ef94ad9b92908d6d963ca9a%7Ceb14b04624c445198f26b89c2159828c%7C0%7C0%7C636935419954300979&sdata=pNYEzd1InZ8gm%2B74ZG%2BgIsCHCXC1L90NDRks6eqcMh0%3D&reserved=0">https://gcc01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.osgeo.org%2Fmailman%2Flistinfo%2Fmapserver-dev&data=02%7C01%7Csteve.lime%40state.mn.us%7C02d7dd2a7ef94ad9b92908d6d963ca9a%7Ceb14b04624c445198f26b89c2159828c%7C0%7C0%7C636935419954300979&sdata=pNYEzd1InZ8gm%2B74ZG%2BgIsCHCXC1L90NDRks6eqcMh0%3D&reserved=0</a></div>
</span></font></div>
</body>
</html>