<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<div class="WordSection1">
<pre style="background:#EEEEEE"><span lang="EN-US" style="font-family:"Helvetica",sans-serif;color:#222222">Here is my region:</span><span class="EmailStyle17"><span lang="EN-US" style="font-size:11.0pt;font-family:Consolas;color:#222222;border:none windowtext 1.0pt;padding:0cm;background:#EEEEEE"> <o:p></o:p></span></span></pre>
<pre style="background:#EEEEEE"><span lang="EN-US" style="font-family:Consolas;color:#222222;border:none windowtext 1.0pt;padding:0cm;background:#EEEEEE">g.region -p projection: 1 (UTM)<o:p></o:p></span></pre>
<p class="MsoNormal" style="background:#EEEEEE"><span lang="EN-US" style="font-size:10.0pt;font-family:Consolas;color:#222222;border:none windowtext 1.0pt;padding:0cm;background:#EEEEEE">zone: 22<o:p></o:p></span></p>
<p class="MsoNormal" style="background:#EEEEEE"><span lang="EN-US" style="font-size:10.0pt;font-family:Consolas;color:#222222;border:none windowtext 1.0pt;padding:0cm;background:#EEEEEE">datum: wgs84<o:p></o:p></span></p>
<p class="MsoNormal" style="background:#EEEEEE"><span lang="EN-US" style="font-size:10.0pt;font-family:Consolas;color:#222222;border:none windowtext 1.0pt;padding:0cm;background:#EEEEEE">ellipsoid: wgs84<o:p></o:p></span></p>
<p class="MsoNormal" style="background:#EEEEEE"><span lang="EN-US" style="font-size:10.0pt;font-family:Consolas;color:#222222;border:none windowtext 1.0pt;padding:0cm;background:#EEEEEE">north: 636094.00956457<o:p></o:p></span></p>
<p class="MsoNormal" style="background:#EEEEEE"><span lang="EN-US" style="font-size:10.0pt;font-family:Consolas;color:#222222;border:none windowtext 1.0pt;padding:0cm;background:#EEEEEE">south: 233878.203125<o:p></o:p></span></p>
<p class="MsoNormal" style="background:#EEEEEE"><span lang="EN-US" style="font-size:10.0pt;font-family:Consolas;color:#222222;border:none windowtext 1.0pt;padding:0cm;background:#EEEEEE">west: 98924.52245413<o:p></o:p></span></p>
<p class="MsoNormal" style="background:#EEEEEE"><span lang="EN-US" style="font-size:10.0pt;font-family:Consolas;color:#222222;border:none windowtext 1.0pt;padding:0cm;background:#EEEEEE">east: 430413.65625<o:p></o:p></span></p>
<p class="MsoNormal" style="background:#EEEEEE"><span lang="EN-US" style="font-size:10.0pt;font-family:Consolas;color:#222222;border:none windowtext 1.0pt;padding:0cm;background:#EEEEEE">nsres: 30.00043309<o:p></o:p></span></p>
<p class="MsoNormal" style="background:#EEEEEE"><span lang="EN-US" style="font-size:10.0pt;font-family:Consolas;color:#222222;border:none windowtext 1.0pt;padding:0cm;background:#EEEEEE">ewres: 29.99901663<o:p></o:p></span></p>
<p class="MsoNormal" style="background:#EEEEEE"><span lang="EN-US" style="font-size:10.0pt;font-family:Consolas;color:#222222;border:none windowtext 1.0pt;padding:0cm;background:#EEEEEE">rows: 13407<o:p></o:p></span></p>
<p class="MsoNormal" style="background:#EEEEEE"><span lang="EN-US" style="font-size:10.0pt;font-family:Consolas;color:#222222;border:none windowtext 1.0pt;padding:0cm;background:#EEEEEE">cols: 11050<o:p></o:p></span></p>
<p class="MsoNormal" style="background:#EEEEEE"><span lang="EN-US" style="font-size:10.0pt;font-family:Consolas;color:#222222;border:none windowtext 1.0pt;padding:0cm;background:#EEEEEE">cells: 148147350</span><span lang="EN-US" style="font-size:10.0pt;font-family:Consolas;color:#222222"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt;font-family:"Helvetica",sans-serif;color:#222222"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:10.0pt">></span><span lang="EN-US">Given my test on a small laptop, it is very likely that your actual >computational region does not match the input map.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">I define the computational area with 'g.region raster=dem zoom=dem' ('dem' being my raster) before launching the script so it should match the elevation map.
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">>Why do you use the r.fill.dir module?<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">r.fill.dir is to extract depression areas as sinks, sinks being one of the outputs of my script.
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">Mael<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">De :</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Markus Neteler [via OSGeo.org] [mailto:ml-node+<a href="/user/SendEmail.jtp?type=node&node=5223818&i=0" target="_top" rel="nofollow" link="external">[hidden email]</a>]
<br>
<b>Envoyé :</b> jeudi 10 septembre 2015 17:07<br>
<b>À :</b> MORENI Mael<br>
<b>Objet :</b> Re: g_malloc on r.watershed with 30GB free ram + r.fill.dir crash<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<p class="MsoNormal">On Thu, Sep 10, 2015 at 9:00 PM, mael <<a href="/user/SendEmail.jtp?type=node&node=5223631&i=0" target="_top" rel="nofollow" link="external">[hidden email]</a>> wrote:<o:p></o:p></p>
<div>
<p class="MsoNormal"><br>
> I am working on a 13407 lines * 11050 columns, 565 MB, raster file (SRTM DEM,<br>
> 30m) with a script that calls a series of hydrological modules in GRASS<br>
> 7.0.0.<br>
> The system I am using is a Windows server 2012 R2, 64 bit Intel Xeon 2.5 GHz<br>
> processor, 32GB of RAM.<br>
><br>
> The first module called in the script is r.watershed. When lunched on that<br>
> data set, it generates the following error : G_malloc: impossible to<br>
> allocate 1185910608 bytes to raster/r.watershed/ram/init_vars.c:149<br>
> It apears to be running out of memory even though there is a lot more<br>
> available than what it's asking for.<o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
Very likely your computational region is wrong, i.e. too large.<br>
Check it with<br>
<br>
g.region -p<br>
<br>
I just used the EU DEM 25m to make a test on my tiny ASUS laptop (4GB RAM,<br>
Intel i3), using Fedora 22, 64bit:<br>
<br>
> 13407 * 11050 <<--- your DEM<br>
[1] 148147350<br>
><br>
> 12880 * 16370 <<-- my DEM<br>
[1] 210845600<br>
<br>
(I just had this DEM ready here to play with)<br>
<br>
<span style="font-family:"Courier New""><br>
GRASS 7.1.svn (eu_laea):~ > g.region -p<br>
projection: 99 (Lambert Azimuthal Equal Area)<br>
zone: 0<br>
datum: etrs89<br>
ellipsoid: grs80<br>
north: 2699750<br>
south: 2377750<br>
west: 4126750<br>
east: 4536000<br>
nsres: 25<br>
ewres: 25<br>
rows: 12880<br>
cols: 16370<br>
cells: 210845600</span><br>
<br>
<br>
Results:<br>
<br>
RAM: it used some swap memory since I have browser etc open at the same time.<br>
<span style="font-family:"Courier New""><br>
[neteler@oboe ~]$ free<br>
total used free shared buff/cache available<br>
Mem: 3930508 3600648 32408 93164 297452 165584<br>
Swap: 3932156 2735164 1196992</span><br>
<br>
Timing:<br>
<span style="font-family:"Courier New""><br>
GRASS 7.1.svn (eu_laea):~ > time -p r.watershed elevation=eu_dem_25_TN accumulation=eu_dem_25_TN.acc basin=eu_dem_25_TN.watersheds threshold=10000<br>
SECTION 1a (of 5): Initiating Memory.<br>
SECTION 1b (of 5): Determining Offmap Flow.<br>
100%<br>
SECTION 2: A* Search.<br>
100%<br>
SECTION 3a: Accumulating Surface Flow with MFD.<br>
100%<br>
SECTION 3b: Adjusting drainage directions.<br>
100%<br>
SECTION 4: Watershed determination.<br>
100%<br>
SECTION 5: Closing Maps.<br>
<br>
real 1270.30<br>
user 1048.68<br>
sys 54.00</span><br>
<br>
... 21 minutes.<br>
<br>
<br>
<br>
> I managed to pass that first hurdle using the -m flag on r.watershed. The<br>
> scripts now requires 7 GB of disk space; even if it's slow and I don't<br>
> understand why it can't use the ram in the first place, r.watershed finishes<br>
> correctly.<o:p></o:p></p>
</div>
<p class="MsoNormal">Given my test on a small laptop, it is very likely that your actual computational region<br>
does not match the input map.<o:p></o:p></p>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
> However, when the script gets to the next module, r.fill.dir, GRASS crashes<br>
> at 'Reading input elevation raster map...' with the following message:<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Why do you use the r.fill.dir module?<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Markus<br>
<br>
-- <br>
<a href="http://consulting.neteler.org" target="_top" rel="nofollow" link="external">http://consulting.neteler.org</a><br>
<a href="http://gis.cri.fmach.it/neteler/" target="_top" rel="nofollow" link="external">http://gis.cri.fmach.it/neteler/</a><br>
<a href="http://courses.neteler.org/blog" target="_top" rel="nofollow" link="external">http://courses.neteler.org/blog</a><br>
<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
_______________________________________________ <br>
grass-user mailing list <br>
<a href="/user/SendEmail.jtp?type=node&node=5223631&i=1" target="_top" rel="nofollow" link="external">[hidden email]</a>
<br>
<a href="http://lists.osgeo.org/mailman/listinfo/grass-user" target="_top" rel="nofollow" link="external">http://lists.osgeo.org/mailman/listinfo/grass-user</a>
<o:p></o:p></p>
<div class="MsoNormal" align="center" style="text-align:center">
<hr size="1" width="100%" noshade="" style="color:#CCCCCC" align="center">
</div>
<div>
<div>
<p class="MsoNormal"><b><span style="font-size:9.0pt;font-family:"Tahoma",sans-serif;color:#444444">If you reply to this email, your message will be added to the discussion below:<o:p></o:p></span></b></p>
</div>
<p class="MsoNormal"><span style="font-size:9.0pt;font-family:"Tahoma",sans-serif;color:#444444"><a href="http://osgeo-org.1560.x6.nabble.com/g-malloc-on-r-watershed-with-30GB-free-ram-r-fill-dir-crash-tp5223620p5223631.html" target="_top" rel="nofollow" link="external">http://osgeo-org.1560.x6.nabble.com/g-malloc-on-r-watershed-with-30GB-free-ram-r-fill-dir-crash-tp5223620p5223631.html</a>
<o:p></o:p></span></p>
</div>
<div style="margin-top:4.8pt">
<p class="MsoNormal" style="line-height:18.0pt"><span style="font-size:8.5pt;font-family:"Tahoma",sans-serif;color:#666666">To unsubscribe from g_malloc on r.watershed with 30GB free ram + r.fill.dir crash,
<a href="" target="_top" rel="nofollow" link="external">
click here</a>.<br>
<a href="http://osgeo-org.1560.x6.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml" target="_top" rel="nofollow" link="external"><span style="font-size:7.0pt;font-family:"Times New Roman",serif">NAML</span></a>
<o:p></o:p></span></p>
</div>
</div>
<br/><hr align="left" width="300" />
View this message in context: <a href="http://osgeo-org.1560.x6.nabble.com/g-malloc-on-r-watershed-with-30GB-free-ram-r-fill-dir-crash-tp5223620p5223818.html">RE: g_malloc on r.watershed with 30GB free ram + r.fill.dir crash</a><br/>
Sent from the <a href="http://osgeo-org.1560.x6.nabble.com/Grass-Users-f3884509.html">Grass - Users mailing list archive</a> at Nabble.com.<br/>