Thanks Glynn-<div><br></div><div>that's exactly the problem. I've never heard of ulimit (I try not to keep so many files open!). SO glad I know! </div><div><br></div><div>Cheers, </div><div><br></div><div>James</div>
<div><br></div><div><br><br><div class="gmail_quote">On Wed, Aug 18, 2010 at 8:11 PM, Glynn Clements <span dir="ltr"><<a href="mailto:glynn@gclements.plus.com" target="_blank">glynn@gclements.plus.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div><br>
James McCreight wrote:<br>
<br>
> I've been forced in to development by this bug (ie i have a only a vague<br>
> idea of what I'm doing). Help greatly appreciated (need to work on thesis<br>
> not bugs).<br>
><br>
> Summary:<br>
><br>
> I've generated a location and a mapset, in this mapset I have files named<br>
> input_file.0001, ... , input_file.nnnn, ... , input_file.3313<br>
><br>
> I'm running r.hydro.CASC2 (used to be in GRASS), which i've built from gipe<br>
> add-on package.<br>
> When it gets to approximately nnnn=1016, i get (i'll use the real rast and<br>
> mapset names, in case they are relevant):<br>
><br>
> WARNING: Unable to open raster map<br>
> <SBB_runoff_lumped_05.1016@lumped_05_9930><br>
<br>
</div>If it's happening after ~1000 files, I strongly suspect you're hitting<br>
an OS limit on the number of open file descriptors. It's common to<br>
have a limit of 1024 open files per process.<br>
<br>
Run "ulimit -n" in the shell to determine the soft limit. If this is<br>
too low, use "ulimit -Hn" to determine the hard limit. The soft limit<br>
is what the OS actually checks against; you can change the soft limit<br>
with e.g. "ulimit -n 5000", but you cannot increase it above the hard<br>
limit, and a non-root user cannot increase the hard limit.<br>
<br>
On systems which use PAM, these limits are set in the file<br>
/etc/security/limits.conf and any files in the directory<br>
/etc/security/limits.d. This file is read by PAM (specifically, the<br>
pam_limits.so module) at login, which sets the limits before dropping<br>
root privilege and switching to the logged in user.<br>
<br>
If you have the ability to change that file, a line such as:<br>
<br>
* hard nofile 5000<br>
<br>
will increase the hard limit to 5000. The limit will take effect for<br>
subsequent logins (you can run "login" in an xterm to get a shell with<br>
the new limits if you don't want to quit your current desktop<br>
session).<br>
<font color="#888888"><br>
--<br>
Glynn Clements <<a href="mailto:glynn@gclements.plus.com" target="_blank">glynn@gclements.plus.com</a>><br>
</font></blockquote></div><br><br clear="all"><br>-- <br>- <br>******************************************************************************<br>James McCreight mccreigh @at@ <a href="http://colorado.edu" target="_blank">colorado.edu</a><br>
NASA Earth Science Fellow<br>PhD Candidate, Water Resources and Environmental Fluid Mechanics<br>University of Colorado, Boulder<br>cell: (831) 261-5149<br><div>VoIP (to cell): (720) 897-7546</div><br>
</div>