[GRASS5] Re: error encountered in r.terraflow

[Maris Nartiss]

hi,

You could test temp space fs with command
dd if=/dev/zero of=/tmp/foo count=83886080
it will create 40Gb zero filled file (count=x*512bytes). If You have
some fs related limits, they will show up.

Maris.

On 4/28/06, abhay menon <abhay.menon at gmail.com> wrote:
> Hello Shaun, Andrew and the list,
>
> To Shaun:
> yes I do have space...on the system there is about 44.5gb of free space
> where as the *ESRI Ascii Raster grid* of size 960mb required 22.62gb as said
> by the program.
>
> >r.terraflow, it requires 80N where N is rows x columns of space to
> >compute the output. This can be upwards of 40G for large rasters
> Is that the Grass Ascii Raster Grid that you are talking about??.
>
> To Andrew:
> yes i do manually delete those files in /var/tmp each time when
> r.terraflowfails.( already warned about the same each time terraflow
> runs ).
>
> Shaun's patch did successed in removing the problem with ami_stream.h for
> the purpose of AMI_STREAM.
>
> but i want to know from Shuan which version of the cvs build did you use, on
> which your patch work and  where able to get the desired results on larger
> files..
>
> --
> Best Regrads
>
> Abhay Menon
>
> On 4/28/06, Shaun Walbridge <walbridge at nceas.ucsb.edu> wrote:
> >
> > Do you have an large amount of disk space available on your /var
> > partition? The error:
> > file=/var/tmp/STREAM_UpisEN:cannot read!: Input/output error
> > indicates you'd run out of space. As mentioned in the help for
> > r.terraflow, it requires 80N where N is rows x columns of space to
> > compute the output. This can be upwards of 40G for large rasters.
> >
> > cheers,
> > Shaun
> >
> > abhay menon wrote:
> >
> > > hello all,
> > >
> > > am still facing this problem.... even after updating the patch file..
> > >
> > > r.terraflow December 2003
> > > region size is 13593 x 15215
> > > cell 960MBdata header compatible with region header
> > > elevation stored as FLOAT (4B) WARNING: raster 960MBdata is of type
> > > CELL_TYPE --you should use r.terraflow.short
> > > STREAM temporary files in /var/tmp  (THESE INTERMEDIATE STREAMS WILL
> > > NOT BE DELETED IN CASE OF ABNORMAL TERMINATION OF THE PROGRAM. TO SAVE
> > > SPACE PLEASE DELETE THESE FILES MANUALLY!)
> > > SFD (D8) flow direction
> > > D8CUT=999999986991104.000000
> > > memory size: 400.00M (419430400) bytes
> > > Memory manager registering memory in MM_WARN_ON_MEMORY_EXCEEDED mode.
> > > reading data from 960MBdata to stream /var/tmp/STREAM_kohqGU:
> > > total elements=206817495, nodata elements=50042031
> > > largest temporary files:
> > >    FILL: 10.79G (11581779720) [206817495 elements, 56B each]
> > >    FLOW: 11.68G (12542037120) [156775464 elements, 80B each]
> > > Will need at least 23.36G (25084074240) space available in /var/tmp
> > > ------------------------------
> > > COMPUTING FLOW DIRECTIONS
> > > classifying nodata (inner & boundary)
> > > finding nodata
> > > relabeling nodata
> > > MM warning: limit=419430400B. allocating 209608296B.  limit exceeded
> > > by 23602B.
> > > MM warning: limit=419430400B. allocating 209608296B.  limit exceeded
> > > by 23633B.
> > > merging relabeled grid
> > > MM warning: limit=419430400B. allocating 209567256B.  limit exceeded
> > > by 23558B.
> > > MM warning: limit=419430400B. allocating 209567256B.  limit exceeded
> > > by 23589B.
> > > ----------
> > > assigning preliminary directions
> > > ----------
> > > finding flat areas (plateaus and depressions)
> > > plateau.cc:starting memscan
> > > plateau.cc:memscan done
> > > removing duplicate plateaus
> > > MM warning: limit=419430400B. allocating 209567260B.  limit exceeded
> > > by 23574B.
> > > :
> > > MM warning: limit=419430400B. allocating 209567260B.  limit exceeded
> > > by 23636B.
> > > relabeling plateaus
> > > MM warning: limit=419430400B. allocating 209567260B.  limit exceeded
> > > by 23570B.
> > > MM warning: limit=419430400B. allocating 209567260B.  limit exceeded
> > > by 23601B.
> > > generating plateau statistics
> > > MM warning: limit=419430400B. allocating 209403100B.  limit exceeded
> > > by 23570B.
> > > MM warning: limit=419430400B. allocating 209403100B.  limit exceeded
> > > by 23601B.
> > > ----------
> > > assigning directions on plateaus
> > > MM warning: limit=419430400B. allocating 209649312B.  limit exceeded
> > > by 19306B.
> > > :
> > > MM warning: limit=419430400B. allocating 209649312B.  limit exceeded
> > > by 19368B.
> > > --------------
> > > generating watersheds and watershed graph
> > > creating windows
> > > warning: using slower scan
> > > generateWatersheds
> > > MM warning: limit=419430400B. allocating 209628776B.  limit exceeded
> > > by 10438B.
> > > :
> > > :
> > > :
> > > :
> > > :
> > > MM warning: limit=419430400B. allocating 209628776B.  limit exceeded
> > > by 11182B.
> > > file=/var/tmp/STREAM_UpisEN:cannot read!: Input/output error
> > > r.terraflow: ./IOStream/include/ami_sort_impl.h:109: void
> > > makeRun_Block(AMI_STREAM<T>*, T*, unsigned int, Compare*) [with T =
> > > waterWindowType, Compare = priorityCmpWaterWindowType]: Assertion `err
> > > == AMI_ERROR_NO_ERROR' failed.
> > >
> > > --
> > > Best Regrads
> > >
> > > Abhay Menon
> > >
>
>