[GRASS5] total cells overflow
    Markus Neteler 
    neteler at geog.uni-hannover.de
       
    Thu Sep  7 07:10:46 EDT 2000
    
    
  
Hi Justin,
On Thu, Sep 07, 2000 at 04:48:33PM +0700, Justin Hickey wrote:
> Hi Markus
> 
> Markus Neteler wrote:
> > while defining a new location (a large one) I got:
> > 
> >   total rows:            58400
> >   total cols:            65600
> >   total cells:   -,463,927,296
> > 
> > total cells should be 3831040000
> 
> It appears that the total cells value is stored as a signed 32 bit
> integer. The largest value that can be stored in such a variable is 2.14
> * 10^9 (2.14 billion). Your value is greater than that so the only
> solution I can think of is either change the variable storing the total
> cells to an unsigned 32 bit number, which should be fine since negative
> cells are invalid. Or create a smaller map.
> 
> Hope this helps.
Probably :-) Well, the file is
src/libes/gis/edit_cellhd.c
line 401
    sprintf(buf,"%ld",    (long) cellhd->rows * cellhd->cols);
    G_insert_commas(buf);
    fprintf (stderr, "  total cells: %15s\n",    buf);
I feel it would not break anything if the variable type would be
changed.
Other comments here?
Markus
---------------------------------------- 
If you want to unsubscribe from GRASS Development Team mailing list write to:
minordomo at geog.uni-hannover.de with
subject 'unsubscribe grass5'
    
    
More information about the grass-dev
mailing list