[GRASS5] total cells overflow

Justin Hickey jhickey at hpcc.nectec.or.th
Thu Sep 7 05:48:33 EDT 2000


Hi Markus

Markus Neteler wrote:
> while defining a new location (a large one) I got:
> 
>   total rows:            58400
>   total cols:            65600
>   total cells:   -,463,927,296
> 
> total cells should be 3831040000

It appears that the total cells value is stored as a signed 32 bit
integer. The largest value that can be stored in such a variable is 2.14
* 10^9 (2.14 billion). Your value is greater than that so the only
solution I can think of is either change the variable storing the total
cells to an unsigned 32 bit number, which should be fine since negative
cells are invalid. Or create a smaller map.

Hope this helps.

-- 
Sincerely,

Jazzman (a.k.a. Justin Hickey)  e-mail: jhickey at hpcc.nectec.or.th
High Performance Computing Center
National Electronics and Computer Technology Center (NECTEC)
Bangkok, Thailand
==================================================================
People who think they know everything are very irritating to those
of us who do.  ---Anonymous

Jazz and Trek Rule!!!
==================================================================

---------------------------------------- 
If you want to unsubscribe from GRASS Development Team mailing list write to:
minordomo at geog.uni-hannover.de with
subject 'unsubscribe grass5'



More information about the grass-dev mailing list