[GRASS-user] r.stats: negative cell counts and percentages

[Hamish]

which versions of grass? the more detailed the answer the
better, I am wondering if it is before or after a recent
off-by-one fix.


tx,
Hamish




--- On Thu, 1/10/09, Hermann Peifer <peifer at gmx.eu> wrote:

> From: Hermann Peifer <peifer at gmx.eu>
> Subject: [GRASS-user] r.stats: negative cell counts and percentages
> To: grass-user at lists.osgeo.org
> Received: Thursday, 1 October, 2009, 10:54 PM
> Hi,
> 
> I have the following raster map:
> 
> Type of Map:  raster         
>      Number of Categories: 255 
> Data Type:    CELL    Rows:   
>      58000     
> Columns:      67000     
>   Total Cells:  3886000000
> 
> r.stats (-c and -p) tells me:
> 
> 1 608232            1 
> -0.15%
> 2 13691259          2 
> -3.35%
> 3 2047970       
>    3  -0.50%
> 4 194288            4 
> -0.05%
> 5 105156            5 
> -0.03%
> 6 303014            6 
> -0.07%
> 7 632953            7 
> -0.15%
> 8 110266            8 
> -0.03%
> 9 119532            9 
> -0.03%
> 10 301250       
>    10  -0.07%
> 11 859077       
>    11  -0.21%
> 12 110022085        12 -26.90%
> 13 3174787          13 
> -0.78%
> 14 587198       
>    14  -0.14%
> 15 3958146          15 
> -0.97%
> 16 2526227          16 
> -0.62%
> 17 3996373          17 
> -0.98%
> 18 38131042         18 
> -9.32%
> 19 989760       
>    19  -0.24%
> 20 27504344         20 
> -6.73%
> 21 22922649         21 
> -5.61%
> 22 3188788          22 
> -0.78%
> 23 52637630         23
> -12.87%
> 24 71417325         24
> -17.46%
> 25 29867401         25 
> -7.30%
> 26 12513397         26 
> -3.06%
> 27 17347949         27 
> -4.24%
> 28 10163292         28 
> -2.49%
> 29 25264490         29 
> -6.18%
> 30 710832       
>    30  -0.17%
> 31 6661714          31 
> -1.63%
> 32 13529887         32 
> -3.31%
> 33 150968       
>    33  -0.04%
> 34 1583419          34 
> -0.39%
> 35 1275927          35 
> -0.31%
> 36 9942214          36 
> -2.43%
> 37 314126       
>    37  -0.08%
> 38 75737            38 
> -0.02%
> 39 1141921          39 
> -0.28%
> 40 1231039          40 
> -0.30%
> 41 11439484         41 
> -2.80%
> 42 590138       
>    42  -0.14%
> 43 331796       
>    43  -0.08%
> 255 -913132378      255 223.28%
> 
> I guess there is an integer overflow somewhere(?)
> 
> Hermann
> 
> _______________________________________________
> grass-user mailing list
> grass-user at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/grass-user
>