[postgis-tickets] [PostGIS] #2353: [raster] GDAL's GDALFPolygonize() function

[PostGIS]

#2353: [raster] GDAL's GDALFPolygonize() function
--------------------+-------------------------------------------------------
 Reporter:  jeanm   |       Owner:  dustymugs   
     Type:  defect  |      Status:  new         
 Priority:  medium  |   Milestone:  PostGIS GDAL
Component:  raster  |     Version:  2.0.x       
 Keywords:          |  
--------------------+-------------------------------------------------------

Comment(by dustymugs):

 So the problem is in the function GDALFloatEquals() of
 alg/fpolygonize.cpp. Specifically, aInt and bInt are integers. intDiff is
 also an integer and is assigned the value from abs(aInt - bInt). Problem
 is that the difference between aInt and bInt may exceed a 32-bit integer.

 This is evident when GDALFloatEquals() is called:

 {{{
 GDALFloatEquals(4, -1)
 }}}

-- 
Ticket URL: <http://trac.osgeo.org/postgis/ticket/2353#comment:3>
PostGIS <http://trac.osgeo.org/postgis/>
The PostGIS Trac is used for bug, enhancement & task tracking, a user and developer wiki, and a view into the subversion code repository of PostGIS project.