[postgis-devel] [PostGIS] #2133: possible performance issue with ST_MapAlgebra

Wed Dec 5 09:39:11 PST 2012

#2133: possible performance issue with ST_MapAlgebra
--------------------+-------------------------------------------------------
 Reporter:  robe    |       Owner:  dustymugs    
     Type:  defect  |      Status:  new          
 Priority:  medium  |   Milestone:  PostGIS 2.1.0
Component:  raster  |     Version:  trunk        
 Keywords:          |  
--------------------+-------------------------------------------------------

Comment(by robe):

 I suspect the speed improvement might be the performance improvment
 changes you made to ST_Clip and ST_Union.  I think last I tested ST_Clip
 had not been converted to pure C.

 Not sure which one it is since I have it all in one table chunked.
 Basically I loaded all of Boston tiles from MassGIS.

 with a download transform sid to jpeg like this:

 {{{

 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/22528915.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/22528930.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/22678900.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/22678915.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/22678930.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/22678945.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/22678975.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/22678990.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/22679005.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/22828900.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/22828915.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/22828930.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/22828945.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/22828975.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/22828990.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/22829005.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/22978870.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/22978885.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/22978900.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/22978915.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/22978930.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/22978945.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/22978960.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/22978990.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/22979005.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/22979020.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23128870.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23128885.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23128900.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23128915.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23128930.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23128945.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23128960.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23128975.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23129005.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23129020.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23278885.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23278900.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23278915.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23278930.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23278945.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23278960.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23278975.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23278990.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23279005.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23428900.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23428915.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23428930.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23428945.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23428960.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23428975.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23428990.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23429005.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23429035.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23429050.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23578915.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23578930.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23578945.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23578960.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23578975.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23578990.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23579005.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23579020.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23579035.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23579050.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23728915.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23728930.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23728945.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23728960.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23728975.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23728990.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23729005.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23729020.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23729035.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23878930.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23878960.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23878975.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23878990.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23879005.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23879020.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/23879035.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24028945.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24028960.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24028975.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24028990.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24029005.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24029020.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24029035.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24029050.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24178960.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24178975.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24179005.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24179020.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24179035.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24179050.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24328960.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24328975.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24329005.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24478960.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24478975.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24478990.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24479005.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24628960.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24628975.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24628990.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24778960.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24778975.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24778990.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24928975.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24928990.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/24929005.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/25078975.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/25078990.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/25079005.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/25228990.zip
 wget http://gis.amherstma.gov/massgis/sid_tiles_30cm/25229020.zip

 -- unzip command here which uses 7zip on windows ---
 for /f %%a IN ('dir /b bostonaerials2008\*.sid') do "gdal_translate" -of
 JPEG bostonaerials2008\%%a bostonaerials2008\%%a.jpg

 raster2pgsql -I -e -F -C -Y -s 26986 -t 500x500 -l 2 *.jpg aerials.boston
 | psql
 }}}

 I'll see if I can get a smaller set that exhibits the same behavior. i'm
 sure you don't want to load all that stuff and the table is kinda big.

 parcel layer is on MASSGIS somewhere too though I use one from Boston
 assessing.

-- 
Ticket URL: <http://trac.osgeo.org/postgis/ticket/2133#comment:2>
PostGIS <http://trac.osgeo.org/postgis/>
The PostGIS Trac is used for bug, enhancement & task tracking, a user and developer wiki, and a view into the subversion code repository of PostGIS project.