[postgis-tickets] [PostGIS] #5176: no data check in raster2pgsql and also ST_BandIsNoData are slow
PostGIS
trac at osgeo.org
Fri Jul 1 23:33:38 PDT 2022
#5176: no data check in raster2pgsql and also ST_BandIsNoData are slow
---------------------+-----------------------------
Reporter: robe | Owner: robe
Type: defect | Status: new
Priority: medium | Milestone: PostGIS Fund Me
Component: raster | Version: master
Resolution: | Keywords:
---------------------+-----------------------------
Comment (by robe):
For this particular file, it was like 95% no data and 5% data. After
retiling, the time for the whole process for this took about 41 minutes
{{{
# this took 40 minutes
raster2pgsql -I -t 128x128 -Y 15000 -e file_retiled.tif t_128_128 >>
test.sql
# this took 75.56 s
psql -f test.sql
}}}
I think going direct to PostgreSQL took about 25 minutes, but have to
recheck
{{{
raster2pgsql -I -t 128x128 -Y 15000 -e file_retiled.tif t_128_128 | psql
}}}
So much of the slowness was just the tiff blocksize of Block=637200x1. It
never completed so I killed it after 48 hrs.
Still would be nice to get the no data checking timing down a bit, but it
does end up much faster doing the no data check than trying to load like
30GB of useless no data data in this case.
--
Ticket URL: <https://trac.osgeo.org/postgis/ticket/5176#comment:2>
PostGIS <http://trac.osgeo.org/postgis/>
The PostGIS Trac is used for bug, enhancement & task tracking, a user and developer wiki, and a view into the subversion code repository of PostGIS project.
More information about the postgis-tickets
mailing list