<div dir="ltr"><div dir="ltr">Hi Sean<div><br></div><div>Could you perhaps insert the following into postgresql.auto.conf file on your machine (On Debian it is /var/lib/postgresql/$PG_VERSION/main/postgresql.auto.conf), and restart the server?</div><div><br></div><div><br></div><div>postgis.gdal_enabled_drivers = 'ENABLE_ALL'<br>postgis.enable_outdb_rasters = TRUE</div><div><br></div><div>Is the raster extension enabled?</div><div><br></div><div>Pieter du Plooy</div></div><br><div class="gmail_quote gmail_quote_container"><div dir="ltr" class="gmail_attr">On Wed, Feb 5, 2025 at 2:46 PM Chater, ST, Mnr [schater--- via postgis-users <<a href="mailto:postgis-users@lists.osgeo.org">postgis-users@lists.osgeo.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div class="msg-3537289289840527937">
<div lang="EN-ZA" style="overflow-wrap: break-word;">
<div class="m_-3537289289840527937WordSection1">
<p class="MsoNormal"><span lang="EN-US">Hi,<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal">I am trying to ingest an out-DB raster into PostgreSQL 15 database using the raster2pgsql command. I have PostGIS 3.3.8 installed (recently upgraded from 3.2). This server is running Rocky Linux (will refer to this as server A). Please
note this server is running a production application so I would prefer not to have to uninstall everything and restart from scratch.<u></u><u></u></p>
<p class="MsoNormal">This is the command I have used in the past and have been using now:<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><b>/usr/pgsql-15/bin/raster2pgsql -d -s 4326 -t auto -R -F -Y -e /home/<username>/Downloads/2016-01-01_40m_k30.tif public.test_raster_table | psql -U <postgres-user> -d <db-name><u></u><u></u></b></p>
<p class="MsoNormal"><b><u></u> <u></u></b></p>
<p class="MsoNormal">After upgrading to PostGIS 3.2 I have been running into the following error when running my ingestion command:<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><b>[user@host Downloads]$ /usr/pgsql-15/bin/raster2pgsql ....<u></u><u></u></b></p>
<p class="MsoNormal"><b>Processing 1/1: /home/demsa/Downloads/2016-01-01_40m_k30.tif<u></u><u></u></b></p>
<p class="MsoNormal"><b>INFO: Using computed tile size: 256x256<u></u><u></u></b></p>
<p class="MsoNormal"><b>DROP TABLE<u></u><u></u></b></p>
<p class="MsoNormal"><b>CREATE TABLE<u></u><u></u></b></p>
<p class="MsoNormal"><b>COPY 50<u></u><u></u></b></p>
<p class="MsoNormal"><b>COPY 50<u></u><u></u></b></p>
<p class="MsoNormal"><b>COPY 50<u></u><u></u></b></p>
<p class="MsoNormal"><b>COPY 50<u></u><u></u></b></p>
<p class="MsoNormal"><b>COPY 50<u></u><u></u></b></p>
<p class="MsoNormal"><b>COPY 50<u></u><u></u></b></p>
<p class="MsoNormal"><b>COPY 50<u></u><u></u></b></p>
<p class="MsoNormal"><b>COPY 50<u></u><u></u></b></p>
<p class="MsoNormal"><b>COPY 50<u></u><u></u></b></p>
<p class="MsoNormal"><b>munmap_chunk(): invalid pointer<u></u><u></u></b></p>
<p class="MsoNormal"><b>ERROR: rt_band_from_wkb: Premature end of WKB on band offline path reading<u></u><u></u></b></p>
<p class="MsoNormal"><b>CONTEXT: COPY backfill_table_mean, line 42, column rast: "010000010043EEF8D9F5353A3F4075AD9570363ABF9A3CA74761E4334043AAD5064C5641C000000000000000000000000000..."<u></u><u></u></b></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal">I have successfully ingested out-DB rasters to the same database in the past. In fact, the <i>2016-01-01_40m_k30.tif</i> in the above command is one of the files that I have successfully ingested into the same database in the past.<u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><b><u><span lang="EN-US">Attemps to resolve:<u></u><u></u></span></u></b></p>
<ul style="margin-top:0in" type="disc">
<li class="MsoNormal">I have created a blank raster in QGIS (<i>test.tif</i>), which is quite small (6x4 pixels) and attempted to ingest this with the above command. The same error appears, which leads me to believe there is
something wrong with the install of PostGIS/postgis_raster package that I have.<u></u><u></u></li><li class="MsoNormal">I copied both rasters (<i>2016-01-01_40m_k30.tif</i> and <i>test.tif</i>) across to another linux server (server B) which is has PostGIS 3.3.4. Using this command: /usr/pgsql-14/bin/raster2pgsql -d -s 4326
-t auto -R -F -Y -e /home/<username>/Downloads/2016-01-01_40m_k30.tif public.test_raster_table | psql -p 5432 -U <postgres-user> -d <dbname> -h <server A IP> I was successfully able to ingest both rasters into the database on server A.<u></u><u></u></li><ul style="margin-top:0in" type="disc">
<li class="MsoNormal">This leads me to believe that there is something wrong with the PostGIS version that I am using and not with the rasters themselves.<u></u><u></u></li></ul>
<li class="MsoNormal">Tried various combinations of the raster2pgsql flags<u></u><u></u></li></ul>
<table border="0" cellspacing="0" cellpadding="0" style="border-collapse:collapse">
<tbody>
<tr>
<td width="312" valign="top" style="width:233.75pt;border:1pt solid windowtext;padding:0in 5.4pt">
<p class="MsoNormal"><span style="font-size:10pt;font-family:"inherit",serif;color:rgb(12,13,14)">Removed </span><code><span style="font-size:10pt;color:rgb(12,13,14);border:1pt none windowtext;padding:0in">-t auto</span></code><span style="font-size:10pt;font-family:"inherit",serif;color:rgb(12,13,14)"><u></u><u></u></span></p>
</td>
<td width="312" valign="top" style="width:233.75pt;border-top:1pt solid windowtext;border-right:1pt solid windowtext;border-bottom:1pt solid windowtext;border-left:none;padding:0in 5.4pt">
<p class="MsoNormal"><span lang="EN-US">free(): invalid pointer<u></u><u></u></span></p>
</td>
</tr>
<tr>
<td width="312" valign="top" style="width:233.75pt;border-right:1pt solid windowtext;border-bottom:1pt solid windowtext;border-left:1pt solid windowtext;border-top:none;padding:0in 5.4pt">
<p class="MsoNormal"><span style="font-size:10pt;font-family:"inherit",serif;color:rgb(12,13,14)">Removed </span><code><span style="font-size:10pt;color:rgb(12,13,14);border:1pt none windowtext;padding:0in">-e</span></code><span style="font-size:10pt;font-family:"inherit",serif;color:rgb(12,13,14)"><u></u><u></u></span></p>
</td>
<td width="312" valign="top" style="width:233.75pt;border-top:none;border-left:none;border-bottom:1pt solid windowtext;border-right:1pt solid windowtext;padding:0in 5.4pt">
<p class="MsoNormal">COPY 50<br>
COPY 50<br>
COPY 50<br>
free(): invalid pointer<br>
ERROR: rt_raster_from_hexwkb: Raster HEXWKB input must have an even number of characters<br>
CONTEXT: COPY backfill_table_mean, line 42, column rast: "010000010043EEF8D9F5353A3F4075AD9570363ABF9A3CA74761E4334043AAD5064C5641C00000..."<span lang="EN-US"><u></u><u></u></span></p>
</td>
</tr>
<tr>
<td width="312" valign="top" style="width:233.75pt;border-right:1pt solid windowtext;border-bottom:1pt solid windowtext;border-left:1pt solid windowtext;border-top:none;padding:0in 5.4pt">
<p class="MsoNormal"><span style="font-size:10pt;font-family:"inherit",serif;color:rgb(12,13,14)">Removed </span><code><span style="font-size:10pt;color:rgb(12,13,14);border:1pt none windowtext;padding:0in">-Y</span></code><span style="font-size:10pt;font-family:"inherit",serif;color:rgb(12,13,14)"><u></u><u></u></span></p>
</td>
<td width="312" valign="top" style="width:233.75pt;border-top:none;border-left:none;border-bottom:1pt solid windowtext;border-right:1pt solid windowtext;padding:0in 5.4pt">
<p class="MsoNormal"><span lang="EN-US">ERROR: unterminated quoted string at or near "'2016-01-01_40m_k30."<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">LINE 1: ...362D30312D30315F34306D5F6B33302E74696600'::raster,'2016-01-0...<u></u><u></u></span></p>
</td>
</tr>
<tr>
<td width="312" valign="top" style="width:233.75pt;border-right:1pt solid windowtext;border-bottom:1pt solid windowtext;border-left:1pt solid windowtext;border-top:none;padding:0in 5.4pt">
<p class="MsoNormal"><span style="font-size:10pt;font-family:"inherit",serif;color:rgb(12,13,14)">Removed </span><code><span style="font-size:10pt;color:rgb(12,13,14);border:1pt none windowtext;padding:0in">-R</span></code><span style="font-size:10pt;font-family:"inherit",serif;color:rgb(12,13,14)"><u></u><u></u></span></p>
</td>
<td width="312" valign="top" style="width:233.75pt;border-top:none;border-left:none;border-bottom:1pt solid windowtext;border-right:1pt solid windowtext;padding:0in 5.4pt">
<p class="MsoNormal">munmap_chunk(): invalid pointer<br>
ERROR: rt_band_from_wkb: Premature end of WKB on band data reading (rt_wkb.c:201)<br>
CONTEXT: COPY backfill_table_mean, line 49, column rast: "010000010043EEF8D9F5353A3F4075AD9570363ABF8835813D97FE3340FE80203F676341C000000000000000000000000000..."<span lang="EN-US"><u></u><u></u></span></p>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><b><u>The results of running gdalinfo (on separate windows PC) on both of the rasters I tried to ingest:<u></u><u></u></u></b></p>
<p class="MsoNormal"><b><u><u></u><span style="text-decoration:none"> </span><u></u></u></b></p>
<p class="MsoNormal"><b>> gdalinfo 2016-01-01_40m_k30.tif<u></u><u></u></b></p>
<p class="MsoNormal">Driver: GTiff/GeoTIFF<u></u><u></u></p>
<p class="MsoNormal">Warning 1: PROJ: proj_create_from_database: C:\Program Files\PostgreSQL\14\share\contrib\postgis-3.3\proj\proj.db contains DATABASE.LAYOUT.VERSION.MINOR = 0 whereas a number >= 2 is expected. It comes from another PROJ installation.<u></u><u></u></p>
<p class="MsoNormal">Files: 2016-01-01_40m_k30.tif<u></u><u></u></p>
<p class="MsoNormal">Size is 7265, 8338<u></u><u></u></p>
<p class="MsoNormal">Coordinate System is:<u></u><u></u></p>
<p class="MsoNormal">GEOGCRS["WGS 84",<u></u><u></u></p>
<p class="MsoNormal"> DATUM["World Geodetic System 1984",<u></u><u></u></p>
<p class="MsoNormal"> ELLIPSOID["WGS 84",6378137,298.257223563,<u></u><u></u></p>
<p class="MsoNormal"> LENGTHUNIT["metre",1,<u></u><u></u></p>
<p class="MsoNormal"> ID["EPSG",9001]]]],<u></u><u></u></p>
<p class="MsoNormal"> PRIMEM["Greenwich",0,<u></u><u></u></p>
<p class="MsoNormal"> ANGLEUNIT["degree",0.0174532925199433,<u></u><u></u></p>
<p class="MsoNormal"> ID["EPSG",9122]]],<u></u><u></u></p>
<p class="MsoNormal"> CS[ellipsoidal,2],<u></u><u></u></p>
<p class="MsoNormal"> AXIS["latitude",north,<u></u><u></u></p>
<p class="MsoNormal"> ORDER[1],<u></u><u></u></p>
<p class="MsoNormal"> ANGLEUNIT["degree",0.0174532925199433,<u></u><u></u></p>
<p class="MsoNormal"> ID["EPSG",9122]]],<u></u><u></u></p>
<p class="MsoNormal"> AXIS["longitude",east,<u></u><u></u></p>
<p class="MsoNormal"> ORDER[2],<u></u><u></u></p>
<p class="MsoNormal"> ANGLEUNIT["degree",0.0174532925199433,<u></u><u></u></p>
<p class="MsoNormal"> ID["EPSG",9122]]]]<u></u><u></u></p>
<p class="MsoNormal">Data axis to CRS axis mapping: 2,1<u></u><u></u></p>
<p class="MsoNormal">Origin = (17.844391979228011,-31.500006410136233)<u></u><u></u></p>
<p class="MsoNormal">Pixel Size = (0.000399944803551,-0.000399973379606)<u></u><u></u></p>
<p class="MsoNormal">Metadata:<u></u><u></u></p>
<p class="MsoNormal"> AREA_OR_POINT=Area<u></u><u></u></p>
<p class="MsoNormal"> TIFFTAG_SOFTWARE=GDAL 3.7.0e (3070046) (4.5.1;1700;3.0.0;2.0.7;;;;), PROJ 9.2.1 (EPSG.VERSION=v10.088;EPSG.DATE=2023-05-13;ESRI.VERSION=ArcGIS Pro 3.1;ESRI.DATE=2023-19-01;PROJ_DATA.VERSION=1.14;)<u></u><u></u></p>
<p class="MsoNormal">Image Structure Metadata:<u></u><u></u></p>
<p class="MsoNormal"> COMPRESSION=DEFLATE<u></u><u></u></p>
<p class="MsoNormal"> INTERLEAVE=BAND<u></u><u></u></p>
<p class="MsoNormal"> PREDICTOR=3<u></u><u></u></p>
<p class="MsoNormal">Corner Coordinates:<u></u><u></u></p>
<p class="MsoNormal">Upper Left ( 17.8443920, -31.5000064) ( 17d50'39.81"E, 31d30' 0.02"S)<u></u><u></u></p>
<p class="MsoNormal">Lower Left ( 17.8443920, -34.8349844) ( 17d50'39.81"E, 34d50' 5.94"S)<u></u><u></u></p>
<p class="MsoNormal">Upper Right ( 20.7499910, -31.5000064) ( 20d44'59.97"E, 31d30' 0.02"S)<u></u><u></u></p>
<p class="MsoNormal">Lower Right ( 20.7499910, -34.8349844) ( 20d44'59.97"E, 34d50' 5.94"S)<u></u><u></u></p>
<p class="MsoNormal">Center ( 19.2971915, -33.1674954) ( 19d17'49.89"E, 33d10' 2.98"S)<u></u><u></u></p>
<p class="MsoNormal">Band 1 Block=256x256 Type=Float32, ColorInterp=Gray<u></u><u></u></p>
<p class="MsoNormal"> Min=19.340 Max=27.754<u></u><u></u></p>
<p class="MsoNormal"> Minimum=19.340, Maximum=27.754, Mean=24.930, StdDev=1.194<u></u><u></u></p>
<p class="MsoNormal"> NoData Value=-9999<u></u><u></u></p>
<p class="MsoNormal"> Metadata:<u></u><u></u></p>
<p class="MsoNormal"> STATISTICS_APPROXIMATE=YES<u></u><u></u></p>
<p class="MsoNormal"> STATISTICS_MAXIMUM=27.753507614136<u></u><u></u></p>
<p class="MsoNormal"> STATISTICS_MEAN=24.93024257498<u></u><u></u></p>
<p class="MsoNormal"> STATISTICS_MINIMUM=19.340391159058<u></u><u></u></p>
<p class="MsoNormal"> STATISTICS_STDDEV=1.1943478187917<u></u><u></u></p>
<p class="MsoNormal"> STATISTICS_VALID_PERCENT=73.14<u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><b>> gdalinfo test_grid.tif<u></u><u></u></b></p>
<p class="MsoNormal">Driver: GTiff/GeoTIFF<u></u><u></u></p>
<p class="MsoNormal">Warning 1: PROJ: proj_create_from_database: C:\Program Files\PostgreSQL\14\share\contrib\postgis-3.3\proj\proj.db contains DATABASE.LAYOUT.VERSION.MINOR = 0 whereas a number >= 2 is expected. It comes from another PROJ installation.<u></u><u></u></p>
<p class="MsoNormal">Files: test_grid.tif<u></u><u></u></p>
<p class="MsoNormal">Size is 6, 4<u></u><u></u></p>
<p class="MsoNormal">Coordinate System is:<u></u><u></u></p>
<p class="MsoNormal">GEOGCRS["WGS 84",<u></u><u></u></p>
<p class="MsoNormal"> DATUM["World Geodetic System 1984",<u></u><u></u></p>
<p class="MsoNormal"> ELLIPSOID["WGS 84",6378137,298.257223563,<u></u><u></u></p>
<p class="MsoNormal"> LENGTHUNIT["metre",1,<u></u><u></u></p>
<p class="MsoNormal"> ID["EPSG",9001]]]],<u></u><u></u></p>
<p class="MsoNormal"> PRIMEM["Greenwich",0,<u></u><u></u></p>
<p class="MsoNormal"> ANGLEUNIT["degree",0.0174532925199433,<u></u><u></u></p>
<p class="MsoNormal"> ID["EPSG",9122]]],<u></u><u></u></p>
<p class="MsoNormal"> CS[ellipsoidal,2],<u></u><u></u></p>
<p class="MsoNormal"> AXIS["latitude",north,<u></u><u></u></p>
<p class="MsoNormal"> ORDER[1],<u></u><u></u></p>
<p class="MsoNormal"> ANGLEUNIT["degree",0.0174532925199433,<u></u><u></u></p>
<p class="MsoNormal"> ID["EPSG",9122]]],<u></u><u></u></p>
<p class="MsoNormal"> AXIS["longitude",east,<u></u><u></u></p>
<p class="MsoNormal"> ORDER[2],<u></u><u></u></p>
<p class="MsoNormal"> ANGLEUNIT["degree",0.0174532925199433,<u></u><u></u></p>
<p class="MsoNormal"> ID["EPSG",9122]]]]<u></u><u></u></p>
<p class="MsoNormal">Data axis to CRS axis mapping: 2,1<u></u><u></u></p>
<p class="MsoNormal">Origin = (16.639998682000002,-31.334238383999999)<u></u><u></u></p>
<p class="MsoNormal">Pixel Size = (1.000000000000000,-1.000000000000001)<u></u><u></u></p>
<p class="MsoNormal">Metadata:<u></u><u></u></p>
<p class="MsoNormal"> AREA_OR_POINT=Area<u></u><u></u></p>
<p class="MsoNormal">Image Structure Metadata:<u></u><u></u></p>
<p class="MsoNormal"> INTERLEAVE=BAND<u></u><u></u></p>
<p class="MsoNormal">Corner Coordinates:<u></u><u></u></p>
<p class="MsoNormal">Upper Left ( 16.6399987, -31.3342384) ( 16d38'24.00"E, 31d20' 3.26"S)<u></u><u></u></p>
<p class="MsoNormal">Lower Left ( 16.6399987, -35.3342384) ( 16d38'24.00"E, 35d20' 3.26"S)<u></u><u></u></p>
<p class="MsoNormal">Upper Right ( 22.6399987, -31.3342384) ( 22d38'24.00"E, 31d20' 3.26"S)<u></u><u></u></p>
<p class="MsoNormal">Lower Right ( 22.6399987, -35.3342384) ( 22d38'24.00"E, 35d20' 3.26"S)<u></u><u></u></p>
<p class="MsoNormal">Center ( 19.6399987, -33.3342384) ( 19d38'24.00"E, 33d20' 3.26"S)<u></u><u></u></p>
<p class="MsoNormal">Band 1 Block=6x4 Type=Float32, ColorInterp=Gray<u></u><u></u></p>
<p class="MsoNormal"> NoData Value=0<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal"><b><u>The result of running sudo journalctl --no-pager | tail -n 30 immediately after raster2pgsql fails.<u></u><u></u></u></b></p>
<p class="MsoNormal">Feb 05 12:46:42 SUNGIS18 systemd[1]: Started Process Core Dump (PID 265814/UID 0).<u></u><u></u></p>
<p class="MsoNormal">Feb 05 12:46:42 SUNGIS18 systemd-coredump[265815]: Resource limits disable core dumping for process 265810 (raster2pgsql).<u></u><u></u></p>
<p class="MsoNormal">Feb 05 12:46:42 SUNGIS18 systemd-coredump[265815]: Process 265810 (raster2pgsql) of user 1000 dumped core.<u></u><u></u></p>
<p class="MsoNormal">Feb 05 12:46:42 SUNGIS18 systemd[1]: <a href="mailto:systemd-coredump@133-265814-0.service" target="_blank">
systemd-coredump@133-265814-0.service</a>: Deactivated successfully.<u></u><u></u></p>
<p class="MsoNormal">Feb 05 12:46:42 SUNGIS18 systemd[1]: Started Process Core Dump (PID 265819/UID 0).<u></u><u></u></p>
<p class="MsoNormal">Feb 05 12:46:42 SUNGIS18 systemd-coredump[265820]: Resource limits disable core dumping for process 265813 (postmaster).<u></u><u></u></p>
<p class="MsoNormal">Feb 05 12:46:42 SUNGIS18 systemd-coredump[265820]: Process 265813 (postmaster) of user 26 dumped core.<u></u><u></u></p>
<p class="MsoNormal">Feb 05 12:46:42 SUNGIS18 systemd[1]: <a href="mailto:systemd-coredump@134-265819-0.service" target="_blank">
systemd-coredump@134-265819-0.service</a>: Deactivated successfully.<u></u><u></u></p>
<p class="MsoNormal">Feb 05 12:46:44 SUNGIS18 sudo[265831]: demsa : TTY=pts/2 ; PWD=/home/demsa/Downloads ; USER=root ; COMMAND=/bin/journalctl --no-pager<u></u><u></u></p>
<p class="MsoNormal">Feb 05 12:46:44 SUNGIS18 sudo[265831]: pam_unix(sudo:session): session opened for user root(uid=0) by demsa(uid=1000)<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">Any advice as to how I could investigate this further or resolve the issue would be much appreciated.<u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-US"><u></u> <u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Many thanks<u></u><u></u></span></p>
<p class="MsoNormal"><span lang="EN-US">Sean Chater<u></u><u></u></span></p>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<span style="font-size:11px;font-family:Verdana;color:rgb(155,159,158)">The integrity and confidentiality of this email are governed by these terms.
<a href="https://www.sun.ac.za/emaildisclaimer/default.aspx" target="_blank">Disclaimer</a><br>
Die integriteit en vertroulikheid van hierdie e-pos word deur die volgende bepalings bereël.
<a href="https://www.sun.ac.za/emaildisclaimer/default.aspx" target="_blank">Vrywaringsklousule</a></span>
</div>
</div></blockquote></div></div>