[Qgis-user] large DEM not loading tiles correctly

Thu Oct 6 08:09:09 PDT 2022

I tried something rather similar to what you suggest however it did not work for the whole area, it was not clear why but on further investigation some of the tiles were missing from the dataset itself on the data suppliers website.  I have asked them to both sort out the missing data and to provide a single file so that people do not have to waste long periods trying to put the little tiles together.

They have been “looking into” the request for a few days, no results yet other than asking me to complete a feedback form about how helpful the were, will resist comment for the moment.

From: Andrew Harfoot <ajph at geodata.soton.ac.uk>
Sent: Thursday, October 6, 2022 12:56 PM
To: qgis-user at lists.osgeo.org
Cc: Michael.Dodd <michael.dodd at open.ac.uk>
Subject: Re: [Qgis-user] large DEM not loading tiles correctly

CAUTION: This mail comes from outside the University. Please consider this before opening attachments, clicking links, or acting on the content.
Hi Michael,

Here are some instructions to do exactly what you are asking that I recently wrote for someone else (you are not alone!):

The ESRI ASCII grid format is supported by QGIS, and will load as a raster if you drag an .asc file over the map canvas. The further complication with the gridded dataset is that it is split into 10km tiles rather than being a single national layer, so needs to be merged before moving on to the next steps. This is fairly straightforward using the following steps:

1. Unzip the downloaded data. You'll notice that the 10km tile files are also zipped, and each placed in a 100km square folder: hp\hp40_OST50GRID_20220506.zip

2. Move the zip files out of their 100km square folders to make it easier to process them all at once. This can be done through File Explorer by searching in the folder below the 100km square folders for *.zip
[cid:image001.png at 01D8D99D.F7056B50]

You should get 2858 results. Select all of these files using Ctrl + A and then drag them into the data folder - they will be moved out of their individual 100km square folders

3. Unzip all the zip files. I don't think that the built in Windows zip functionality can do this in one go though. I use the open source 7zip software which allows a bunch of zip files to be selected in File Explorer and then from the right click menu, 'Extract Here' can be chosen. You should now see a .asc file in the folder for each 10km grid square, eg: HP40.asc. This is the grid data.

4. Merge the 10km tiles together. This is done in QGIS using the Merge tool from the Processing toolbox (or Raster > Miscellaneous > Merge...). In the Input layers section, click the ellipsis button to open the file selector, and use the 'Add File(s)...' button to add the .asc files (if you sort by file type you can select them as a block).

[cid:image002.png at 01D8D99D.F7056B50]

Fill out the rest of the Merge tool dialog like this:

[cid:image003.png at 01D8D99D.F7056B50]

Clicking Run will start the process, which may take some time, but on completion you should have a single national terrain dataset!

Cheers,

Andy

On 28/09/2022 12:32, Michael.Dodd via Qgis-user wrote:
CAUTION: This e-mail originated outside the University of Southampton.
I am trying to put together the 50m uk DEM e.g. https://www.data.gov.uk/dataset/835cf20a-8feb-4394-8b30-dcfe840ac13d/os-terrain-50-dtm<https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.data.gov.uk%2Fdataset%2F835cf20a-8feb-4394-8b30-dcfe840ac13d%2Fos-terrain-50-dtm&data=05%7C01%7Cmichael.dodd%40open.ac.uk%7Cd3cdaad156b04d271ce908daa791b766%7C0e2ed45596af4100bed3a8e5fd981685%7C0%7C0%7C638006541534876923%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=LBCYq1vE5A3cHIN%2Bw0WEOcTlN9aSsWwBP7%2FsnqYy6tw%3D&reserved=0> but it often does not work.  The data are supplied as thousands of small tiles that takes ages to unpack and put into a folder to get into qgis, however when you try to load the tiles some work and others don’t and even the ones that do work and display fine sometimes don’t merge to form large tiles and sometimes will form virtual rasters but not merged files.  Basically it is a mess.  I suspect others have done this successfully so any suggestions?
It is particularly odd that some of the tiles will merge and others won’t and that some won’t display if you ask it to load hundreds at a time but if you just add them in a few at a time then they will load and display (in addition to the hundreds already loaded). This suggests various bugs assuming the original data are not in a whole variety of slightly different formats (should all be .asc)

_______________________________________________

Qgis-user mailing list

Qgis-user at lists.osgeo.org<mailto:Qgis-user at lists.osgeo.org>

List info: https://lists.osgeo.org/mailman/listinfo/qgis-user<https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.osgeo.org%2Fmailman%2Flistinfo%2Fqgis-user&data=05%7C01%7Cmichael.dodd%40open.ac.uk%7Cd3cdaad156b04d271ce908daa791b766%7C0e2ed45596af4100bed3a8e5fd981685%7C0%7C0%7C638006541534876923%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=dIWwMx2TvGdBfJC55beUSNB1Qw1l454XqnLr5ooq3ZE%3D&reserved=0>

Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user<https://eur01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.osgeo.org%2Fmailman%2Flistinfo%2Fqgis-user&data=05%7C01%7Cmichael.dodd%40open.ac.uk%7Cd3cdaad156b04d271ce908daa791b766%7C0e2ed45596af4100bed3a8e5fd981685%7C0%7C0%7C638006541534876923%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=dIWwMx2TvGdBfJC55beUSNB1Qw1l454XqnLr5ooq3ZE%3D&reserved=0>

--

Andy Harfoot

Skype: gdi_ajph

Teams: ajph at soton.ac.uk<mailto:ajph at soton.ac.uk>

GeoData Institute

University of Southampton

Southampton

SO17 1BJ

www.geodata.soton.ac.uk<https://eur01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.geodata.soton.ac.uk%2F&data=05%7C01%7Cmichael.dodd%40open.ac.uk%7Cd3cdaad156b04d271ce908daa791b766%7C0e2ed45596af4100bed3a8e5fd981685%7C0%7C0%7C638006541534876923%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=3LsGH6T8i%2BYhAWqXh4n4yxYERkKRQqaFnMc6D2Xr7i8%3D&reserved=0>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/qgis-user/attachments/20221006/9613b729/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image001.png
Type: image/png
Size: 11255 bytes
Desc: image001.png
URL: <http://lists.osgeo.org/pipermail/qgis-user/attachments/20221006/9613b729/attachment-0003.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image002.png
Type: image/png
Size: 29581 bytes
Desc: image002.png
URL: <http://lists.osgeo.org/pipermail/qgis-user/attachments/20221006/9613b729/attachment-0004.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image003.png
Type: image/png
Size: 38972 bytes
Desc: image003.png
URL: <http://lists.osgeo.org/pipermail/qgis-user/attachments/20221006/9613b729/attachment-0005.png>