<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Verdana;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Aptos;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
font-size:12.0pt;
font-family:"Aptos",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
p.v1msonormal, li.v1msonormal, div.v1msonormal
{mso-style-name:v1msonormal;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:12.0pt;
font-family:"Aptos",sans-serif;}
span.EmailStyle19
{mso-style-type:personal-reply;
font-family:"Aptos",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;
mso-ligatures:none;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-NZ link=blue vlink=purple style='word-wrap:break-word'><div class=WordSection1><p class=MsoNormal><span style='font-size:11.0pt;mso-fareast-language:EN-US'>Hi Nigel<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;mso-fareast-language:EN-US'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;mso-fareast-language:EN-US'>Thank you, that works a treat, although it does fail if I try to merge a line feature at the same time as a polygon. That is not a big deal and can get around that.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;mso-fareast-language:EN-US'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;mso-fareast-language:EN-US'>Your comment, </span><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'>“Then parse these through to the merge vector layer”. I can’t see a way of parsing the filelist.txt to the tool. I am not experienced in using python.<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'>Cheers<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'>TIby<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;mso-fareast-language:EN-US'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;mso-fareast-language:EN-US'><o:p> </o:p></span></p><div><div style='border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm'><p class=MsoNormal><b><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif'>From:</span></b><span lang=EN-US style='font-size:11.0pt;font-family:"Calibri",sans-serif'> Nigel Berjak - S3 Technologies <<a href="mailto:nigel@s3.co.za">nigel@s3.co.za</a>> <br><b>Sent:</b> Friday, May 10, 2024 6:03 PM<br><b>To:</b> Nyall Dawson <<a href="mailto:nyall.dawson@gmail.com">nyall.dawson@gmail.com</a>><br><b>Cc:</b> Tony Shepherd (FarmMaps NZ) <<a href="mailto:tony@farmmaps.nz">tony@farmmaps.nz</a>>; <a href="mailto:qgis-user@lists.osgeo.org">qgis-user@lists.osgeo.org</a><br><b>Subject:</b> Re: [Qgis-user] Search through folders and combine SHP files<o:p></o:p></span></p></div></div><p class=MsoNormal><o:p> </o:p></p><p><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'>Hi<o:p></o:p></span></p><p><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'>For your listing, although it would not provide the file type i.e. point, line, polygon etc, you could simply create a DOS batch command (dir/s *.shp > shapefilelist.txt) to locate all the file and generate a list of their locations. Then parse these through to the merge vector layer. If you are merging them all into a Geopackage, then file type would not be relevant and you could then sort them once they are in a single location. I don't think the Geopackage would have a limitation on the number of files and records in it.<o:p></o:p></span></p><p><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'>Perhaps this can assist.<o:p></o:p></span></p><div id=signature><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'>---<o:p></o:p></span></p><div><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Courier New"'>Regards,<br><br>Nigel Berjak<br>S3 Technologies<br>Geographic Information Systems & Large Format Printing specialists<br>T: +27 33 3423681<br>F: +27 86 6721242<br>E: </span><a href="mailto:nigel@S3.co.za"><span style='font-size:10.0pt;font-family:"Courier New"'>nigel@S3.co.za</span></a><span style='font-size:10.0pt;font-family:"Courier New"'><br>Website: </span><a href="http://www.S3.co.za" target="_blank"><span style='font-size:10.0pt;font-family:"Courier New"'>http://www.S3.co.za</span></a><span style='font-size:10.0pt;font-family:"Courier New"'><br><br>Please consider the environment before printing this email.<o:p></o:p></span></p></div></div><p><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'><o:p> </o:p></span></p><p id=reply-intro><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'>On 2024-05-10 04:06, Nyall Dawson via QGIS-User wrote:<o:p></o:p></span></p><blockquote style='border:none;border-left:solid #1010FF 1.5pt;padding:0cm 0cm 0cm 5.0pt;margin-left:0cm;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt'><div id=replybody1><div><div><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'> <o:p></o:p></span></p></div><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'><o:p> </o:p></span></p><div><div><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'>On Fri, 10 May 2024 at 09:06, Tony Shepherd (FarmMaps NZ) via QGIS-User <</span><a href="mailto:qgis-user@lists.osgeo.org"><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'>qgis-user@lists.osgeo.org</span></a><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'>> wrote:<o:p></o:p></span></p></div><blockquote style='border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt'><div><div><div><p class=v1msonormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'>Hi<o:p></o:p></span></p><p class=v1msonormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'> <o:p></o:p></span></p><p class=v1msonormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'>I have loads, literally thousands, of SHP, GPKG, TAB files located in loads of different folders and sub-folders.<o:p></o:p></span></p><p class=v1msonormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'> <o:p></o:p></span></p><p class=v1msonormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'>Is there a plugin that will trawl through a set of folders, copy say just the polygons from each file into a new file, and populate a field with say the filename and folder the polygon(s) came from?<o:p></o:p></span></p><p class=v1msonormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'> <o:p></o:p></span></p><p class=v1msonormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'>Essentially combining a heap of files into one with some metadata about where the data came from?<o:p></o:p></span></p><p class=v1msonormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'> <o:p></o:p></span></p><p class=v1msonormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'>Why? I have files from clients dating back about 20 years. Clients sell properties. Properties get subdivided. New clients come and see us, and often we don't realise we have GIS info on file for that property from many years ago, usually under a different name. It would be handy to see a polygon on the screen and easily go back to some old GIS data.<o:p></o:p></span></p><p class=v1msonormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'> <o:p></o:p></span></p><p class=v1msonormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'>Maybe I am missing an easy tool to do this, but I can't see anything obvious.<o:p></o:p></span></p></div></div></div></blockquote><div><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'> <o:p></o:p></span></p></div><div><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'>You could use the "Merge Vector Layers" tool from the Processing toolbox, that does everything you want. The trickiest bit would be getting a master list of ALL your shapefiles/etc you want to combine and passing this to the tool. It's not going to be easy from the GUI itself, as that only allows you to add files from a single folder at once.<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'> <o:p></o:p></span></p></div><div><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'>I'd run the tool on the files from a single folder, then checkout the processing history dialog and copy the python command which corresponds to what you just did. You could then adapt this command to pass a complete list of all the files you want to combine. (It's quite straightforward in Python to build a list of files which recursively match a file pattern -- see eg </span><a href="https://stackoverflow.com/a/2186565" target="_blank"><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'>https://stackoverflow.com/a/2186565</span></a><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'> )<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'> <o:p></o:p></span></p></div><div><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'>Hope that helps!<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'>Nyall<o:p></o:p></span></p></div><div><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'> <o:p></o:p></span></p></div><blockquote style='border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0cm;margin-bottom:5.0pt'><div><div><div><p class=v1msonormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'> <o:p></o:p></span></p><p class=v1msonormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'> <o:p></o:p></span></p><p class=v1msonormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'> <o:p></o:p></span></p><p class=v1msonormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'>Cheers<o:p></o:p></span></p><p class=v1msonormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'>Tony<o:p></o:p></span></p><p class=v1msonormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'> <o:p></o:p></span></p><p class=v1msonormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'>------------------------------------------------------------------------------------------------------------------<o:p></o:p></span></p><p class=v1msonormal><strong><span style='font-size:10.0pt;font-family:"Verdana",sans-serif;color:#404040'>Tony Shepherd</span></strong><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'><o:p></o:p></span></p><p class=v1msonormal><em><span style='font-size:10.0pt;font-family:"Verdana",sans-serif;color:#595959'> GeoSpatial Manager @ FarmMaps NZ & Photographer @ Shepherd Photos</span></em><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'><o:p></o:p></span></p><p class=v1msonormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif;color:#595959'> </span><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'><o:p></o:p></span></p><p class=v1msonormal><em><b><span style='font-size:10.0pt;font-family:"Verdana",sans-serif;color:#595959'>Phone</span></b></em><span style='font-size:10.0pt;font-family:"Verdana",sans-serif;color:#595959'> <strong><span style='font-family:"Verdana",sans-serif'>–</span></strong> 027 435 6193 | <em><b><span style='font-family:"Verdana",sans-serif'>Website</span></b></em><strong><span style='font-family:"Verdana",sans-serif'> – </span></strong></span><a href="http://shepherdphotos.co.nz/" target="_blank"><span style='font-size:10.0pt;font-family:"Verdana",sans-serif;color:#0563C1'>shepherdphotos.co.nz</span></a><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'><o:p></o:p></span></p><p class=v1msonormal><em><b><span style='font-size:10.0pt;font-family:"Verdana",sans-serif;color:#595959'>Email</span></b></em><strong><span style='font-size:10.0pt;font-family:"Verdana",sans-serif;color:#595959'> – Maps</span></strong><span style='font-size:10.0pt;font-family:"Verdana",sans-serif;color:#595959'> </span><a href="mailto:tony@farmmaps.nz"><span style='font-size:10.0pt;font-family:"Verdana",sans-serif;color:#0563C1'>tony@farmmaps.nz</span></a><span style='font-size:10.0pt;font-family:"Verdana",sans-serif;color:#595959'> | <em><b><span style='font-family:"Verdana",sans-serif'>Email</span></b></em><strong><span style='font-family:"Verdana",sans-serif'> – Photos</span></strong> </span><a href="mailto:tony@shepherdphotos.co.nz"><span style='font-size:10.0pt;font-family:"Verdana",sans-serif;color:#0563C1'>tony@shepherdphotos.co.nz</span></a><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'><o:p></o:p></span></p><p class=v1msonormal><em><b><span style='font-size:10.0pt;font-family:"Verdana",sans-serif;color:#595959'>Facebook</span></b></em><span style='font-size:10.0pt;font-family:"Verdana",sans-serif;color:#595959'> </span><a href="https://www.facebook.com/TonyShepherdPhotos" target="_blank"><span style='font-size:10.0pt;font-family:"Verdana",sans-serif;color:#0563C1'>TonyShepherdPhotos</span></a><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'><o:p></o:p></span></p><p class=v1msonormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif;color:#595959'> </span><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'><o:p></o:p></span></p><p class=v1msonormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif;color:#595959'> </span><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'><o:p></o:p></span></p><p class=v1msonormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif;color:#595959'><img border=0 width=160 height=75 style='width:1.6666in;height:.7812in' id="v1m_8596937801374573577Picture_x0020_1" src="cid:image001.jpg@01DAA514.F09115A0" alt="FM_logo1_small (Custom)"></span><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'><o:p></o:p></span></p><p class=v1msonormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'> <o:p></o:p></span></p></div></div><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'>_______________________________________________<br>QGIS-User mailing list<br></span><a href="mailto:QGIS-User@lists.osgeo.org"><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'>QGIS-User@lists.osgeo.org</span></a><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'><br>List info: </span><a href="https://lists.osgeo.org/mailman/listinfo/qgis-user" target="_blank"><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'>https://lists.osgeo.org/mailman/listinfo/qgis-user</span></a><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'><br>Unsubscribe: </span><a href="https://lists.osgeo.org/mailman/listinfo/qgis-user" target="_blank"><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'>https://lists.osgeo.org/mailman/listinfo/qgis-user</span></a><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'><o:p></o:p></span></p></div></blockquote></div></div></div><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Verdana",sans-serif'><o:p> </o:p></span></p><div><p class=MsoNormal><span style='font-size:10.0pt;font-family:"Courier New"'>_______________________________________________<br>QGIS-User mailing list<br></span><a href="mailto:QGIS-User@lists.osgeo.org"><span style='font-size:10.0pt;font-family:"Courier New"'>QGIS-User@lists.osgeo.org</span></a><span style='font-size:10.0pt;font-family:"Courier New"'><br>List info: </span><a href="https://lists.osgeo.org/mailman/listinfo/qgis-user" target="_blank"><span style='font-size:10.0pt;font-family:"Courier New"'>https://lists.osgeo.org/mailman/listinfo/qgis-user</span></a><span style='font-size:10.0pt;font-family:"Courier New"'><br>Unsubscribe: </span><a href="https://lists.osgeo.org/mailman/listinfo/qgis-user" target="_blank"><span style='font-size:10.0pt;font-family:"Courier New"'>https://lists.osgeo.org/mailman/listinfo/qgis-user</span></a><span style='font-size:10.0pt;font-family:"Courier New"'><o:p></o:p></span></p></div></blockquote></div></body></html>