<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
p.qt-msonormal1, li.qt-msonormal1, div.qt-msonormal1
{mso-style-name:qt-msonormal1;
margin:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
p.qt-qt-msonormal11, li.qt-qt-msonormal11, div.qt-qt-msonormal11
{mso-style-name:qt-qt-msonormal11;
margin:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.size
{mso-style-name:size;}
span.font
{mso-style-name:font;}
span.qt-size
{mso-style-name:qt-size;}
span.EmailStyle28
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:12.0pt;color:#1F497D">Ya like 10 seconds, most things are under 2 minutes, so I can live with that..
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:12.0pt;color:#1F497D"><o:p> </o:p></span></p>
<div>
<p class="MsoNormal"><span style="color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal" style="text-autospace:none"><b><span style="font-size:10.0pt;color:#1F497D"><img width="112" height="32" style="width:1.1666in;height:.3333in" id="Picture_x0020_2" src="cid:image001.png@01D8E52C.5E905A70" alt="LTI-Full_175px"></span></b><span style="color:#1F497D"><o:p></o:p></span></p>
<p class="MsoNormal" style="text-autospace:none"><b><span style="font-size:10.0pt;color:#1F497D">Dennis Burgess<o:p></o:p></span></b></p>
<p class="MsoNormal" style="text-autospace:none"><b><span style="font-size:10.0pt;color:#1F497D"><br>
</span></b><span style="font-size:10.0pt;color:#1F497D">Author of "Learn RouterOS- Second Edition”
</span><span style="color:#1F497D"><o:p></o:p></span></p>
<p class="MsoNormal" style="text-autospace:none"><b><span style="font-size:10.0pt;color:#1F497D">Link Technologies, Inc</span></b><span style="font-size:10.0pt;color:#1F497D"> -- Mikrotik & WISP Support Services
</span><span style="color:#1F497D"><o:p></o:p></span></p>
<p class="MsoNormal" style="text-autospace:none"><b><span style="font-size:10.0pt;color:#1F497D">Office</span></b><span style="font-size:10.0pt;color:#1F497D">: 314-735-0270 Website:
</span><span style="color:#1F497D"><a href="http://www.linktechs.net/"><span style="font-size:10.0pt">http://www.linktechs.net</span></a></span><span style="font-size:10.0pt;color:#1F497D">
</span><span style="color:#1F497D"><o:p></o:p></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:10.0pt;color:#1F497D">Create Wireless Coverage’s with
</span><span style="color:#1F497D"><a href="www.towercoverage.com"><span style="font-size:10.0pt">www.towercoverage.com</span></a></span><span style="font-size:10.0pt;color:#1F497D">
<o:p></o:p></span></p>
<p class="MsoNormal" style="text-autospace:none"><span style="font-size:10.0pt;color:#1F497D">Need MikroTik Cloud Management:
<a href="https://cloud.linktechs.net"><span style="color:#0563C1">https://cloud.linktechs.net</span></a>
<o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b>From:</b> Laurențiu Nicola <lnicola@dend.ro> <br>
<b>Sent:</b> Friday, October 21, 2022 7:21 AM<br>
<b>To:</b> Dennis Burgess <dmburgess@linktechs.net><br>
<b>Cc:</b> gdal-dev@lists.osgeo.org<br>
<b>Subject:</b> Re: [gdal-dev] Tips on Speeding up OGR2OGR GeoPackage Creation<o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif">It is single-threaded (AFAIK), but as you said, loading the data doesn't take too long, so you won't win more than that by pipelining it. And SQLite doesn't support concurrent writes, not even
in WAL mode, so there's not much use for threads there.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif">I would have expected OGR_SQLITE_SYNCHRONOUS=NO to make a slight difference, but probably less than disabling the spatial index.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif">Laurentiu<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:"Arial",sans-serif"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal">On Fri, Oct 21, 2022, at 15:14, Dennis Burgess wrote:<o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt;overflow-wrap:break-word" id="qt">
<div>
<p class="qt-msonormal1"><span class="size"><span style="font-size:12.0pt;color:#1F497D">Yep, tried all of those items it does help if I don’t create the index and then index it later, but we are not talking a huge amount of time. Guess it’s a single threaded
app?</span></span><o:p></o:p></p>
<p class="qt-msonormal1"><span class="size"><span style="font-size:12.0pt;color:#1F497D"> </span></span><o:p></o:p></p>
<div>
<p class="qt-msonormal1"><span style="color:#1F497D"> </span><o:p></o:p></p>
<p class="qt-msonormal1"><b><span style="font-size:10.0pt;color:#1F497D"><img border="0" width="112" height="32" style="width:1.1666in;height:.3333in" id="qt-Picture_x0020_2" src="cid:image001.png@01D8E52C.5E905A70" alt="LTI-Full_175px"></span></b><o:p></o:p></p>
<p class="qt-msonormal1"><span class="size"><b><span style="font-size:10.0pt;color:#1F497D">Dennis Burgess</span></b></span><o:p></o:p></p>
<p class="qt-msonormal1"><b><span style="font-size:10.0pt;color:#1F497D"><br>
</span></b><span class="size"><span style="font-size:10.0pt;color:#1F497D">Author of "Learn RouterOS- Second Edition”
</span></span><o:p></o:p></p>
<p class="qt-msonormal1"><span class="size"><b><span style="font-size:10.0pt;color:#1F497D">Link Technologies, Inc</span></b></span><span class="size"><span style="font-size:10.0pt;color:#1F497D"> -- Mikrotik & WISP Support Services
</span></span><o:p></o:p></p>
<p class="qt-msonormal1"><span class="size"><b><span style="font-size:10.0pt;color:#1F497D">Office</span></b></span><span class="size"><span style="font-size:10.0pt;color:#1F497D">: 314-735-0270 Website:
</span></span><span style="color:#1F497D"><a href="http://www.linktechs.net/"><span class="size"><span style="font-size:10.0pt">http://www.linktechs.net</span></span></a></span><span class="size"><span style="font-size:10.0pt;color:#1F497D">
</span></span><o:p></o:p></p>
<p class="qt-msonormal1"><span class="size"><span style="font-size:10.0pt;color:#1F497D">Create Wireless Coverage’s with
</span></span><span style="color:#1F497D"><a href="http://www.towercoverage.com"><span class="size"><span style="font-size:10.0pt">www.towercoverage.com</span></span></a></span><o:p></o:p></p>
<p class="qt-msonormal1"><span class="size"><span style="font-size:10.0pt;color:#1F497D">Need MikroTik Cloud Management:
<a href="https://cloud.linktechs.net"><span style="color:#0563C1">https://cloud.linktechs.net</span></a></span></span><o:p></o:p></p>
</div>
<p class="qt-msonormal1"><span class="size"><span style="font-size:12.0pt;color:#1F497D"> </span></span><o:p></o:p></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in;border-right-width:initial;border-bottom-width:initial;border-left-width:initial;border-right-color:initial;border-bottom-color:initial;border-left-color:initial;border-image-source:initial;border-image-slice:initial;border-image-width:initial;border-image-outset:initial;border-image-repeat:initial">
<div>
<p class="MsoNormal"><b>From:</b> gdal-dev <<a href="mailto:gdal-dev-bounces@lists.osgeo.org">gdal-dev-bounces@lists.osgeo.org</a>>
<b>On Behalf Of </b>Lauren?iu Nicola via gdal-dev<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><b>Sent:</b> Thursday, October 20, 2022 8:09 AM<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><b>To:</b> <a href="mailto:gdal-dev@lists.osgeo.org">gdal-dev@lists.osgeo.org</a><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><b>Subject:</b> Re: [gdal-dev] Tips on Speeding up OGR2OGR GeoPackage Creation<o:p></o:p></p>
</div>
</div>
</div>
<p class="qt-msonormal1"> <o:p></o:p></p>
<div>
<p class="qt-msonormal1"><span class="font"><span style="font-family:"Arial",sans-serif">Hi,</span></span><o:p></o:p></p>
</div>
<div>
<p class="qt-msonormal1"><span class="font"><span style="font-family:"Arial",sans-serif"> </span></span><o:p></o:p></p>
</div>
<div>
<p class="qt-msonormal1"><span class="font"><span style="font-family:"Arial",sans-serif"><a href="https://gdal.org/drivers/vector/gpkg.html#configuration-options">https://gdal.org/drivers/vector/gpkg.html#configuration-options</a> has a couple of options that
can help with performance. See also <a href="https://gdal.org/drivers/vector/sqlite.html#target-drivers-vector-sqlite-performance-hints">
https://gdal.org/drivers/vector/sqlite.html#target-drivers-vector-sqlite-performance-hints</a>.</span></span><o:p></o:p></p>
</div>
<div>
<p class="qt-msonormal1"><span class="font"><span style="font-family:"Arial",sans-serif"> </span></span><o:p></o:p></p>
</div>
<div>
<p class="qt-msonormal1"><span class="font"><span style="font-family:"Arial",sans-serif">But I don't recall them helping that much. YMMV.</span></span><o:p></o:p></p>
</div>
<div>
<p class="qt-msonormal1"><span class="font"><span style="font-family:"Arial",sans-serif"> </span></span><o:p></o:p></p>
</div>
<div>
<p class="qt-msonormal1"><span class="font"><span style="font-family:"Arial",sans-serif">Regards,</span></span><o:p></o:p></p>
</div>
<div>
<p class="qt-msonormal1"><span class="font"><span style="font-family:"Arial",sans-serif">Laurentiu</span></span><o:p></o:p></p>
</div>
<div>
<p class="qt-msonormal1"><span class="font"><span style="font-family:"Arial",sans-serif"> </span></span><o:p></o:p></p>
</div>
<div>
<p class="qt-msonormal1">On Thu, Oct 20, 2022, at 15:06, Dennis Burgess wrote:<o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt;overflow-wrap:break-word" id="qt-qt">
<div>
<p class="qt-qt-msonormal11">We have a large table in MSSQL, this table we extract data from and drop it into a GeoPackage for further processing. However, the extraction can take some time, its only using 5% of the CPU available, and pulling the data is fairly
quick in debug mode, its really its generation and index creation that is slow. Any tips on speeding this up? We have SSDs and NVME drives, 10gig networking etc.. So. It should be as quick as it can be, but the 5% CPU is what I think the killer is. On
this server 24 cores, so 5% would be right at one core.. Is there no multi-threading or other options here? <o:p></o:p></p>
<p class="qt-qt-msonormal11"> <o:p></o:p></p>
<p class="qt-qt-msonormal11"> <o:p></o:p></p>
<p class="qt-qt-msonormal11"><b><span style="font-size:10.0pt;color:#1F497D"><img border="0" width="112" height="32" style="width:1.1666in;height:.3333in" id="qt-qt-x_x_x_Picture_x0020_1" src="cid:image001.png@01D8E52C.5E905A70" alt="LTI-Full_175px"></span></b><o:p></o:p></p>
<p class="qt-qt-msonormal11"><span class="size"><b><span style="font-size:10.0pt;color:#1F497D">Dennis Burgess, Mikrotik Certified Trainer</span></b></span><b><span style="font-size:10.0pt;color:#1F497D"><br>
<span class="qt-size">MTCNA, MTCRE, MTCWE, MTCTCE, MTCINE, MTCSE, HE IPv6 Sage, Cambium ePMP Certified</span></span></b><o:p></o:p></p>
<p class="qt-qt-msonormal11"><span class="size"><span style="font-size:10.0pt;color:#1F497D">Author of "Learn RouterOS- Second Edition”</span></span><o:p></o:p></p>
<p class="qt-qt-msonormal11"><span class="size"><b><span style="font-size:10.0pt;color:#1F497D">Link Technologies, Inc</span></b></span><span class="size"><span style="font-size:10.0pt;color:#1F497D"> -- Mikrotik & WISP Support Services</span></span><o:p></o:p></p>
<p class="qt-qt-msonormal11"><span class="size"><b><span style="font-size:10.0pt;color:#1F497D">Office</span></b></span><span class="size"><span style="font-size:10.0pt;color:#1F497D">: 314-735-0270 Website:
</span></span><a href="http://www.linktechs.net/"><span class="size"><span style="font-size:10.0pt">http://www.linktechs.net</span></span></a><o:p></o:p></p>
<p class="qt-qt-msonormal11"><span class="size"><span style="font-size:10.0pt;color:#1F497D">Need to Automate MikroTik Backups:
<a href="https://cloud.linktechs.net"><span style="color:#0563C1">https://cloud.linktechs.net</span></a></span></span><o:p></o:p></p>
<p class="qt-qt-msonormal11"><span class="size"><span style="font-size:10.0pt;color:#1F497D">Create Wireless Coverage’s with
</span></span><a href="http://www.towercoverage.com"><span class="size"><span style="font-size:10.0pt">www.towercoverage.com</span></span></a><o:p></o:p></p>
<p class="qt-qt-msonormal11"> <o:p></o:p></p>
</div>
<div>
<p class="qt-msonormal1">_______________________________________________<o:p></o:p></p>
</div>
<div>
<p class="qt-msonormal1">gdal-dev mailing list<o:p></o:p></p>
</div>
<div>
<p class="qt-msonormal1"><a href="mailto:gdal-dev@lists.osgeo.org">gdal-dev@lists.osgeo.org</a><o:p></o:p></p>
</div>
<div>
<p class="qt-msonormal1"><a href="https://lists.osgeo.org/mailman/listinfo/gdal-dev">https://lists.osgeo.org/mailman/listinfo/gdal-dev</a><o:p></o:p></p>
</div>
<div>
<p class="qt-msonormal1"> <o:p></o:p></p>
</div>
</blockquote>
<div>
<p class="qt-msonormal1"><span class="font"><span style="font-family:"Arial",sans-serif"> </span></span><o:p></o:p></p>
</div>
</div>
</blockquote>
</div>
</body>
</html>