<!DOCTYPE html>
<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body>
<p>Jesse,</p>
<p>Maybe you use SQL with the SQLite dialect? Otherwise we lack
context to tell why you get SQLite kicking it.</p>
<p>I don't think sqlite3_limit() would really help you here, givenit
can be used to grow settings beyond the compile time default which
is 1 GiB I believe ("Attempts to increase a limit above its hard
upper bound are
silently truncated to the hard upper bound."). You would need to
recompile SQLite itself.<br>
</p>
<p>Even<br>
</p>
<div class="moz-cite-prefix">Le 03/07/2025 à 22:14, Meyer, Jesse R.
(GSFC-618.0)[SCIENCE SYSTEMS AND APPLICATIONS INC] via gdal-dev a
écrit :<br>
</div>
<blockquote type="cite"
cite="mid:MN2PR09MB5932F60FD7F4B94268B8A91CC943A@MN2PR09MB5932.namprd09.prod.outlook.com">
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
<meta name="Generator"
content="Microsoft Word 15 (filtered medium)">
<style>@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}@font-face
{font-family:Aptos;
panose-1:2 11 0 4 2 2 2 2 2 4;}p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:12.0pt;
font-family:"Aptos",sans-serif;
mso-ligatures:standardcontextual;}a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#467886;
text-decoration:underline;}span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Aptos",sans-serif;
color:windowtext;}.MsoChpDefault
{mso-style-type:export-only;}div.WordSection1
{page:WordSection1;}</style>
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt">We’re trying
to gdal.Polygonize a feature that exceeds SQLite’s default
blob size of 1,000,000,000 bytes. Curiously, we’re using
the memory dataset, but this appears to leverage SQLite
under the hood (evidenced by the error message: ERROR 1: In
GetNextRawFeature(): sqlite3_step() : string or blob too
big). SQLite docs state the that limit can be changed at
runtime using the
<a href="https://www.sqlite.org/c3ref/limit.html"
moz-do-not-send="true">sqlite3_limit</a>(db,<a
href="https://www.sqlite.org/c3ref/c_limit_attached.html#sqlitelimitlength"
moz-do-not-send="true">SQLITE_LIMIT_LENGTH</a>,...)
interface. Maybe there could be some way to leverage
PRELUDE_STATEMENTS to achieve this but we are not “opening”
a dataset - we’re creating one directly from the memory
driver.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt">What is the
best way to work around this?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt"><o:p> </o:p></span></p>
<div>
<div>
<p class="MsoNormal"><span style="mso-ligatures:none">Best,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-ligatures:none">Jesse<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-ligatures:none"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="mso-ligatures:none">Lead
Computer Scientist<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="mso-ligatures:none">Science
Systems and Applications, Inc.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-ligatures:none">Dr
Compton Tucker Team<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><span style="mso-ligatures:none">NASA
Goddard Space Flight Center</span><o:p></o:p></p>
</div>
<br>
<fieldset class="moz-mime-attachment-header"></fieldset>
<pre class="moz-quote-pre" wrap="">_______________________________________________
gdal-dev mailing list
<a class="moz-txt-link-abbreviated" href="mailto:gdal-dev@lists.osgeo.org">gdal-dev@lists.osgeo.org</a>
<a class="moz-txt-link-freetext" href="https://lists.osgeo.org/mailman/listinfo/gdal-dev">https://lists.osgeo.org/mailman/listinfo/gdal-dev</a>
</pre>
</blockquote>
<pre class="moz-signature" cols="72">--
<a class="moz-txt-link-freetext" href="http://www.spatialys.com">http://www.spatialys.com</a>
My software is free, but my time generally not.</pre>
</body>
</html>