<div dir="ltr">Thanks for the response,<div><br></div><div>I am reading each raster chunk into its own Dataset within the function and also creating its own output GPKG file. From what I can tell there are no shared Datasets between the separate threads. The code in the function can be found in this Github issue which I believe you also helped resolve. <a href="https://github.com/OSGeo/gdal/issues/8001">https://github.com/OSGeo/gdal/issues/8001</a></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Jun 26, 2023 at 3:00 PM <<a href="mailto:gdal-dev-request@lists.osgeo.org">gdal-dev-request@lists.osgeo.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Send gdal-dev mailing list submissions to<br>
<a href="mailto:gdal-dev@lists.osgeo.org" target="_blank">gdal-dev@lists.osgeo.org</a><br>
<br>
To subscribe or unsubscribe via the World Wide Web, visit<br>
<a href="https://lists.osgeo.org/mailman/listinfo/gdal-dev" rel="noreferrer" target="_blank">https://lists.osgeo.org/mailman/listinfo/gdal-dev</a><br>
or, via email, send a message with subject or body 'help' to<br>
<a href="mailto:gdal-dev-request@lists.osgeo.org" target="_blank">gdal-dev-request@lists.osgeo.org</a><br>
<br>
You can reach the person managing the list at<br>
<a href="mailto:gdal-dev-owner@lists.osgeo.org" target="_blank">gdal-dev-owner@lists.osgeo.org</a><br>
<br>
When replying, please edit your Subject line so it is more specific<br>
than "Re: Contents of gdal-dev digest..."<br>
<br>
<br>
Today's Topics:<br>
<br>
1. Multi-threaded GDALPolygonize C++ (Shayan Ghofrany)<br>
2. Re: Multi-threaded GDALPolygonize C++ (Even Rouault)<br>
<br>
<br>
----------------------------------------------------------------------<br>
<br>
Message: 1<br>
Date: Mon, 26 Jun 2023 12:38:14 -0400<br>
From: Shayan Ghofrany <<a href="mailto:shayanghofrany@gmail.com" target="_blank">shayanghofrany@gmail.com</a>><br>
To: <a href="mailto:gdal-dev@lists.osgeo.org" target="_blank">gdal-dev@lists.osgeo.org</a><br>
Subject: [gdal-dev] Multi-threaded GDALPolygonize C++<br>
Message-ID:<br>
<<a href="mailto:CA%2B-QNNiFvj_wqXn-FtAx0vbr%2BsvFDvzYvA3LDGcWgNgouuZTDg@mail.gmail.com" target="_blank">CA+-QNNiFvj_wqXn-FtAx0vbr+svFDvzYvA3LDGcWgNgouuZTDg@mail.gmail.com</a>><br>
Content-Type: text/plain; charset="utf-8"<br>
<br>
Good afternoon everyone,<br>
<br>
I'm new to the mailing list, so if my question is not formatted correctly<br>
please let me know.<br>
<br>
I am attempting to polygonize a raster file by first chunking it into<br>
smaller pieces and then using multi-threaded to polygonize those chunks<br>
simultaneously. I often come across Disk I/O errors which makes me think<br>
that what I want to do is not necessarily how GDALPolygonize should be<br>
used. I was wondering if anyone has attempted something similar and whether<br>
there are public examples available that I could look into.<br>
<br>
Thanks for your time,<br>
<br>
Shayan Ghofrany<br>
-------------- next part --------------<br>
An HTML attachment was scrubbed...<br>
URL: <<a href="http://lists.osgeo.org/pipermail/gdal-dev/attachments/20230626/04f4cd2e/attachment-0001.htm" rel="noreferrer" target="_blank">http://lists.osgeo.org/pipermail/gdal-dev/attachments/20230626/04f4cd2e/attachment-0001.htm</a>><br>
<br>
------------------------------<br>
<br>
Message: 2<br>
Date: Mon, 26 Jun 2023 19:04:34 +0200<br>
From: Even Rouault <<a href="mailto:even.rouault@spatialys.com" target="_blank">even.rouault@spatialys.com</a>><br>
To: <a href="mailto:gdal-dev@lists.osgeo.org" target="_blank">gdal-dev@lists.osgeo.org</a><br>
Subject: Re: [gdal-dev] Multi-threaded GDALPolygonize C++<br>
Message-ID: <<a href="mailto:cb38058f-440e-13cf-c893-00c249db700d@spatialys.com" target="_blank">cb38058f-440e-13cf-c893-00c249db700d@spatialys.com</a>><br>
Content-Type: text/plain; charset=UTF-8; format=flowed<br>
<br>
Shayan,<br>
<br>
make sure to read <a href="https://gdal.org/user/multithreading.html" rel="noreferrer" target="_blank">https://gdal.org/user/multithreading.html</a> . I suspect <br>
you use the same GDAL Dataset or RasterBand object from multiple <br>
threads, which isn't allowed<br>
<br>
Even<br>
<br>
Le 26/06/2023 ? 18:38, Shayan Ghofrany a ?crit?:<br>
> Good afternoon everyone,<br>
><br>
> I'm new to the mailing list, so if my question is not formatted <br>
> correctly please let me know.<br>
><br>
> I am attempting to polygonize a raster file by first chunking it into <br>
> smaller pieces?and then using multi-threaded to polygonize those <br>
> chunks simultaneously. I often come across Disk I/O errors which makes <br>
> me think that what I want to do is not necessarily how GDALPolygonize <br>
> should be used. I was wondering if anyone has attempted something <br>
> similar and whether there are public examples available that I could <br>
> look into.<br>
><br>
> Thanks for your time,<br>
><br>
> Shayan Ghofrany<br>
><br>
> _______________________________________________<br>
> gdal-dev mailing list<br>
> <a href="mailto:gdal-dev@lists.osgeo.org" target="_blank">gdal-dev@lists.osgeo.org</a><br>
> <a href="https://lists.osgeo.org/mailman/listinfo/gdal-dev" rel="noreferrer" target="_blank">https://lists.osgeo.org/mailman/listinfo/gdal-dev</a><br>
<br>
-- <br>
<a href="http://www.spatialys.com" rel="noreferrer" target="_blank">http://www.spatialys.com</a><br>
My software is free, but my time generally not.<br>
<br>
<br>
<br>
------------------------------<br>
<br>
Subject: Digest Footer<br>
<br>
_______________________________________________<br>
gdal-dev mailing list<br>
<a href="mailto:gdal-dev@lists.osgeo.org" target="_blank">gdal-dev@lists.osgeo.org</a><br>
<a href="https://lists.osgeo.org/mailman/listinfo/gdal-dev" rel="noreferrer" target="_blank">https://lists.osgeo.org/mailman/listinfo/gdal-dev</a><br>
<br>
<br>
------------------------------<br>
<br>
End of gdal-dev Digest, Vol 229, Issue 28<br>
*****************************************<br>
</blockquote></div>