[gdal-dev] gdal-dev Digest, Vol 229, Issue 28

[Shayan Ghofrany]

Thanks for the response,

I am reading each raster chunk into its own Dataset within the function and
also creating its own output GPKG file. From what I can tell there are no
shared Datasets between the separate threads. The code in the function can
be found in this Github issue which I believe you also helped resolve.
https://github.com/OSGeo/gdal/issues/8001

On Mon, Jun 26, 2023 at 3:00 PM <gdal-dev-request at lists.osgeo.org> wrote:

> Send gdal-dev mailing list submissions to
>         gdal-dev at lists.osgeo.org
>
> To subscribe or unsubscribe via the World Wide Web, visit
>         https://lists.osgeo.org/mailman/listinfo/gdal-dev
> or, via email, send a message with subject or body 'help' to
>         gdal-dev-request at lists.osgeo.org
>
> You can reach the person managing the list at
>         gdal-dev-owner at lists.osgeo.org
>
> When replying, please edit your Subject line so it is more specific
> than "Re: Contents of gdal-dev digest..."
>
>
> Today's Topics:
>
>    1. Multi-threaded GDALPolygonize C++ (Shayan Ghofrany)
>    2. Re: Multi-threaded GDALPolygonize C++ (Even Rouault)
>
>
> ----------------------------------------------------------------------
>
> Message: 1
> Date: Mon, 26 Jun 2023 12:38:14 -0400
> From: Shayan Ghofrany <shayanghofrany at gmail.com>
> To: gdal-dev at lists.osgeo.org
> Subject: [gdal-dev] Multi-threaded GDALPolygonize C++
> Message-ID:
>         <
> CA+-QNNiFvj_wqXn-FtAx0vbr+svFDvzYvA3LDGcWgNgouuZTDg at mail.gmail.com>
> Content-Type: text/plain; charset="utf-8"
>
> Good afternoon everyone,
>
> I'm new to the mailing list, so if my question is not formatted correctly
> please let me know.
>
> I am attempting to polygonize a raster file by first chunking it into
> smaller pieces and then using multi-threaded to polygonize those chunks
> simultaneously. I often come across Disk I/O errors which makes me think
> that what I want to do is not necessarily how GDALPolygonize should be
> used. I was wondering if anyone has attempted something similar and whether
> there are public examples available that I could look into.
>
> Thanks for your time,
>
> Shayan Ghofrany
> -------------- next part --------------
> An HTML attachment was scrubbed...
> URL: <
> http://lists.osgeo.org/pipermail/gdal-dev/attachments/20230626/04f4cd2e/attachment-0001.htm
> >
>
> ------------------------------
>
> Message: 2
> Date: Mon, 26 Jun 2023 19:04:34 +0200
> From: Even Rouault <even.rouault at spatialys.com>
> To: gdal-dev at lists.osgeo.org
> Subject: Re: [gdal-dev] Multi-threaded GDALPolygonize C++
> Message-ID: <cb38058f-440e-13cf-c893-00c249db700d at spatialys.com>
> Content-Type: text/plain; charset=UTF-8; format=flowed
>
> Shayan,
>
> make sure to read https://gdal.org/user/multithreading.html . I suspect
> you use the same GDAL Dataset or RasterBand object from multiple
> threads, which isn't allowed
>
> Even
>
> Le 26/06/2023 ? 18:38, Shayan Ghofrany a ?crit?:
> > Good afternoon everyone,
> >
> > I'm new to the mailing list, so if my question is not formatted
> > correctly please let me know.
> >
> > I am attempting to polygonize a raster file by first chunking it into
> > smaller pieces?and then using multi-threaded to polygonize those
> > chunks simultaneously. I often come across Disk I/O errors which makes
> > me think that what I want to do is not necessarily how GDALPolygonize
> > should be used. I was wondering if anyone has attempted something
> > similar and whether there are public examples available that I could
> > look into.
> >
> > Thanks for your time,
> >
> > Shayan Ghofrany
> >
> > _______________________________________________
> > gdal-dev mailing list
> > gdal-dev at lists.osgeo.org
> > https://lists.osgeo.org/mailman/listinfo/gdal-dev
>
> --
> http://www.spatialys.com
> My software is free, but my time generally not.
>
>
>
> ------------------------------
>
> Subject: Digest Footer
>
> _______________________________________________
> gdal-dev mailing list
> gdal-dev at lists.osgeo.org
> https://lists.osgeo.org/mailman/listinfo/gdal-dev
>
>
> ------------------------------
>
> End of gdal-dev Digest, Vol 229, Issue 28
> *****************************************
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/gdal-dev/attachments/20230626/812a7720/attachment.htm>