Thanks for the response, I am reading each raster chunk into its own Dataset within the function and also creating its own output GPKG file. From what I can tell there are no shared Datasets between the separate threads. The code in the function can be found in this Github issue which I believe you also helped resolve. https://github.com/OSGeo/gdal/issues/8001
On Mon, Jun 26, 2023 at 3:00 PM <[email protected]> wrote: > Send gdal-dev mailing list submissions to > [email protected] > > To subscribe or unsubscribe via the World Wide Web, visit > https://lists.osgeo.org/mailman/listinfo/gdal-dev > or, via email, send a message with subject or body 'help' to > [email protected] > > You can reach the person managing the list at > [email protected] > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of gdal-dev digest..." > > > Today's Topics: > > 1. Multi-threaded GDALPolygonize C++ (Shayan Ghofrany) > 2. Re: Multi-threaded GDALPolygonize C++ (Even Rouault) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Mon, 26 Jun 2023 12:38:14 -0400 > From: Shayan Ghofrany <[email protected]> > To: [email protected] > Subject: [gdal-dev] Multi-threaded GDALPolygonize C++ > Message-ID: > < > ca+-qnnifvj_wqxn-ftax0vbr+svfdvzyva3ldgcwgngouuz...@mail.gmail.com> > Content-Type: text/plain; charset="utf-8" > > Good afternoon everyone, > > I'm new to the mailing list, so if my question is not formatted correctly > please let me know. > > I am attempting to polygonize a raster file by first chunking it into > smaller pieces and then using multi-threaded to polygonize those chunks > simultaneously. I often come across Disk I/O errors which makes me think > that what I want to do is not necessarily how GDALPolygonize should be > used. I was wondering if anyone has attempted something similar and whether > there are public examples available that I could look into. > > Thanks for your time, > > Shayan Ghofrany > -------------- next part -------------- > An HTML attachment was scrubbed... > URL: < > http://lists.osgeo.org/pipermail/gdal-dev/attachments/20230626/04f4cd2e/attachment-0001.htm > > > > ------------------------------ > > Message: 2 > Date: Mon, 26 Jun 2023 19:04:34 +0200 > From: Even Rouault <[email protected]> > To: [email protected] > Subject: Re: [gdal-dev] Multi-threaded GDALPolygonize C++ > Message-ID: <[email protected]> > Content-Type: text/plain; charset=UTF-8; format=flowed > > Shayan, > > make sure to read https://gdal.org/user/multithreading.html . I suspect > you use the same GDAL Dataset or RasterBand object from multiple > threads, which isn't allowed > > Even > > Le 26/06/2023 ? 18:38, Shayan Ghofrany a ?crit?: > > Good afternoon everyone, > > > > I'm new to the mailing list, so if my question is not formatted > > correctly please let me know. > > > > I am attempting to polygonize a raster file by first chunking it into > > smaller pieces?and then using multi-threaded to polygonize those > > chunks simultaneously. I often come across Disk I/O errors which makes > > me think that what I want to do is not necessarily how GDALPolygonize > > should be used. I was wondering if anyone has attempted something > > similar and whether there are public examples available that I could > > look into. > > > > Thanks for your time, > > > > Shayan Ghofrany > > > > _______________________________________________ > > gdal-dev mailing list > > [email protected] > > https://lists.osgeo.org/mailman/listinfo/gdal-dev > > -- > http://www.spatialys.com > My software is free, but my time generally not. > > > > ------------------------------ > > Subject: Digest Footer > > _______________________________________________ > gdal-dev mailing list > [email protected] > https://lists.osgeo.org/mailman/listinfo/gdal-dev > > > ------------------------------ > > End of gdal-dev Digest, Vol 229, Issue 28 > ***************************************** >
_______________________________________________ gdal-dev mailing list [email protected] https://lists.osgeo.org/mailman/listinfo/gdal-dev
