[gdal-dev] Proposal: Native MrSID DSDK Support for Upcoming GDAL Version (Surendrakumar Dandru)

Michael Katz michaeladamkatz at yahoo.com
Mon Sep 29 19:00:26 PDT 2025 

 Can someone clarify whether the "Native MrSID" proposal would change the functionality of the library, or would only make it easier to use the library through GDAL. I posted a few months ago about an apparent color bug in the GDAL MrSID implementation compared to the LizardTech tool.


    On Monday, September 29, 2025 at 03:08:50 PM PDT, gdal-dev-request at lists.osgeo.org <gdal-dev-request at lists.osgeo.org> wrote:  
 
 Send gdal-dev mailing list submissions to
    gdal-dev at lists.osgeo.org

To subscribe or unsubscribe via the World Wide Web, visit
    https://lists.osgeo.org/mailman/listinfo/gdal-dev
or, via email, send a message with subject or body 'help' to
    gdal-dev-request at lists.osgeo.org

You can reach the person managing the list at
    gdal-dev-owner at lists.osgeo.org

When replying, please edit your Subject line so it is more specific
than "Re: Contents of gdal-dev digest..."


Today's Topics:

  1. Proposal: Native MrSID DSDK Support for Upcoming GDAL Version
      (Surendrakumar Dandru)
  2. Re: Proposal: Native MrSID DSDK Support for Upcoming GDAL
      Version (Surendrakumar Dandru)
  3. Re: Proposal: Native MrSID DSDK Support for Upcoming GDAL
      Version (Greg Troxel)
  4. gdal2tiles 3.11.3 dies when source files have transparency
      (Stefan Gofferje)
  5. Re: gdal2tiles 3.11.3 dies when source files have
      transparency (Scott)
  6. Generating Python Bindings for GDAL 3.11.4 (Mazin Marwan)


----------------------------------------------------------------------

Message: 1
Date: Mon, 29 Sep 2025 17:28:21 +0530
From: Surendrakumar Dandru <surendra232208 at gmail.com>
To: gdal-dev at lists.osgeo.org
Subject: [gdal-dev] Proposal: Native MrSID DSDK Support for Upcoming
    GDAL Version
Message-ID:
    <CACUrS0ALmRKMoUiuZ4taU0XX27KNwVkp3M+t1rNBYEH-iyOQzw at mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Dear GDAL Developers,

I hope this message finds you well.

I would like to propose adding native support for the MrSID Decode SDK
(DSDK) in an upcoming GDAL release. Currently, enabling MrSID support
requires manual configuration and custom builds, which complicates adoption
for users who have access to the DSDK.

Native integration could include:

  -

  Automatic detection of MrSID DSDK headers and libraries in
  CMake/Autotools.
  -

  A streamlined build process when the SDK is present.
  -

  Updated documentation for enabling the driver with minimal manual steps.

This would allow GDAL users with the DSDK to easily leverage MrSID support
while maintaining compliance with licensing restrictions.

I would greatly appreciate your consideration of this feature for an
upcoming release and any guidance on the feasibility or requirements for
including it.

Thank you for your work on GDAL.

Best regards,
Surendrakumar Dandru
Geowgs84.corp
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/gdal-dev/attachments/20250929/ce22e7b3/attachment-0001.htm>

------------------------------

Message: 2
Date: Mon, 29 Sep 2025 17:34:39 +0530
From: Surendrakumar Dandru <surendra232208 at gmail.com>
To: gdal-dev at lists.osgeo.org
Subject: Re: [gdal-dev] Proposal: Native MrSID DSDK Support for
    Upcoming GDAL Version
Message-ID:
    <CACUrS0ANoM9aTCfJ1LT83A9JKBTdJPPuOeAVumaFMwETQDfkeg at mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Dear GDAL Developers,

Native integration of the *DSDK* would allow GDAL to *decode MrSID files
out-of-the-box*, while fully respecting the decode-only licensing
restrictions. This would simplify workflows and improve accessibility for
users who rely on MrSID data.

I am happy to provide guidance or assistance with build integration and
testing on Windows and Linux platforms to ensure a smooth implementation.

Thank you for considering this proposal. I look forward to your feedback.



On Mon, Sep 29, 2025 at 5:28?PM Surendrakumar Dandru <
surendra232208 at gmail.com> wrote:

> Dear GDAL Developers,
>
> I hope this message finds you well.
>
> I would like to propose adding native support for the MrSID Decode SDK
> (DSDK) in an upcoming GDAL release. Currently, enabling MrSID support
> requires manual configuration and custom builds, which complicates adoption
> for users who have access to the DSDK.
>
> Native integration could include:
>
>    -
>
>    Automatic detection of MrSID DSDK headers and libraries in
>    CMake/Autotools.
>    -
>
>    A streamlined build process when the SDK is present.
>    -
>
>    Updated documentation for enabling the driver with minimal manual
>    steps.
>
> This would allow GDAL users with the DSDK to easily leverage MrSID support
> while maintaining compliance with licensing restrictions.
>
> I would greatly appreciate your consideration of this feature for an
> upcoming release and any guidance on the feasibility or requirements for
> including it.
>
> Thank you for your work on GDAL.
>
> Best regards,
> Surendrakumar Dandru
> Geowgs84.corp
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/gdal-dev/attachments/20250929/9886f8df/attachment-0001.htm>

------------------------------

Message: 3
Date: Mon, 29 Sep 2025 08:20:50 -0400
From: Greg Troxel <gdt at lexort.com>
To: Surendrakumar Dandru via gdal-dev <gdal-dev at lists.osgeo.org>
Subject: Re: [gdal-dev] Proposal: Native MrSID DSDK Support for
    Upcoming GDAL Version
Message-ID: <rmi8qhxcuvx.fsf at s1.lexort.com>
Content-Type: text/plain

It's hard to tell what you are asking for.

You're writing from gmail and have what looks like an odd domain name in
your signature.  I'm not in charge here, but my social expectations are
that people acting on behalf of a company write from their company email
address.

I would suggest that you do the following (or hire someone to do it for
you):

  - Publish a web page with up-to-date instructions for dealing with
    mrsid in gdal, including integrated builds and plugin builds.  (All
    the ones I found were old.)

  - Prepare a detailed proposal of what you'd like to change, so that
    those familiar with the sources can understand what you really mean
    and the consequences.

  - If that seems ok to the maintainers, prepare a PR.


I did find

  https://gist.github.com/james-roden/01d9ea266528ed685319adb60222953e

which is pretty up to date and also looks as easy to deal with as is
possible with proprietary software.  About the only complaint I could
make about gdal is that there are 4 cmake variables:

    && cmake -DMRSID_ROOT=${MRSID_DIR} \
        -DMRSID_INCLUDE_DIR=${MRSID_DIR}/include \
        -DMRSID_LIBRARY=${MRSID_DIR}/lib/libltidsdk.so \
        -DGDAL_USE_MRSID=ON .. \

when the "autoconf is the one true way" part of me would expect the
analog of

    --with-mrsid-${MRSID_DIR}

and the rest to be picked up from there.  But really, that's trivial,
and I somehow don't think you mean "it's causing us real trouble to set
4 variables in our build script (which is of course under configuration
management) instead of 1".






------------------------------

Message: 4
Date: Mon, 29 Sep 2025 15:41:48 +0000
From: Stefan Gofferje <lists at home.gofferje.net>
To: gdal-dev at lists.osgeo.org
Subject: [gdal-dev] gdal2tiles 3.11.3 dies when source files have
    transparency
Message-ID:
    <0107019996231f7a-890f7558-9b25-44e9-a3cb-4439570bc85c-000000 at eu-central-1.amazonses.com>
    
Content-Type: text/plain; charset=UTF-8; format=flowed

Hi all,

I have 4 large GeoTIFF files from which I want to create XYZ tiles. I 
have tried various combinations with gdal_merge, gdalbuildvrt and 
gdal_translate and the result is the same:

When the source file contains transparency such as

gdalbuildvrt -srcnodata 0 VVVH.vrt ${LIST}
gdal_merge -n 0 -a_nodata 0 -o VVVH.tif ${LIST}

etc...

gdal2tiles dies complaining that the source file cannot be found in the 
/tmp directory.

I call gdal2tiles like this:
/usr/bin/gdal2tiles -x --processes 8 --xyz -z 8-14 VVVH.vrt tiles
or
/usr/bin/gdal2tiles -x --processes 8 --xyz -z 8-14 VVVH.tif tiles
depending on what source file I created.

I really would like to have tiles which are transparent where the source 
files are instead of black.

Example output:

0multiprocessing.pool.RemoteTraceback:
"""
Traceback (most recent call last):
  File "/usr/lib/python3.12/multiprocessing/pool.py", line 125, in worker
    result = (True, func(*args, **kwds))
                    ^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/multiprocessing/pool.py", line 48, in mapstar
    return list(map(*args))
            ^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/osgeo_utils/gdal2tiles.py", line 
1335, in create_base_tile
    alpha = alphaband.ReadRaster(rx, ry, rxsize, rysize, wxsize, wysize)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/osgeo/gdal.py", line 8756, in 
ReadRaster
    return _gdal.Band_ReadRaster1(self, xoff, yoff, xsize, ysize,
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
RuntimeError: /tmp/tmpg8iuy420/VVVH.tif: No such file or directory
May be caused by: /tmp/tmpg8iuy420/VVVH.tif: No such file or directory
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/bin/gdal2tiles", line 33, in <module>
    sys.exit(load_entry_point('GDAL==3.11.3', 'console_scripts', 
'gdal2tiles')())
  
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/osgeo_utils/gdal2tiles.py", line 
4625, in main
    return submain(argv, called_from_main=called_from_main)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/osgeo_utils/auxiliary/util.py", 
line 46, in enable_exceptions_wrapper
    return fun(*args, **kwargs)
            ^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/osgeo_utils/gdal2tiles.py", line 
4655, in submain
    multi_threaded_tiling(input_file, output_folder, options, pool)
  File "/usr/lib/python3/dist-packages/osgeo_utils/auxiliary/util.py", 
line 46, in enable_exceptions_wrapper
    return fun(*args, **kwargs)
            ^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3/dist-packages/osgeo_utils/gdal2tiles.py", line 
4549, in multi_threaded_tiling
    for _ in pool.imap_unordered(
  File "/usr/lib/python3.12/multiprocessing/pool.py", line 451, in 
<genexpr>
    return (item for chunk in result for item in chunk)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/multiprocessing/pool.py", line 873, in next
    raise value
RuntimeError: /tmp/tmpg8iuy420/VVVH.tif: No such file or directory
May be caused by: /tmp/tmpg8iuy420/VVVH.tif: No such file or directory



-- 
  (o_  Stefan Gofferje            | SCLT, MCP, CCSA
  //\  Reg'd Linux User #247167  | VCP #2263
  V_/_  https://www.gofferje.net  | https://www.saakeskus.fi



------------------------------

Message: 5
Date: Mon, 29 Sep 2025 09:03:22 -0700
From: Scott <public at postholer.com>
To: gdal-dev at mail.osgeo.org
Subject: Re: [gdal-dev] gdal2tiles 3.11.3 dies when source files have
    transparency
Message-ID: <8cfc8d53-8beb-46c4-88c8-ddf7e626ece1 at postholer.com>
Content-Type: text/plain; charset=UTF-8; format=flowed

Hey Stefan,

I don't have a direct answer to your question. But, I noticed you are 
using gdal 3.11.3. I would encourage you to try the gdal cli version. It 
doesn't rely on python and has a whole bunch of options. Something like:

echo "Creating complete.gdalg.json..."
gdal raster mosaic \
    --input="cache/*.tif" \
    --output="complete.gdalg.json" \
    --resolution=highest \
    --overwrite

echo "Creating tiles..."
gdal raster tile \
    --input=complete.gdalg.json \
    --min-zoom=12 --max-zoom=14 \
    --skip-blank --overview-resampling=cubic \
    --co ZLEVEL=9 --add-alpha \
    --output=tilesDir \
    --progress

Documentation can be found here:
https://gdal.org/en/stable/programs/gdal_raster_tile.html#gdal-raster-tile

Hope that helps!
Scott


On 9/29/25 08:41, Stefan Gofferje via gdal-dev wrote:
> Hi all,
> 
> I have 4 large GeoTIFF files from which I want to create XYZ tiles. I 
> have tried various combinations with gdal_merge, gdalbuildvrt and 
> gdal_translate and the result is the same:
> 
> When the source file contains transparency such as
> 
> gdalbuildvrt -srcnodata 0 VVVH.vrt ${LIST}
> gdal_merge -n 0 -a_nodata 0 -o VVVH.tif ${LIST}
> 
> etc...
> 
> gdal2tiles dies complaining that the source file cannot be found in 
> the /tmp directory.
> 
> I call gdal2tiles like this:
> /usr/bin/gdal2tiles -x --processes 8 --xyz -z 8-14 VVVH.vrt tiles
> or
> /usr/bin/gdal2tiles -x --processes 8 --xyz -z 8-14 VVVH.tif tiles
> depending on what source file I created.
> 
> I really would like to have tiles which are transparent where the source 
> files are instead of black.
> 
> Example output:
> 
> 0multiprocessing.pool.RemoteTraceback:
> """
> Traceback (most recent call last):
>  ? File "/usr/lib/python3.12/multiprocessing/pool.py", line 125, in worker
>  ??? result = (True, func(*args, **kwds))
>  ??????????????????? ^^^^^^^^^^^^^^^^^^^
>  ? File "/usr/lib/python3.12/multiprocessing/pool.py", line 48, in mapstar
>  ??? return list(map(*args))
>  ?????????? ^^^^^^^^^^^^^^^^
>  ? File "/usr/lib/python3/dist-packages/osgeo_utils/gdal2tiles.py", line 
> 1335, in create_base_tile
>  ??? alpha = alphaband.ReadRaster(rx, ry, rxsize, rysize, wxsize, wysize)
>  ??????????? ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
>  ? File "/usr/lib/python3/dist-packages/osgeo/gdal.py", line 8756, in 
> ReadRaster
>  ??? return _gdal.Band_ReadRaster1(self, xoff, yoff, xsize, ysize,
>  ?????????? ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
> RuntimeError: /tmp/tmpg8iuy420/VVVH.tif: No such file or directory
> May be caused by: /tmp/tmpg8iuy420/VVVH.tif: No such file or directory
> """
> 
> The above exception was the direct cause of the following exception:
> 
> Traceback (most recent call last):
>  ? File "/usr/bin/gdal2tiles", line 33, in <module>
>  ??? sys.exit(load_entry_point('GDAL==3.11.3', 'console_scripts', 
> 'gdal2tiles')())
> 
> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
>  ? File "/usr/lib/python3/dist-packages/osgeo_utils/gdal2tiles.py", line 
> 4625, in main
>  ??? return submain(argv, called_from_main=called_from_main)
>  ?????????? ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
>  ? File "/usr/lib/python3/dist-packages/osgeo_utils/auxiliary/util.py", 
> line 46, in enable_exceptions_wrapper
>  ??? return fun(*args, **kwargs)
>  ?????????? ^^^^^^^^^^^^^^^^^^^^
>  ? File "/usr/lib/python3/dist-packages/osgeo_utils/gdal2tiles.py", line 
> 4655, in submain
>  ??? multi_threaded_tiling(input_file, output_folder, options, pool)
>  ? File "/usr/lib/python3/dist-packages/osgeo_utils/auxiliary/util.py", 
> line 46, in enable_exceptions_wrapper
>  ??? return fun(*args, **kwargs)
>  ?????????? ^^^^^^^^^^^^^^^^^^^^
>  ? File "/usr/lib/python3/dist-packages/osgeo_utils/gdal2tiles.py", line 
> 4549, in multi_threaded_tiling
>  ??? for _ in pool.imap_unordered(
>  ? File "/usr/lib/python3.12/multiprocessing/pool.py", line 451, in 
> <genexpr>
>  ??? return (item for chunk in result for item in chunk)
>  ?????????? ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
>  ? File "/usr/lib/python3.12/multiprocessing/pool.py", line 873, in next
>  ??? raise value
> RuntimeError: /tmp/tmpg8iuy420/VVVH.tif: No such file or directory
> May be caused by: /tmp/tmpg8iuy420/VVVH.tif: No such file or directory
> 
> 
> 



------------------------------

Message: 6
Date: Mon, 29 Sep 2025 15:08:19 -0700
From: Mazin Marwan <mazin.marwan0 at gmail.com>
To: gdal-dev at lists.osgeo.org
Subject: [gdal-dev] Generating Python Bindings for GDAL 3.11.4
Message-ID:
    <CAJgBAzBbw2FZ5+1T3zOuO1_fibJ5BK5bn=xQYU_hKUvrL3OukA at mail.gmail.com>
Content-Type: text/plain; charset="utf-8"

Hi all,

I've installed GDAL 3.11.4 using VCPKG and am now trying to generate the
python bindings using:

pip install gdal

However I'm running into the following error:

ERROR: Failed building wheel for gdal
Failed to build gdal
error: failed-wheel-build-for-install

? Failed to build installable wheels for some pyproject.toml based projects
??> gdal

A bit of research online has led me to believe that the pip version is just
broken and that the fix is installing a .whl file from cgholke's geospatial
wheels repo but that seems like a workaround instead of a proper fix. Is
there another way to fix this?
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/gdal-dev/attachments/20250929/dff8053d/attachment.htm>

------------------------------

Subject: Digest Footer

_______________________________________________
gdal-dev mailing list
gdal-dev at lists.osgeo.org
https://lists.osgeo.org/mailman/listinfo/gdal-dev


------------------------------

End of gdal-dev Digest, Vol 256, Issue 30
*****************************************
  
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/gdal-dev/attachments/20250930/ee36d962/attachment-0001.htm>

More information about the gdal-dev mailing list