<div dir="ltr"><div dir="ltr"><p style="margin:0px;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue""><br></p><p style="margin:0px;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">Thank you Momtchil for providing additional references including debbuild-gdal! Currently we do not have such a use case but I see that it would be useful if we want to upgrade to a newer GDAL version on an existing distribution. If I am not mistaken, the Dockerfiles are not updated for Bullseye and especially for Aarch64. Is there someone else now maintaining these packages for newer Debian distribution? If so, reference to those could be helpful if I (or someone else) will need to revisit this in the future.</p><p style="margin:0px;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue""><br></p><p style="margin:0px;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue"">- Snehal</p><p style="margin:0px;font-stretch:normal;font-size:13px;line-height:normal;font-family:"Helvetica Neue""><br></p></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Mar 25, 2022 at 11:40 PM Momtchil Momtchev <<a href="mailto:momtchil@momtchev.com">momtchil@momtchev.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex">
<div>
<p><br>
</p>
<p>If you have lots of Debian servers, what you can do is to use the
Debian experimental GDAL packages - which are usually up to date
with the latest version of GDAL - and to set up a Dockerfile to
build these for Debian stable and then to use reprepro to
distribute them to your machines. If you have never done this
before, you have about 1 day of work to set up everything. I did
maintain a GDAL distribution for Debian 10 for a few years. You
can find my Dockerfiles here: <br>
</p>
<p><a href="https://github.com/mmomtchev/debbuild-gdal" target="_blank">https://github.com/mmomtchev/debbuild-gdal</a></p>
<p><br>
</p>
<div>On 25/03/2022 23:24, snehal waychal
wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">
<p>Dear Evan,</p>
<p><br>
</p>
<p>Oh! thank you very much for a fast test release!</p>
<p><br>
</p>
<p>I can confirm that released version works as
expected. And to be sure, here is what/how I have tested:</p>
<p><br>
</p>
<blockquote style="margin:0px 0px 0px 40px;border:none;padding:0px">
<p><font color="#0b5394">```</font></p>
<p><font color="#0b5394">$ docker run -it
python:3.7.13-slim-bullseye bash</font></p>
<p><font color="#0b5394"><br>
</font></p>
<p><font color="#0b5394">$ apt-get update
&& apt-get install -y libgdal-dev gcc g++</font></p>
<p><font color="#0b5394"><br>
</font></p>
<p><font color="#0b5394"># let's take newer,
problematic setuptools</font></p>
<p><font color="#0b5394">$ pip install -U
setuptools</font></p>
<p><font color="#0b5394">$ pip list</font></p>
<p><font color="#0b5394">Package<span> </span><span> <span> </span></span>Version</font></p>
<p><font color="#0b5394">----------<span> </span><span> <span> </span></span>-------</font></p>
<p><font color="#0b5394">pip<span> </span><span> <span> </span></span>22.0.4</font></p>
<p><font color="#0b5394">setuptools<span> <span> </span></span>61.0.0</font></p>
<p><font color="#0b5394">wheel<span> <span> </span></span>0.37.1</font></p>
<p><font color="#0b5394"><br>
</font></p>
<p><font color="#0b5394"># existing release from <a href="http://pypi.org" target="_blank">pypi.org</a>
fails</font></p>
<p><font color="#0b5394"><br>
</font></p>
<p><font color="#0b5394">$ pip install gdal==3.2.2</font></p>
<p><font color="#0b5394"><br>
</font></p>
<p><font color="#0b5394">Collecting gdal==3.2.2</font></p>
<p><font color="#0b5394"><span> <span> </span></span>Downloading
GDAL-3.2.2.tar.gz (601 kB)</font></p>
<p><font color="#0b5394"><span> <span> </span></span>━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
601.7/601.7 KB 8.0 MB/s eta 0:00:00</font></p>
<p><font color="#0b5394"><span> <span> </span></span>Preparing
metadata (setup.py) ... error</font></p>
<p><font color="#0b5394"><span> <span> </span></span>error:
subprocess-exited-with-error</font></p>
<p><font color="#0b5394"><br>
</font></p>
<p><font color="#0b5394"><span> <span> </span></span>×
python setup.py egg_info did not run successfully.</font></p>
<p><font color="#0b5394"><span> <span> </span></span>│
exit code: 1</font></p>
<p><font color="#0b5394"><span> <span> </span></span>╰─>
[6 lines of output]</font></p>
<p><font color="#0b5394"><span> <span> </span></span>WARNING:
numpy not available!<span> <span> </span></span>Array
support will not be enabled</font></p>
<p><font color="#0b5394"><span> <span> </span></span>/usr/local/lib/python3.7/site-packages/setuptools/_distutils/dist.py:275:
UserWarning: Unknown distribution option:
'use_2to3_fixers'</font></p>
<p><font color="#0b5394"><span> <span> </span></span>warnings.warn(msg)</font></p>
<p><font color="#0b5394"><span> <span> </span></span>/usr/local/lib/python3.7/site-packages/setuptools/_distutils/dist.py:275:
UserWarning: Unknown distribution option:
'use_2to3_exclude_fixers'</font></p>
<p><font color="#0b5394"><span> <span> </span></span>warnings.warn(msg)</font></p>
<p><font color="#0b5394"><span> <span> </span></span>error
in GDAL setup command: use_2to3 is invalid.</font></p>
<p><font color="#0b5394"><span> <span> </span></span>[end
of output]</font></p>
<p><font color="#0b5394"><br>
</font></p>
<p><font color="#0b5394"><span> <span> </span></span>note:
This error originates from a subprocess, and is likely not
a problem with pip.</font></p>
<p><font color="#0b5394">error:
metadata-generation-failed</font></p>
<p><font color="#0b5394"><br>
</font></p>
<p><font color="#0b5394">× Encountered error while
generating package metadata.</font></p>
<p><font color="#0b5394">╰─> See above for
output.</font></p>
<p><font color="#0b5394"><br>
</font></p>
<p><font color="#0b5394">note: This is an issue
with the package mentioned above, not pip.</font></p>
<p><font color="#0b5394">hint: See above for
details.</font></p>
<p><span><font color="#0b5394"> </font></span></p>
<p><span><font color="#0b5394"> </font></span></p>
<p><font color="#0b5394"># installing newer one
from <a href="http://test.pypi.org" target="_blank">test.pypi.org</a> works fine!</font></p>
<p><span><font color="#0b5394"> </font></span></p>
<p><font color="#0b5394">$ pip install -i <a href="https://test.pypi.org/simple/" target="_blank">https://test.pypi.org/simple/</a>
GDAL==3.2.2.1</font></p>
<p><font color="#0b5394"><br>
</font></p>
<p><font color="#0b5394">Looking in indexes: <a href="https://test.pypi.org/simple/" target="_blank">https://test.pypi.org/simple/</a></font></p>
<p><font color="#0b5394">Collecting GDAL==3.2.2.1</font></p>
<p><font color="#0b5394"><span> <span> </span></span>Downloading
<a href="https://test-files.pythonhosted.org/packages/b7/02/4356dbdabf8f4fa898fe2378c8c096df3da254508ec8bc0663920cf4b92d/GDAL-3.2.2.1.tar.gz" target="_blank">https://test-files.pythonhosted.org/packages/b7/02/4356dbdabf8f4fa898fe2378c8c096df3da254508ec8bc0663920cf4b92d/GDAL-3.2.2.1.tar.gz</a>
(600 kB)</font></p>
<p><font color="#0b5394"><span> <span> </span></span>━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━
600.9/600.9 KB 8.2 MB/s eta 0:00:00</font></p>
<p><font color="#0b5394"><span> <span> </span></span>Preparing
metadata (setup.py) ... done</font></p>
<p><font color="#0b5394">Building wheels for
collected packages: GDAL</font></p>
<p><font color="#0b5394"><span> <span> </span></span>Building
wheel for GDAL (setup.py) ... done</font></p>
<p><font color="#0b5394"><span> <span> </span></span>Created
wheel for GDAL:
filename=GDAL-3.2.2.1-cp37-cp37m-linux_x86_64.whl
size=816416
sha256=0209dc3c56cd626137c53187c4a8fb7758587c9030cf8d479d8a2c7864fd5c77</font></p>
<p><font color="#0b5394"><span> <span> </span></span>Stored
in directory:
/root/.cache/pip/wheels/4b/f2/02/0ca533c034c5cc5840d619cd7004f32d3362c04a1c1500d0a1</font></p>
<p><font color="#0b5394">Successfully built GDAL</font></p>
<p><font color="#0b5394">Installing collected
packages: GDAL</font></p>
<p><font color="#0b5394">Successfully installed
GDAL-3.2.2.1</font></p>
<p><font color="#0b5394">WARNING: Running pip as
the 'root' user can result in broken permissions and
conflicting behaviour with the system package manager. It
is recommended to use a virtual environment instead:<span> </span><a href="https://pip.pypa.io/warnings/venv" target="_blank">https://pip.pypa.io/warnings/venv</a></font></p>
<p><font color="#0b5394"><br>
</font></p>
<p><font color="#0b5394">```</font></p>
</blockquote>
<p><br>
</p>
<p>I hope this gives us some confidence that we are
on a right track! :)<span> </span></p>
<p><br>
</p>
<p>If I should test something else, please let me
know! Looking forward for the release on the <a href="http://pypi.org" target="_blank">pypi.org</a>.</p>
<p><br>
</p>
<p>Thank you again!!</p>
<p><br>
</p>
<p>Regards,</p>
<p>Snehal</p>
<br>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Fri, Mar 25, 2022 at 1:45
PM Even Rouault <<a href="mailto:even.rouault@spatialys.com" target="_blank">even.rouault@spatialys.com</a>>
wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex">
<div>
<p>ok, I missed this was on the pypi package.</p>
<p>I've tried to make a patch over 3.2.2. For now, I've
uploaded it only to <a href="https://test.pypi.org/project/GDAL/3.2.2.1/" target="_blank">https://test.pypi.org/project/GDAL/3.2.2.1/</a>
. Can you test that and confirm that works properly ? If
so, I'll push it to pypi official.</p>
<p>I've tracked the changes in a patch/<a href="http://3.2.2.1" target="_blank">3.2.2.1</a> branch, sitting for
now in my fork:<br>
</p>
<p><a href="https://github.com/OSGeo/gdal/compare/v3.2.2..rouault:patch/3.2.2.1?expand=1" target="_blank">https://github.com/OSGeo/gdal/compare/v3.2.2..rouault:patch/3.2.2.1?expand=1</a></p>
<p>I'll push that to OSGeo/gdal as well and tag once
confirmed things work fine<br>
</p>
<p>Hoping I'm not going into troubles doing this stuff
outside of our usual release processes...</p>
<p>Even<br>
</p>
<div>Le 25/03/2022 à 13:13, snehal waychal a écrit :<br>
</div>
<blockquote type="cite">
<div dir="ltr">
<div dir="ltr">
<p>Dear Even, dear Bas,</p>
<p><br>
</p>
<p>Thank you very much for the quick response and
highlighting<span> </span>the Debian/Ubuntu release
policy aspects. And also about the link to the
ubuntugis-unstable PPA.</p>
<p><br>
</p>
<p>><i> what you discuss here is all about the
patch & backport policy of the<span> </span></i></p>
<p>><i> Debian GDAL package. You can try to file a
bug to Debian and point to<span> </span></i></p>
<p>><i> the patch you'd want to see backported,</i></p>
<p><br>
</p>
<p>But just to be sure I haven’t misunderstood<span> </span>your
response or misrepresented the original issue. The
patch release I described is also needed in the
official releases of the GDAL <b>*python*</b>
package. If I am not mistaken, the GDAL team is
taking care of source distributions on <a href="https://pypi.org/project/GDAL/" target="_blank"><span style="color:rgb(220,161,13)">https://pypi.org/project/GDAL/</span></a>.
I looked into released pypi versions and if I am not
mistaken there is no patch release for v3.2.2 with
fix for setuptools compatibility issue.</p>
<p><br>
</p>
<p>So, if we could make a new patch release of the<i>
*python* package of GDAL</i> and push the sdist
package to <a href="http://pypi.org" target="_blank"><span style="color:rgb(220,161,13)">pypi.org</span></a>
(something like 3.2.2.1, as I described in the
previous email) then that would also solve the
issue. Because as python developers, we install
*python* packages via pip/pipenv/poetry and those
package managers would pick the new patch release
from <a href="http://pypi.org" target="_blank"><span style="color:rgb(220,161,13)">pypi.org</span></a>.
(The GDAL library component libgdal-dev v3.2.2 will
still come from the debian system package repo and
there is no issue with that).<span> </span></p>
<p><br>
</p>
<p>Hope I am not missing something obvious here.
Please let me know.</p>
<p><br>
</p>
<p>Thank you again!</p>
<p><br>
</p>
<p>Regards,</p>
<p>Snehal</p>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Fri, Mar 25, 2022
at 12:29 PM Sebastiaan Couwenberg <<a href="mailto:sebastic@xs4all.nl" target="_blank">sebastic@xs4all.nl</a>>
wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left-width:1px;border-left-style:solid;border-left-color:rgb(204,204,204);padding-left:1ex">On
3/25/22 12:07, Even Rouault wrote:<br>
> what you discuss here is all about the patch
& backport policy of the <br>
> Debian GDAL package. You can try to file a bug
to Debian and point to <br>
> the patch you'd want to see backported, but I
can't promise if there <br>
> would be interest in their maintenance team to
create an updated package <br>
> with it (my understanding is that even if we'd
release a new 3.2.x patch <br>
> release, it wouldn't be packaged in LTS
distributions. I'm not sure how <br>
> much of that is linked to Debian policy or
availability of people that <br>
> do the work)<br>
<br>
Packages in Debian stable releases only get updates
to fix bugs of <br>
severity important or higher [0]. GDAL patch
releases also contain <br>
changes for lower severity issues, it's not worth
the effort to vet all <br>
those changes. Any changes to packages in stable
also risk introducing <br>
regressions which are highly undesirable in LTS
releases known for their <br>
stability.<br>
<br>
People should be maintaining their own packaging
repositories where they <br>
host packages with changes for their needs that
cannot be easily <br>
upstreamed to the package in the distribution
itself. Scratching your <br>
own itch was a corner stone of Open Source that
people are seemingly <br>
forgetting or never having known about in the first
place.<br>
<br>
[0] <br>
<a href="https://www.debian.org/doc/manuals/developers-reference/pkgs.en.html#special-case-uploads-to-the-stable-and-oldstable-distributions" rel="noreferrer" target="_blank">https://www.debian.org/doc/manuals/developers-reference/pkgs.en.html#special-case-uploads-to-the-stable-and-oldstable-distributions</a><br>
<br>
Kind Regards,<br>
<br>
Bas<br>
<br>
-- <br>
GPG Key ID: 4096R/6750F10AE88D4AF1<br>
Fingerprint: 8182 DE41 7056 408D 6146 50D1 6750
F10A E88D 4AF1<br>
_______________________________________________<br>
gdal-dev mailing list<br>
<a href="mailto:gdal-dev@lists.osgeo.org" target="_blank">gdal-dev@lists.osgeo.org</a><br>
<a href="https://lists.osgeo.org/mailman/listinfo/gdal-dev" rel="noreferrer" target="_blank">https://lists.osgeo.org/mailman/listinfo/gdal-dev</a><br>
</blockquote>
</div>
</div>
</blockquote>
<pre cols="72">--
<a href="http://www.spatialys.com" target="_blank">http://www.spatialys.com</a>
My software is free, but my time generally not.</pre>
</div>
</blockquote>
</div>
<br>
<fieldset></fieldset>
<pre>_______________________________________________
gdal-dev mailing list
<a href="mailto:gdal-dev@lists.osgeo.org" target="_blank">gdal-dev@lists.osgeo.org</a>
<a href="https://lists.osgeo.org/mailman/listinfo/gdal-dev" target="_blank">https://lists.osgeo.org/mailman/listinfo/gdal-dev</a>
</pre>
</blockquote>
<pre cols="72">--
Momtchil Momtchev <a href="mailto:momtchil@momtchev.com" target="_blank"><momtchil@momtchev.com></a>
</pre>
</div>
_______________________________________________<br>
gdal-dev mailing list<br>
<a href="mailto:gdal-dev@lists.osgeo.org" target="_blank">gdal-dev@lists.osgeo.org</a><br>
<a href="https://lists.osgeo.org/mailman/listinfo/gdal-dev" rel="noreferrer" target="_blank">https://lists.osgeo.org/mailman/listinfo/gdal-dev</a><br>
</blockquote></div></div>