[PROJ] Big grid files

Kristian Evers kristianevers at gmail.com
Sun Apr 27 11:07:56 PDT 2025


Mike,

We have plenty of storage on download.osgeo.org/proj/ <http://download.osgeo.org/proj/>. The issue here is flooding the git repo
where we keep track of the history and handle the code that is involved in making the data
package. As far I can tell that’s not an option at the Source Cooperative.

/Kristian

> On 27 Apr 2025, at 17.40, Michael Sumner via PROJ <proj at lists.osgeo.org> wrote:
> 
> For storage what about Source Cooperative? https://source.coop/
> 
> Lots of groups putting up rather large datasets with no cost implications.
> 
> Cheers, Mike
> 
> On Sun, Apr 27, 2025, 22:55 Even Rouault via PROJ <proj at lists.osgeo.org <mailto:proj at lists.osgeo.org>> wrote:
>> 
>> 
>> Le 24/04/2025 à 21:51, Mike Taves via PROJ a écrit :
>>> There is Git Large File Storage (Git LFS), which has a limit of 2GB.
>>> 
>> Yes, but there are billing / bandwidth implications. I remember we had it enabled, but CI cloning typically exhausted the allowed free bandwidth.
>> 
>> Javier, maybe you can try using gdal_translate -scale X X X X -ot UInt16 -co COMPRESS=DEFLATE -co TILED=YES -co PREDICTOR=2 with the appropriate scaling values ?
>> 
>> Or gdal_translate -co DISCARD_LSB=X -co COMPRESS=DEFLATE -co TILED=YES -co PREDICTOR=3  to nullify least signifcant bits of the mantissa.
>> 
>> 
>> 
>>> 
>>> On Fri, 25 Apr 2025, 04:37 Javier Jimenez Shaw via PROJ, <proj at lists.osgeo.org <mailto:proj at lists.osgeo.org>> wrote:
>>>> Hi
>>>> 
>>>> I am playing with the new American geoid model SGEOID2022
>>>> 
>>>> After compressing with this command (can I do it better?)
>>>> gdal_translate sgeoid2022.tif sgcomp.tif -co COMPRESS=DEFLATE -co TILED=YES -co PREDICTOR=3
>>>> I get a 110 MB file (and it is only one band. No velocities).
>>>> 
>>>> GitHub has a limit of 100MB:
>>>> https://docs.github.com/en/repositories/working-with-files/managing-large-files/about-large-files-on-github
>>>> 
>>>> Just to let you know.
>>>> 
>>>> Cheers,
>>>> Javier.
>>>> _______________________________________________
>>>> PROJ mailing list
>>>> PROJ at lists.osgeo.org <mailto:PROJ at lists.osgeo.org>
>>>> https://lists.osgeo.org/mailman/listinfo/proj
>>> 
>>> 
>>> _______________________________________________
>>> PROJ mailing list
>>> PROJ at lists.osgeo.org <mailto:PROJ at lists.osgeo.org>
>>> https://lists.osgeo.org/mailman/listinfo/proj
>> -- 
>> http://www.spatialys.com <http://www.spatialys.com/>
>> My software is free, but my time generally not.
>> _______________________________________________
>> PROJ mailing list
>> PROJ at lists.osgeo.org <mailto:PROJ at lists.osgeo.org>
>> https://lists.osgeo.org/mailman/listinfo/proj
> 
> Michael Sumner
> Research Software Engineer
> Australian Antarctic Division
> Hobart, Australia
> e-mail: mdsumner at gmail.com <mailto:mdsumner at gmail.com>_______________________________________________
> PROJ mailing list
> PROJ at lists.osgeo.org
> https://lists.osgeo.org/mailman/listinfo/proj

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/proj/attachments/20250427/bd9fe981/attachment.htm>


More information about the PROJ mailing list