<div dir="auto"><div dir="ltr">nice, I've been hitting that up with the multidim model and it works pretty well. (i'm still scratchy in the C++ but getting what I want out of it). <div><br></div><div dir="auto">We were checking out CMIP6 holdings too that look similarly impressive.</div><div dir="auto"><br></div><div>M</div></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Feb 27, 2025 at 5:27 PM Kurt Schwehr <<a href="mailto:schwehr@gmail.com" target="_blank" rel="noreferrer">schwehr@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>Mike,</div><div><br></div><div>That's an interesting one for sure.</div><div><br></div>Even before the ESA talk of Zarr, we have a good amount of Zarr data around. Just one I know of: <a href="https://cloud.google.com/storage/docs/public-datasets/era5" target="_blank" rel="noreferrer">https://cloud.google.com/storage/docs/public-datasets/era5</a></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Feb 26, 2025 at 8:07 PM Michael Sumner <<a href="mailto:mdsumner@gmail.com" target="_blank" rel="noreferrer">mdsumner@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Just clueing into why you might be working with this, have you seen this critique? (was a bit shocked to see that this is apparently going forward for Sentinel 2, let alone that it was even considered!)<div><br></div><div><a href="https://github.com/csaybar/ESA-zar-zip-decision" target="_blank" rel="noreferrer">https://github.com/csaybar/ESA-zar-zip-decision</a></div><div><br></div><div>Also glad to see a working example outlined that I can follow, Thanks!</div><div><br></div><div>Cheers, Mike</div><div><br></div><div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Feb 25, 2025 at 7:10 AM Kurt Schwehr via gdal-dev <<a href="mailto:gdal-dev@lists.osgeo.org" target="_blank" rel="noreferrer">gdal-dev@lists.osgeo.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Thanks Laurentiu and Scott!<div><br></div><div>I can't believe 1) I left off -r and 2) I didn't think to look at what's in the zip. Doh!<div><br></div><div>And thanks for reminding me about sozip. I was one of the reviewers of the initial spec and still don't have it front-of-mind.</div><div><br></div><div><font face="monospace">unzip -l nczarr_v2.zarr.zip <br>Archive: nczarr_v2.zarr.zip<br> Length Date Time Name<br>--------- ---------- ----- ----<br> 0 2024-12-23 02:00 nczarr_v2.zarr/<br>--------- -------<br> 0 1 file</font></div><div><br></div><div>Now happily able to see the contents:</div><div><br></div><div><font face="monospace">gdalinfo /vsizip/nczarr_v2.zarr.zip/nczarr_v2.zarr<br>Driver: Zarr/Zarr<br>Files: /vsizip/nczarr_v2.zarr.zip/nczarr_v2.zarr<br>Size is 512, 512<br>Subdatasets:<br> SUBDATASET_1_NAME=ZARR:"/vsizip/nczarr_v2.zarr.zip/nczarr_v2.zarr":/MyGroup/lon<br> SUBDATASET_1_DESC=Array /MyGroup/lon<br> SUBDATASET_2_NAME=ZARR:"/vsizip/nczarr_v2.zarr.zip/nczarr_v2.zarr":/MyGroup/lat<br> SUBDATASET_2_DESC=Array /MyGroup/lat<br> SUBDATASET_3_NAME=ZARR:"/vsizip/nczarr_v2.zarr.zip/nczarr_v2.zarr":/MyGroup/dset1<br> SUBDATASET_3_DESC=Array /MyGroup/dset1<br> SUBDATASET_4_NAME=ZARR:"/vsizip/nczarr_v2.zarr.zip/nczarr_v2.zarr":/MyGroup/Group_A/dset2<br> SUBDATASET_4_DESC=Array /MyGroup/Group_A/dset2<br> SUBDATASET_5_NAME=ZARR:"/vsizip/nczarr_v2.zarr.zip/nczarr_v2.zarr":/MyGroup/Group_A/dset3<br> SUBDATASET_5_DESC=Array /MyGroup/Group_A/dset3</font></div><div><font face="monospace">[SNIP]</font></div><div><br></div><div>-Kurt</div></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Feb 24, 2025 at 11:21 AM Laurențiu Nicola via gdal-dev <<a href="mailto:gdal-dev@lists.osgeo.org" target="_blank" rel="noreferrer">gdal-dev@lists.osgeo.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">I suspect it won't make a lot of difference. SOZIP is designed to allow seeking within a compressed file, but Zarr is tile- (block) based, where each of those is stored in a different file. So you end up uncompressing a whole file anyway.<br>
<br>
Laurentiu<br>
<br>
On Mon, Feb 24, 2025, at 21:17, Scott via gdal-dev wrote:<br>
> There's GDAL's sozip (Search Optimized Zip) utility as well. I have no <br>
> idea if it works with .zarr. I'm sure someone will correct me! ;)<br>
><br>
> cd nczarr_v2.zarr<br>
> sozip ../nczarr_v2.zarr.zip .<br>
> sozip -l /vsizip/../nczarr_v2.zarr.zip<br>
><br>
> On 2/24/25 10:09, Kurt Schwehr via gdal-dev wrote:<br>
>> Hi all,<br>
>> <br>
>> I seem to be having trouble exactly how to correctly make a zip of a <br>
>> zarr and how to correctly specify the vsizip url.<br>
>> <br>
>> e.g from autotest/gdrivers/data/zarr<br>
>> <br>
>> gdalinfo nczarr_v2.zarr # Works<br>
>> tar cf nczarr_v2.zarr.zip nczarr_v2.zarr<br>
>> <br>
>> Then what? I've tried lots of variations and not had any success.<br>
>> <br>
>> Thanks!<br>
>> -Kurt<br>
>> <br>
>> _______________________________________________<br>
>> gdal-dev mailing list<br>
>> <a href="mailto:gdal-dev@lists.osgeo.org" target="_blank" rel="noreferrer">gdal-dev@lists.osgeo.org</a><br>
>> <a href="https://lists.osgeo.org/mailman/listinfo/gdal-dev" rel="noreferrer noreferrer" target="_blank">https://lists.osgeo.org/mailman/listinfo/gdal-dev</a><br>
><br>
> _______________________________________________<br>
> gdal-dev mailing list<br>
> <a href="mailto:gdal-dev@lists.osgeo.org" target="_blank" rel="noreferrer">gdal-dev@lists.osgeo.org</a><br>
> <a href="https://lists.osgeo.org/mailman/listinfo/gdal-dev" rel="noreferrer noreferrer" target="_blank">https://lists.osgeo.org/mailman/listinfo/gdal-dev</a><br>
_______________________________________________<br>
gdal-dev mailing list<br>
<a href="mailto:gdal-dev@lists.osgeo.org" target="_blank" rel="noreferrer">gdal-dev@lists.osgeo.org</a><br>
<a href="https://lists.osgeo.org/mailman/listinfo/gdal-dev" rel="noreferrer noreferrer" target="_blank">https://lists.osgeo.org/mailman/listinfo/gdal-dev</a><br>
</blockquote></div>
_______________________________________________<br>
gdal-dev mailing list<br>
<a href="mailto:gdal-dev@lists.osgeo.org" target="_blank" rel="noreferrer">gdal-dev@lists.osgeo.org</a><br>
<a href="https://lists.osgeo.org/mailman/listinfo/gdal-dev" rel="noreferrer noreferrer" target="_blank">https://lists.osgeo.org/mailman/listinfo/gdal-dev</a><br>
</blockquote></div><div><br clear="all"></div><div><br></div><span class="gmail_signature_prefix">-- </span><br><div dir="ltr" class="gmail_signature"><div dir="ltr">Michael Sumner<br>Research Software Engineer<br>Australian Antarctic Division<br>Hobart, Australia<br>e-mail: <a href="mailto:mdsumner@gmail.com" target="_blank" rel="noreferrer">mdsumner@gmail.com</a></div></div>
</blockquote></div>
</blockquote></div><div><br clear="all"></div><div><br></div><span class="gmail_signature_prefix">-- </span><br><div dir="ltr" class="gmail_signature"><div dir="ltr">Michael Sumner<br>Research Software Engineer<br>Australian Antarctic Division<br>Hobart, Australia<br>e-mail: <a href="mailto:mdsumner@gmail.com" target="_blank" rel="noreferrer">mdsumner@gmail.com</a></div></div>