<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 70.85pt 70.85pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="FR" link="#0563C1" vlink="#954F72" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal"><span style="mso-fareast-language:EN-US">Kurt,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">I tried the latest version of NetCDF’s nccopy utility on your files and it also failed. Same with an old NetCDF v4.2/HDF5 v1.8.9 version.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">So the files seem wrong/corrupted for an unknow reason, or created with a specific NetCDF/HDF5 version which include a compatibility break.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">Did you get answer from NOAA?<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">I’m not sure if GDAL should handle this case (skip failed chunks and set them to nodata).<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">Best,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US">Julien<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b>De :</b> gdal-dev <gdal-dev-bounces@lists.osgeo.org> <b>De la part de</b> Kurt Schwehr<br>
<b>Envoyé :</b> mardi 12 janvier 2021 00:52<br>
<b>À :</b> gdal dev <gdal-dev@lists.osgeo.org><br>
<b>Objet :</b> [gdal-dev] netCDF chunk fetch failed<o:p></o:p></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">Hi all,<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">In a build of gdal 3.2.0, I'm seeing this error: "netCDF chunk fetch failed" for 2 out of 5 subdatasets. Is there an easy way to handle this so the bad data is returned as the nodata value? And also, any idea what is actually wrong with
the netcdf files?<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">I am in contact with the NOAA folks who made this data.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Thanks!<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">-kurt<o:p></o:p></p>
</div>
<div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">gsutil cp gs://gcp-public-data-goes-16/ABI-L2-FDCF/2017/263/21/OR_ABI-L2-FDCF-M3_G16_s20172632115407_e20172632126173_c20172632126283.nc .<br>
gsutil cp gs://gcp-public-data-goes-16/ABI-L2-FDCF/2018/123/12/OR_ABI-L2-FDCF-M3_G16_s20181231215382_e20181231226149_c20181231226258.nc .<br>
gsutil cp gs://gcp-public-data-goes-16/ABI-L2-FDCF/2018/324/18/OR_ABI-L2-FDCF-M3_G16_s20183241845341_e20183241856108_c20183241856213.nc .<br>
gsutil cp gs://gcp-public-data-goes-16/ABI-L2-FDCF/2020/247/16/OR_ABI-L2-FDCF-M6_G16_s20202471650186_e20202471659494_c20202471700318.nc .<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">for subdataset in Area Temp Mask Power DQF; do<br>
echo $subdataset<br>
(gdalinfo -stats NETCDF:OR_ABI-L2-FDCF-M3_G16_s20183241845341_e20183241856108_c20183241856213.nc:$subdataset | grep 'Band 1');<br>
done<br>
<br>
Area<br>
Warning 1: netCDFDataset::valid_range: min > max:<br>
min: 0.000000<br>
max: -6.000000<br>
<br>
ERROR 1: netCDF chunk fetch failed: #-101 (NetCDF: HDF error)<br>
ERROR 1: NETCDF:OR_ABI-L2-FDCF-M3_G16_s20183241845341_e20183241856108_c20183241856213.nc:Area, band 1: IReadBlock failed at X offset 19, Y offset 10: netCDF chunk fetch failed: #-101 (NetCDF: HDF error)<br>
Band 1 Block=226x226 Type=Int16, ColorInterp=Undefined<br>
Temp<br>
Warning 1: netCDFDataset::valid_range: min > max:<br>
min: 0.000000<br>
max: -6.000000<br>
Band 1 Block=226x226 Type=Int16, ColorInterp=Undefined<br>
Mask<br>
ERROR 1: netCDF chunk fetch failed: #-101 (NetCDF: HDF error)<br>
ERROR 1: NETCDF:OR_ABI-L2-FDCF-M3_G16_s20183241845341_e20183241856108_c20183241856213.nc:Mask, band 1: IReadBlock failed at X offset 4, Y offset 11: netCDF chunk fetch failed: #-101 (NetCDF: HDF error)<br>
Band 1 Block=226x226 Type=Int16, ColorInterp=Undefined<br>
Power<br>
Band 1 Block=226x226 Type=Float32, ColorInterp=Undefined<br>
DQF<br>
Band 1 Block=226x226 Type=Byte, ColorInterp=Undefined<o:p></o:p></p>
</div>
</div>
</div>
</body>
</html>