[gdal-dev] Help with GDAL and HDF4 MODIS data
Etienne Tourigny
etourigny.dev at gmail.com
Fri May 18 13:07:36 EDT 2012
I can confirm the bug on linux 64bit. Please file a bug report and
attach a small dataset (<1MB) or whith the link you sent in your
second mail.
I suspect that the gdal hdf4 driver does not handle something spedific
in this hdf-eos dataset.
On Fri, May 18, 2012 at 12:54 PM, Christopher Mutel <cmutel at gmail.com> wrote:
> Dear all-
>
> I am having trouble reading a HDF4 dataset using GDAL 1.9.0. The
> datasets I am want to process come from the MODIS evapotranspiration
> project (http://www.ntsg.umt.edu/project/mod16), and can be understood
> correctly in e.g. HDFlook
> (http://www-loa.univ-lille1.fr/Hdflook/hdflook_gb.html). They look
> something like this:
>
> http://imgur.com/nw7ts
>
> The problem is that when GDAL opens a subdataset (any of the 4
> possible ones), the resulting image data
>
> http://imgur.com/fILW2
>
> This effect happens using gdal_translate and the python bindings to
> write the raw array data directly to a file. Basically, the lower
> third of the image is fine; the next half of the image is masked
> (given the nodata value); and the upper fifth, more peculiarly, has a
> another section of the image repeated several times.
>
> I am using GDAL 1.9.0 installed through MacPorts. The supported
> formats are listed below. The gdalinfo output is also below.
>
> My questions are:
>
> 1. Has anyone else experienced something like this? Is this fixable by
> overriding some metadata in the gdal commands, or doing some other
> transform?
>
> 2. Could this be related to the fact that I have NetCDF support enabled?
> See e.g.
> http://trac.osgeo.org/gdal/wiki/NetCDF
> http://trac.osgeo.org/gdal/ticket/3957
not at all, the hdf4 driver is opening the file and the netcdf does
not interfere:
Driver: HDF4Image/HDF4 Dataset
That bug report is about building gdal with hdf4 and netcdf (no one
else has confirmed that problem), not about using hdf4 and netcdf
drivers.
>
> Any help would be greatly appreciated,
> Yours,
> Chris
>
> ===============
> Supported Formats:
> ===============
> GRASS (ro): GRASS Database Rasters (5.7+)
> VRT (rw+v): Virtual Raster
> GTiff (rw+v): GeoTIFF
> NITF (rw+v): National Imagery Transmission Format
> RPFTOC (rov): Raster Product Format TOC format
> ECRGTOC (rov): ECRG TOC format
> HFA (rw+v): Erdas Imagine Images (.img)
> SAR_CEOS (rov): CEOS SAR Image
> CEOS (rov): CEOS Image
> JAXAPALSAR (rov): JAXA PALSAR Product Reader (Level 1.1/1.5)
> GFF (rov): Ground-based SAR Applications Testbed File Format (.gff)
> ELAS (rw+v): ELAS
> AIG (rov): Arc/Info Binary Grid
> AAIGrid (rwv): Arc/Info ASCII Grid
> GRASSASCIIGrid (rov): GRASS ASCII Grid
> SDTS (rov): SDTS Raster
> DTED (rwv): DTED Elevation Raster
> PNG (rwv): Portable Network Graphics
> JPEG (rwv): JPEG JFIF
> MEM (rw+): In Memory Raster
> JDEM (rov): Japanese DEM (.mem)
> GIF (rwv): Graphics Interchange Format (.gif)
> BIGGIF (rov): Graphics Interchange Format (.gif)
> ESAT (ro): Envisat Image Format
> XPM (rwv): X11 PixMap Format
> BMP (rw+v): MS Windows Device Independent Bitmap
> DIMAP (rov): SPOT DIMAP
> AirSAR (ro): AirSAR Polarimetric Image
> RS2 (ro): RadarSat 2 XML Product
> PCIDSK (rw+v): PCIDSK Database File
> ILWIS (rw+v): ILWIS Raster Map
> SGI (rw+): SGI Image File Format 1.0
> SRTMHGT (rwv): SRTMHGT File Format
> Leveller (rw+): Leveller heightfield
> Terragen (rw+): Terragen heightfield
> GMT (rw): GMT NetCDF Grid Format
> netCDF (rw+): Network Common Data Format
> HDF4 (ro): Hierarchical Data Format Release 4
> HDF4Image (rw+): HDF4 Dataset
> ISIS3 (rov): USGS Astrogeology ISIS cube (Version 3)
> ISIS2 (rw+v): USGS Astrogeology ISIS cube (Version 2)
> PDS (rov): NASA Planetary Data System
> TIL (rov): EarthWatch .TIL
> ERS (rw+v): ERMapper .ers Labelled
> L1B (rov): NOAA Polar Orbiter Level 1b Data Set
> FIT (rwv): FIT Image
> RMF (rw+v): Raster Matrix Format
> WCS (rov): OGC Web Coverage Service
> WMS (rwv): OGC Web Map Service
> MSGN (ro): EUMETSAT Archive native (.nat)
> RST (rw+v): Idrisi Raster A.1
> INGR (rw+v): Intergraph Raster
> GSAG (rwv): Golden Software ASCII Grid (.grd)
> GSBG (rw+v): Golden Software Binary Grid (.grd)
> GS7BG (rov): Golden Software 7 Binary Grid (.grd)
> COSAR (ro): COSAR Annotated Binary Matrix (TerraSAR-X)
> TSX (rov): TerraSAR-X Product
> COASP (ro): DRDC COASP SAR Processor Raster
> R (rwv): R Object Data Store
> PNM (rw+v): Portable Pixmap Format (netpbm)
> DOQ1 (rov): USGS DOQ (Old Style)
> DOQ2 (rov): USGS DOQ (New Style)
> ENVI (rw+v): ENVI .hdr Labelled
> EHdr (rw+v): ESRI .hdr Labelled
> GenBin (rov): Generic Binary (.hdr Labelled)
> PAux (rw+): PCI .aux Labelled
> MFF (rw+): Vexcel MFF Raster
> MFF2 (rw+): Vexcel MFF2 (HKV) Raster
> FujiBAS (ro): Fuji BAS Scanner Image
> GSC (rov): GSC Geogrid
> FAST (rov): EOSAT FAST Format
> BT (rw+v): VTP .bt (Binary Terrain) 1.3 Format
> LAN (rw+v): Erdas .LAN/.GIS
> CPG (ro): Convair PolGASP
> IDA (rw+): Image Data and Analysis
> NDF (rov): NLAPS Data Format
> EIR (rov): Erdas Imagine Raw
> DIPEx (rov): DIPEx
> LCP (rov): FARSITE v.4 Landscape File (.lcp)
> GTX (rw+v): NOAA Vertical Datum .GTX
> LOSLAS (rov): NADCON .los/.las Datum Grid Shift
> NTv2 (rw+v): NTv2 Datum Grid Shift
> ACE2 (rov): ACE2
> SNODAS (rov): Snow Data Assimilation System
> RIK (ro): Swedish Grid RIK (.rik)
> USGSDEM (rwv): USGS Optional ASCII DEM (and CDED)
> GXF (ro): GeoSoft Grid Exchange Format
> HTTP (ro): HTTP Fetching Wrapper
> BAG (ro): Bathymetry Attributed Grid
> HDF5 (ro): Hierarchical Data Format Release 5
> HDF5Image (ro): HDF5 Dataset
> NWT_GRD (rov): Northwood Numeric Grid Format .grd/.tab
> NWT_GRC (rov): Northwood Classified Grid Format .grc/.tab
> ADRG (rw+v): ARC Digitized Raster Graphics
> SRP (rov): Standard Raster Product (ASRP/USRP)
> BLX (rw): Magellan topo (.blx)
> PostGISRaster (ro): PostGIS Raster driver
> SAGA (rw+v): SAGA GIS Binary Grid (.sdat)
> KMLSUPEROVERLAY (rwv): Kml Super Overlay
> XYZ (rwv): ASCII Gridded XYZ
> HF2 (rwv): HF2/HFZ heightfield raster
> OZI (rov): OziExplorer Image File
> CTG (rov): USGS LULC Composite Theme Grid
> E00GRID (rov): Arc/Info Export E00 GRID
> ZMap (rwv): ZMap Plus Grid
> NGSGEOID (rov): NOAA NGS Geoid Height Grids
>
> =======
> gdalinfo
> =======
>
> Driver: HDF4Image/HDF4 Dataset
> Files: none associated
> Size is 1200, 1200
> Coordinate System is:
> PROJCS["unnamed",
> GEOGCS["Unknown datum based upon the custom spheroid",
> DATUM["Not specified (based on custom spheroid)",
> SPHEROID["Custom spheroid",6371007.181,0]],
> PRIMEM["Greenwich",0],
> UNIT["degree",0.0174532925199433]],
> PROJECTION["Sinusoidal"],
> PARAMETER["longitude_of_center",0],
> PARAMETER["false_easting",0],
> PARAMETER["false_northing",0],
> UNIT["Meter",1]]
> Origin = (-6671703.117999999783933,-3335851.558999999891967)
> Pixel Size = (926.625433055833014,-926.625433055833355)
> Metadata:
> _FillValue=32767
> add_offset=0
> add_offset_err=0
> Affi.=NTSG, School of Forestry, U. of MT
> ALGORITHMPACKAGEACCEPTANCEDATE=10-01-2004
> ALGORITHMPACKAGEMATURITYCODE=Normal
> ALGORITHMPACKAGENAME=MODPR_15A2
> ALGORITHMPACKAGEVERSION=5
> ASSOCIATEDINSTRUMENTSHORTNAME=MODIS
> ASSOCIATEDPLATFORMSHORTNAME=Terra
> ASSOCIATEDSENSORSHORTNAME=MODIS
> AUTOMATICQUALITYFLAG=Passed
> AUTOMATICQUALITYFLAGEXPLANATION=No automatic quality assessment is
> performed in the PGE
> calibrated_nt=22
> CHARACTERISTICBINANGULARSIZE=30.0
> CHARACTERISTICBINSIZE=926.625433055556
> DATACOLUMNS=1200
> DATAROWS=1200
> DAYNIGHTFLAG=Day
> DESCRREVISION=5.0
> EASTBOUNDINGCOORDINATE=-57.7254044077251
> Email=qiaozhen at ntsg.umt.edu
> EXCLUSIONGRINGFLAG=N
> GEOANYABNORMAL=False
> GEOESTMAXRMSERROR=50.0
> GLOBALGRIDCOLUMNS=43200
> GLOBALGRIDROWS=21600
> GRANULEBEGINNINGDATETIME=2006-12-11T09:38:17.000Z
> GRANULEDAYNIGHTFLAG=Day
> GRANULEENDINGDATETIME=2006-12-11T09:38:17.000Z
> GRINGPOINTLATITUDE=-39.9999999964079, -29.8506269556485,
> -29.8879227550404, -40.0438107454138
> GRINGPOINTLONGITUDE=-78.3244373487826, -69.2295648918179,
> -57.4987926415755, -65.0468184138665
> GRINGPOINTSEQUENCENO=1, 2, 3, 4
> HDF-EOS file name=MOD16A2.A2000M01.h12v12.105.2010357170459.hdf
> HDFEOSVersion=HDFEOS_V2.16
> HORIZONTALTILENUMBER=12
> INPUTPOINTER=MOD15A1.A2001008.h12v12.005.2006348070239.hdf,
> MOD15A1.A2001007.h12v12.005.2006348001835.hdf,
> MOD15A1.A2001006.h12v12.005.2006347202242.hdf,
> MOD15A1.A2001005.h12v12.005.2006347152227.hdf,
> MOD15A1.A2001004.h12v12.005.2006347093732.hdf,
> MOD15A1.A2001003.h12v12.005.2006346135836.hdf,
> MOD15A1.A2001002.h12v12.005.2006345172013.hdf,
> MOD15A1.A2001001.h12v12.005.2006345093817.hdf, MOD15A2_ANC_RI4.hdf
> LOCALGRANULEID=MOD15A2.A2001001.h12v12.005.2006351105708.hdf
> LOCALVERSIONID=5.0.3
> long_name=MOD16A2 -- MODIS Gridded 1KM monthly Composite potential
> Evapotranspiration (ET)
> LONGNAME=MODIS/Terra Leaf Area Index/FPAR 8-Day L4 Global 1km SIN Grid
> Maker=Qiaozhen Mu
> MAXIMUMOBSERVATIONS=1
> MOD16 version=UM_collection5
> NADIRDATARESOLUTION=1km
> NDAYS_COMPOSITED=8
> NORTHBOUNDINGCOORDINATE=-29.9999999973059
> NUMBEROFGRANULES=1
> PARAMETERNAME=MOD15A2
> PGEVERSION=5.0.5
> PROCESSINGCENTER=MODAPS
> PROCESSINGENVIRONMENT=IRIX64 mtvs3 6.5 10070055 IP35
> PRODUCTIONDATETIME=2006-12-17T10:57:08.000Z
> QAPERCENTCLOUDCOVER=5
> QAPERCENTEMPIRICALMODEL=2
> QAPERCENTGOODFPAR=98
> QAPERCENTGOODLAI=98
> QAPERCENTGOODQUALITY=98
> QAPERCENTINTERPOLATEDDATA=0
> QAPERCENTMAINMETHOD=98
> QAPERCENTMISSINGDATA=17
> QAPERCENTOTHERQUALITY=100
> QAPERCENTOUTOFBOUNDSDATA=17
> RANGEBEGINNINGDATE=2001-01-01
> RANGEBEGINNINGTIME=00:00:00
> RANGEENDINGDATE=2001-01-08
> RANGEENDINGTIME=23:59:59
> REPROCESSINGACTUAL=reprocessed
> REPROCESSINGPLANNED=further update is anticipated
> scale_factor=0.1
> scale_factor_err=0
> SCIENCEQUALITYFLAG=Not Investigated
> SCIENCEQUALITYFLAGEXPLANATION=See
> http://landweb.nascom/nasa.gov/cgi-bin/QA_WWW/qaFlagPage.cgi?sat=terra
> the product Science Quality status.
> SHORTNAME=MOD15A2
> SOUTHBOUNDINGCOORDINATE=-39.9999999964079
> SPSOPARAMETERS=5367, 2680
> SYSTEMFILENAME=MOD15A1.A2001008.h12v12.005.2006348070239.hdf,
> MOD15A1.A2001007.h12v12.005.2006348001835.hdf,
> MOD15A1.A2001006.h12v12.005.2006347202242.hdf,
> MOD15A1.A2001005.h12v12.005.2006347152227.hdf,
> MOD15A1.A2001004.h12v12.005.2006347093732.hdf,
> MOD15A1.A2001003.h12v12.005.2006346135836.hdf,
> MOD15A1.A2001002.h12v12.005.2006345172013.hdf,
> MOD15A1.A2001001.h12v12.005.2006345093817.hdf
> TileID=51012012
> units=kg/m^2/mon
> valid_range=-32767, 32700
> VERSIONID=5
> VERTICALTILENUMBER=12
> Webpage=http://www.ntsg.umt.edu
> WESTBOUNDINGCOORDINATE=-78.3244373487825
> Corner Coordinates:
> Upper Left (-6671703.118,-3335851.559) ( 69d16'55.32"W, 30d 0' 0.00"S)
> Lower Left (-6671703.118,-4447802.079) ( 78d19'27.97"W, 40d 0' 0.00"S)
> Upper Right (-5559752.598,-3335851.559) ( 57d44' 6.10"W, 30d 0' 0.00"S)
> Lower Right (-5559752.598,-4447802.079) ( 65d16'13.31"W, 40d 0' 0.00"S)
> Center (-6115727.858,-3891826.819) ( 67d 8'33.37"W, 35d 0' 0.00"S)
> Band 1 Block=1200x833 Type=Int16, ColorInterp=Gray
> Description = MOD16A2 -- MODIS Gridded 1KM monthly Composite
> potential Evapotranspiration (ET)
> NoData Value=32767
> Unit Type: kg/m^2/mon
> Offset: 0, Scale:0.1
>
> --
> ############################
> Chris Mutel
> Ökologisches Systemdesign - Ecological Systems Design
> Institut f.Umweltingenieurwissenschaften - Institute for Environmental
> Engineering
> ETH Zürich - HIF C 44 - Schafmattstr. 6
> 8093 Zürich
>
> Telefon: +41 44 633 71 45 - Fax: +41 44 633 10 61
> ############################
> _______________________________________________
> gdal-dev mailing list
> gdal-dev at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/gdal-dev
More information about the gdal-dev
mailing list