[gdal-dev] Help with GDAL and HDF4 MODIS data

Christopher Mutel cmutel at gmail.com
Fri May 18 11:54:02 EDT 2012


Dear all-

I am having trouble reading a HDF4 dataset using GDAL 1.9.0. The
datasets I am want to process come from the MODIS evapotranspiration
project (http://www.ntsg.umt.edu/project/mod16), and can be understood
correctly in e.g. HDFlook
(http://www-loa.univ-lille1.fr/Hdflook/hdflook_gb.html). They look
something like this:

http://imgur.com/nw7ts

The problem is that when GDAL opens a subdataset (any of the 4
possible ones), the resulting image data

http://imgur.com/fILW2

This effect happens using gdal_translate and the python bindings to
write the raw array data directly to a file. Basically, the lower
third of the image is fine; the next half of the image is masked
(given the nodata value); and the upper fifth, more peculiarly, has a
another section of the image repeated several times.

I am using GDAL 1.9.0 installed through MacPorts. The supported
formats are listed below. The gdalinfo output is also below.

My questions are:

1. Has anyone else experienced something like this? Is this fixable by
overriding some metadata in the gdal commands, or doing some other
transform?

2. Could this be related to the fact that I have NetCDF support enabled?
See e.g.
http://trac.osgeo.org/gdal/wiki/NetCDF
http://trac.osgeo.org/gdal/ticket/3957

Any help would be greatly appreciated,
Yours,
Chris

===============
Supported Formats:
===============
 GRASS (ro): GRASS Database Rasters (5.7+)
 VRT (rw+v): Virtual Raster
 GTiff (rw+v): GeoTIFF
 NITF (rw+v): National Imagery Transmission Format
 RPFTOC (rov): Raster Product Format TOC format
 ECRGTOC (rov): ECRG TOC format
 HFA (rw+v): Erdas Imagine Images (.img)
 SAR_CEOS (rov): CEOS SAR Image
 CEOS (rov): CEOS Image
 JAXAPALSAR (rov): JAXA PALSAR Product Reader (Level 1.1/1.5)
 GFF (rov): Ground-based SAR Applications Testbed File Format (.gff)
 ELAS (rw+v): ELAS
 AIG (rov): Arc/Info Binary Grid
 AAIGrid (rwv): Arc/Info ASCII Grid
 GRASSASCIIGrid (rov): GRASS ASCII Grid
 SDTS (rov): SDTS Raster
 DTED (rwv): DTED Elevation Raster
 PNG (rwv): Portable Network Graphics
 JPEG (rwv): JPEG JFIF
 MEM (rw+): In Memory Raster
 JDEM (rov): Japanese DEM (.mem)
 GIF (rwv): Graphics Interchange Format (.gif)
 BIGGIF (rov): Graphics Interchange Format (.gif)
 ESAT (ro): Envisat Image Format
 XPM (rwv): X11 PixMap Format
 BMP (rw+v): MS Windows Device Independent Bitmap
 DIMAP (rov): SPOT DIMAP
 AirSAR (ro): AirSAR Polarimetric Image
 RS2 (ro): RadarSat 2 XML Product
 PCIDSK (rw+v): PCIDSK Database File
 ILWIS (rw+v): ILWIS Raster Map
 SGI (rw+): SGI Image File Format 1.0
 SRTMHGT (rwv): SRTMHGT File Format
 Leveller (rw+): Leveller heightfield
 Terragen (rw+): Terragen heightfield
 GMT (rw): GMT NetCDF Grid Format
 netCDF (rw+): Network Common Data Format
 HDF4 (ro): Hierarchical Data Format Release 4
 HDF4Image (rw+): HDF4 Dataset
 ISIS3 (rov): USGS Astrogeology ISIS cube (Version 3)
 ISIS2 (rw+v): USGS Astrogeology ISIS cube (Version 2)
 PDS (rov): NASA Planetary Data System
 TIL (rov): EarthWatch .TIL
 ERS (rw+v): ERMapper .ers Labelled
 L1B (rov): NOAA Polar Orbiter Level 1b Data Set
 FIT (rwv): FIT Image
 RMF (rw+v): Raster Matrix Format
 WCS (rov): OGC Web Coverage Service
 WMS (rwv): OGC Web Map Service
 MSGN (ro): EUMETSAT Archive native (.nat)
 RST (rw+v): Idrisi Raster A.1
 INGR (rw+v): Intergraph Raster
 GSAG (rwv): Golden Software ASCII Grid (.grd)
 GSBG (rw+v): Golden Software Binary Grid (.grd)
 GS7BG (rov): Golden Software 7 Binary Grid (.grd)
 COSAR (ro): COSAR Annotated Binary Matrix (TerraSAR-X)
 TSX (rov): TerraSAR-X Product
 COASP (ro): DRDC COASP SAR Processor Raster
 R (rwv): R Object Data Store
 PNM (rw+v): Portable Pixmap Format (netpbm)
 DOQ1 (rov): USGS DOQ (Old Style)
 DOQ2 (rov): USGS DOQ (New Style)
 ENVI (rw+v): ENVI .hdr Labelled
 EHdr (rw+v): ESRI .hdr Labelled
 GenBin (rov): Generic Binary (.hdr Labelled)
 PAux (rw+): PCI .aux Labelled
 MFF (rw+): Vexcel MFF Raster
 MFF2 (rw+): Vexcel MFF2 (HKV) Raster
 FujiBAS (ro): Fuji BAS Scanner Image
 GSC (rov): GSC Geogrid
 FAST (rov): EOSAT FAST Format
 BT (rw+v): VTP .bt (Binary Terrain) 1.3 Format
 LAN (rw+v): Erdas .LAN/.GIS
 CPG (ro): Convair PolGASP
 IDA (rw+): Image Data and Analysis
 NDF (rov): NLAPS Data Format
 EIR (rov): Erdas Imagine Raw
 DIPEx (rov): DIPEx
 LCP (rov): FARSITE v.4 Landscape File (.lcp)
 GTX (rw+v): NOAA Vertical Datum .GTX
 LOSLAS (rov): NADCON .los/.las Datum Grid Shift
 NTv2 (rw+v): NTv2 Datum Grid Shift
 ACE2 (rov): ACE2
 SNODAS (rov): Snow Data Assimilation System
 RIK (ro): Swedish Grid RIK (.rik)
 USGSDEM (rwv): USGS Optional ASCII DEM (and CDED)
 GXF (ro): GeoSoft Grid Exchange Format
 HTTP (ro): HTTP Fetching Wrapper
 BAG (ro): Bathymetry Attributed Grid
 HDF5 (ro): Hierarchical Data Format Release 5
 HDF5Image (ro): HDF5 Dataset
 NWT_GRD (rov): Northwood Numeric Grid Format .grd/.tab
 NWT_GRC (rov): Northwood Classified Grid Format .grc/.tab
 ADRG (rw+v): ARC Digitized Raster Graphics
 SRP (rov): Standard Raster Product (ASRP/USRP)
 BLX (rw): Magellan topo (.blx)
 PostGISRaster (ro): PostGIS Raster driver
 SAGA (rw+v): SAGA GIS Binary Grid (.sdat)
 KMLSUPEROVERLAY (rwv): Kml Super Overlay
 XYZ (rwv): ASCII Gridded XYZ
 HF2 (rwv): HF2/HFZ heightfield raster
 OZI (rov): OziExplorer Image File
 CTG (rov): USGS LULC Composite Theme Grid
 E00GRID (rov): Arc/Info Export E00 GRID
 ZMap (rwv): ZMap Plus Grid
 NGSGEOID (rov): NOAA NGS Geoid Height Grids

=======
gdalinfo
=======

Driver: HDF4Image/HDF4 Dataset
Files: none associated
Size is 1200, 1200
Coordinate System is:
PROJCS["unnamed",
   GEOGCS["Unknown datum based upon the custom spheroid",
       DATUM["Not specified (based on custom spheroid)",
           SPHEROID["Custom spheroid",6371007.181,0]],
       PRIMEM["Greenwich",0],
       UNIT["degree",0.0174532925199433]],
   PROJECTION["Sinusoidal"],
   PARAMETER["longitude_of_center",0],
   PARAMETER["false_easting",0],
   PARAMETER["false_northing",0],
   UNIT["Meter",1]]
Origin = (-6671703.117999999783933,-3335851.558999999891967)
Pixel Size = (926.625433055833014,-926.625433055833355)
Metadata:
 _FillValue=32767
 add_offset=0
 add_offset_err=0
 Affi.=NTSG, School of Forestry, U. of MT
 ALGORITHMPACKAGEACCEPTANCEDATE=10-01-2004
 ALGORITHMPACKAGEMATURITYCODE=Normal
 ALGORITHMPACKAGENAME=MODPR_15A2
 ALGORITHMPACKAGEVERSION=5
 ASSOCIATEDINSTRUMENTSHORTNAME=MODIS
 ASSOCIATEDPLATFORMSHORTNAME=Terra
 ASSOCIATEDSENSORSHORTNAME=MODIS
 AUTOMATICQUALITYFLAG=Passed
 AUTOMATICQUALITYFLAGEXPLANATION=No automatic quality assessment is
performed in the PGE
 calibrated_nt=22
 CHARACTERISTICBINANGULARSIZE=30.0
 CHARACTERISTICBINSIZE=926.625433055556
 DATACOLUMNS=1200
 DATAROWS=1200
 DAYNIGHTFLAG=Day
 DESCRREVISION=5.0
 EASTBOUNDINGCOORDINATE=-57.7254044077251
 Email=qiaozhen at ntsg.umt.edu
 EXCLUSIONGRINGFLAG=N
 GEOANYABNORMAL=False
 GEOESTMAXRMSERROR=50.0
 GLOBALGRIDCOLUMNS=43200
 GLOBALGRIDROWS=21600
 GRANULEBEGINNINGDATETIME=2006-12-11T09:38:17.000Z
 GRANULEDAYNIGHTFLAG=Day
 GRANULEENDINGDATETIME=2006-12-11T09:38:17.000Z
 GRINGPOINTLATITUDE=-39.9999999964079, -29.8506269556485,
-29.8879227550404, -40.0438107454138
 GRINGPOINTLONGITUDE=-78.3244373487826, -69.2295648918179,
-57.4987926415755, -65.0468184138665
 GRINGPOINTSEQUENCENO=1, 2, 3, 4
 HDF-EOS file name=MOD16A2.A2000M01.h12v12.105.2010357170459.hdf
 HDFEOSVersion=HDFEOS_V2.16
 HORIZONTALTILENUMBER=12
 INPUTPOINTER=MOD15A1.A2001008.h12v12.005.2006348070239.hdf,
MOD15A1.A2001007.h12v12.005.2006348001835.hdf,
MOD15A1.A2001006.h12v12.005.2006347202242.hdf,
MOD15A1.A2001005.h12v12.005.2006347152227.hdf,
MOD15A1.A2001004.h12v12.005.2006347093732.hdf,
MOD15A1.A2001003.h12v12.005.2006346135836.hdf,
MOD15A1.A2001002.h12v12.005.2006345172013.hdf,
MOD15A1.A2001001.h12v12.005.2006345093817.hdf, MOD15A2_ANC_RI4.hdf
 LOCALGRANULEID=MOD15A2.A2001001.h12v12.005.2006351105708.hdf
 LOCALVERSIONID=5.0.3
 long_name=MOD16A2 -- MODIS Gridded 1KM monthly Composite potential
Evapotranspiration (ET)
 LONGNAME=MODIS/Terra Leaf Area Index/FPAR 8-Day L4 Global 1km SIN Grid
 Maker=Qiaozhen Mu
 MAXIMUMOBSERVATIONS=1
 MOD16 version=UM_collection5
 NADIRDATARESOLUTION=1km
 NDAYS_COMPOSITED=8
 NORTHBOUNDINGCOORDINATE=-29.9999999973059
 NUMBEROFGRANULES=1
 PARAMETERNAME=MOD15A2
 PGEVERSION=5.0.5
 PROCESSINGCENTER=MODAPS
 PROCESSINGENVIRONMENT=IRIX64 mtvs3 6.5 10070055 IP35
 PRODUCTIONDATETIME=2006-12-17T10:57:08.000Z
 QAPERCENTCLOUDCOVER=5
 QAPERCENTEMPIRICALMODEL=2
 QAPERCENTGOODFPAR=98
 QAPERCENTGOODLAI=98
 QAPERCENTGOODQUALITY=98
 QAPERCENTINTERPOLATEDDATA=0
 QAPERCENTMAINMETHOD=98
 QAPERCENTMISSINGDATA=17
 QAPERCENTOTHERQUALITY=100
 QAPERCENTOUTOFBOUNDSDATA=17
 RANGEBEGINNINGDATE=2001-01-01
 RANGEBEGINNINGTIME=00:00:00
 RANGEENDINGDATE=2001-01-08
 RANGEENDINGTIME=23:59:59
 REPROCESSINGACTUAL=reprocessed
 REPROCESSINGPLANNED=further update is anticipated
 scale_factor=0.1
 scale_factor_err=0
 SCIENCEQUALITYFLAG=Not Investigated
 SCIENCEQUALITYFLAGEXPLANATION=See
http://landweb.nascom/nasa.gov/cgi-bin/QA_WWW/qaFlagPage.cgi?sat=terra
the product Science Quality status.
 SHORTNAME=MOD15A2
 SOUTHBOUNDINGCOORDINATE=-39.9999999964079
 SPSOPARAMETERS=5367, 2680
 SYSTEMFILENAME=MOD15A1.A2001008.h12v12.005.2006348070239.hdf,
MOD15A1.A2001007.h12v12.005.2006348001835.hdf,
MOD15A1.A2001006.h12v12.005.2006347202242.hdf,
MOD15A1.A2001005.h12v12.005.2006347152227.hdf,
MOD15A1.A2001004.h12v12.005.2006347093732.hdf,
MOD15A1.A2001003.h12v12.005.2006346135836.hdf,
MOD15A1.A2001002.h12v12.005.2006345172013.hdf,
MOD15A1.A2001001.h12v12.005.2006345093817.hdf
 TileID=51012012
 units=kg/m^2/mon
 valid_range=-32767, 32700
 VERSIONID=5
 VERTICALTILENUMBER=12
 Webpage=http://www.ntsg.umt.edu
 WESTBOUNDINGCOORDINATE=-78.3244373487825
Corner Coordinates:
Upper Left  (-6671703.118,-3335851.559) ( 69d16'55.32"W, 30d 0' 0.00"S)
Lower Left  (-6671703.118,-4447802.079) ( 78d19'27.97"W, 40d 0' 0.00"S)
Upper Right (-5559752.598,-3335851.559) ( 57d44' 6.10"W, 30d 0' 0.00"S)
Lower Right (-5559752.598,-4447802.079) ( 65d16'13.31"W, 40d 0' 0.00"S)
Center      (-6115727.858,-3891826.819) ( 67d 8'33.37"W, 35d 0' 0.00"S)
Band 1 Block=1200x833 Type=Int16, ColorInterp=Gray
 Description = MOD16A2 -- MODIS Gridded 1KM monthly Composite
potential Evapotranspiration (ET)
 NoData Value=32767
 Unit Type: kg/m^2/mon
 Offset: 0,   Scale:0.1

--
############################
Chris Mutel
Ökologisches Systemdesign - Ecological Systems Design
Institut f.Umweltingenieurwissenschaften - Institute for Environmental
Engineering
ETH Zürich - HIF C 44 - Schafmattstr. 6
8093 Zürich

Telefon: +41 44 633 71 45 - Fax: +41 44 633 10 61
############################


More information about the gdal-dev mailing list