[gdal-dev] Help with GDAL and HDF4 MODIS data

Christopher Mutel cmutel at gmail.com
Fri May 18 12:57:10 EDT 2012


Frank-

Here is the dataset in the given images:

ftp://ftp.ntsg.umt.edu/pub/MODIS/Mirror/MOD16/MOD16A2_MONTHLY.MERRA_GMAO_1kmALB/Y2000/M01/MOD16A2.A2000M01.h12v12.105.2010357170459.hdf

However, I see the same behaviour with all the files in the directory:

ftp://ftp.ntsg.umt.edu/pub/MODIS/Mirror/MOD16/MOD16A2_MONTHLY.MERRA_GMAO_1kmALB/Y2000/M01/

Yours, Chris

On Fri, May 18, 2012 at 6:34 PM, Frank Warmerdam <warmerdam at pobox.com> wrote:
> Christopher,
>
> Can you provide a pointer to one of the hdf4 images giving problems?
>
> I don't see how this could relate to disabling netcdf support.
>
> Best regards,
>
> On Fri, May 18, 2012 at 8:54 AM, Christopher Mutel <cmutel at gmail.com> wrote:
>> Dear all-
>>
>> I am having trouble reading a HDF4 dataset using GDAL 1.9.0. The
>> datasets I am want to process come from the MODIS evapotranspiration
>> project (http://www.ntsg.umt.edu/project/mod16), and can be understood
>> correctly in e.g. HDFlook
>> (http://www-loa.univ-lille1.fr/Hdflook/hdflook_gb.html). They look
>> something like this:
>>
>> http://imgur.com/nw7ts
>>
>> The problem is that when GDAL opens a subdataset (any of the 4
>> possible ones), the resulting image data
>>
>> http://imgur.com/fILW2
>>
>> This effect happens using gdal_translate and the python bindings to
>> write the raw array data directly to a file. Basically, the lower
>> third of the image is fine; the next half of the image is masked
>> (given the nodata value); and the upper fifth, more peculiarly, has a
>> another section of the image repeated several times.
>>
>> I am using GDAL 1.9.0 installed through MacPorts. The supported
>> formats are listed below. The gdalinfo output is also below.
>>
>> My questions are:
>>
>> 1. Has anyone else experienced something like this? Is this fixable by
>> overriding some metadata in the gdal commands, or doing some other
>> transform?
>>
>> 2. Could this be related to the fact that I have NetCDF support enabled?
>> See e.g.
>> http://trac.osgeo.org/gdal/wiki/NetCDF
>> http://trac.osgeo.org/gdal/ticket/3957
>>
>> Any help would be greatly appreciated,
>> Yours,
>> Chris
>>
>> ===============
>> Supported Formats:
>> ===============
>>  GRASS (ro): GRASS Database Rasters (5.7+)
>>  VRT (rw+v): Virtual Raster
>>  GTiff (rw+v): GeoTIFF
>>  NITF (rw+v): National Imagery Transmission Format
>>  RPFTOC (rov): Raster Product Format TOC format
>>  ECRGTOC (rov): ECRG TOC format
>>  HFA (rw+v): Erdas Imagine Images (.img)
>>  SAR_CEOS (rov): CEOS SAR Image
>>  CEOS (rov): CEOS Image
>>  JAXAPALSAR (rov): JAXA PALSAR Product Reader (Level 1.1/1.5)
>>  GFF (rov): Ground-based SAR Applications Testbed File Format (.gff)
>>  ELAS (rw+v): ELAS
>>  AIG (rov): Arc/Info Binary Grid
>>  AAIGrid (rwv): Arc/Info ASCII Grid
>>  GRASSASCIIGrid (rov): GRASS ASCII Grid
>>  SDTS (rov): SDTS Raster
>>  DTED (rwv): DTED Elevation Raster
>>  PNG (rwv): Portable Network Graphics
>>  JPEG (rwv): JPEG JFIF
>>  MEM (rw+): In Memory Raster
>>  JDEM (rov): Japanese DEM (.mem)
>>  GIF (rwv): Graphics Interchange Format (.gif)
>>  BIGGIF (rov): Graphics Interchange Format (.gif)
>>  ESAT (ro): Envisat Image Format
>>  XPM (rwv): X11 PixMap Format
>>  BMP (rw+v): MS Windows Device Independent Bitmap
>>  DIMAP (rov): SPOT DIMAP
>>  AirSAR (ro): AirSAR Polarimetric Image
>>  RS2 (ro): RadarSat 2 XML Product
>>  PCIDSK (rw+v): PCIDSK Database File
>>  ILWIS (rw+v): ILWIS Raster Map
>>  SGI (rw+): SGI Image File Format 1.0
>>  SRTMHGT (rwv): SRTMHGT File Format
>>  Leveller (rw+): Leveller heightfield
>>  Terragen (rw+): Terragen heightfield
>>  GMT (rw): GMT NetCDF Grid Format
>>  netCDF (rw+): Network Common Data Format
>>  HDF4 (ro): Hierarchical Data Format Release 4
>>  HDF4Image (rw+): HDF4 Dataset
>>  ISIS3 (rov): USGS Astrogeology ISIS cube (Version 3)
>>  ISIS2 (rw+v): USGS Astrogeology ISIS cube (Version 2)
>>  PDS (rov): NASA Planetary Data System
>>  TIL (rov): EarthWatch .TIL
>>  ERS (rw+v): ERMapper .ers Labelled
>>  L1B (rov): NOAA Polar Orbiter Level 1b Data Set
>>  FIT (rwv): FIT Image
>>  RMF (rw+v): Raster Matrix Format
>>  WCS (rov): OGC Web Coverage Service
>>  WMS (rwv): OGC Web Map Service
>>  MSGN (ro): EUMETSAT Archive native (.nat)
>>  RST (rw+v): Idrisi Raster A.1
>>  INGR (rw+v): Intergraph Raster
>>  GSAG (rwv): Golden Software ASCII Grid (.grd)
>>  GSBG (rw+v): Golden Software Binary Grid (.grd)
>>  GS7BG (rov): Golden Software 7 Binary Grid (.grd)
>>  COSAR (ro): COSAR Annotated Binary Matrix (TerraSAR-X)
>>  TSX (rov): TerraSAR-X Product
>>  COASP (ro): DRDC COASP SAR Processor Raster
>>  R (rwv): R Object Data Store
>>  PNM (rw+v): Portable Pixmap Format (netpbm)
>>  DOQ1 (rov): USGS DOQ (Old Style)
>>  DOQ2 (rov): USGS DOQ (New Style)
>>  ENVI (rw+v): ENVI .hdr Labelled
>>  EHdr (rw+v): ESRI .hdr Labelled
>>  GenBin (rov): Generic Binary (.hdr Labelled)
>>  PAux (rw+): PCI .aux Labelled
>>  MFF (rw+): Vexcel MFF Raster
>>  MFF2 (rw+): Vexcel MFF2 (HKV) Raster
>>  FujiBAS (ro): Fuji BAS Scanner Image
>>  GSC (rov): GSC Geogrid
>>  FAST (rov): EOSAT FAST Format
>>  BT (rw+v): VTP .bt (Binary Terrain) 1.3 Format
>>  LAN (rw+v): Erdas .LAN/.GIS
>>  CPG (ro): Convair PolGASP
>>  IDA (rw+): Image Data and Analysis
>>  NDF (rov): NLAPS Data Format
>>  EIR (rov): Erdas Imagine Raw
>>  DIPEx (rov): DIPEx
>>  LCP (rov): FARSITE v.4 Landscape File (.lcp)
>>  GTX (rw+v): NOAA Vertical Datum .GTX
>>  LOSLAS (rov): NADCON .los/.las Datum Grid Shift
>>  NTv2 (rw+v): NTv2 Datum Grid Shift
>>  ACE2 (rov): ACE2
>>  SNODAS (rov): Snow Data Assimilation System
>>  RIK (ro): Swedish Grid RIK (.rik)
>>  USGSDEM (rwv): USGS Optional ASCII DEM (and CDED)
>>  GXF (ro): GeoSoft Grid Exchange Format
>>  HTTP (ro): HTTP Fetching Wrapper
>>  BAG (ro): Bathymetry Attributed Grid
>>  HDF5 (ro): Hierarchical Data Format Release 5
>>  HDF5Image (ro): HDF5 Dataset
>>  NWT_GRD (rov): Northwood Numeric Grid Format .grd/.tab
>>  NWT_GRC (rov): Northwood Classified Grid Format .grc/.tab
>>  ADRG (rw+v): ARC Digitized Raster Graphics
>>  SRP (rov): Standard Raster Product (ASRP/USRP)
>>  BLX (rw): Magellan topo (.blx)
>>  PostGISRaster (ro): PostGIS Raster driver
>>  SAGA (rw+v): SAGA GIS Binary Grid (.sdat)
>>  KMLSUPEROVERLAY (rwv): Kml Super Overlay
>>  XYZ (rwv): ASCII Gridded XYZ
>>  HF2 (rwv): HF2/HFZ heightfield raster
>>  OZI (rov): OziExplorer Image File
>>  CTG (rov): USGS LULC Composite Theme Grid
>>  E00GRID (rov): Arc/Info Export E00 GRID
>>  ZMap (rwv): ZMap Plus Grid
>>  NGSGEOID (rov): NOAA NGS Geoid Height Grids
>>
>> =======
>> gdalinfo
>> =======
>>
>> Driver: HDF4Image/HDF4 Dataset
>> Files: none associated
>> Size is 1200, 1200
>> Coordinate System is:
>> PROJCS["unnamed",
>>    GEOGCS["Unknown datum based upon the custom spheroid",
>>        DATUM["Not specified (based on custom spheroid)",
>>            SPHEROID["Custom spheroid",6371007.181,0]],
>>        PRIMEM["Greenwich",0],
>>        UNIT["degree",0.0174532925199433]],
>>    PROJECTION["Sinusoidal"],
>>    PARAMETER["longitude_of_center",0],
>>    PARAMETER["false_easting",0],
>>    PARAMETER["false_northing",0],
>>    UNIT["Meter",1]]
>> Origin = (-6671703.117999999783933,-3335851.558999999891967)
>> Pixel Size = (926.625433055833014,-926.625433055833355)
>> Metadata:
>>  _FillValue=32767
>>  add_offset=0
>>  add_offset_err=0
>>  Affi.=NTSG, School of Forestry, U. of MT
>>  ALGORITHMPACKAGEACCEPTANCEDATE=10-01-2004
>>  ALGORITHMPACKAGEMATURITYCODE=Normal
>>  ALGORITHMPACKAGENAME=MODPR_15A2
>>  ALGORITHMPACKAGEVERSION=5
>>  ASSOCIATEDINSTRUMENTSHORTNAME=MODIS
>>  ASSOCIATEDPLATFORMSHORTNAME=Terra
>>  ASSOCIATEDSENSORSHORTNAME=MODIS
>>  AUTOMATICQUALITYFLAG=Passed
>>  AUTOMATICQUALITYFLAGEXPLANATION=No automatic quality assessment is
>> performed in the PGE
>>  calibrated_nt=22
>>  CHARACTERISTICBINANGULARSIZE=30.0
>>  CHARACTERISTICBINSIZE=926.625433055556
>>  DATACOLUMNS=1200
>>  DATAROWS=1200
>>  DAYNIGHTFLAG=Day
>>  DESCRREVISION=5.0
>>  EASTBOUNDINGCOORDINATE=-57.7254044077251
>>  Email=qiaozhen at ntsg.umt.edu
>>  EXCLUSIONGRINGFLAG=N
>>  GEOANYABNORMAL=False
>>  GEOESTMAXRMSERROR=50.0
>>  GLOBALGRIDCOLUMNS=43200
>>  GLOBALGRIDROWS=21600
>>  GRANULEBEGINNINGDATETIME=2006-12-11T09:38:17.000Z
>>  GRANULEDAYNIGHTFLAG=Day
>>  GRANULEENDINGDATETIME=2006-12-11T09:38:17.000Z
>>  GRINGPOINTLATITUDE=-39.9999999964079, -29.8506269556485,
>> -29.8879227550404, -40.0438107454138
>>  GRINGPOINTLONGITUDE=-78.3244373487826, -69.2295648918179,
>> -57.4987926415755, -65.0468184138665
>>  GRINGPOINTSEQUENCENO=1, 2, 3, 4
>>  HDF-EOS file name=MOD16A2.A2000M01.h12v12.105.2010357170459.hdf
>>  HDFEOSVersion=HDFEOS_V2.16
>>  HORIZONTALTILENUMBER=12
>>  INPUTPOINTER=MOD15A1.A2001008.h12v12.005.2006348070239.hdf,
>> MOD15A1.A2001007.h12v12.005.2006348001835.hdf,
>> MOD15A1.A2001006.h12v12.005.2006347202242.hdf,
>> MOD15A1.A2001005.h12v12.005.2006347152227.hdf,
>> MOD15A1.A2001004.h12v12.005.2006347093732.hdf,
>> MOD15A1.A2001003.h12v12.005.2006346135836.hdf,
>> MOD15A1.A2001002.h12v12.005.2006345172013.hdf,
>> MOD15A1.A2001001.h12v12.005.2006345093817.hdf, MOD15A2_ANC_RI4.hdf
>>  LOCALGRANULEID=MOD15A2.A2001001.h12v12.005.2006351105708.hdf
>>  LOCALVERSIONID=5.0.3
>>  long_name=MOD16A2 -- MODIS Gridded 1KM monthly Composite potential
>> Evapotranspiration (ET)
>>  LONGNAME=MODIS/Terra Leaf Area Index/FPAR 8-Day L4 Global 1km SIN Grid
>>  Maker=Qiaozhen Mu
>>  MAXIMUMOBSERVATIONS=1
>>  MOD16 version=UM_collection5
>>  NADIRDATARESOLUTION=1km
>>  NDAYS_COMPOSITED=8
>>  NORTHBOUNDINGCOORDINATE=-29.9999999973059
>>  NUMBEROFGRANULES=1
>>  PARAMETERNAME=MOD15A2
>>  PGEVERSION=5.0.5
>>  PROCESSINGCENTER=MODAPS
>>  PROCESSINGENVIRONMENT=IRIX64 mtvs3 6.5 10070055 IP35
>>  PRODUCTIONDATETIME=2006-12-17T10:57:08.000Z
>>  QAPERCENTCLOUDCOVER=5
>>  QAPERCENTEMPIRICALMODEL=2
>>  QAPERCENTGOODFPAR=98
>>  QAPERCENTGOODLAI=98
>>  QAPERCENTGOODQUALITY=98
>>  QAPERCENTINTERPOLATEDDATA=0
>>  QAPERCENTMAINMETHOD=98
>>  QAPERCENTMISSINGDATA=17
>>  QAPERCENTOTHERQUALITY=100
>>  QAPERCENTOUTOFBOUNDSDATA=17
>>  RANGEBEGINNINGDATE=2001-01-01
>>  RANGEBEGINNINGTIME=00:00:00
>>  RANGEENDINGDATE=2001-01-08
>>  RANGEENDINGTIME=23:59:59
>>  REPROCESSINGACTUAL=reprocessed
>>  REPROCESSINGPLANNED=further update is anticipated
>>  scale_factor=0.1
>>  scale_factor_err=0
>>  SCIENCEQUALITYFLAG=Not Investigated
>>  SCIENCEQUALITYFLAGEXPLANATION=See
>> http://landweb.nascom/nasa.gov/cgi-bin/QA_WWW/qaFlagPage.cgi?sat=terra
>> the product Science Quality status.
>>  SHORTNAME=MOD15A2
>>  SOUTHBOUNDINGCOORDINATE=-39.9999999964079
>>  SPSOPARAMETERS=5367, 2680
>>  SYSTEMFILENAME=MOD15A1.A2001008.h12v12.005.2006348070239.hdf,
>> MOD15A1.A2001007.h12v12.005.2006348001835.hdf,
>> MOD15A1.A2001006.h12v12.005.2006347202242.hdf,
>> MOD15A1.A2001005.h12v12.005.2006347152227.hdf,
>> MOD15A1.A2001004.h12v12.005.2006347093732.hdf,
>> MOD15A1.A2001003.h12v12.005.2006346135836.hdf,
>> MOD15A1.A2001002.h12v12.005.2006345172013.hdf,
>> MOD15A1.A2001001.h12v12.005.2006345093817.hdf
>>  TileID=51012012
>>  units=kg/m^2/mon
>>  valid_range=-32767, 32700
>>  VERSIONID=5
>>  VERTICALTILENUMBER=12
>>  Webpage=http://www.ntsg.umt.edu
>>  WESTBOUNDINGCOORDINATE=-78.3244373487825
>> Corner Coordinates:
>> Upper Left  (-6671703.118,-3335851.559) ( 69d16'55.32"W, 30d 0' 0.00"S)
>> Lower Left  (-6671703.118,-4447802.079) ( 78d19'27.97"W, 40d 0' 0.00"S)
>> Upper Right (-5559752.598,-3335851.559) ( 57d44' 6.10"W, 30d 0' 0.00"S)
>> Lower Right (-5559752.598,-4447802.079) ( 65d16'13.31"W, 40d 0' 0.00"S)
>> Center      (-6115727.858,-3891826.819) ( 67d 8'33.37"W, 35d 0' 0.00"S)
>> Band 1 Block=1200x833 Type=Int16, ColorInterp=Gray
>>  Description = MOD16A2 -- MODIS Gridded 1KM monthly Composite
>> potential Evapotranspiration (ET)
>>  NoData Value=32767
>>  Unit Type: kg/m^2/mon
>>  Offset: 0,   Scale:0.1
>>
>> --
>> ############################
>> Chris Mutel
>> Ökologisches Systemdesign - Ecological Systems Design
>> Institut f.Umweltingenieurwissenschaften - Institute for Environmental
>> Engineering
>> ETH Zürich - HIF C 44 - Schafmattstr. 6
>> 8093 Zürich
>>
>> Telefon: +41 44 633 71 45 - Fax: +41 44 633 10 61
>> ############################
>> _______________________________________________
>> gdal-dev mailing list
>> gdal-dev at lists.osgeo.org
>> http://lists.osgeo.org/mailman/listinfo/gdal-dev
>
>
>
> --
> ---------------------------------------+--------------------------------------
> I set the clouds in motion - turn up   | Frank Warmerdam, warmerdam at pobox.com
> light and sound - activate the windows | http://pobox.com/~warmerdam
> and watch the world go round - Rush    | Geospatial Software Developer



-- 
############################
Chris Mutel
Ökologisches Systemdesign - Ecological Systems Design
Institut f.Umweltingenieurwissenschaften - Institute for Environmental
Engineering
ETH Zürich - HIF C 44 - Schafmattstr. 6
8093 Zürich

Telefon: +41 44 633 71 45 - Fax: +41 44 633 10 61
############################


More information about the gdal-dev mailing list