[gdal-dev] Help with GDAL and HDF4 MODIS data
Christopher Mutel
cmutel at gmail.com
Fri May 18 12:57:10 EDT 2012
Frank-
Here is the dataset in the given images:
ftp://ftp.ntsg.umt.edu/pub/MODIS/Mirror/MOD16/MOD16A2_MONTHLY.MERRA_GMAO_1kmALB/Y2000/M01/MOD16A2.A2000M01.h12v12.105.2010357170459.hdf
However, I see the same behaviour with all the files in the directory:
ftp://ftp.ntsg.umt.edu/pub/MODIS/Mirror/MOD16/MOD16A2_MONTHLY.MERRA_GMAO_1kmALB/Y2000/M01/
Yours, Chris
On Fri, May 18, 2012 at 6:34 PM, Frank Warmerdam <warmerdam at pobox.com> wrote:
> Christopher,
>
> Can you provide a pointer to one of the hdf4 images giving problems?
>
> I don't see how this could relate to disabling netcdf support.
>
> Best regards,
>
> On Fri, May 18, 2012 at 8:54 AM, Christopher Mutel <cmutel at gmail.com> wrote:
>> Dear all-
>>
>> I am having trouble reading a HDF4 dataset using GDAL 1.9.0. The
>> datasets I am want to process come from the MODIS evapotranspiration
>> project (http://www.ntsg.umt.edu/project/mod16), and can be understood
>> correctly in e.g. HDFlook
>> (http://www-loa.univ-lille1.fr/Hdflook/hdflook_gb.html). They look
>> something like this:
>>
>> http://imgur.com/nw7ts
>>
>> The problem is that when GDAL opens a subdataset (any of the 4
>> possible ones), the resulting image data
>>
>> http://imgur.com/fILW2
>>
>> This effect happens using gdal_translate and the python bindings to
>> write the raw array data directly to a file. Basically, the lower
>> third of the image is fine; the next half of the image is masked
>> (given the nodata value); and the upper fifth, more peculiarly, has a
>> another section of the image repeated several times.
>>
>> I am using GDAL 1.9.0 installed through MacPorts. The supported
>> formats are listed below. The gdalinfo output is also below.
>>
>> My questions are:
>>
>> 1. Has anyone else experienced something like this? Is this fixable by
>> overriding some metadata in the gdal commands, or doing some other
>> transform?
>>
>> 2. Could this be related to the fact that I have NetCDF support enabled?
>> See e.g.
>> http://trac.osgeo.org/gdal/wiki/NetCDF
>> http://trac.osgeo.org/gdal/ticket/3957
>>
>> Any help would be greatly appreciated,
>> Yours,
>> Chris
>>
>> ===============
>> Supported Formats:
>> ===============
>> GRASS (ro): GRASS Database Rasters (5.7+)
>> VRT (rw+v): Virtual Raster
>> GTiff (rw+v): GeoTIFF
>> NITF (rw+v): National Imagery Transmission Format
>> RPFTOC (rov): Raster Product Format TOC format
>> ECRGTOC (rov): ECRG TOC format
>> HFA (rw+v): Erdas Imagine Images (.img)
>> SAR_CEOS (rov): CEOS SAR Image
>> CEOS (rov): CEOS Image
>> JAXAPALSAR (rov): JAXA PALSAR Product Reader (Level 1.1/1.5)
>> GFF (rov): Ground-based SAR Applications Testbed File Format (.gff)
>> ELAS (rw+v): ELAS
>> AIG (rov): Arc/Info Binary Grid
>> AAIGrid (rwv): Arc/Info ASCII Grid
>> GRASSASCIIGrid (rov): GRASS ASCII Grid
>> SDTS (rov): SDTS Raster
>> DTED (rwv): DTED Elevation Raster
>> PNG (rwv): Portable Network Graphics
>> JPEG (rwv): JPEG JFIF
>> MEM (rw+): In Memory Raster
>> JDEM (rov): Japanese DEM (.mem)
>> GIF (rwv): Graphics Interchange Format (.gif)
>> BIGGIF (rov): Graphics Interchange Format (.gif)
>> ESAT (ro): Envisat Image Format
>> XPM (rwv): X11 PixMap Format
>> BMP (rw+v): MS Windows Device Independent Bitmap
>> DIMAP (rov): SPOT DIMAP
>> AirSAR (ro): AirSAR Polarimetric Image
>> RS2 (ro): RadarSat 2 XML Product
>> PCIDSK (rw+v): PCIDSK Database File
>> ILWIS (rw+v): ILWIS Raster Map
>> SGI (rw+): SGI Image File Format 1.0
>> SRTMHGT (rwv): SRTMHGT File Format
>> Leveller (rw+): Leveller heightfield
>> Terragen (rw+): Terragen heightfield
>> GMT (rw): GMT NetCDF Grid Format
>> netCDF (rw+): Network Common Data Format
>> HDF4 (ro): Hierarchical Data Format Release 4
>> HDF4Image (rw+): HDF4 Dataset
>> ISIS3 (rov): USGS Astrogeology ISIS cube (Version 3)
>> ISIS2 (rw+v): USGS Astrogeology ISIS cube (Version 2)
>> PDS (rov): NASA Planetary Data System
>> TIL (rov): EarthWatch .TIL
>> ERS (rw+v): ERMapper .ers Labelled
>> L1B (rov): NOAA Polar Orbiter Level 1b Data Set
>> FIT (rwv): FIT Image
>> RMF (rw+v): Raster Matrix Format
>> WCS (rov): OGC Web Coverage Service
>> WMS (rwv): OGC Web Map Service
>> MSGN (ro): EUMETSAT Archive native (.nat)
>> RST (rw+v): Idrisi Raster A.1
>> INGR (rw+v): Intergraph Raster
>> GSAG (rwv): Golden Software ASCII Grid (.grd)
>> GSBG (rw+v): Golden Software Binary Grid (.grd)
>> GS7BG (rov): Golden Software 7 Binary Grid (.grd)
>> COSAR (ro): COSAR Annotated Binary Matrix (TerraSAR-X)
>> TSX (rov): TerraSAR-X Product
>> COASP (ro): DRDC COASP SAR Processor Raster
>> R (rwv): R Object Data Store
>> PNM (rw+v): Portable Pixmap Format (netpbm)
>> DOQ1 (rov): USGS DOQ (Old Style)
>> DOQ2 (rov): USGS DOQ (New Style)
>> ENVI (rw+v): ENVI .hdr Labelled
>> EHdr (rw+v): ESRI .hdr Labelled
>> GenBin (rov): Generic Binary (.hdr Labelled)
>> PAux (rw+): PCI .aux Labelled
>> MFF (rw+): Vexcel MFF Raster
>> MFF2 (rw+): Vexcel MFF2 (HKV) Raster
>> FujiBAS (ro): Fuji BAS Scanner Image
>> GSC (rov): GSC Geogrid
>> FAST (rov): EOSAT FAST Format
>> BT (rw+v): VTP .bt (Binary Terrain) 1.3 Format
>> LAN (rw+v): Erdas .LAN/.GIS
>> CPG (ro): Convair PolGASP
>> IDA (rw+): Image Data and Analysis
>> NDF (rov): NLAPS Data Format
>> EIR (rov): Erdas Imagine Raw
>> DIPEx (rov): DIPEx
>> LCP (rov): FARSITE v.4 Landscape File (.lcp)
>> GTX (rw+v): NOAA Vertical Datum .GTX
>> LOSLAS (rov): NADCON .los/.las Datum Grid Shift
>> NTv2 (rw+v): NTv2 Datum Grid Shift
>> ACE2 (rov): ACE2
>> SNODAS (rov): Snow Data Assimilation System
>> RIK (ro): Swedish Grid RIK (.rik)
>> USGSDEM (rwv): USGS Optional ASCII DEM (and CDED)
>> GXF (ro): GeoSoft Grid Exchange Format
>> HTTP (ro): HTTP Fetching Wrapper
>> BAG (ro): Bathymetry Attributed Grid
>> HDF5 (ro): Hierarchical Data Format Release 5
>> HDF5Image (ro): HDF5 Dataset
>> NWT_GRD (rov): Northwood Numeric Grid Format .grd/.tab
>> NWT_GRC (rov): Northwood Classified Grid Format .grc/.tab
>> ADRG (rw+v): ARC Digitized Raster Graphics
>> SRP (rov): Standard Raster Product (ASRP/USRP)
>> BLX (rw): Magellan topo (.blx)
>> PostGISRaster (ro): PostGIS Raster driver
>> SAGA (rw+v): SAGA GIS Binary Grid (.sdat)
>> KMLSUPEROVERLAY (rwv): Kml Super Overlay
>> XYZ (rwv): ASCII Gridded XYZ
>> HF2 (rwv): HF2/HFZ heightfield raster
>> OZI (rov): OziExplorer Image File
>> CTG (rov): USGS LULC Composite Theme Grid
>> E00GRID (rov): Arc/Info Export E00 GRID
>> ZMap (rwv): ZMap Plus Grid
>> NGSGEOID (rov): NOAA NGS Geoid Height Grids
>>
>> =======
>> gdalinfo
>> =======
>>
>> Driver: HDF4Image/HDF4 Dataset
>> Files: none associated
>> Size is 1200, 1200
>> Coordinate System is:
>> PROJCS["unnamed",
>> GEOGCS["Unknown datum based upon the custom spheroid",
>> DATUM["Not specified (based on custom spheroid)",
>> SPHEROID["Custom spheroid",6371007.181,0]],
>> PRIMEM["Greenwich",0],
>> UNIT["degree",0.0174532925199433]],
>> PROJECTION["Sinusoidal"],
>> PARAMETER["longitude_of_center",0],
>> PARAMETER["false_easting",0],
>> PARAMETER["false_northing",0],
>> UNIT["Meter",1]]
>> Origin = (-6671703.117999999783933,-3335851.558999999891967)
>> Pixel Size = (926.625433055833014,-926.625433055833355)
>> Metadata:
>> _FillValue=32767
>> add_offset=0
>> add_offset_err=0
>> Affi.=NTSG, School of Forestry, U. of MT
>> ALGORITHMPACKAGEACCEPTANCEDATE=10-01-2004
>> ALGORITHMPACKAGEMATURITYCODE=Normal
>> ALGORITHMPACKAGENAME=MODPR_15A2
>> ALGORITHMPACKAGEVERSION=5
>> ASSOCIATEDINSTRUMENTSHORTNAME=MODIS
>> ASSOCIATEDPLATFORMSHORTNAME=Terra
>> ASSOCIATEDSENSORSHORTNAME=MODIS
>> AUTOMATICQUALITYFLAG=Passed
>> AUTOMATICQUALITYFLAGEXPLANATION=No automatic quality assessment is
>> performed in the PGE
>> calibrated_nt=22
>> CHARACTERISTICBINANGULARSIZE=30.0
>> CHARACTERISTICBINSIZE=926.625433055556
>> DATACOLUMNS=1200
>> DATAROWS=1200
>> DAYNIGHTFLAG=Day
>> DESCRREVISION=5.0
>> EASTBOUNDINGCOORDINATE=-57.7254044077251
>> Email=qiaozhen at ntsg.umt.edu
>> EXCLUSIONGRINGFLAG=N
>> GEOANYABNORMAL=False
>> GEOESTMAXRMSERROR=50.0
>> GLOBALGRIDCOLUMNS=43200
>> GLOBALGRIDROWS=21600
>> GRANULEBEGINNINGDATETIME=2006-12-11T09:38:17.000Z
>> GRANULEDAYNIGHTFLAG=Day
>> GRANULEENDINGDATETIME=2006-12-11T09:38:17.000Z
>> GRINGPOINTLATITUDE=-39.9999999964079, -29.8506269556485,
>> -29.8879227550404, -40.0438107454138
>> GRINGPOINTLONGITUDE=-78.3244373487826, -69.2295648918179,
>> -57.4987926415755, -65.0468184138665
>> GRINGPOINTSEQUENCENO=1, 2, 3, 4
>> HDF-EOS file name=MOD16A2.A2000M01.h12v12.105.2010357170459.hdf
>> HDFEOSVersion=HDFEOS_V2.16
>> HORIZONTALTILENUMBER=12
>> INPUTPOINTER=MOD15A1.A2001008.h12v12.005.2006348070239.hdf,
>> MOD15A1.A2001007.h12v12.005.2006348001835.hdf,
>> MOD15A1.A2001006.h12v12.005.2006347202242.hdf,
>> MOD15A1.A2001005.h12v12.005.2006347152227.hdf,
>> MOD15A1.A2001004.h12v12.005.2006347093732.hdf,
>> MOD15A1.A2001003.h12v12.005.2006346135836.hdf,
>> MOD15A1.A2001002.h12v12.005.2006345172013.hdf,
>> MOD15A1.A2001001.h12v12.005.2006345093817.hdf, MOD15A2_ANC_RI4.hdf
>> LOCALGRANULEID=MOD15A2.A2001001.h12v12.005.2006351105708.hdf
>> LOCALVERSIONID=5.0.3
>> long_name=MOD16A2 -- MODIS Gridded 1KM monthly Composite potential
>> Evapotranspiration (ET)
>> LONGNAME=MODIS/Terra Leaf Area Index/FPAR 8-Day L4 Global 1km SIN Grid
>> Maker=Qiaozhen Mu
>> MAXIMUMOBSERVATIONS=1
>> MOD16 version=UM_collection5
>> NADIRDATARESOLUTION=1km
>> NDAYS_COMPOSITED=8
>> NORTHBOUNDINGCOORDINATE=-29.9999999973059
>> NUMBEROFGRANULES=1
>> PARAMETERNAME=MOD15A2
>> PGEVERSION=5.0.5
>> PROCESSINGCENTER=MODAPS
>> PROCESSINGENVIRONMENT=IRIX64 mtvs3 6.5 10070055 IP35
>> PRODUCTIONDATETIME=2006-12-17T10:57:08.000Z
>> QAPERCENTCLOUDCOVER=5
>> QAPERCENTEMPIRICALMODEL=2
>> QAPERCENTGOODFPAR=98
>> QAPERCENTGOODLAI=98
>> QAPERCENTGOODQUALITY=98
>> QAPERCENTINTERPOLATEDDATA=0
>> QAPERCENTMAINMETHOD=98
>> QAPERCENTMISSINGDATA=17
>> QAPERCENTOTHERQUALITY=100
>> QAPERCENTOUTOFBOUNDSDATA=17
>> RANGEBEGINNINGDATE=2001-01-01
>> RANGEBEGINNINGTIME=00:00:00
>> RANGEENDINGDATE=2001-01-08
>> RANGEENDINGTIME=23:59:59
>> REPROCESSINGACTUAL=reprocessed
>> REPROCESSINGPLANNED=further update is anticipated
>> scale_factor=0.1
>> scale_factor_err=0
>> SCIENCEQUALITYFLAG=Not Investigated
>> SCIENCEQUALITYFLAGEXPLANATION=See
>> http://landweb.nascom/nasa.gov/cgi-bin/QA_WWW/qaFlagPage.cgi?sat=terra
>> the product Science Quality status.
>> SHORTNAME=MOD15A2
>> SOUTHBOUNDINGCOORDINATE=-39.9999999964079
>> SPSOPARAMETERS=5367, 2680
>> SYSTEMFILENAME=MOD15A1.A2001008.h12v12.005.2006348070239.hdf,
>> MOD15A1.A2001007.h12v12.005.2006348001835.hdf,
>> MOD15A1.A2001006.h12v12.005.2006347202242.hdf,
>> MOD15A1.A2001005.h12v12.005.2006347152227.hdf,
>> MOD15A1.A2001004.h12v12.005.2006347093732.hdf,
>> MOD15A1.A2001003.h12v12.005.2006346135836.hdf,
>> MOD15A1.A2001002.h12v12.005.2006345172013.hdf,
>> MOD15A1.A2001001.h12v12.005.2006345093817.hdf
>> TileID=51012012
>> units=kg/m^2/mon
>> valid_range=-32767, 32700
>> VERSIONID=5
>> VERTICALTILENUMBER=12
>> Webpage=http://www.ntsg.umt.edu
>> WESTBOUNDINGCOORDINATE=-78.3244373487825
>> Corner Coordinates:
>> Upper Left (-6671703.118,-3335851.559) ( 69d16'55.32"W, 30d 0' 0.00"S)
>> Lower Left (-6671703.118,-4447802.079) ( 78d19'27.97"W, 40d 0' 0.00"S)
>> Upper Right (-5559752.598,-3335851.559) ( 57d44' 6.10"W, 30d 0' 0.00"S)
>> Lower Right (-5559752.598,-4447802.079) ( 65d16'13.31"W, 40d 0' 0.00"S)
>> Center (-6115727.858,-3891826.819) ( 67d 8'33.37"W, 35d 0' 0.00"S)
>> Band 1 Block=1200x833 Type=Int16, ColorInterp=Gray
>> Description = MOD16A2 -- MODIS Gridded 1KM monthly Composite
>> potential Evapotranspiration (ET)
>> NoData Value=32767
>> Unit Type: kg/m^2/mon
>> Offset: 0, Scale:0.1
>>
>> --
>> ############################
>> Chris Mutel
>> Ökologisches Systemdesign - Ecological Systems Design
>> Institut f.Umweltingenieurwissenschaften - Institute for Environmental
>> Engineering
>> ETH Zürich - HIF C 44 - Schafmattstr. 6
>> 8093 Zürich
>>
>> Telefon: +41 44 633 71 45 - Fax: +41 44 633 10 61
>> ############################
>> _______________________________________________
>> gdal-dev mailing list
>> gdal-dev at lists.osgeo.org
>> http://lists.osgeo.org/mailman/listinfo/gdal-dev
>
>
>
> --
> ---------------------------------------+--------------------------------------
> I set the clouds in motion - turn up | Frank Warmerdam, warmerdam at pobox.com
> light and sound - activate the windows | http://pobox.com/~warmerdam
> and watch the world go round - Rush | Geospatial Software Developer
--
############################
Chris Mutel
Ökologisches Systemdesign - Ecological Systems Design
Institut f.Umweltingenieurwissenschaften - Institute for Environmental
Engineering
ETH Zürich - HIF C 44 - Schafmattstr. 6
8093 Zürich
Telefon: +41 44 633 71 45 - Fax: +41 44 633 10 61
############################
More information about the gdal-dev
mailing list