[gdal-dev] Help with GDAL and HDF4 MODIS data
Frank Warmerdam
warmerdam at pobox.com
Fri May 18 13:08:01 EDT 2012
Christopher,
I have no problem reproducing the problem. Please file a ticket
referencing this particular file. I'm going to look into it briefly
now but I don't want the issue lost track of so it is important to
have a ticket filed.
Best regards,
Frank
On Fri, May 18, 2012 at 9:57 AM, Christopher Mutel <cmutel at gmail.com> wrote:
> Frank-
>
> Here is the dataset in the given images:
>
> ftp://ftp.ntsg.umt.edu/pub/MODIS/Mirror/MOD16/MOD16A2_MONTHLY.MERRA_GMAO_1kmALB/Y2000/M01/MOD16A2.A2000M01.h12v12.105.2010357170459.hdf
>
> However, I see the same behaviour with all the files in the directory:
>
> ftp://ftp.ntsg.umt.edu/pub/MODIS/Mirror/MOD16/MOD16A2_MONTHLY.MERRA_GMAO_1kmALB/Y2000/M01/
>
> Yours, Chris
>
> On Fri, May 18, 2012 at 6:34 PM, Frank Warmerdam <warmerdam at pobox.com> wrote:
>> Christopher,
>>
>> Can you provide a pointer to one of the hdf4 images giving problems?
>>
>> I don't see how this could relate to disabling netcdf support.
>>
>> Best regards,
>>
>> On Fri, May 18, 2012 at 8:54 AM, Christopher Mutel <cmutel at gmail.com> wrote:
>>> Dear all-
>>>
>>> I am having trouble reading a HDF4 dataset using GDAL 1.9.0. The
>>> datasets I am want to process come from the MODIS evapotranspiration
>>> project (http://www.ntsg.umt.edu/project/mod16), and can be understood
>>> correctly in e.g. HDFlook
>>> (http://www-loa.univ-lille1.fr/Hdflook/hdflook_gb.html). They look
>>> something like this:
>>>
>>> http://imgur.com/nw7ts
>>>
>>> The problem is that when GDAL opens a subdataset (any of the 4
>>> possible ones), the resulting image data
>>>
>>> http://imgur.com/fILW2
>>>
>>> This effect happens using gdal_translate and the python bindings to
>>> write the raw array data directly to a file. Basically, the lower
>>> third of the image is fine; the next half of the image is masked
>>> (given the nodata value); and the upper fifth, more peculiarly, has a
>>> another section of the image repeated several times.
>>>
>>> I am using GDAL 1.9.0 installed through MacPorts. The supported
>>> formats are listed below. The gdalinfo output is also below.
>>>
>>> My questions are:
>>>
>>> 1. Has anyone else experienced something like this? Is this fixable by
>>> overriding some metadata in the gdal commands, or doing some other
>>> transform?
>>>
>>> 2. Could this be related to the fact that I have NetCDF support enabled?
>>> See e.g.
>>> http://trac.osgeo.org/gdal/wiki/NetCDF
>>> http://trac.osgeo.org/gdal/ticket/3957
>>>
>>> Any help would be greatly appreciated,
>>> Yours,
>>> Chris
>>>
>>> ===============
>>> Supported Formats:
>>> ===============
>>> GRASS (ro): GRASS Database Rasters (5.7+)
>>> VRT (rw+v): Virtual Raster
>>> GTiff (rw+v): GeoTIFF
>>> NITF (rw+v): National Imagery Transmission Format
>>> RPFTOC (rov): Raster Product Format TOC format
>>> ECRGTOC (rov): ECRG TOC format
>>> HFA (rw+v): Erdas Imagine Images (.img)
>>> SAR_CEOS (rov): CEOS SAR Image
>>> CEOS (rov): CEOS Image
>>> JAXAPALSAR (rov): JAXA PALSAR Product Reader (Level 1.1/1.5)
>>> GFF (rov): Ground-based SAR Applications Testbed File Format (.gff)
>>> ELAS (rw+v): ELAS
>>> AIG (rov): Arc/Info Binary Grid
>>> AAIGrid (rwv): Arc/Info ASCII Grid
>>> GRASSASCIIGrid (rov): GRASS ASCII Grid
>>> SDTS (rov): SDTS Raster
>>> DTED (rwv): DTED Elevation Raster
>>> PNG (rwv): Portable Network Graphics
>>> JPEG (rwv): JPEG JFIF
>>> MEM (rw+): In Memory Raster
>>> JDEM (rov): Japanese DEM (.mem)
>>> GIF (rwv): Graphics Interchange Format (.gif)
>>> BIGGIF (rov): Graphics Interchange Format (.gif)
>>> ESAT (ro): Envisat Image Format
>>> XPM (rwv): X11 PixMap Format
>>> BMP (rw+v): MS Windows Device Independent Bitmap
>>> DIMAP (rov): SPOT DIMAP
>>> AirSAR (ro): AirSAR Polarimetric Image
>>> RS2 (ro): RadarSat 2 XML Product
>>> PCIDSK (rw+v): PCIDSK Database File
>>> ILWIS (rw+v): ILWIS Raster Map
>>> SGI (rw+): SGI Image File Format 1.0
>>> SRTMHGT (rwv): SRTMHGT File Format
>>> Leveller (rw+): Leveller heightfield
>>> Terragen (rw+): Terragen heightfield
>>> GMT (rw): GMT NetCDF Grid Format
>>> netCDF (rw+): Network Common Data Format
>>> HDF4 (ro): Hierarchical Data Format Release 4
>>> HDF4Image (rw+): HDF4 Dataset
>>> ISIS3 (rov): USGS Astrogeology ISIS cube (Version 3)
>>> ISIS2 (rw+v): USGS Astrogeology ISIS cube (Version 2)
>>> PDS (rov): NASA Planetary Data System
>>> TIL (rov): EarthWatch .TIL
>>> ERS (rw+v): ERMapper .ers Labelled
>>> L1B (rov): NOAA Polar Orbiter Level 1b Data Set
>>> FIT (rwv): FIT Image
>>> RMF (rw+v): Raster Matrix Format
>>> WCS (rov): OGC Web Coverage Service
>>> WMS (rwv): OGC Web Map Service
>>> MSGN (ro): EUMETSAT Archive native (.nat)
>>> RST (rw+v): Idrisi Raster A.1
>>> INGR (rw+v): Intergraph Raster
>>> GSAG (rwv): Golden Software ASCII Grid (.grd)
>>> GSBG (rw+v): Golden Software Binary Grid (.grd)
>>> GS7BG (rov): Golden Software 7 Binary Grid (.grd)
>>> COSAR (ro): COSAR Annotated Binary Matrix (TerraSAR-X)
>>> TSX (rov): TerraSAR-X Product
>>> COASP (ro): DRDC COASP SAR Processor Raster
>>> R (rwv): R Object Data Store
>>> PNM (rw+v): Portable Pixmap Format (netpbm)
>>> DOQ1 (rov): USGS DOQ (Old Style)
>>> DOQ2 (rov): USGS DOQ (New Style)
>>> ENVI (rw+v): ENVI .hdr Labelled
>>> EHdr (rw+v): ESRI .hdr Labelled
>>> GenBin (rov): Generic Binary (.hdr Labelled)
>>> PAux (rw+): PCI .aux Labelled
>>> MFF (rw+): Vexcel MFF Raster
>>> MFF2 (rw+): Vexcel MFF2 (HKV) Raster
>>> FujiBAS (ro): Fuji BAS Scanner Image
>>> GSC (rov): GSC Geogrid
>>> FAST (rov): EOSAT FAST Format
>>> BT (rw+v): VTP .bt (Binary Terrain) 1.3 Format
>>> LAN (rw+v): Erdas .LAN/.GIS
>>> CPG (ro): Convair PolGASP
>>> IDA (rw+): Image Data and Analysis
>>> NDF (rov): NLAPS Data Format
>>> EIR (rov): Erdas Imagine Raw
>>> DIPEx (rov): DIPEx
>>> LCP (rov): FARSITE v.4 Landscape File (.lcp)
>>> GTX (rw+v): NOAA Vertical Datum .GTX
>>> LOSLAS (rov): NADCON .los/.las Datum Grid Shift
>>> NTv2 (rw+v): NTv2 Datum Grid Shift
>>> ACE2 (rov): ACE2
>>> SNODAS (rov): Snow Data Assimilation System
>>> RIK (ro): Swedish Grid RIK (.rik)
>>> USGSDEM (rwv): USGS Optional ASCII DEM (and CDED)
>>> GXF (ro): GeoSoft Grid Exchange Format
>>> HTTP (ro): HTTP Fetching Wrapper
>>> BAG (ro): Bathymetry Attributed Grid
>>> HDF5 (ro): Hierarchical Data Format Release 5
>>> HDF5Image (ro): HDF5 Dataset
>>> NWT_GRD (rov): Northwood Numeric Grid Format .grd/.tab
>>> NWT_GRC (rov): Northwood Classified Grid Format .grc/.tab
>>> ADRG (rw+v): ARC Digitized Raster Graphics
>>> SRP (rov): Standard Raster Product (ASRP/USRP)
>>> BLX (rw): Magellan topo (.blx)
>>> PostGISRaster (ro): PostGIS Raster driver
>>> SAGA (rw+v): SAGA GIS Binary Grid (.sdat)
>>> KMLSUPEROVERLAY (rwv): Kml Super Overlay
>>> XYZ (rwv): ASCII Gridded XYZ
>>> HF2 (rwv): HF2/HFZ heightfield raster
>>> OZI (rov): OziExplorer Image File
>>> CTG (rov): USGS LULC Composite Theme Grid
>>> E00GRID (rov): Arc/Info Export E00 GRID
>>> ZMap (rwv): ZMap Plus Grid
>>> NGSGEOID (rov): NOAA NGS Geoid Height Grids
>>>
>>> =======
>>> gdalinfo
>>> =======
>>>
>>> Driver: HDF4Image/HDF4 Dataset
>>> Files: none associated
>>> Size is 1200, 1200
>>> Coordinate System is:
>>> PROJCS["unnamed",
>>> GEOGCS["Unknown datum based upon the custom spheroid",
>>> DATUM["Not specified (based on custom spheroid)",
>>> SPHEROID["Custom spheroid",6371007.181,0]],
>>> PRIMEM["Greenwich",0],
>>> UNIT["degree",0.0174532925199433]],
>>> PROJECTION["Sinusoidal"],
>>> PARAMETER["longitude_of_center",0],
>>> PARAMETER["false_easting",0],
>>> PARAMETER["false_northing",0],
>>> UNIT["Meter",1]]
>>> Origin = (-6671703.117999999783933,-3335851.558999999891967)
>>> Pixel Size = (926.625433055833014,-926.625433055833355)
>>> Metadata:
>>> _FillValue=32767
>>> add_offset=0
>>> add_offset_err=0
>>> Affi.=NTSG, School of Forestry, U. of MT
>>> ALGORITHMPACKAGEACCEPTANCEDATE=10-01-2004
>>> ALGORITHMPACKAGEMATURITYCODE=Normal
>>> ALGORITHMPACKAGENAME=MODPR_15A2
>>> ALGORITHMPACKAGEVERSION=5
>>> ASSOCIATEDINSTRUMENTSHORTNAME=MODIS
>>> ASSOCIATEDPLATFORMSHORTNAME=Terra
>>> ASSOCIATEDSENSORSHORTNAME=MODIS
>>> AUTOMATICQUALITYFLAG=Passed
>>> AUTOMATICQUALITYFLAGEXPLANATION=No automatic quality assessment is
>>> performed in the PGE
>>> calibrated_nt=22
>>> CHARACTERISTICBINANGULARSIZE=30.0
>>> CHARACTERISTICBINSIZE=926.625433055556
>>> DATACOLUMNS=1200
>>> DATAROWS=1200
>>> DAYNIGHTFLAG=Day
>>> DESCRREVISION=5.0
>>> EASTBOUNDINGCOORDINATE=-57.7254044077251
>>> Email=qiaozhen at ntsg.umt.edu
>>> EXCLUSIONGRINGFLAG=N
>>> GEOANYABNORMAL=False
>>> GEOESTMAXRMSERROR=50.0
>>> GLOBALGRIDCOLUMNS=43200
>>> GLOBALGRIDROWS=21600
>>> GRANULEBEGINNINGDATETIME=2006-12-11T09:38:17.000Z
>>> GRANULEDAYNIGHTFLAG=Day
>>> GRANULEENDINGDATETIME=2006-12-11T09:38:17.000Z
>>> GRINGPOINTLATITUDE=-39.9999999964079, -29.8506269556485,
>>> -29.8879227550404, -40.0438107454138
>>> GRINGPOINTLONGITUDE=-78.3244373487826, -69.2295648918179,
>>> -57.4987926415755, -65.0468184138665
>>> GRINGPOINTSEQUENCENO=1, 2, 3, 4
>>> HDF-EOS file name=MOD16A2.A2000M01.h12v12.105.2010357170459.hdf
>>> HDFEOSVersion=HDFEOS_V2.16
>>> HORIZONTALTILENUMBER=12
>>> INPUTPOINTER=MOD15A1.A2001008.h12v12.005.2006348070239.hdf,
>>> MOD15A1.A2001007.h12v12.005.2006348001835.hdf,
>>> MOD15A1.A2001006.h12v12.005.2006347202242.hdf,
>>> MOD15A1.A2001005.h12v12.005.2006347152227.hdf,
>>> MOD15A1.A2001004.h12v12.005.2006347093732.hdf,
>>> MOD15A1.A2001003.h12v12.005.2006346135836.hdf,
>>> MOD15A1.A2001002.h12v12.005.2006345172013.hdf,
>>> MOD15A1.A2001001.h12v12.005.2006345093817.hdf, MOD15A2_ANC_RI4.hdf
>>> LOCALGRANULEID=MOD15A2.A2001001.h12v12.005.2006351105708.hdf
>>> LOCALVERSIONID=5.0.3
>>> long_name=MOD16A2 -- MODIS Gridded 1KM monthly Composite potential
>>> Evapotranspiration (ET)
>>> LONGNAME=MODIS/Terra Leaf Area Index/FPAR 8-Day L4 Global 1km SIN Grid
>>> Maker=Qiaozhen Mu
>>> MAXIMUMOBSERVATIONS=1
>>> MOD16 version=UM_collection5
>>> NADIRDATARESOLUTION=1km
>>> NDAYS_COMPOSITED=8
>>> NORTHBOUNDINGCOORDINATE=-29.9999999973059
>>> NUMBEROFGRANULES=1
>>> PARAMETERNAME=MOD15A2
>>> PGEVERSION=5.0.5
>>> PROCESSINGCENTER=MODAPS
>>> PROCESSINGENVIRONMENT=IRIX64 mtvs3 6.5 10070055 IP35
>>> PRODUCTIONDATETIME=2006-12-17T10:57:08.000Z
>>> QAPERCENTCLOUDCOVER=5
>>> QAPERCENTEMPIRICALMODEL=2
>>> QAPERCENTGOODFPAR=98
>>> QAPERCENTGOODLAI=98
>>> QAPERCENTGOODQUALITY=98
>>> QAPERCENTINTERPOLATEDDATA=0
>>> QAPERCENTMAINMETHOD=98
>>> QAPERCENTMISSINGDATA=17
>>> QAPERCENTOTHERQUALITY=100
>>> QAPERCENTOUTOFBOUNDSDATA=17
>>> RANGEBEGINNINGDATE=2001-01-01
>>> RANGEBEGINNINGTIME=00:00:00
>>> RANGEENDINGDATE=2001-01-08
>>> RANGEENDINGTIME=23:59:59
>>> REPROCESSINGACTUAL=reprocessed
>>> REPROCESSINGPLANNED=further update is anticipated
>>> scale_factor=0.1
>>> scale_factor_err=0
>>> SCIENCEQUALITYFLAG=Not Investigated
>>> SCIENCEQUALITYFLAGEXPLANATION=See
>>> http://landweb.nascom/nasa.gov/cgi-bin/QA_WWW/qaFlagPage.cgi?sat=terra
>>> the product Science Quality status.
>>> SHORTNAME=MOD15A2
>>> SOUTHBOUNDINGCOORDINATE=-39.9999999964079
>>> SPSOPARAMETERS=5367, 2680
>>> SYSTEMFILENAME=MOD15A1.A2001008.h12v12.005.2006348070239.hdf,
>>> MOD15A1.A2001007.h12v12.005.2006348001835.hdf,
>>> MOD15A1.A2001006.h12v12.005.2006347202242.hdf,
>>> MOD15A1.A2001005.h12v12.005.2006347152227.hdf,
>>> MOD15A1.A2001004.h12v12.005.2006347093732.hdf,
>>> MOD15A1.A2001003.h12v12.005.2006346135836.hdf,
>>> MOD15A1.A2001002.h12v12.005.2006345172013.hdf,
>>> MOD15A1.A2001001.h12v12.005.2006345093817.hdf
>>> TileID=51012012
>>> units=kg/m^2/mon
>>> valid_range=-32767, 32700
>>> VERSIONID=5
>>> VERTICALTILENUMBER=12
>>> Webpage=http://www.ntsg.umt.edu
>>> WESTBOUNDINGCOORDINATE=-78.3244373487825
>>> Corner Coordinates:
>>> Upper Left (-6671703.118,-3335851.559) ( 69d16'55.32"W, 30d 0' 0.00"S)
>>> Lower Left (-6671703.118,-4447802.079) ( 78d19'27.97"W, 40d 0' 0.00"S)
>>> Upper Right (-5559752.598,-3335851.559) ( 57d44' 6.10"W, 30d 0' 0.00"S)
>>> Lower Right (-5559752.598,-4447802.079) ( 65d16'13.31"W, 40d 0' 0.00"S)
>>> Center (-6115727.858,-3891826.819) ( 67d 8'33.37"W, 35d 0' 0.00"S)
>>> Band 1 Block=1200x833 Type=Int16, ColorInterp=Gray
>>> Description = MOD16A2 -- MODIS Gridded 1KM monthly Composite
>>> potential Evapotranspiration (ET)
>>> NoData Value=32767
>>> Unit Type: kg/m^2/mon
>>> Offset: 0, Scale:0.1
>>>
>>> --
>>> ############################
>>> Chris Mutel
>>> Ökologisches Systemdesign - Ecological Systems Design
>>> Institut f.Umweltingenieurwissenschaften - Institute for Environmental
>>> Engineering
>>> ETH Zürich - HIF C 44 - Schafmattstr. 6
>>> 8093 Zürich
>>>
>>> Telefon: +41 44 633 71 45 - Fax: +41 44 633 10 61
>>> ############################
>>> _______________________________________________
>>> gdal-dev mailing list
>>> gdal-dev at lists.osgeo.org
>>> http://lists.osgeo.org/mailman/listinfo/gdal-dev
>>
>>
>>
>> --
>> ---------------------------------------+--------------------------------------
>> I set the clouds in motion - turn up | Frank Warmerdam, warmerdam at pobox.com
>> light and sound - activate the windows | http://pobox.com/~warmerdam
>> and watch the world go round - Rush | Geospatial Software Developer
>
>
>
> --
> ############################
> Chris Mutel
> Ökologisches Systemdesign - Ecological Systems Design
> Institut f.Umweltingenieurwissenschaften - Institute for Environmental
> Engineering
> ETH Zürich - HIF C 44 - Schafmattstr. 6
> 8093 Zürich
>
> Telefon: +41 44 633 71 45 - Fax: +41 44 633 10 61
> ############################
> _______________________________________________
> gdal-dev mailing list
> gdal-dev at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/gdal-dev
--
---------------------------------------+--------------------------------------
I set the clouds in motion - turn up | Frank Warmerdam, warmerdam at pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush | Geospatial Software Developer
More information about the gdal-dev
mailing list