[gdal-dev] Help with GDAL and HDF4 MODIS data
Christopher Mutel
cmutel at gmail.com
Fri May 18 14:20:56 EDT 2012
Thanks Frank and Etienne-
Ticket filed here: http://trac.osgeo.org/gdal/ticket/4672
Yours,
Chris
On Fri, May 18, 2012 at 7:08 PM, Frank Warmerdam <warmerdam at pobox.com> wrote:
> Christopher,
>
> I have no problem reproducing the problem. Please file a ticket
> referencing this particular file. I'm going to look into it briefly
> now but I don't want the issue lost track of so it is important to
> have a ticket filed.
>
> Best regards,
> Frank
>
> On Fri, May 18, 2012 at 9:57 AM, Christopher Mutel <cmutel at gmail.com> wrote:
>> Frank-
>>
>> Here is the dataset in the given images:
>>
>> ftp://ftp.ntsg.umt.edu/pub/MODIS/Mirror/MOD16/MOD16A2_MONTHLY.MERRA_GMAO_1kmALB/Y2000/M01/MOD16A2.A2000M01.h12v12.105.2010357170459.hdf
>>
>> However, I see the same behaviour with all the files in the directory:
>>
>> ftp://ftp.ntsg.umt.edu/pub/MODIS/Mirror/MOD16/MOD16A2_MONTHLY.MERRA_GMAO_1kmALB/Y2000/M01/
>>
>> Yours, Chris
>>
>> On Fri, May 18, 2012 at 6:34 PM, Frank Warmerdam <warmerdam at pobox.com> wrote:
>>> Christopher,
>>>
>>> Can you provide a pointer to one of the hdf4 images giving problems?
>>>
>>> I don't see how this could relate to disabling netcdf support.
>>>
>>> Best regards,
>>>
>>> On Fri, May 18, 2012 at 8:54 AM, Christopher Mutel <cmutel at gmail.com> wrote:
>>>> Dear all-
>>>>
>>>> I am having trouble reading a HDF4 dataset using GDAL 1.9.0. The
>>>> datasets I am want to process come from the MODIS evapotranspiration
>>>> project (http://www.ntsg.umt.edu/project/mod16), and can be understood
>>>> correctly in e.g. HDFlook
>>>> (http://www-loa.univ-lille1.fr/Hdflook/hdflook_gb.html). They look
>>>> something like this:
>>>>
>>>> http://imgur.com/nw7ts
>>>>
>>>> The problem is that when GDAL opens a subdataset (any of the 4
>>>> possible ones), the resulting image data
>>>>
>>>> http://imgur.com/fILW2
>>>>
>>>> This effect happens using gdal_translate and the python bindings to
>>>> write the raw array data directly to a file. Basically, the lower
>>>> third of the image is fine; the next half of the image is masked
>>>> (given the nodata value); and the upper fifth, more peculiarly, has a
>>>> another section of the image repeated several times.
>>>>
>>>> I am using GDAL 1.9.0 installed through MacPorts. The supported
>>>> formats are listed below. The gdalinfo output is also below.
>>>>
>>>> My questions are:
>>>>
>>>> 1. Has anyone else experienced something like this? Is this fixable by
>>>> overriding some metadata in the gdal commands, or doing some other
>>>> transform?
>>>>
>>>> 2. Could this be related to the fact that I have NetCDF support enabled?
>>>> See e.g.
>>>> http://trac.osgeo.org/gdal/wiki/NetCDF
>>>> http://trac.osgeo.org/gdal/ticket/3957
>>>>
>>>> Any help would be greatly appreciated,
>>>> Yours,
>>>> Chris
>>>>
>>>> ===============
>>>> Supported Formats:
>>>> ===============
>>>> GRASS (ro): GRASS Database Rasters (5.7+)
>>>> VRT (rw+v): Virtual Raster
>>>> GTiff (rw+v): GeoTIFF
>>>> NITF (rw+v): National Imagery Transmission Format
>>>> RPFTOC (rov): Raster Product Format TOC format
>>>> ECRGTOC (rov): ECRG TOC format
>>>> HFA (rw+v): Erdas Imagine Images (.img)
>>>> SAR_CEOS (rov): CEOS SAR Image
>>>> CEOS (rov): CEOS Image
>>>> JAXAPALSAR (rov): JAXA PALSAR Product Reader (Level 1.1/1.5)
>>>> GFF (rov): Ground-based SAR Applications Testbed File Format (.gff)
>>>> ELAS (rw+v): ELAS
>>>> AIG (rov): Arc/Info Binary Grid
>>>> AAIGrid (rwv): Arc/Info ASCII Grid
>>>> GRASSASCIIGrid (rov): GRASS ASCII Grid
>>>> SDTS (rov): SDTS Raster
>>>> DTED (rwv): DTED Elevation Raster
>>>> PNG (rwv): Portable Network Graphics
>>>> JPEG (rwv): JPEG JFIF
>>>> MEM (rw+): In Memory Raster
>>>> JDEM (rov): Japanese DEM (.mem)
>>>> GIF (rwv): Graphics Interchange Format (.gif)
>>>> BIGGIF (rov): Graphics Interchange Format (.gif)
>>>> ESAT (ro): Envisat Image Format
>>>> XPM (rwv): X11 PixMap Format
>>>> BMP (rw+v): MS Windows Device Independent Bitmap
>>>> DIMAP (rov): SPOT DIMAP
>>>> AirSAR (ro): AirSAR Polarimetric Image
>>>> RS2 (ro): RadarSat 2 XML Product
>>>> PCIDSK (rw+v): PCIDSK Database File
>>>> ILWIS (rw+v): ILWIS Raster Map
>>>> SGI (rw+): SGI Image File Format 1.0
>>>> SRTMHGT (rwv): SRTMHGT File Format
>>>> Leveller (rw+): Leveller heightfield
>>>> Terragen (rw+): Terragen heightfield
>>>> GMT (rw): GMT NetCDF Grid Format
>>>> netCDF (rw+): Network Common Data Format
>>>> HDF4 (ro): Hierarchical Data Format Release 4
>>>> HDF4Image (rw+): HDF4 Dataset
>>>> ISIS3 (rov): USGS Astrogeology ISIS cube (Version 3)
>>>> ISIS2 (rw+v): USGS Astrogeology ISIS cube (Version 2)
>>>> PDS (rov): NASA Planetary Data System
>>>> TIL (rov): EarthWatch .TIL
>>>> ERS (rw+v): ERMapper .ers Labelled
>>>> L1B (rov): NOAA Polar Orbiter Level 1b Data Set
>>>> FIT (rwv): FIT Image
>>>> RMF (rw+v): Raster Matrix Format
>>>> WCS (rov): OGC Web Coverage Service
>>>> WMS (rwv): OGC Web Map Service
>>>> MSGN (ro): EUMETSAT Archive native (.nat)
>>>> RST (rw+v): Idrisi Raster A.1
>>>> INGR (rw+v): Intergraph Raster
>>>> GSAG (rwv): Golden Software ASCII Grid (.grd)
>>>> GSBG (rw+v): Golden Software Binary Grid (.grd)
>>>> GS7BG (rov): Golden Software 7 Binary Grid (.grd)
>>>> COSAR (ro): COSAR Annotated Binary Matrix (TerraSAR-X)
>>>> TSX (rov): TerraSAR-X Product
>>>> COASP (ro): DRDC COASP SAR Processor Raster
>>>> R (rwv): R Object Data Store
>>>> PNM (rw+v): Portable Pixmap Format (netpbm)
>>>> DOQ1 (rov): USGS DOQ (Old Style)
>>>> DOQ2 (rov): USGS DOQ (New Style)
>>>> ENVI (rw+v): ENVI .hdr Labelled
>>>> EHdr (rw+v): ESRI .hdr Labelled
>>>> GenBin (rov): Generic Binary (.hdr Labelled)
>>>> PAux (rw+): PCI .aux Labelled
>>>> MFF (rw+): Vexcel MFF Raster
>>>> MFF2 (rw+): Vexcel MFF2 (HKV) Raster
>>>> FujiBAS (ro): Fuji BAS Scanner Image
>>>> GSC (rov): GSC Geogrid
>>>> FAST (rov): EOSAT FAST Format
>>>> BT (rw+v): VTP .bt (Binary Terrain) 1.3 Format
>>>> LAN (rw+v): Erdas .LAN/.GIS
>>>> CPG (ro): Convair PolGASP
>>>> IDA (rw+): Image Data and Analysis
>>>> NDF (rov): NLAPS Data Format
>>>> EIR (rov): Erdas Imagine Raw
>>>> DIPEx (rov): DIPEx
>>>> LCP (rov): FARSITE v.4 Landscape File (.lcp)
>>>> GTX (rw+v): NOAA Vertical Datum .GTX
>>>> LOSLAS (rov): NADCON .los/.las Datum Grid Shift
>>>> NTv2 (rw+v): NTv2 Datum Grid Shift
>>>> ACE2 (rov): ACE2
>>>> SNODAS (rov): Snow Data Assimilation System
>>>> RIK (ro): Swedish Grid RIK (.rik)
>>>> USGSDEM (rwv): USGS Optional ASCII DEM (and CDED)
>>>> GXF (ro): GeoSoft Grid Exchange Format
>>>> HTTP (ro): HTTP Fetching Wrapper
>>>> BAG (ro): Bathymetry Attributed Grid
>>>> HDF5 (ro): Hierarchical Data Format Release 5
>>>> HDF5Image (ro): HDF5 Dataset
>>>> NWT_GRD (rov): Northwood Numeric Grid Format .grd/.tab
>>>> NWT_GRC (rov): Northwood Classified Grid Format .grc/.tab
>>>> ADRG (rw+v): ARC Digitized Raster Graphics
>>>> SRP (rov): Standard Raster Product (ASRP/USRP)
>>>> BLX (rw): Magellan topo (.blx)
>>>> PostGISRaster (ro): PostGIS Raster driver
>>>> SAGA (rw+v): SAGA GIS Binary Grid (.sdat)
>>>> KMLSUPEROVERLAY (rwv): Kml Super Overlay
>>>> XYZ (rwv): ASCII Gridded XYZ
>>>> HF2 (rwv): HF2/HFZ heightfield raster
>>>> OZI (rov): OziExplorer Image File
>>>> CTG (rov): USGS LULC Composite Theme Grid
>>>> E00GRID (rov): Arc/Info Export E00 GRID
>>>> ZMap (rwv): ZMap Plus Grid
>>>> NGSGEOID (rov): NOAA NGS Geoid Height Grids
>>>>
>>>> =======
>>>> gdalinfo
>>>> =======
>>>>
>>>> Driver: HDF4Image/HDF4 Dataset
>>>> Files: none associated
>>>> Size is 1200, 1200
>>>> Coordinate System is:
>>>> PROJCS["unnamed",
>>>> GEOGCS["Unknown datum based upon the custom spheroid",
>>>> DATUM["Not specified (based on custom spheroid)",
>>>> SPHEROID["Custom spheroid",6371007.181,0]],
>>>> PRIMEM["Greenwich",0],
>>>> UNIT["degree",0.0174532925199433]],
>>>> PROJECTION["Sinusoidal"],
>>>> PARAMETER["longitude_of_center",0],
>>>> PARAMETER["false_easting",0],
>>>> PARAMETER["false_northing",0],
>>>> UNIT["Meter",1]]
>>>> Origin = (-6671703.117999999783933,-3335851.558999999891967)
>>>> Pixel Size = (926.625433055833014,-926.625433055833355)
>>>> Metadata:
>>>> _FillValue=32767
>>>> add_offset=0
>>>> add_offset_err=0
>>>> Affi.=NTSG, School of Forestry, U. of MT
>>>> ALGORITHMPACKAGEACCEPTANCEDATE=10-01-2004
>>>> ALGORITHMPACKAGEMATURITYCODE=Normal
>>>> ALGORITHMPACKAGENAME=MODPR_15A2
>>>> ALGORITHMPACKAGEVERSION=5
>>>> ASSOCIATEDINSTRUMENTSHORTNAME=MODIS
>>>> ASSOCIATEDPLATFORMSHORTNAME=Terra
>>>> ASSOCIATEDSENSORSHORTNAME=MODIS
>>>> AUTOMATICQUALITYFLAG=Passed
>>>> AUTOMATICQUALITYFLAGEXPLANATION=No automatic quality assessment is
>>>> performed in the PGE
>>>> calibrated_nt=22
>>>> CHARACTERISTICBINANGULARSIZE=30.0
>>>> CHARACTERISTICBINSIZE=926.625433055556
>>>> DATACOLUMNS=1200
>>>> DATAROWS=1200
>>>> DAYNIGHTFLAG=Day
>>>> DESCRREVISION=5.0
>>>> EASTBOUNDINGCOORDINATE=-57.7254044077251
>>>> Email=qiaozhen at ntsg.umt.edu
>>>> EXCLUSIONGRINGFLAG=N
>>>> GEOANYABNORMAL=False
>>>> GEOESTMAXRMSERROR=50.0
>>>> GLOBALGRIDCOLUMNS=43200
>>>> GLOBALGRIDROWS=21600
>>>> GRANULEBEGINNINGDATETIME=2006-12-11T09:38:17.000Z
>>>> GRANULEDAYNIGHTFLAG=Day
>>>> GRANULEENDINGDATETIME=2006-12-11T09:38:17.000Z
>>>> GRINGPOINTLATITUDE=-39.9999999964079, -29.8506269556485,
>>>> -29.8879227550404, -40.0438107454138
>>>> GRINGPOINTLONGITUDE=-78.3244373487826, -69.2295648918179,
>>>> -57.4987926415755, -65.0468184138665
>>>> GRINGPOINTSEQUENCENO=1, 2, 3, 4
>>>> HDF-EOS file name=MOD16A2.A2000M01.h12v12.105.2010357170459.hdf
>>>> HDFEOSVersion=HDFEOS_V2.16
>>>> HORIZONTALTILENUMBER=12
>>>> INPUTPOINTER=MOD15A1.A2001008.h12v12.005.2006348070239.hdf,
>>>> MOD15A1.A2001007.h12v12.005.2006348001835.hdf,
>>>> MOD15A1.A2001006.h12v12.005.2006347202242.hdf,
>>>> MOD15A1.A2001005.h12v12.005.2006347152227.hdf,
>>>> MOD15A1.A2001004.h12v12.005.2006347093732.hdf,
>>>> MOD15A1.A2001003.h12v12.005.2006346135836.hdf,
>>>> MOD15A1.A2001002.h12v12.005.2006345172013.hdf,
>>>> MOD15A1.A2001001.h12v12.005.2006345093817.hdf, MOD15A2_ANC_RI4.hdf
>>>> LOCALGRANULEID=MOD15A2.A2001001.h12v12.005.2006351105708.hdf
>>>> LOCALVERSIONID=5.0.3
>>>> long_name=MOD16A2 -- MODIS Gridded 1KM monthly Composite potential
>>>> Evapotranspiration (ET)
>>>> LONGNAME=MODIS/Terra Leaf Area Index/FPAR 8-Day L4 Global 1km SIN Grid
>>>> Maker=Qiaozhen Mu
>>>> MAXIMUMOBSERVATIONS=1
>>>> MOD16 version=UM_collection5
>>>> NADIRDATARESOLUTION=1km
>>>> NDAYS_COMPOSITED=8
>>>> NORTHBOUNDINGCOORDINATE=-29.9999999973059
>>>> NUMBEROFGRANULES=1
>>>> PARAMETERNAME=MOD15A2
>>>> PGEVERSION=5.0.5
>>>> PROCESSINGCENTER=MODAPS
>>>> PROCESSINGENVIRONMENT=IRIX64 mtvs3 6.5 10070055 IP35
>>>> PRODUCTIONDATETIME=2006-12-17T10:57:08.000Z
>>>> QAPERCENTCLOUDCOVER=5
>>>> QAPERCENTEMPIRICALMODEL=2
>>>> QAPERCENTGOODFPAR=98
>>>> QAPERCENTGOODLAI=98
>>>> QAPERCENTGOODQUALITY=98
>>>> QAPERCENTINTERPOLATEDDATA=0
>>>> QAPERCENTMAINMETHOD=98
>>>> QAPERCENTMISSINGDATA=17
>>>> QAPERCENTOTHERQUALITY=100
>>>> QAPERCENTOUTOFBOUNDSDATA=17
>>>> RANGEBEGINNINGDATE=2001-01-01
>>>> RANGEBEGINNINGTIME=00:00:00
>>>> RANGEENDINGDATE=2001-01-08
>>>> RANGEENDINGTIME=23:59:59
>>>> REPROCESSINGACTUAL=reprocessed
>>>> REPROCESSINGPLANNED=further update is anticipated
>>>> scale_factor=0.1
>>>> scale_factor_err=0
>>>> SCIENCEQUALITYFLAG=Not Investigated
>>>> SCIENCEQUALITYFLAGEXPLANATION=See
>>>> http://landweb.nascom/nasa.gov/cgi-bin/QA_WWW/qaFlagPage.cgi?sat=terra
>>>> the product Science Quality status.
>>>> SHORTNAME=MOD15A2
>>>> SOUTHBOUNDINGCOORDINATE=-39.9999999964079
>>>> SPSOPARAMETERS=5367, 2680
>>>> SYSTEMFILENAME=MOD15A1.A2001008.h12v12.005.2006348070239.hdf,
>>>> MOD15A1.A2001007.h12v12.005.2006348001835.hdf,
>>>> MOD15A1.A2001006.h12v12.005.2006347202242.hdf,
>>>> MOD15A1.A2001005.h12v12.005.2006347152227.hdf,
>>>> MOD15A1.A2001004.h12v12.005.2006347093732.hdf,
>>>> MOD15A1.A2001003.h12v12.005.2006346135836.hdf,
>>>> MOD15A1.A2001002.h12v12.005.2006345172013.hdf,
>>>> MOD15A1.A2001001.h12v12.005.2006345093817.hdf
>>>> TileID=51012012
>>>> units=kg/m^2/mon
>>>> valid_range=-32767, 32700
>>>> VERSIONID=5
>>>> VERTICALTILENUMBER=12
>>>> Webpage=http://www.ntsg.umt.edu
>>>> WESTBOUNDINGCOORDINATE=-78.3244373487825
>>>> Corner Coordinates:
>>>> Upper Left (-6671703.118,-3335851.559) ( 69d16'55.32"W, 30d 0' 0.00"S)
>>>> Lower Left (-6671703.118,-4447802.079) ( 78d19'27.97"W, 40d 0' 0.00"S)
>>>> Upper Right (-5559752.598,-3335851.559) ( 57d44' 6.10"W, 30d 0' 0.00"S)
>>>> Lower Right (-5559752.598,-4447802.079) ( 65d16'13.31"W, 40d 0' 0.00"S)
>>>> Center (-6115727.858,-3891826.819) ( 67d 8'33.37"W, 35d 0' 0.00"S)
>>>> Band 1 Block=1200x833 Type=Int16, ColorInterp=Gray
>>>> Description = MOD16A2 -- MODIS Gridded 1KM monthly Composite
>>>> potential Evapotranspiration (ET)
>>>> NoData Value=32767
>>>> Unit Type: kg/m^2/mon
>>>> Offset: 0, Scale:0.1
>>>>
>>>> --
>>>> ############################
>>>> Chris Mutel
>>>> Ökologisches Systemdesign - Ecological Systems Design
>>>> Institut f.Umweltingenieurwissenschaften - Institute for Environmental
>>>> Engineering
>>>> ETH Zürich - HIF C 44 - Schafmattstr. 6
>>>> 8093 Zürich
>>>>
>>>> Telefon: +41 44 633 71 45 - Fax: +41 44 633 10 61
>>>> ############################
>>>> _______________________________________________
>>>> gdal-dev mailing list
>>>> gdal-dev at lists.osgeo.org
>>>> http://lists.osgeo.org/mailman/listinfo/gdal-dev
>>>
>>>
>>>
>>> --
>>> ---------------------------------------+--------------------------------------
>>> I set the clouds in motion - turn up | Frank Warmerdam, warmerdam at pobox.com
>>> light and sound - activate the windows | http://pobox.com/~warmerdam
>>> and watch the world go round - Rush | Geospatial Software Developer
>>
>>
>>
>> --
>> ############################
>> Chris Mutel
>> Ökologisches Systemdesign - Ecological Systems Design
>> Institut f.Umweltingenieurwissenschaften - Institute for Environmental
>> Engineering
>> ETH Zürich - HIF C 44 - Schafmattstr. 6
>> 8093 Zürich
>>
>> Telefon: +41 44 633 71 45 - Fax: +41 44 633 10 61
>> ############################
>> _______________________________________________
>> gdal-dev mailing list
>> gdal-dev at lists.osgeo.org
>> http://lists.osgeo.org/mailman/listinfo/gdal-dev
>
>
>
> --
> ---------------------------------------+--------------------------------------
> I set the clouds in motion - turn up | Frank Warmerdam, warmerdam at pobox.com
> light and sound - activate the windows | http://pobox.com/~warmerdam
> and watch the world go round - Rush | Geospatial Software Developer
--
############################
Chris Mutel
Ökologisches Systemdesign - Ecological Systems Design
Institut f.Umweltingenieurwissenschaften - Institute for Environmental
Engineering
ETH Zürich - HIF C 44 - Schafmattstr. 6
8093 Zürich
Telefon: +41 44 633 71 45 - Fax: +41 44 633 10 61
############################
More information about the gdal-dev
mailing list