[gdal-dev] gdal_retile error

[Vasile Craciunescu]

Solved (I hope). Something I fail to mention in the first place: the 
drive where the tiles are processed is mounted through sshfs (physically 
the disk is incorporated in another server). After moving the data on a 
local drive, gdal_retile.py passed, without error, the 4151 tile limit. 
Currently, the tilling process is far from finish, but more than 8000 
tiles from level 0 were successfully written on disk. Definitively, 
somethings goes wrong when tiles are written through sshfs. But, this is 
not caused by a directory maximum file number limit (through other types 
of gdal scripting I generated 10000+ files in the same folder through 
sshfs).

Thank you for your help,
Vasile

On 3/8/11 3:16 PM, christian.mueller at nvoe.at wrote:
> Perhaps there is a resource limit for the number of the files in a
> directory.
>
> Try using
>
> -useDirForEachRow
>
> This builds another directory hierarchy with less files per directory.
>
>
>
> Quoting Vasile Craciunescu <vasile.craciunescu at gmail.com>:
>
>> Christian,
>>
>> The permissions are OK. 1-8 subdirs are created as soon as the command
>> is launched. The program stops after generating 10-15% of the level0
>> tiles.
>>
>> -Vasile
>>
>> On 3/8/11 10:13 AM, christian.mueller at nvoe.at wrote:
>>> Perhaps a problem with the file permissions ?
>>> After creating the tiles for level 0, the utility wants to create a
>>> subdir called "1" and store the tiles for level 1 in this subdir.
>>>
>>> Check this with your user. Make
>>> mkdir 1
>>> cd 1
>>> touch test.tif
>>> rm test.tif
>>>
>>>
>>>
>>>
>>> Quoting Vasile Craciunescu <vasile.craciunescu at gmail.com>:
>>>
>>>> Dear all,
>>>>
>>>> I'm trying to create tiled pyramids levels with gdal_retile.py. The
>>>> input is a 441671px x 311892px VRT collection (1615 JPEG compressed
>>>> GeoTiff files). The command is presented bellow:
>>>>
>>>> gdal_retile.py -levels 8 -ps 2048 2048 -r bilinear -v -co "TILED=YES"
>>>> -co "BLOCKXSIZE=256" -co COMPRESS=JPEG -s_srs EPSG:31700 -targetDir pt
>>>> merge.vrt
>>>>
>>>> This runs smoothly for a while (I manage to create 4151 tiles from
>>>> level 0). Then throws the following error:
>>>>
>>>> ERROR 1: TIFFOpen:2479.tif: Operation not permitted
>>>> Traceback (most recent call last):
>>>> File "/usr/bin/gdal_retile.py", line 1001, in <module>
>>>> sys.exit(main(sys.argv))
>>>> File "/usr/bin/gdal_retile.py", line 911, in main
>>>> dsCreatedTileIndex = tileImage(minfo,ti)
>>>> File "/usr/bin/gdal_retile.py", line 349, in tileImage
>>>> createTile(minfo, offsetX, offsetY, width, height,tilename,OGRDS)
>>>> File "/usr/bin/gdal_retile.py", line 494, in createTile
>>>> dec.uly+offsetY*dec.scaleY)
>>>> File "/usr/bin/gdal_retile.py", line 257, in getDataSet
>>>> t_band.WriteRaster(writeOffsetX,writeOffsetY,readX,readY,data )
>>>> File
>>>> "/usr/local/lib/python2.6/dist-packages/GDAL-1.8.0-py2.6-linux-i686.egg/osgeo/gdal.py",
>>>>
>>>> line 941, in
>>>> WriteRaster
>>>> return _gdal.Band_WriteRaster(self, *args, **kwargs)
>>>> TypeError: not a string
>>>>
>>>> After several attempts I decided to remove 2479.tif from VRT. The same
>>>> error is displayed when gdal_retile reach the next file (2579.tif). I
>>>> get this error on the following configuration.
>>>>
>>>> OS: Ubuntu server 10.10
>>>> GDAL: 1.8
>>>> Python: 2.6.5
>>>> Hardware: Dell PowerEdge 6650; 4 x Xeon 3.00Ghz dual core; 16GB DDR
>>>> SDRAM; 5 x 72GB SCSI + 4TB SATA
>>>>
>>>> Any clues?
>>>>
>>>> Regards,
>>>> Vasile
>>>> _______________________________________________
>>>> gdal-dev mailing list
>>>> gdal-dev at lists.osgeo.org
>>>> http://lists.osgeo.org/mailman/listinfo/gdal-dev
>>>
>>>
>>>
>>> ----------------------------------------------------------------
>>> This message was sent using IMP, the Internet Messaging Program.
>>>
>>>
>>>
>
>
>
> ----------------------------------------------------------------
> This message was sent using IMP, the Internet Messaging Program.
>
>
>