[gdal-dev] Read error on large VRT files

[Armin Burger]

Hi all

I sometimes get read errors when trying to convert large input VRT files 
into a single BigTIFF file, typically applying an outsize of e.g. 50% or 
25%. Errors are like

ERROR 1: TIFFFillTile:Read error at row 11264, col 11264; got 46 by
tes, expected 84
ERROR 1: TIFFReadEncodedTile() failed.

ERROR 1: 2352/2592_BUCNFD.tif, band 1: IReadBlock failed at X offset 45, 
Y offset 47

The tile that returns the error can be converted alone without problems.
All together the number of tiles of the VRT can be towards 6000, having 
100 GB in total, tiles are LZW or Deflate compressed TIFF's.


Is there a possible source of errors when trying to read and convert 
VRT's of compressed TIFF of that size?

Thanks for any hint

Armin