[gdal-dev] Ogr2ogr taking too much time to process a MapInfo TAB file

Even Rouault even.rouault at spatialys.com
Wed Jul 27 08:55:28 PDT 2022


Moises,

I've not reviewed in depth the MITAB driver, but reading from a .tab 
file may require random access, and it is thus not surprising that 
reading from a compressed file may exhibit poor performance. You might 
try to set the VSI_CACHE config option / env variable to YES, but no 
guarantee this will help for your use case.

Even

Le 27/07/2022 à 11:39, Moises Calzado via gdal-dev a écrit :
> Hi everyone!
>
> We're using ogr2ogr to convert MapInfo TAB files into CSV format using 
> the following command:
>
>     ogr2ogr -f CSV -skipfailures -makevalid /vsistdout/
>     /vsizip/onLDU.zip  -oo AUTODETECT_TYPE=YES -lco CREATE_CSVT=YES >
>     test_2.csv
>
>
> The file weights ≈200 MB and the process is taking too much time to 
> finish (almost 20 min), so we don't know if we're doing something 
> wrong regarding the command that we launch.
> Screenshot 2022-07-20 at 12.55.14.png
> However, if we launch the same command against the .tab file instead 
> of using the vsizip virtual file system, it takes less than 30 seconds 
> to complete.
>
> Have you ever seen something like this? Do you know if it's expected 
> that it takes too much time to process this kind of files, or we're 
> doing something wrong?
>
> Thanks so much for your help in advance,
> Regards!
> -- 
> *Moises Calzado*
>
> Support Engineer
>
> (US) +1 917 463 3232 | (ES) +34 911 165 823 | mcalzado at carto.com
>
> <https://spatial-data-science-conference.com/2022/newyork/>
>
> _______________________________________________
> gdal-dev mailing list
> gdal-dev at lists.osgeo.org
> https://lists.osgeo.org/mailman/listinfo/gdal-dev

-- 
http://www.spatialys.com
My software is free, but my time generally not.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/gdal-dev/attachments/20220727/db57ae98/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: Screenshot%202022-07-20%20at%2012.55.14.png
Type: image/png
Size: 22063 bytes
Desc: not available
URL: <http://lists.osgeo.org/pipermail/gdal-dev/attachments/20220727/db57ae98/attachment-0001.png>


More information about the gdal-dev mailing list