[gdal-dev] SQL Server Driver

[Tamas Szekeres]

Jimmy,

Seems we can get the significant improvement by using bulk inserts then.
You may submit a ticket to keep this enhancements in scope.
Some of the guys used the driver successfully by using FreeTDS on Linux.

Best regards,

Tamas



2012/8/27 Duchesne, Jimmy <JDuchesne at korem.com>

> Thanks for the answers guys.
>
> What you're saying concurs with what I was experiencing, and I believe,
> what I was seeing with the SQL Server Management profiler.
>
> Also, I don't know if inserting with something else than WKT would
> actually improve the performance because my test, bulk inserts done with
> Java, were also inserting using WKT.
>
> Finally, just to be sure, is there any issue with using this driver on a
> Linux OS?
>
> Jimmy.
>
> -----Original Message-----
> From: fwarmerdam at gmail.com [mailto:fwarmerdam at gmail.com] On Behalf Of
> Frank Warmerdam
> Sent: August-24-12 6:39 PM
> To: Duchesne, Jimmy
> Cc: gdal-dev at lists.osgeo.org; Szekeres Tamás
> Subject: Re: [gdal-dev] SQL Server Driver
>
> Jimmy,
>
> From an examination of MSSQLSpatialTableLayer::CreateFeature() it
> appears a regular INSERT statement is done for each feature written to
> the db rather than any sort of bulk mechanism.  I could be missing
> something of course.  Hopefully Tamas will provide a more experienced
> answer.
>
> Best regards,
> Frank
>
>
> On Fri, Aug 24, 2012 at 3:03 PM, Duchesne, Jimmy <JDuchesne at korem.com>
> wrote:
> > Hello,
> >
> >
> >
> > I've been using SQL Server Driver for a few days now, and I noticed it
> was
> > very slow, whatever the parameters, such as GT, I was using.
> >
> >
> >
> > I need to insert millions of rows in a table.
> >
> >
> >
> > To give you an idea, it takes around 1 minute to import 10k records with
> the
> > driver
> >
> >
> >
> > On the other hand, if I write my own routine which reads a MapInfo file
> and
> > does batch insert into the database, I can insert over 125k records per
> > minute.
> >
> >
> >
> > I tried reading the same TAB file with ogr2ogr but writing to PostGis and
> > noticed the speed was about the same than my routine, which is enough
> for my
> > needs.
> >
> >
> >
> > Would it be possible that the SQL Server Driver does not do bulk insert?
> >
> >
> >
> > Thanks for the help.
> >
> >
> >
> > Jimmy Duchesne
> >
> >
> >
> >
> > _______________________________________________
> > gdal-dev mailing list
> > gdal-dev at lists.osgeo.org
> > http://lists.osgeo.org/mailman/listinfo/gdal-dev
>
>
>
> --
>
> ---------------------------------------+--------------------------------------
> I set the clouds in motion - turn up   | Frank Warmerdam,
> warmerdam at pobox.com
> light and sound - activate the windows | http://pobox.com/~warmerdam
> and watch the world go round - Rush    | Geospatial Software Developer
> _______________________________________________
> gdal-dev mailing list
> gdal-dev at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/gdal-dev
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/gdal-dev/attachments/20120827/3d4e2063/attachment.html>