[Qgis-developer] Quantum GIS and fileservers performance with shape
files
Windmuller, H (Hans)
Hans.Windmuller at PWN.NL
Mon Mar 14 09:21:40 EDT 2011
LS,
We are using Quantum GIS for our wardens. I have a question of which I don't know where I can put it so I'm hoping one of you can get me into the right direction.
On our clients we have Windows XP sp2 as Operating System and on our fileservers we have Microsoft Server 2003 as Operating System.
We store our data files (shape files and raster files (ecw)) on the central file server.
For a shape file with a .shp file (size 3 MB) and a .dbf file (size 155 MB) it takes 7 minutes and 30 seconds to get the shape displayed on screen. Between the two locations there is a WAN of 10 Mbps.
Other applications (MapWindow, ArcGIS, DIVA-GIS) only take 40 seconds to do the same.
My presumption is that Quantum GIS first downloads the entire shape file onto the client before rendering. The other applications seem only to download the .shp file and to approach the .dbf file on the file server.
I have observed that it is the .dbf file that is taking the time because when I deleted a number of fields in the specific .dbf file time dropped to about 3 minutes (and the size of the .dbf file dropped to 85 MB).
The other applications still gave the same result of 40 seconds.
Can someone of you please tell me how Quantum GIS handles shape files on a remote file server and if / when Quantum GIS will be able to get the same results in performance as the other applications mentioned above?
I'm looking forward to receiving your answer.
Kind regards
Met vriendelijke groet,
Hans Windmüller
medewerker GIS
Rijksweg 501
1991 AS VELSERBROEK
0251-661035
06-53792012
hans.windmuller at pwn.nl
www.pwn.nl
-----Oorspronkelijk bericht-----
Van: qgis-developer-bounces at lists.osgeo.org [mailto:qgis-developer-bounces at lists.osgeo.org] Namens qgis-developer-request at lists.osgeo.org
Verzonden: maandag 14 maart 2011 13:46
Aan: qgis-developer at lists.osgeo.org
Onderwerp: Qgis-developer Digest, Vol 61, Issue 55
Send Qgis-developer mailing list submissions to
qgis-developer at lists.osgeo.org
To subscribe or unsubscribe via the World Wide Web, visit
http://lists.osgeo.org/mailman/listinfo/qgis-developer
or, via email, send a message with subject or body 'help' to
qgis-developer-request at lists.osgeo.org
You can reach the person managing the list at
qgis-developer-owner at lists.osgeo.org
When replying, please edit your Subject line so it is more specific
than "Re: Contents of Qgis-developer digest..."
Today's Topics:
1. Re: Last two days before feature freeze and 1.7 release
timeline update (Luiz Motta)
2. RE: crash addind wms server from mapproxy (Duarte Carreira)
3. RE: crash addind wms server from mapproxy (Duarte Carreira)
4. Re: Last two days before feature freeze and 1.7 release
timeline update (Giovanni Manghi)
5. QgsPostgresProvider and UseEstimatedMetadata (Ziegler Stefan)
6. Re: Bringing diagrams into labeling-ng (Marco Hugentobler)
----------------------------------------------------------------------
Message: 1
Date: Mon, 14 Mar 2011 08:38:21 -0300
From: Luiz Motta <motta.luiz at gmail.com>
Subject: Re: [Qgis-developer] Last two days before feature freeze and
1.7 release timeline update
To: Tim Sutton <lists at linfiniti.com>
Cc: qgis-developer <qgis-developer at lists.osgeo.org>
Message-ID:
<AANLkTin5kpvU9Ye3fMSqxzzb1skTzmKuyzWYaVbYxJJ_ at mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1
Tim,
I made update in Spatialquery Plugin(see ticket #2634).
Regards,
Luiz
2011/3/14 Tim Sutton <lists at linfiniti.com>:
> Hi all
>
> Just reminder that there is just today and tomorrow to get your last
> features in before we go into feature freeze. If there are patches
> still outstanding please bring them to a developer's attention and try
> to get them in before Wednesday.
>
> I'm also proposing to delay the release process by one week to allow a
> little more time for testing and bugfixing the new raster code. So the
> revised timetable would run:
>
> March 15 - Feature Freeze
> March 21 - String freeze (although it would be great if translators
> could get started already)
> April 7 - release branching
> 12 April - Release announcements (or when packages are available)
>
> Regards
>
>
> --
> Tim Sutton - QGIS Project Steering Committee Member (Release Manager)
> ==============================================
> Please do not email me off-list with technical
> support questions. Using the lists will gain
> more exposure for your issues and the knowledge
> surrounding your issue will be shared with all.
>
> Visit http://linfiniti.com to find out about:
> * QGIS programming and support services
> * Mapserver and PostGIS based hosting plans
> * FOSS Consulting Services
> Skype: timlinux
> Irc: timlinux on #qgis at freenode.net
> ==============================================
> _______________________________________________
> Qgis-developer mailing list
> Qgis-developer at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/qgis-developer
>
------------------------------
Message: 2
Date: Mon, 14 Mar 2011 11:56:53 +0000
From: Duarte Carreira <DCarreira at edia.pt>
Subject: RE: [Qgis-developer] crash addind wms server from mapproxy
To: Luiz Motta <motta.luiz at gmail.com>
Cc: "qgis-developer at lists.osgeo.org" <qgis-developer at lists.osgeo.org>
Message-ID:
<58C383B0A191E747BE79503F3EEA22BF76309B6D27 at beja012.edia.pt>
Content-Type: text/plain; charset="iso-8859-1"
I updated to r15470 and still crashes for me.
I don't set any CRS. Setting to 4326 still crashes.
I wanted to get some confirmation before opening a ticket.
I now have contradictory results. Some work fine, 1.6 crashes, I'm the only one that has a crash in latest trunk.
So I'll open a ticket.
Duarte
-----Mensagem original-----
De: Luiz Motta [mailto:motta.luiz at gmail.com]
Enviada: segunda-feira, 14 de Março de 2011 11:30
Para: Duarte Carreira
Cc: qgis-developer at lists.osgeo.org
Assunto: Re: [Qgis-developer] crash addind wms server from mapproxy
Duarte,
I can see OMS layer.
Enviroment:
Windows XP
QGIS trunck R15470
The problem is the on the fly.
It is need use the same CRS of the OSM (EPSG: 4326) to work with others layers.
Luiz
2011/3/14 Duarte Carreira <DCarreira at edia.pt>:
> Can anyone confirm this?
>
>
>
> 1) Add wms server http://osm.omniscale.net/proxy/service?tiled=true
>
> 2) Connect, and answer twice "No" to questions about ignoring
> advertised url (I supposed this always happens with wms-c services?)
>
> 3) Select "osm" layer
>
> 4) Click Add
>
> 5) QGIS crashes
>
>
>
> Using Win 7 32bit, QGIS 1.7 r15458.
>
>
>
> Duarte
>
> _______________________________________________
> Qgis-developer mailing list
> Qgis-developer at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/qgis-developer
>
>
------------------------------
Message: 3
Date: Mon, 14 Mar 2011 12:00:42 +0000
From: Duarte Carreira <DCarreira at edia.pt>
Subject: RE: [Qgis-developer] crash addind wms server from mapproxy
To: "qgis-developer at lists.osgeo.org" <qgis-developer at lists.osgeo.org>
Message-ID:
<58C383B0A191E747BE79503F3EEA22BF76309B6D2A at beja012.edia.pt>
Content-Type: text/plain; charset="iso-8859-1"
Ticket created:
https://trac.osgeo.org/qgis/ticket/3608
Duarte
De: Duarte Carreira [mailto:DCarreira at edia.pt]
Enviada: segunda-feira, 14 de Março de 2011 09:49
Para: qgis-developer at lists.osgeo.org
Assunto: [Qgis-developer] crash addind wms server from mapproxy
Can anyone confirm this?
1) Add wms server http://osm.omniscale.net/proxy/service?tiled=true
2) Connect, and answer twice "No" to questions about ignoring advertised url (I supposed this always happens with wms-c services?)
3) Select "osm" layer
4) Click Add
5) QGIS crashes
Using Win 7 32bit, QGIS 1.7 r15458.
Duarte
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.osgeo.org/pipermail/qgis-developer/attachments/20110314/3b08c6ce/attachment-0001.html
------------------------------
Message: 4
Date: Mon, 14 Mar 2011 12:10:26 +0000
From: Giovanni Manghi <giovanni.manghi at gmail.com>
Subject: Re: [Qgis-developer] Last two days before feature freeze and
1.7 release timeline update
To: Tim Sutton <lists at linfiniti.com>
Cc: qgis-developer <qgis-developer at lists.osgeo.org>
Message-ID: <1300104626.2007.17.camel at sibirica>
Content-Type: text/plain; charset="UTF-8"
> I'm also proposing to delay the release process by one week to allow a
> little more time for testing and bugfixing the new raster code.
Agree,
there are problems with the georeferencer
https://trac.osgeo.org/qgis/ticket/3596
with the "zoom to best scale"
https://trac.osgeo.org/qgis/ticket/3609
and with GRASS rasters
https://trac.osgeo.org/qgis/ticket/3582
https://trac.osgeo.org/qgis/ticket/3603
plus this that is really a stopper
https://trac.osgeo.org/qgis/ticket/3602
cheers
-- Giovanni --
------------------------------
Message: 5
Date: Mon, 14 Mar 2011 13:29:16 +0100
From: Ziegler Stefan <Stefan.Ziegler at bd.so.ch>
Subject: [Qgis-developer] QgsPostgresProvider and UseEstimatedMetadata
To: qgis-developer <qgis-developer at lists.osgeo.org>
Message-ID: <H00002ea08fdcfe4.1300105754.srsofaioi6145.ktso.ch at MHS>
Content-Type: text/plain; charset="iso-8859-1"
Hi
I have some problems with the zoom to full extent functionality with
posgresql layers. It seems that it is always selecting the estimated
extend and never the real extent from postgresql even with an unchecked
"Use estimated table metadata" checkbox.
regards
Stefan
Mit freundlichem Gruss
Stefan Ziegler
Leiter amtliche Vermessung
Kanton Solothurn
Bau- und Justizdepartement
Amt für Geoinformation
Rötistrasse 4
4501 Solothurn
Telefon 032 627 75 96
Telefax 032 627 75 98
stefan.ziegler at bd.so.ch
http://www.so.ch
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.osgeo.org/pipermail/qgis-developer/attachments/20110314/a30e7063/attachment-0001.html
------------------------------
Message: 6
Date: Mon, 14 Mar 2011 13:45:04 +0100
From: Marco Hugentobler <marco.hugentobler at sourcepole.ch>
Subject: Re: [Qgis-developer] Bringing diagrams into labeling-ng
To: Martin Dobias <wonder.sk at gmail.com>
Cc: qgis-developer at lists.osgeo.org
Message-ID: <201103141345.04462.marco.hugentobler at sourcepole.ch>
Content-Type: Text/Plain; charset="iso-8859-1"
Hi Martin
Great. I'm going to commit probably tomorrow evening.
> - does this imply a complete removal of diagram overlay plugin?
At the moment, the diagram overlay plugin has more options (bar diagrams and
the proportional svg symbols). Therefore I'm planning to remove overlay code
and plugin after 1.7 because of backward compatibility.
> - does it make sense to you to remove the "overlays" tab in the
> options dialog? It only allows changing the PAL algorithm, I guess
> barely anyone knows what those options mean (and they don't make any
> difference anyway unless you have a very dense set of label
> candidates)
+1 (going to do this for 1.7)
> - I wonder if it wouldn't better to move QgsDiagramLayerSettings
> instance from QgsVectorLayer to QgsDiagramRendererV2. If I understand
> the code correctly, the diagram layer settings make sense only if
> there exists a diagram renderer, right?
Conceptually, it is the other way round (renderer is a part of the layer
settings). But agreed, there is no need to keep both variables in the vector
layer. Keeping only the settings variable should work too.
Regards,
Marco
Am Montag, 14. März 2011, um 10.08:34 schrieb Martin Dobias:
> Hi Marco
>
> On Wed, Mar 9, 2011 at 3:01 PM, Marco Hugentobler
>
> <marco.hugentobler at sourcepole.ch> wrote:
> > Hi all
> >
> > There's a patch now that adds diagram support using QgsPalLabeling
> > (http://trac.osgeo.org/qgis/ticket/3583). It tries to change the labeling
> > classes as little as possible to not introduce additional issues.
> >
> > Currently available are pie diagrams and text diagrams. My plan is to
> > also support bars (and maybe proportional svg symbols) and to remove the
> > vector overlay classes after 1.7.
> >
> > What do you think, is it still ok for those changes to go into 1.7?
> > Looking forward to your comments.
>
> I have looked at the patch and it seems fine to me. Some comments:
> - does this imply a complete removal of diagram overlay plugin?
> - does it make sense to you to remove the "overlays" tab in the
> options dialog? It only allows changing the PAL algorithm, I guess
> barely anyone knows what those options mean (and they don't make any
> difference anyway unless you have a very dense set of label
> candidates)
> - I wonder if it wouldn't better to move QgsDiagramLayerSettings
> instance from QgsVectorLayer to QgsDiagramRendererV2. If I understand
> the code correctly, the diagram layer settings make sense only if
> there exists a diagram renderer, right?
> - please do not forget to add notes to the new classes and new methods
> that they have been added in 1.7, if possible update also the bindings
> (I could help you if necessary)
>
> Otherwise +1 from me to apply before the feature freeze.
>
> Regards
> Martin
--
Dr. Marco Hugentobler
Sourcepole - Linux & Open Source Solutions
Churerstrasse 22, CH-8808 Pfäffikon SZ, Switzerland
marco.hugentobler at sourcepole.ch http://www.sourcepole.ch
Technical Advisor QGIS Project Steering Committee
------------------------------
_______________________________________________
Qgis-developer mailing list
Qgis-developer at lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/qgis-developer
End of Qgis-developer Digest, Vol 61, Issue 55
**********************************************
More information about the Qgis-developer
mailing list