[Qgis-user] GeoPackage deadlocks (Andrea Peri)

Fri Sep 27 01:06:14 PDT 2019

Hi,

We have a plan to migrate from Oracle to PostGIS but there is a lot of work to move other associated systems.

I should point out we did not move from Oracle to GeoPackage; we use Oracle for other systems. We are migrating users from MapInfo to QGIS and so I told the users to keep using the tab files at the start. This resulted in MapInfo errors and got me in hot water so I suggested they use GeoPackage instead as that is the official data type. Unfortunately that then resulted in the file deadlocks so I developed a custom python plugin to go with our install of QGIS and used that to give access to some (but not all) datasets using our existing Oracle spatial database.

I hope that provides sufficient background but you can probably see it’s not going well really as I’ve had to change my advice three times already.
Paul

From: Luigi Pirelli <luipir at gmail.com>
Sent: 27 September 2019 08:59
To: Paul Wittle <P.Wittle at dorsetcc.gov.uk>
Cc: Alessandro Pasotti <apasotti at gmail.com>; qgis-user at lists.osgeo.org
Subject: Re: [Qgis-user] GeoPackage deadlocks (Andrea Peri)

without resting importance to the issue, reading the bug report, I can read you moved from oracle spatial to geopackage! why not postgis?

Luigi Pirelli

**************************************************************************************************
* LinkedIn: https://www.linkedin.com/in/luigipirelli
* Stackexchange: http://gis.stackexchange.com/users/19667/luigi-pirelli
* GitHub: https://github.com/luipir
* Book: Mastering QGIS3 - 3rd Edition<https://www.packtpub.com/eu/application-development/mastering-geospatial-development-qgis-3x-third-edition>
* Hire a team: http://www.qcooperative.net
**************************************************************************************************

On Fri, 27 Sep 2019 at 09:39, Paul Wittle <paul.wittle at dorsetcouncil.gov.uk<mailto:paul.wittle at dorsetcouncil.gov.uk>> wrote:
Hi,

I couldn’t see a bug report which I thought matched so I have added one as requests but please accept my apologies if it does turn out to be a duplicate or if my use of the word deadlock is incorrect.

The ticket can be found at https://github.com/qgis/QGIS/issues/32034

It would be great if others that have experienced the issue could provide any further relevant comments as I’ve not got it as well documented as I’d like. Sorry, time constraints in the office.

Many thanks,
Paul

From: Alessandro Pasotti <apasotti at gmail.com<mailto:apasotti at gmail.com>>
Sent: 27 September 2019 08:20
To: Paul Wittle <P.Wittle at dorsetcc.gov.uk<mailto:P.Wittle at dorsetcc.gov.uk>>
Cc: qgis-user at lists.osgeo.org<mailto:qgis-user at lists.osgeo.org>
Subject: Re: [Qgis-user] GeoPackage deadlocks (Andrea Peri)

On Fri, Sep 27, 2019 at 9:13 AM Paul Wittle <paul.wittle at dorsetcouncil.gov.uk<mailto:paul.wittle at dorsetcouncil.gov.uk>> wrote:
Hi Andrea and Enrico,

Thank you for providing an answer even if it was not what I was hoping to hear; it was the conclusion I'd reached myself.

Has this issue been considered given the official move from shapefile to geopackage as the default format?

My understanding was that shapefiles could be used over a network and whilst multiple people editing was dangerous it did not cause deadlocks.

Combined with the issues relating to MapInfo tab files over a network I've got into some hot water over my attempt to get QGIS rolled out in our organisation now. I'm going to have to think carefully about my next steps as it can be difficult to educate large numbers of staff and the two issues mean that people using QGIS incorrectly can cause pretty big issues.

To summarise,
 - You open a geopackage and save to the network; someone else comes along and opens it in their QGIS and everything looks okay until the PCs deadlock...ICT help calls and data corruption may occur.
 - You open a MapInfo tab file from the network and it looks fine (accept that it my draw in a user projection). MapInfo user receive errors but this is unknown to the QGIS user...ICT help calls result.

Whilst I'm glad the forums have helped to diagnose both behaviours I would personally say that the issues pose a bit of a threat to software adoption by larger companies and institutions that may be using Windows networks and potentially migrating from MapInfo.

In both cases my gut feel is that the best solution might be to look into use detection. If GDAL (I assume) can be improved to detect that either file type is already open then it might be possible to simply ban a second user from opening the file at the same time. This might frustrate some users but most importantly it would make the application safer from an ICT perspective.

These are of course just my personal opinion from my particular use case so please don't be offended by them if you disagree but I'd be really happy to hear how others are approaching the issues and/or opposing views?

Many thanks,
Paul

Hi Paul,

A deadlock is a QGIS bug (and quite a serious one).

Can you please file an issue on https://github.com/qgis/QGIS/issues ?
Please check if it's not there, and if it is, you can add your comments to the existing issue.

Thanks

--
Alessandro Pasotti
w3:   www.itopen.it<http://www.itopen.it>
This e-mail and any files transmitted with it are intended solely for the use of the individual or entity to whom they are addressed. It may contain unclassified but sensitive or protectively marked material and should be handled accordingly. Unless you are the named addressee (or authorised to receive it for the addressee) you may not copy or use it, or disclose it to anyone else. If you have received this transmission in error please notify the sender immediately. All traffic may be subject to recording and/or monitoring in accordance with relevant legislation. Any views expressed in this message are those of the individual sender, except where the sender specifies and with authority, states them to be the views of Dorset Council. Dorset Council does not accept service of documents by fax or other electronic means. Virus checking: Whilst all reasonable steps have been taken to ensure that this electronic communication and its attachments whether encoded, encrypted or otherwise supplied are free from computer viruses, Dorset Council accepts no liability in respect of any loss, cost, damage or expense suffered as a result of accessing this message or any of its attachments. For information on how Dorset Council processes your information, please see www.dorsetcouncil.gov.uk/416433<http://www.dorsetcouncil.gov.uk/416433>
_______________________________________________
Qgis-user mailing list
Qgis-user at lists.osgeo.org<mailto:Qgis-user at lists.osgeo.org>
List info: https://lists.osgeo.org/mailman/listinfo/qgis-user
Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
This e-mail and any files transmitted with it are intended solely for the use of the individual or entity to whom they are addressed. It may contain unclassified but sensitive or protectively marked material and should be handled accordingly. Unless you are the named addressee (or authorised to receive it for the addressee) you may not copy or use it, or disclose it to anyone else. If you have received this transmission in error please notify the sender immediately. All traffic may be subject to recording and/or monitoring in accordance with relevant legislation. Any views expressed in this message are those of the individual sender, except where the sender specifies and with authority, states them to be the views of Dorset Council. Dorset Council does not accept service of documents by fax or other electronic means. Virus checking: Whilst all reasonable steps have been taken to ensure that this electronic communication and its attachments whether encoded, encrypted or otherwise supplied are free from computer viruses, Dorset Council accepts no liability in respect of any loss, cost, damage or expense suffered as a result of accessing this message or any of its attachments. For information on how Dorset Council processes your information, please see www.dorsetcouncil.gov.uk/416433
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/qgis-user/attachments/20190927/27bffa19/attachment.html>