[Qgis-user] Filtering layer or selected features by attributes does not work for new added features in QGIS 3.22.8

[Tudorache, Marian]

Hi Andrea,

Thank you for your advice.
How these .idm and and .ind files were created?
These files are created by reading ESRI coverage data used in an application under ArcInfo:
vLayer = qgis.core.QgsVectorLayer(coverageSource + "|layername=arc", layerSourceName, "ogr")
and I created shapefile like this
qgis.core.QgsVectorFileWriter.writeAsVectorFormat(vLayer, \
                                                                  shapeDestination + "/" + shapeLayerName + ".shp", \
                                                                  "utf-8", \
                                                                  srs, \
                                                                  "ESRI Shapefile")

What is interesting not all the shapefiles have these idm and ind files.
QGIS 2.18 did not have this problem.

Anyway, I assume I can have a general script to remove any file with extension idm and ind.
Cab these file be recreated without knowing?

Thanks,
Marian

From: Andrea Giudiceandrea <andreaerdna at libero.it>
Sent: July 23, 2022 6:29 AM
To: Tudorache, Marian <Marian.Tudorache at navcanada.ca>; qgis-user at lists.osgeo.org
Subject: [EXT] Re: RE: Re: [Qgis-user] Filtering layer or selected features by attributes does not work for new added features in QGIS 3.22.8

Hi Marian, I advise you, for the future, to avoid sending e-mail messages to a mailing list user personal e-mail address (unless requested) and instead please always prefer to send the message/replay to the mailing list e-mail address.⁠​ Moreover,

Hi Marian,
I advise you, for the future, to avoid sending e-mail messages to a mailing list user personal e-mail address (unless requested) and instead please always prefer to send the message/replay to the mailing list e-mail address. Moreover, better to avoid attach big files to an e-mail message (better to specify a link to an online resource).

Looking at the provided ESRI Shapefile layer, it seems to me the issue is due to the fact that in addition to the typical ESRI Shapefile files (.shp, .shx, .dbf, .prj, ...) are also present the non standard .idm and .ind files which contain the "attribute indexes as a mapinfo format index" [1].

If you remove such .idm and and .ind files, then the issue will not occur with your ESRI Shapefile layer.

What I suppose is that while QGIS, using the GDAL/OGR library, can use such non standard .idm and .ind files for attribute indexes, it (or the GDAL/OGR library) fails to properly update such attribute indexes files when a new feature is added to the layer. You can check this just looking at such files modification time in you file system when a new feature is added to the layer: such files are not modified.

Best regards.

Andrea Giudiceandrea



[1] https://gdal.org/drivers/vector/shapefile.html#spatial-and-attribute-indexing<https://urldefense.com/v3/__https:/gdal.org/drivers/vector/shapefile.html*spatial-and-attribute-indexing__;Iw!!P0kg3YazkQ!Bt-tNo4aq3ENChJ2xQGTArs2o6LONBDrdCC4xd3u6NaDJSQJVEcm56YkkJjuk8ahBf9AviXt5MKBBGDgbqmDkal_wT_gv88$>
Il 22/07/2022 21:54, Tudorache, Marian ha scritto:
Hi Andrea,

Thank you for your answer.
I attach the an archive with the shapefile in question.
I also attached a video to see what is going on.

________________________________

This electronic message, as well as any transmitted files included in the electronic message, may contain privileged or confidential information and is intended solely for the use of the individual(s) or entity to which it is addressed. If you have received this electronic message in error please notify the sender immediately and delete the electronic message. Any unauthorized copying, disclosure or distribution of the electronic message is strictly forbidden. NAV CANADA accepts no liability for any damage caused by any virus and/or other malicious code transmitted by this electronic communication.

Le présent message électronique et tout fichier qui peut y être joint peuvent contenir des renseignements privilégiés ou confidentiels destinés à l’usage exclusif des personnes ou des organismes à qui ils s’adressent. Si vous avez reçu ce message électronique par erreur, veuillez en informer l’expéditeur immédiatement et supprimez le. Toute reproduction, divulgation ou distribution du présent message électronique est strictement interdite. NAV CANADA n’assume aucune responsabilité en cas de dommage causé par tout virus ou autre programme malveillant transmis par ce message électronique.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/qgis-user/attachments/20220724/71a73cc5/attachment.htm>