[Qgis-user] Recurrent problem importing .CSV files : Numbers seen like text

Harrissou delazj at gmail.com
Tue Mar 31 11:51:53 PDT 2020


Hi Ludovic,

You can use a csvt file. Read https://docs.qgis.org/3.10/en/docs/user_manual/managing_data_source/supported_data.html#using-csvt-file-to-control-field-formatting

Hope that helps,
Harrissou

Le 31 mars 2020 20:40:53 GMT+02:00, Marcin <prokes95 at interia.pl> a écrit :
>This is code and how to prepare csv correctly Temat: [Qgis-user]
>Recurrent problem importing .CSV files : Numbers seen	like textData:
>2020-03-31 20:38Nadawca: "Ludovic Cepre" Adresat:
>qgis-user at lists.osgeo.org; Hello all,I frequently have problems in
>importing data from Excel to Qgis : often the numbers are imported like
>text, and i cannot manage to understand why sometimes it works
>correctly and sometimes not.Perhaps i missed a very basical way of
>importing... ??I precise that i know that it's possible to import
>directly data from Excel, but I use .CSV format so as to have more
>reliable files.Thanks to all... !!LudovicLe mar. 31 mars 2020 à 18:53,
><qgis-user-request at lists.osgeo.org> a écrit :Send Qgis-user
>mailing list submissions to
>        qgis-user at lists.osgeo.org
>To subscribe or unsubscribe via the World Wide Web, visit
>        https://lists.osgeo.org/mailman/listinfo/qgis-user
>or, via email, send a message with subject or body 'help' to
>        qgis-user-request at lists.osgeo.org
>You can reach the person managing the list at
>        qgis-user-owner at lists.osgeo.org
>When replying, please edit your Subject line so it is more specific
>than "Re: Contents of Qgis-user digest..."
>Today's Topics:
>   1. Re: Should be easy? Open csv in Graphical Modeller (Yann Voté)
>   2. Re: Should be easy? Open csv in Graphical Modeller (Ujaval
>Gandhi)
>   3. Re: DataPlotly questions/suggestions (matteo)
>   4. Embedded projects and QGIS server (Karl Magnus Jönsson)
>   5. Re: Plugin Processing crashes QGIS and computer (Sabine
>Vanhuysse)
>   6. Re: DataPlotly questions/suggestions (Tom Chadwin)
>   7. Problem with upgrade to QGIS 3.12.1 (QGIS.USER)
>   8. Re: Plugin Processing crashes QGIS and computer (Sabine
>Vanhuysse)
>----------------------------------------------------------------------
>Message: 1
>Date: Tue, 31 Mar 2020 13:08:26 +0200
>From: Yann Voté <ygversil at lilo.org>
>To: qgis-user at lists.osgeo.org
>Subject: Re: [Qgis-user] Should be easy? Open csv in Graphical
>        Modeller
>Message-ID: <00db00a4-2d9e-c7a6-baaa-4dbd3bc10949 at lilo.org>
>Content-Type: text/plain; charset=utf-8; format=flowed
>Hi,
>Not sure if this will help you, but I recently wrote a processing
>plugin 
>to deal with CSV files. The plugin is named CSV Tools. It aims to be a 
>little more generic than the "create points layer from table" since it 
>can handle WKT geometries and hence can load lines and polygons.
>The plugin is *highly* experimental, and thus is available in QGIS only
>
>when experimental plugins are allowed.
>It works for me at the moment, I use it in models. But I've plans to 
>make it more usable so that it can be useful to more people. I'd love
>to 
>have feedback : if it works or not and would gladly fix bugs.
>Regards.
>Yann
>Le 31/03/2020 à 12:43, magerlin a écrit :
>> Thanks for your comment.
>> 
>> But I am trying to setup a model for reading GTFS data (General
>Transit Feed
>> Specification) which are sets of like 10 csv files and I am right
>now
>> working with 3 sets so like 30 csv files in total.
>> 
>> So the aim was to automate tedious work and not have to remember
>every time
>> how these 10 csv files relate to each other.
>> 
>> I am aware of two plugins reading GTFS data but they both break
>down with
>> python errors ...
>> 
>> 
>> 
>> -----
>> Regards Morten
>> 
>> Currently using Qgis 3.10.0
>> Windows 10, 64bit
>> --
>> Sent from:
>http://osgeo-org.1560.x6.nabble.com/QGIS-User-f4125267.html
>> _______________________________________________
>> Qgis-user mailing list
>> Qgis-user at lists.osgeo.org
>> List info: https://lists.osgeo.org/mailman/listinfo/qgis-user
>> Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
>> 
>------------------------------
>Message: 2
>Date: Tue, 31 Mar 2020 16:54:15 +0530
>From: Ujaval Gandhi <ujaval at spatialthoughts.com>
>To: Yann Voté <ygversil at lilo.org>
>Cc: QGIS User List <qgis-user at lists.osgeo.org>
>Subject: Re: [Qgis-user] Should be easy? Open csv in Graphical
>        Modeller
>Message-ID:
>       
><CALymcQDobAFFWxVnsE8B7NnttRsRuF_B1ZpD5rES_4RBtxWJMA at mail.gmail.com>
>Content-Type: text/plain; charset="utf-8"
>Processing Toolbox has a 'Create point layer from table' algorithm that
>can
>read a CSV and give you a vector layer that can be used in the model.
>[image: Logo] <https://spatialthoughts.com/>
>Ujaval Gandhi
>Spatial Thoughts
>mobile: +91-8095684687
>email: ujaval at spatialthoughts.com
>[image: LinkedIn icon]
><https://www.linkedin.com/in/spatialthoughts/>  [image:
>Twitter icon] <https://twitter.com/spatialthoughts>
>Subscribe to our newsletter http://bit.ly/spatialthoughts-newsletter
>On Tue, Mar 31, 2020 at 4:48 PM Yann Voté <ygversil at lilo.org>
>wrote:
>> Hi,
>>
>> Not sure if this will help you, but I recently wrote a processing
>plugin
>> to deal with CSV files. The plugin is named CSV Tools. It aims to
>be a
>> little more generic than the "create points layer from table"
>since it
>> can handle WKT geometries and hence can load lines and polygons.
>>
>> The plugin is *highly* experimental, and thus is available in QGIS
>only
>> when experimental plugins are allowed.
>>
>> It works for me at the moment, I use it in models. But I've plans
>to
>> make it more usable so that it can be useful to more people. I'd
>love to
>> have feedback : if it works or not and would gladly fix bugs.
>>
>> Regards.
>>
>> Yann
>>
>>
>> Le 31/03/2020 à 12:43, magerlin a écrit :
>> > Thanks for your comment.
>> >
>> > But I am trying to setup a model for reading GTFS data
>(General Transit
>> Feed
>> > Specification) which are sets of like 10 csv files and I am
>right now
>> > working with 3 sets so like 30 csv files in total.
>> >
>> > So the aim was to automate tedious work and not have to
>remember every
>> time
>> > how these 10 csv files relate to each other.
>> >
>> > I am aware of two plugins reading GTFS data but they both
>break down with
>> > python errors ...
>> >
>> >
>> >
>> > -----
>> > Regards Morten
>> >
>> > Currently using Qgis 3.10.0
>> > Windows 10, 64bit
>> > --
>> > Sent from:
>http://osgeo-org.1560.x6.nabble.com/QGIS-User-f4125267.html
>> > _______________________________________________
>> > Qgis-user mailing list
>> > Qgis-user at lists.osgeo.org
>> > List info: https://lists.osgeo.org/mailman/listinfo/qgis-user
>> > Unsubscribe:
>https://lists.osgeo.org/mailman/listinfo/qgis-user
>> >
>> _______________________________________________
>> Qgis-user mailing list
>> Qgis-user at lists.osgeo.org
>> List info: https://lists.osgeo.org/mailman/listinfo/qgis-user
>> Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
>-------------- next part --------------
>An HTML attachment was scrubbed...
>URL:
><http://lists.osgeo.org/pipermail/qgis-user/attachments/20200331/dce10c4e/attachment-0001.html>
>------------------------------
>Message: 3
>Date: Tue, 31 Mar 2020 16:16:38 +0200
>From: matteo <matteo.ghetta at gmail.com>
>To: qgis-user at lists.osgeo.org
>Cc: Tom Chadwin <tom.chadwin at nnpa.org.uk>, Federico Gianoli
>        <gianoli.federico at gmail.com>
>Subject: Re: [Qgis-user] DataPlotly questions/suggestions
>Message-ID: <8cbc55a2-f364-8770-e3b5-8393ca258bd0 at gmail.com>
>Content-Type: text/plain; charset=utf-8
>Hi Magnus,
>> I recently tested the DataPlotly (impressive work!) plugin and I
>have a few
>> questions/suggestions:
>thanks! Appreciations are always welcome!
>> - Can I change the font for the plot title, legend title and X/Y
>labels? I
>> don´t see a setting for this.
>not yet, but plotly let's you easily do it. Do you mind open a feature
>request on the DataPlotly
>repository?https://github.com/ghtmtt/DataPlotly/issues
>> - Wouldn´t it be great if one could publish a layout as an online
>resource
>> for additional interactivity? As an alternative to Power BI
>presentations
>> but with a geodata focus? I guess this a rather massive task.
>yep, massive task ;) maps on plotly side lack for some ore
>functionalities (currently it is only possible via mapbox while it
>would
>be great to have it also with leaflet and openlayer).
>Anyway merging (part) of DataPlotly with QGIS2WEB plugin could also be
>an idea (also massive work (ping @Tom Chadwin)
>another alternative (still in beta due to a migration to django)
>ishttps://www.talkingmaps.eu/ (ping @Federico Gianoli)
>> - When I try adding DataPlotly in a processing model, I get an
>error:
>> 
>> 
>> Exception: unknown Traceback (most recent call last):
>>   File
>>
>"C:/PROGRA~1/QGIS3~1.4/apps/qgis-ltr/./python/plugins\processing\modeler\ModelerDialog.py",
>> line 796, in addAlgorithm
>>     alg =
>>
>QgsApplication.processingRegistry().createAlgorithmById(algorithm.id())
>> Exception: unknown
>> 
>> Python version: 3.7.0 (v3.7.0:1bf9cc5093, Jun 27 2018, 04:59:51)
>[MSC v.1914
>> 64 bit (AMD64)] 
>> QGIS version: 3.4.11-Madeira Madeira, 9a8a6d4687
>same of above, could you open an
>issue?https://github.com/ghtmtt/DataPlotly/issues/
>there is already one (https://github.com/ghtmtt/DataPlotly/issues/92)
>Cheers
>Matteo
>------------------------------
>Message: 4
>Date: Tue, 31 Mar 2020 14:19:19 +0000
>From: Karl Magnus Jönsson  <Karl-Magnus.Jonsson at kristianstad.se>
>To: "qgis-user at lists.osgeo.org" <qgis-user at lists.osgeo.org>
>Subject: [Qgis-user] Embedded projects and QGIS server
>Message-ID: <2f0f4cef47f7482e83a44aa3b935eff8 at kristianstad.se>
>Content-Type: text/plain; charset="iso-8859-1"
>Hi all!
>I'm trying to embed some thematic projects into a master project
>containing all themes for publishing a service in QGIS Server. Works
>nice in desktop but the WMS service just contains empty group layers
>for the embedded projects. Paths seems to be relative. It would have
>been nice to be able to publish layers or projects in different master
>projects and not have to duplicate the cartography and settings in
>several projects. Does anyone know if it is intended to work with
>embedded projects in QGIS Server? Or have another smart solution for
>this? Thanks in advance.
>Karl-Magnus Jönsson
>-------------- next part --------------
>An HTML attachment was scrubbed...
>URL:
><http://lists.osgeo.org/pipermail/qgis-user/attachments/20200331/6285137b/attachment-0001.html>
>------------------------------
>Message: 5
>Date: Tue, 31 Mar 2020 16:20:26 +0200
>From: "Sabine Vanhuysse" <svhuysse at ulb.ac.be>
>To: <qgis-user at lists.osgeo.org>
>Subject: Re: [Qgis-user] Plugin Processing crashes QGIS and computer
>Message-ID: <000f01d60767$8c074180$a415c480$@ulb.ac.be>
>Content-Type: text/plain; charset="iso-8859-1"
>Hi Phil,
>Thanks for your speedy reply. I have checked what you suggested: my
>windows
>installation is up to date and the memory diagnostic tool couldn’t find
>any
>problem. I have also installed monitor drivers from the manufacturer,
>as I
>had the windows defaults. Unfortunately, the issue was not fixed. 
>I would be grateful for any other suggestion.
>Cheers,
>Sabine
>De : Phil Wyatt <phil at wyatt-family.com> 
>Envoyé : mardi 31 mars 2020 12:36
>À : 'Sabine Vanhuysse' <svhuysse at ulb.ac.be>;
>qgis-user at lists.osgeo.org
>Objet : RE: [Qgis-user] Plugin Processing crashes QGIS and computer
>Hi Sabine,
>I would also try making sure that your windows installation is up to
>date,
>memory is all OK and also check drivers for your monitors. I had a
>similar
>error (WHEA) that bugged me for ages and it was fixed with new monitor
>drivers from the manufacturer (not the windows defaults!)
>Cheers - Phil
>From: Qgis-user <qgis-user-bounces at lists.osgeo.org
><mailto:qgis-user-bounces at lists.osgeo.org> > On Behalf Of
>Sabine Vanhuysse
>Sent: Tuesday, 31 March 2020 8:40 PM
>To: qgis-user at lists.osgeo.org <mailto:qgis-user at lists.osgeo.org> 
>Subject: [Qgis-user] Plugin Processing crashes QGIS and computer
>Hi all,
>I have recently installed QGIS 3.10.4 LTR, as some of the new features
>would
>be very useful to my work. Unfortunately, the Processing plugin which I
>use
>quite a lot causes QGIS and my computer to crash nearly systematically.
>After each fresh install - I uninstalled/installed QGIS a few times -
>and
>the first crash, I get this message when I open QGIS again : « Plugin
>processing : The plugin will be disabled because it crashed QGIS during
>last
>startup. Please report an issue and re-enable the plugin when the
>problem
>has been solved.” When I try to activate the plugin by ticking the box
>in
>the ‘Manage and Install Plugins’ menu, my computer crashes again.
>I have tried to install other standalone versions of QGIS, ie, 3.12.0-2
>and
>3.8.3-1, and the version that comes with the osgeo4w installer, and
>they all
>cause the same problem. Only when I revert to my old 3.4.7 version does
>the
>plugin function without any problem.
>I have also tried to use a new user profile, and even to delete the
>QGIS
>folder in the user/appdata/roaming folder, but this didn’t work.
>I should add that the crashes are not totally systematic, as after one
>fresh
>install, there was no crash when I opened QGIS without Grass functions
>for
>the first time. However, the second time (QGIS with Grass functions),
>it
>crashed again. The next times, it crashed be it with or without Grass
>functions.
>I am using Windows 10 Family edition and I have 2 monitors. When my
>computer
>crashes, I get a blue screen with an error message that is not always
>the
>same, but often it is a WHEA message. I have tried to unplug one of my
>monitors before restarting the computer, but this did not solve the
>issue.
>Of course, I can go on using QGIS 3.4.7, but it would be very helpful
>to
>work with a more recent version, so I would very much appreciate your
>help
>with this issue.
>Thanks!
>Best wishes,
>Sabine
>-------------- next part --------------
>An HTML attachment was scrubbed...
>URL:
><http://lists.osgeo.org/pipermail/qgis-user/attachments/20200331/858bfcfe/attachment-0001.html>
>------------------------------
>Message: 6
>Date: Tue, 31 Mar 2020 07:32:39 -0700 (MST)
>From: Tom Chadwin <tom.chadwin at nnpa.org.uk>
>To: qgis-user at lists.osgeo.org
>Subject: Re: [Qgis-user] DataPlotly questions/suggestions
>Message-ID: <1585665159541-0.post at n6.nabble.com>
>Content-Type: text/plain; charset=us-ascii
>ghtmtt wrote
>> merging (part) of DataPlotly with QGIS2WEB plugin could also be
>> an idea
>This would indeed be amazing, but it would require each chart type to
>be
>prototyped in d3, and then hooked into the exported qgis2web map. Given
>the
>three qgis2web export formats, this would indeed be a big job.
>Anyone up for it? Very happy to answer questions, but definitely not
>something I can take on myself.
>All the best
>Tom
>-----
>Buy Pie Spy: Adventures in British pastry 2010-11 on Amazon 
>--
>Sent from: http://osgeo-org.1560.x6.nabble.com/QGIS-User-f4125267.html
>------------------------------
>Message: 7
>Date: Tue, 31 Mar 2020 16:34:27 +0100
>From: "QGIS.USER" <qgis.user at raycar.plus.com>
>To: <qgis-user at lists.osgeo.org>
>Subject: [Qgis-user] Problem with upgrade to QGIS 3.12.1
>Message-ID: <007601d60771$dddb1630$99914290$@raycar.plus.com>
>Content-Type: text/plain;       charset="UTF-8"
>Hi All,
>OS Win 7 & Win10. 
>UK based and always use UK CRS EPSG:27700 (OSGB 1936/ British National
>Grid) so I have an enhanced conversion utility
>(OSTN15_NTv2_OSGBtoETRS.gsb) installed in my QGIS profile.
>After upgrading 3.12.1, I get an error message that I need to install
>OSTN15_NTv2_OSGBtoETRS.gsb (despite it already being in my profile).
>Attempting to install it (via the warning) results in an error message
>about unable to access the relevant folder in my profile. I can solve
>that problem by deleting the existing copy of
>OSTN15_NTv2_OSGBtoETRS.gsb in my profile and it will then install
>correctly. However, even then I still get a warning that the best
>conversion is not available. Reverting to 3.12.0 solves the problem So
>for the moment, I am staying with that version.
>Is this a known issue please? 
>Stay Safe,
>Ray Carpenter.
>------------------------------
>Message: 8
>Date: Tue, 31 Mar 2020 18:52:19 +0200
>From: "Sabine Vanhuysse" <svhuysse at ulb.ac.be>
>To: <qgis-user at lists.osgeo.org>
>Subject: Re: [Qgis-user] Plugin Processing crashes QGIS and computer
>Message-ID: <000201d6077c$ca7d5980$5f780c80$@ulb.ac.be>
>Content-Type: text/plain; charset="iso-8859-1"
>If this gives any hint, I have the same issue with the Semi-Automatic
>Classification plugin and with the Lecos plugin.
>Thank you !
>Sabine
>De : Sabine Vanhuysse <svhuysse at ulb.ac.be> 
>Envoyé : mardi 31 mars 2020 16:20
>À : 'qgis-user at lists.osgeo.org' <qgis-user at lists.osgeo.org>
>Objet : RE: [Qgis-user] Plugin Processing crashes QGIS and computer
>Hi Phil,
>Thanks for your speedy reply. I have checked what you suggested: my
>windows
>installation is up to date and the memory diagnostic tool couldn’t find
>any
>problem. I have also installed monitor drivers from the manufacturer,
>as I
>had the windows defaults. Unfortunately, the issue was not fixed. 
>I would be grateful for any other suggestion.
>Cheers,
>Sabine
>De : Phil Wyatt <phil at wyatt-family.com
><mailto:phil at wyatt-family.com> > 
>Envoyé : mardi 31 mars 2020 12:36
>À : 'Sabine Vanhuysse' <svhuysse at ulb.ac.be
><mailto:svhuysse at ulb.ac.be> >;qgis-user at lists.osgeo.org
><mailto:qgis-user at lists.osgeo.org> 
>Objet : RE: [Qgis-user] Plugin Processing crashes QGIS and computer
>Hi Sabine,
>I would also try making sure that your windows installation is up to
>date,
>memory is all OK and also check drivers for your monitors. I had a
>similar
>error (WHEA) that bugged me for ages and it was fixed with new monitor
>drivers from the manufacturer (not the windows defaults!)
>Cheers - Phil
>From: Qgis-user <qgis-user-bounces at lists.osgeo.org
><mailto:qgis-user-bounces at lists.osgeo.org> > On Behalf Of
>Sabine Vanhuysse
>Sent: Tuesday, 31 March 2020 8:40 PM
>To: qgis-user at lists.osgeo.org <mailto:qgis-user at lists.osgeo.org> 
>Subject: [Qgis-user] Plugin Processing crashes QGIS and computer
>Hi all,
>I have recently installed QGIS 3.10.4 LTR, as some of the new features
>would
>be very useful to my work. Unfortunately, the Processing plugin which I
>use
>quite a lot causes QGIS and my computer to crash nearly systematically.
>After each fresh install - I uninstalled/installed QGIS a few times -
>and
>the first crash, I get this message when I open QGIS again : « Plugin
>processing : The plugin will be disabled because it crashed QGIS during
>last
>startup. Please report an issue and re-enable the plugin when the
>problem
>has been solved.” When I try to activate the plugin by ticking the box
>in
>the ‘Manage and Install Plugins’ menu, my computer crashes again.
>I have tried to install other standalone versions of QGIS, ie, 3.12.0-2
>and
>3.8.3-1, and the version that comes with the osgeo4w installer, and
>they all
>cause the same problem. Only when I revert to my old 3.4.7 version does
>the
>plugin function without any problem.
>I have also tried to use a new user profile, and even to delete the
>QGIS
>folder in the user/appdata/roaming folder, but this didn’t work.
>I should add that the crashes are not totally systematic, as after one
>fresh
>install, there was no crash when I opened QGIS without Grass functions
>for
>the first time. However, the second time (QGIS with Grass functions),
>it
>crashed again. The next times, it crashed be it with or without Grass
>functions.
>I am using Windows 10 Family edition and I have 2 monitors. When my
>computer
>crashes, I get a blue screen with an error message that is not always
>the
>same, but often it is a WHEA message. I have tried to unplug one of my
>monitors before restarting the computer, but this did not solve the
>issue.
>Of course, I can go on using QGIS 3.4.7, but it would be very helpful
>to
>work with a more recent version, so I would very much appreciate your
>help
>with this issue.
>Thanks!
>Best wishes,
>Sabine
>-------------- next part --------------
>An HTML attachment was scrubbed...
>URL:
><http://lists.osgeo.org/pipermail/qgis-user/attachments/20200331/bc99416d/attachment.html>
>------------------------------
>Subject: Digest Footer
>_______________________________________________
>Qgis-user mailing listQgis-user at lists.osgeo.org
>List info: https://lists.osgeo.org/mailman/listinfo/qgis-user
>Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-user
>------------------------------
>End of Qgis-user Digest, Vol 169, Issue 50
>******************************************

-- 
Envoyé de mon appareil Android avec Courriel K-9 Mail. Veuillez excuser ma brièveté.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/qgis-user/attachments/20200331/f3a14298/attachment-0001.html>


More information about the Qgis-user mailing list