[QGIS-Developer] Temporary folders for processing

[Nyall Dawson]

On Tue, 26 Nov 2019 at 17:47, Andreas Neumann <a.neumann at carto.net> wrote:
>
> Hi all,
>
> Thanks all for the discussion.
>
> In our specific situation we need to put all Processing related files outside of the C: drive. One of our users made a large analysis on a shared Windows application server and put the whole server to sleep because the C:\ drive went full - I have to admit that the available storage on the C:\ drive was rather limited (only 80GB) for ten simultaneous users. But users were never supposed to store anything in the C:\ drive ... I hope that we convince our IT services to offer more storage on such servers - nonetheless. Maybe there are also policies our IT servers could set on the C: drive to prevent it from running out of storage (maybe some quota).
>
> So for the time being we have to overwrite the "TMP" variable specifically only for QGIS and also set the setting for "default output files" to a folder outside of the C:\ drive.

Why not just set the temp folder environment variable for the whole
user account? QGIS isn't the only application which uses the temp
folder for storing files. You'll likely run into issues elsewhere if
we just work around this on the QGIS side alone...

Nyall


>
> Thanks and greetings,
>
> Andreas
>
> On 2019-11-26 00:07, Nyall Dawson wrote:
>
> On Mon, 25 Nov 2019 at 21:24, Alexander Bruy <alexander.bruy at gmail.com> wrote:
>
>
> Temporary files are removed on QGIS exit, so if it crashes these files
> will be left
> untouched. AFAIK on the next run it won't be removed, as folder name is unique
> between runs.
>
>
> Just to round out this discussion - if QGIS does crash, then these
> files are still likely to be cleaned up by the operating system
> itself. E.g. on linux they'll be cleaned out at next reboot.
>
> Nyall
>
>
>
> пн, 25 лист. 2019 о 12:09 Andreas Neumann <a.neumann at carto.net> пише:
>
>
> Thanks Nathan and Alex.
>
> My follow-up question is: when are these temporary files cleaned/removed? I assume after the process finished - but what happens if QGIS crashes wile processing is running? Will QGIS clean up the old temporary files when it is started the next time?
>
> Thanks,
>
> Andreas
>
> On 2019-11-25 11:06, Alexander Bruy wrote:
>
> Hi Andreas,
>
> Processing keeps al temporary files and outputs in the user temporary folder,
> e.g. C:\Usres\user\AppData\Local\Temp\ on WIndows by default and /tmp on Linux.
>
>
>
> пн, 25 лист. 2019 о 11:53 Andreas Neumann <a.neumann at carto.net> пише:
>
>
> Hi,
>
> I would like to know where the temporary files of QGIS processing are stored? I know that there is a setting for default output files (defaults on Windows to C:\Users\username\AppData\Roaming\QGIS\QGIS3\profiles\profilename\processing\outputs - but is this really the same location where also temporary files that are needed during the processing are stored?
>
> Our issues is that several users share Windows servers and the C partition is only 80GB in size. If 5-10 users are sharing one Windows server, we fear that our C drive is filled really quickly.
>
> Can we set another temporary drive/folder than "C:\Users\username\AppData\Roaming\QGIS\QGIS3\profiles\profilename\processing\outputs" ? If yes, where do I find this setting?
>
> Thank you for your help,
>
> Andreas
>
>
>
> _______________________________________________
> QGIS-Developer mailing list
> QGIS-Developer at lists.osgeo.org
> List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
> Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer
>
>
>
>
>
>
> --
> Alexander Bruy
> _______________________________________________
> QGIS-Developer mailing list
> QGIS-Developer at lists.osgeo.org
> List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
> Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer
>
>