[QGIS-Developer] Temporary folders for processing

[Andreas Neumann]

Hi all, 

Thanks all for the discussion. 

In our specific situation we need to put all Processing related files
outside of the C: drive. One of our users made a large analysis on a
shared Windows application server and put the whole server to sleep
because the C:\ drive went full - I have to admit that the available
storage on the C:\ drive was rather limited (only 80GB) for ten
simultaneous users. But users were never supposed to store anything in
the C:\ drive ... I hope that we convince our IT services to offer more
storage on such servers - nonetheless. Maybe there are also policies our
IT servers could set on the C: drive to prevent it from running out of
storage (maybe some quota). 

So for the time being we have to overwrite the "TMP" variable
specifically only for QGIS and also set the setting for "default output
files" to a folder outside of the C:\ drive. 

Thanks and greetings, 

Andreas 

On 2019-11-26 00:07, Nyall Dawson wrote:

> On Mon, 25 Nov 2019 at 21:24, Alexander Bruy <alexander.bruy at gmail.com> wrote: 
> 
>> Temporary files are removed on QGIS exit, so if it crashes these files
>> will be left
>> untouched. AFAIK on the next run it won't be removed, as folder name is unique
>> between runs.
> 
> Just to round out this discussion - if QGIS does crash, then these
> files are still likely to be cleaned up by the operating system
> itself. E.g. on linux they'll be cleaned out at next reboot.
> 
> Nyall
> 
> пн, 25 лист. 2019 о 12:09 Andreas Neumann <a.neumann at carto.net> пише: 
> Thanks Nathan and Alex.
> 
> My follow-up question is: when are these temporary files cleaned/removed? I assume after the process finished - but what happens if QGIS crashes wile processing is running? Will QGIS clean up the old temporary files when it is started the next time?
> 
> Thanks,
> 
> Andreas
> 
> On 2019-11-25 11:06, Alexander Bruy wrote:
> 
> Hi Andreas,
> 
> Processing keeps al temporary files and outputs in the user temporary folder,
> e.g. C:\Usres\user\AppData\Local\Temp\ on WIndows by default and /tmp on Linux.
> 
> пн, 25 лист. 2019 о 11:53 Andreas Neumann <a.neumann at carto.net> пише:
> 
> Hi,
> 
> I would like to know where the temporary files of QGIS processing are stored? I know that there is a setting for default output files (defaults on Windows to C:\Users\username\AppData\Roaming\QGIS\QGIS3\profiles\profilename\processing\outputs - but is this really the same location where also temporary files that are needed during the processing are stored?
> 
> Our issues is that several users share Windows servers and the C partition is only 80GB in size. If 5-10 users are sharing one Windows server, we fear that our C drive is filled really quickly.
> 
> Can we set another temporary drive/folder than "C:\Users\username\AppData\Roaming\QGIS\QGIS3\profiles\profilename\processing\outputs" ? If yes, where do I find this setting?
> 
> Thank you for your help,
> 
> Andreas
> 
> _______________________________________________
> QGIS-Developer mailing list
> QGIS-Developer at lists.osgeo.org
> List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
> Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer
> 
> --
> Alexander Bruy
> _______________________________________________
> QGIS-Developer mailing list
> QGIS-Developer at lists.osgeo.org
> List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
> Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/qgis-developer/attachments/20191126/9528e849/attachment.html>