[Pywps-dev] Asynchronous processing

[Luís de Sousa]

Hi everyone, here's what came out of our analysis on this issue:

. Celery seems to be an overkill at this stage - it is actually a
second service that must be set up and configured on its own. It will
also make installing PyWPS somewhat more complex. Since Calin only has
6 weeks left in his internship we decided not to tackle it.

. Multiprocessing has no inbuilt ability to pause/resume a process.
This means that we are unlikely to achieve full WPS 2.0 compliance
during Calin's internship. There are messaging libraries that could be
explored later on for this purpose; it might be a better strategy than
going full on with Celery.

. Flask comes with inbuilt multiprocessing functionality - this is
what Calin will explore in first place.

Regards,

Luís

On 22 April 2015 at 09:13, Jorge Samuel Mendes de Jesus
<jorge.mendesdejesus at wur.nl> wrote:
> Hi Calin
>
> I once or twice looked at the documentation of Celery to use it inside
> Flask, I must say that is a very interesting thing, the problem is that
> it would have to be installed together with pywps and configured adding
> another layer of complexity, my opinion is for pywps to run using
> multiprocess and then later give a look at Celery (this could be the
> perfect topic for google summer school)
>
> Jorge
>
> On 20-04-15 12:02, Calin Ciociu wrote:
>> Hello everyone,
>>
>>
>> Looking at running processes asynchronously for implementing the
>> status XML response I wanted to ask if there were already some
>> ideas/plans for using some specific python library?
>>
>> This needs to be done with multiprocessing and I read something about
>> using task queue like Celery.
>>
>> What do you think about this?
>>
>>
>> Calin
>> _______________________________________________
>> pywps-dev mailing list
>> pywps-dev at lists.osgeo.org
>> http://lists.osgeo.org/cgi-bin/mailman/listinfo/pywps-dev
>
> --
> ISRIC - World Soil Information
> Post: PO box 353, 6700 AJ, Wageningen,
> The Netherlands Visiting Address: Droevendaalsesteeg 3, 6708 PB
> Wageningen (Bdg. 101),
> Office: C.013
> Office Phone: +31 (0) 317 4 83715
> Mobile Phone: +31 (0) 613 9 06950
> OpenPGPKey: 0xA3D0065A
>
> _______________________________________________
> pywps-dev mailing list
> pywps-dev at lists.osgeo.org
> http://lists.osgeo.org/cgi-bin/mailman/listinfo/pywps-dev