[GRASS-dev] [GRASS GIS] #3166: Parallelization with tiling for grass.script
GRASS GIS
trac at osgeo.org
Mon Sep 26 05:34:19 PDT 2016
#3166: Parallelization with tiling for grass.script
--------------------------+------------------------------
Reporter: wenzeslaus | Owner: grass-dev@…
Type: enhancement | Status: new
Priority: normal | Milestone: 7.4.0
Component: Python | Version: unspecified
Resolution: | Keywords: script, parallel
CPU: Unspecified | Platform: Unspecified
--------------------------+------------------------------
Comment (by huhabla):
I think we can adapt your implementation to use the
MultiModule/ParallelModuleQueue approach. The MultiModule class supports
the execution of a stack of any GRASS modules in a temporary region
environment. Hence instead of implementing a different module executor,
you can use pygrass Module and MultiModule to define the processing. Use
the ParallelModuleQueue to run the stacks in parallel. You have access to
all executed modules and can investigate errors, stdout, stderr and
input/output options.
Hence the TiledWorkflow class would accept MutliModule objects and will
use the ParallelModuleQueue internally to run the module stacks in
parallel. What do you think?
--
Ticket URL: <https://trac.osgeo.org/grass/ticket/3166#comment:2>
GRASS GIS <https://grass.osgeo.org>
More information about the grass-dev
mailing list