[GRASS-dev] [GRASS GIS] #3166: Parallelization with tiling for grass.script

GRASS GIS trac at osgeo.org
Mon Sep 26 05:34:19 PDT 2016


#3166: Parallelization with tiling for grass.script
--------------------------+------------------------------
  Reporter:  wenzeslaus   |      Owner:  grass-dev@…
      Type:  enhancement  |     Status:  new
  Priority:  normal       |  Milestone:  7.4.0
 Component:  Python       |    Version:  unspecified
Resolution:               |   Keywords:  script, parallel
       CPU:  Unspecified  |   Platform:  Unspecified
--------------------------+------------------------------

Comment (by huhabla):

 I think we can adapt your implementation to use the
 MultiModule/ParallelModuleQueue approach. The MultiModule class supports
 the execution of a stack of any GRASS modules in a temporary region
 environment. Hence instead of implementing a different module executor,
 you can use pygrass Module and MultiModule to define the processing. Use
 the ParallelModuleQueue to run the stacks in parallel. You have access to
 all executed modules and can investigate errors, stdout, stderr and
 input/output options.

 Hence the TiledWorkflow class would accept MutliModule objects and will
 use the ParallelModuleQueue internally to run the module stacks in
 parallel. What do you think?

--
Ticket URL: <https://trac.osgeo.org/grass/ticket/3166#comment:2>
GRASS GIS <https://grass.osgeo.org>



More information about the grass-dev mailing list