[postgis-users] Parallelisation provides powerful postgis performance perks (script + ppt slides) [x-posted: pgsql-performance]
Graeme B. Bell
graeme.bell at nibio.no
Thu Jul 23 06:54:22 PDT 2015
Hi all,
Do you run map intersections between national scale geometry maps in postgis? (or other long-running GIS operations?)
Do you hate that feeling of waiting all day/week for the query to complete?
Well, here's a solution for you.
1. For those that don't like par_psql (http://github.com/gbb/par_psql), this alternative approach uses the Gnu Parallel command to organise parallelism for queries that take days to run usually. We saw up to 20x performance improvements here, a day's work in one hour. May give you a few ideas about how to parallelise your own code with Gnu Parallel.
https://github.com/gbb/fast_map_intersection
2. Also, I gave a talk at FOSS4G Como about these tools (and a few others), and how to get better performance from your PostGIS database with parallelisation.
This may be helpful to people who are new to parallelisation / multi-core work with postgres for GIS work.
http://graemebell.net/foss4gcomo.pdf
Enjoy,
Graeme Bell.
More information about the postgis-users
mailing list