[postgis-users] Multi-server, multi-core reverse_geocode processing

[Barry McCall]

I was just wondering if anyone was utilizing multiple servers with a large
amount of cores to harness multi-threading for batch processing?

I'm currently running a farm of 4 systems with 32 cores per system. A
number of bash scripts handle grabbing files from an s3 bucket when files
exist. The design is able to scale up as needed by simply spinning up a new
image. After doing a POC this weekend I've obtained some benchmark numbers.
I was able to successfully reverse geocode 46,826,673 lon/lats in an
average of 33 hours. (Approx 353,834 records per hour, per-machine,
1,415,337 per hour across the farm)

Was just curious if anyone else had designed something like this and what
your design methodologies were?!

I've only posted a few questions but wanted to contribute what I had going
on :-)

Thanks again for all the previous help!

-Barry
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/postgis-users/attachments/20141222/781f7ada/attachment.html>