[OSGeo-Discuss] any spatial databases for high performance geo-computing

[Alex Mandel]

On 05/19/2014 03:04 PM, Zhang, Shuai wrote:
> Hi All,
> 
> sorry for asking, but what do you think is a good choice of spatial database for high performance geo-computing?
> 
> In some high performance computing scenarios, data size tends to be huge, and a bunch of computer clusters work together with high throughput and tense computation. sometimes we use parallel filesystems like lustre, gfs, hdfs to handle specific problems but what if a spatial database?
> 
> I explored some of postgresql cluster solutions, such as streaming replication, pgpool, slony and so on. I think most of them are designed for failover, and they might not be able to stand up with the huge data size and high performance demands. the case is quite alike in oracle and db2 spatial, i think.
> 
> so any suggestions for projects aiming to build a distributed and parallel spatial database running on a cluster?
> 
> Thanks,
> shuai

I haven't used but have a seen a few Hadoop implementations. If you do
research on Sharding that's the kind of db where the data is split
across nodes not redundantly.

http://www.nathankerr.com/projects/parallel-gis-processing/alternative_approaches_to_parallel_gis_processing.html

http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3814183/

Then of course depending on your needs there are plenty of MPI
compatible libraries in various languages.

Thanks,
Alex