[TCMUG] Best processes for visualizing large datasets?

[Lime, Steve D (MNIT)]

I agree with Dan that you can get a lot of mileage out of MapServer and PostGIS – plus your favorite server-side scripting language (Pyton, Perl, Node) for connecting to things. Note that MapServer and MapCache also have vector tile support pending – it’s available in pull requests or developer branches.

From: Tcmug [mailto:tcmug-bounces at lists.osgeo.org] On Behalf Of Dan Little
Sent: Monday, May 08, 2017 7:33 AM
To: Jennifer Strahan <strahanjen at gmail.com>
Cc: TCMUG <tcmug at lists.osgeo.org>
Subject: Re: [TCMUG] Best processes for visualizing large datasets?

Depending on the size of data and the analysis needed (and the responsiveness) you are probably still money ahead with a VPS (Amazon, DigitalOcean) with MapServer and PostGIS installed on it.

In terms of covering your requirements:
1. "Connect with Dynamic Data Services".  I wouldn't touch that as a contractor with a 10 foot pole without a lot more spec.  Sorry, can't be super helpful there.
2. Generate Vector Tiles - PostGIS can do this natively now.
3. Create dynamic charts/graphs.  Sounds like you'll want a small query engine that can kick back JSON of whatever.  Then you can feed that to D3 (which is still reasonably trendy).
4. 3D map rendering.  I still don't get the appeal here other than oohs and aahs but it's a personal bias.  Cesium, I think, is your most practical choice at this point.

Anywho, HTH,

-Duck

On Sun, May 7, 2017 at 4:05 PM, Jennifer Strahan <strahanjen at gmail.com<mailto:strahanjen at gmail.com>> wrote:
I've been out of the loop for the past few years, staying home with my now 2 year old and am  trying to get back up to speed on best practices for visualizing and interacting with large datasets (eg. Twin Cities parcels, Foursquare data, etc.).  I'm working with a local consulting group that does a lot of site selection analysis and similar projects.

I've been asked to give some recommendations on server requirements and technology approach and wonder if you all might have some suggestions.

Our requirements are:
1.  Ability to connect with dynamic data sources
2.  Generate vector tiles
3.  Create dynamic charts/graphs - using tools such as d3 (or whatever is preferred these days)
4.  3D map rendering

I started playing with MapBox and looks like we can do a lot with it, but it doesn't offer everything we need and seems like it could get expensive.  I also wonder if I should play with Carto.  In the past, I've worked with PostGIS, MapServer, Tilestache and had access to a server that was managed by an admin person.  I'm wondering if I should recommend that they get a server with the open source stack installed, or if we should rely on services.  If a server is recommended, are there packages that make it easy to install and manage software updates?

Would love to hear your suggestions!

Thanks,
Jennifer



_______________________________________________
Tcmug mailing list
Tcmug at lists.osgeo.org<mailto:Tcmug at lists.osgeo.org>
https://lists.osgeo.org/mailman/listinfo/tcmug

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/tcmug/attachments/20170508/66670026/attachment-0001.html>