[OSGeo-Discuss] Batch geocoding

Fri Feb 4 13:18:05 EST 2011

Hi JP,

I live in Barcelona and unfortunately there is no open geocoding service in
Barcelona. In the group of geoinquietos (http://www.geoinquiets.cat/ or
http://wiki.osgeo.org/wiki/Geoinquiets_Barcelona) we are trying to get the
ICC (http://www.icc.cat/) the official agency open the geocoding service they
have.

Cheers,
BOLO

2011/2/4 Stark Hans-Jörg <hansjoerg.stark at fhnw.ch>

> Any initiative for OA is appreciated highly ;o)
>
>
>
> Best,
>
> hj
>
>
>
> *Von:* discuss-bounces at lists.osgeo.org [mailto:
> discuss-bounces at lists.osgeo.org] *Im Auftrag von *JP Glutting
> *Gesendet:* Freitag, 4. Februar 2011 16:17
>
> *An:* OSGeo Discussions
> *Betreff:* Re: [OSGeo-Discuss] Batch geocoding
>
>
>
> There might be a data sharing initiative, there are several different
> actors (city, regional government, etc.). I don't know all of what there is
> out there, and the data was originally collected for another project.
>
>
>
> I think I will be Ok with Yahoo. If it works out, it shouldn't be difficult
> to export the dataset for openaddresses. It isn't my data, though, so I will
> have to ask permission first. It seems like a good idea, though.
>
>
>
> Cheers,
>
> JP
>
> On Fri, Feb 4, 2011 at 3:49 PM, Stark Hans-Jörg <hansjoerg.stark at fhnw.ch>
> wrote:
>
>
>
> *Von:* discuss-bounces at lists.osgeo.org [mailto:
> discuss-bounces at lists.osgeo.org] *Im Auftrag von *JP Glutting
> *Gesendet:* Freitag, 4. Februar 2011 15:34
>
>
> *An:* OSGeo Discussions
> *Betreff:* Re: [OSGeo-Discuss] Batch geocoding
>
>
>
> Hi Hans-Jörg,
>
>
>
> I am not aware that Barcelona (the city?) has a very open geodata strategy,
> but that certainly would be nice. If you know of anyone in the area who
> might know more, I am more than willing to contact them.
>
> *[shj] my mistake. I thought I had read something on this some time ago.
> Maybe also because Spain has strong support in the FOSS domain.*
>
>
>
> I have the addresses, do you mean the coordinates? The address format is
> not ideal, but I am pretty happy with them, as they seem to geocode well in
> the tests I have done.
>
> *[shj] yes, addresses along with co-ordinates.*
>
>
>
> The Yahoo API allows geocoding of 50k addresses a day, which is plenty for
> what I need. I am going to try to use that.
>
> *[shj] that’ll certainly do.*
>
>
>
> Cheers,
>
> JP
>
>
>
> On Fri, Feb 4, 2011 at 3:26 PM, Stark Hans-Jörg <hansjoerg.stark at fhnw.ch>
> wrote:
>
> Hi JP
>
>
>
> Barcelona is unfortunately not well covered yet in OA. But I thought that
> Spain has a very “open” strategy in terms of providing geodata. If you
> manage to get Barcelona addresses (perhaps from council or any other
> “official body”) the OA team will insert these into OA and then you can use
> the REST service.
>
>
>
> Good luck!
>
> -hj
>
>
>
> *Von:* discuss-bounces at lists.osgeo.org [mailto:
> discuss-bounces at lists.osgeo.org] *Im Auftrag von *JP Glutting
> *Gesendet:* Freitag, 4. Februar 2011 15:24
> *An:* OSGeo Discussions
> *Betreff:* Re: [OSGeo-Discuss] Batch geocoding
>
>
>
> Thanks for all the responses! I will track them all down and see how they
> work.
>
>
>
> Stark, I have 146,472 addresses in the city of Barcelona. Many of them are
> duplicates, but at the very least I have 31,514 that need to be coded,
> although that would leave out many that I want to use. I am in the process
> of developing filters to clean out apartment numbers, etc., to be able to
> pull a single coordinate for a whole set of addresses, and there are at
> least 6,000 that are invalid (from the original 146k, so 140k). It is a lot.
> I will take a look at openaddresses and do some testing.
>
>
>
> Thanks!
>
> JP
>
> On Fri, Feb 4, 2011 at 3:10 PM, Stark Hans-Jörg <hansjoerg.stark at fhnw.ch>
> wrote:
>
> The OpenAddresses project (www.openaddresses.org) is supposed to solve
> exactly your problem.
>
> You can use the provided geocoding services (
> http://code.google.com/p/openaddresses/wiki/RESTService)
>
>
>
> OpenAddresses has some regions where data was donated – there you will get
> high-quality results. Unfortunately this is not yet globally available…
>
>
>
> Hth
>
> -hj
>
>
>
> *Von:* discuss-bounces at lists.osgeo.org [mailto:
> discuss-bounces at lists.osgeo.org] *Im Auftrag von *JP Glutting
> *Gesendet:* Freitag, 4. Februar 2011 14:34
> *An:* discuss at lists.osgeo.org
> *Betreff:* [OSGeo-Discuss] Batch geocoding
>
>
>
> Hello,
>
>
>
> I have a large set of addresses (around 150k) that I need to geocode for a
> study (my Masters thesis on heat-related mortality). I am looking into
> different solutions, but I can't find anything that seems like it would work
> properly.
>
>
>
> I could script a solution using Google's map API, but there is a limit of
> 2,500 addreses per day (I can get around them with a little patience).
>
>
>
> Right now the best solution I am looking at geopy for geocoding addresses (
> http://code.google.com/p/geopy/). It seems like a good system, I think I
> can use it to pull addresses out of my database and write back coordinates.
> There is one thing that I am not sure, about, though, is whether I am
> actually allowed to use the Google API without my use being liked to a
> specific web page. The terms of service and form for getting a Google API
> key require a URL linked to a Google account. In fact, it looks like the API
> can only be used through a web site:
>
>
>
> "5.2 *Account Key*. After supplying Google with your account information
> and the URL of your Maps API Implementation, and accepting the Terms, you
> will be issued an alphanumeric key assigned to you by Google that is
> uniquely associated with your Google Account and the URL of your Maps API
> Implementation. Your Maps API Implementation must import the Google Maps
> APIs using this key as described in the Maps APIs Documentation<http://code.google.com/apis/maps/documentation/>,
> and Google will block requests with an invalid key or invalid URL. You may
> only obtain and use a key in accordance with these Terms and the Maps APIs
> Documentation <http://code.google.com/apis/maps/documentation/>."
>
>
>
> So it looks like I can't even get it to work without a URL.
>
>
>
> I can always write a script that loops through results extracted from the
> database, creates URLs and parses the XML results one at a time, but that
> seems like a fairly inelegant solution.
>
>
>
> Does anyone have any good ideas about how to geocode a few thousand
> addresses?
>
>
>
> Many thanks,
>
> JP
>
>
> _______________________________________________
> Discuss mailing list
> Discuss at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/discuss
>
>
>
>
> _______________________________________________
> Discuss mailing list
> Discuss at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/discuss
>
>
>
>
> _______________________________________________
> Discuss mailing list
> Discuss at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/discuss
>
>
>
> _______________________________________________
> Discuss mailing list
> Discuss at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/discuss
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.osgeo.org/pipermail/discuss/attachments/20110204/fb605c99/attachment-0001.html