Hi Wladimir,<div><br></div><div>That is sort of what I thought. Too bad. I was just in Barcelona yesterday, at the CSIC, to get data. Where do you work?</div><div><br></div><div>I am on the geoinquiets list too, but I am afraid I am on so many lists and in so many projects that I don't keep close track of them all. I should hop over and introduce myself, though.</div>
<div><br></div><div>Fins aviat,</div><div>JP</div><div><br></div><div>Public Health - GIS - Bioinformatics<br><a href="http://www.bmeisis.com/" target="_blank">http://www.bmeisis.com</a><div><a href="http://www.bmeisis.com/" target="_blank"></a><a href="http://www.jpglutting.com" target="_blank">http://www.jpglutting.com</a><div>
<br></div></div><br>
<br><br><div class="gmail_quote">On Fri, Feb 4, 2011 at 7:18 PM, Wladimir Szczerban <span dir="ltr"><<a href="mailto:bolosig@gmail.com">bolosig@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex;">
Hi JP, <br><br><span lang="en"><span title="Haz clic para obtener traducciones alternativas">I live</span> <span title="Haz clic para obtener traducciones alternativas">in</span> <span title="Haz clic para obtener traducciones alternativas">Barcelona</span> <span title="Haz clic para obtener traducciones alternativas">and</span> <span title="Haz clic para obtener traducciones alternativas">unfortunately</span> <span title="Haz clic para obtener traducciones alternativas">there is no</span> <span title="Haz clic para obtener traducciones alternativas">open</span> <span title="Haz clic para obtener traducciones alternativas">geocoding</span> <span title="Haz clic para obtener traducciones alternativas">service</span> <span title="Haz clic para obtener traducciones alternativas">in</span> <span title="Haz clic para obtener traducciones alternativas">Barcelona</span><span title="Haz clic para obtener traducciones alternativas">.</span> <span title="Haz clic para obtener traducciones alternativas">In the</span> <span title="Haz clic para obtener traducciones alternativas">group of</span> <span title="Haz clic para obtener traducciones alternativas">geoinquietos</span> <span title="Haz clic para obtener traducciones alternativas">(</span><span title="Haz clic para obtener traducciones alternativas"><a href="http://www.geoinquiets.cat/" target="_blank">http://www.geoinquiets.cat/</a></span> <span title="Haz clic para obtener traducciones alternativas">or</span> <span title="Haz clic para obtener traducciones alternativas"><a href="http://wiki.osgeo.org/wiki/Geoinquiets_Barcelona" target="_blank">http://wiki.osgeo.org/wiki/Geoinquiets_Barcelona</a></span><span title="Haz clic para obtener traducciones alternativas">) we are</span> <span title="Haz clic para obtener traducciones alternativas">trying</span> <span title="Haz clic para obtener traducciones alternativas">to get the</span> <span title="Haz clic para obtener traducciones alternativas">ICC</span> <span title="Haz clic para obtener traducciones alternativas">(</span><span title="Haz clic para obtener traducciones alternativas"><a href="http://www.icc.cat/" target="_blank">http://www.icc.cat/</a></span><span title="Haz clic para obtener traducciones alternativas">)</span> <span title="Haz clic para obtener traducciones alternativas">the</span> <span title="Haz clic para obtener traducciones alternativas">official agency</span> <span title="Haz clic para obtener traducciones alternativas">open the</span> <span title="Haz clic para obtener traducciones alternativas">geocoding service</span> <span title="Haz clic para obtener traducciones alternativas">they have</span><span title="Haz clic para obtener traducciones alternativas">.<br>
<br>Cheers,<br>BOLO<br></span></span><br><div class="gmail_quote">2011/2/4 Stark Hans-Jörg <span dir="ltr"><<a href="mailto:hansjoerg.stark@fhnw.ch" target="_blank">hansjoerg.stark@fhnw.ch</a>></span><div><div></div>
<div class="h5"><br><blockquote class="gmail_quote" style="margin:0pt 0pt 0pt 0.8ex;border-left:1px solid rgb(204, 204, 204);padding-left:1ex">
<div link="blue" vlink="purple" lang="DE-CH"><div><p class="MsoNormal"><span style="font-size:11pt;color:rgb(31, 73, 125)" lang="EN-GB">Any initiative for OA is appreciated highly ;o)</span></p><p class="MsoNormal"><span style="font-size:11pt;color:rgb(31, 73, 125)" lang="EN-GB"> </span></p>
<p class="MsoNormal"><span style="font-size:11pt;color:rgb(31, 73, 125)" lang="EN-GB">Best,</span></p><p class="MsoNormal"><span style="font-size:11pt;color:rgb(31, 73, 125)" lang="EN-GB">hj</span></p><p class="MsoNormal">
<span style="font-size:11pt;color:rgb(31, 73, 125)" lang="EN-GB"> </span></p><p class="MsoNormal" style="margin-left:35.4pt"><b><span style="font-size:10pt" lang="DE">Von:</span></b><span style="font-size:10pt" lang="DE"> <a href="mailto:discuss-bounces@lists.osgeo.org" target="_blank">discuss-bounces@lists.osgeo.org</a> [mailto:<a href="mailto:discuss-bounces@lists.osgeo.org" target="_blank">discuss-bounces@lists.osgeo.org</a>] <b>Im Auftrag von </b>JP Glutting<br>
<b>Gesendet:</b> Freitag, 4. Februar 2011 16:17</span></p><div><div></div><div><br><b>An:</b> OSGeo Discussions<br><b>Betreff:</b> Re: [OSGeo-Discuss] Batch geocoding</div></div><p></p><div><div></div><div>
<p class="MsoNormal" style="margin-left:35.4pt"> </p><p class="MsoNormal" style="margin-left:35.4pt">There might be a data sharing initiative, there are several different actors (city, regional government, etc.). I don't know all of what there is out there, and the data was originally collected for another project.</p>
<div><p class="MsoNormal" style="margin-left:35.4pt"> </p></div><div><p class="MsoNormal" style="margin-left:35.4pt">I think I will be Ok with Yahoo. If it works out, it shouldn't be difficult to export the dataset for openaddresses. It isn't my data, though, so I will have to ask permission first. It seems like a good idea, though. </p>
</div><div><p class="MsoNormal" style="margin-left:35.4pt"> </p></div><div><p class="MsoNormal" style="margin-left:35.4pt">Cheers,</p></div><div><p class="MsoNormal" style="margin-right:0cm;margin-bottom:12pt;margin-left:35.4pt">
JP<br><br></p><div><p class="MsoNormal" style="margin-left:35.4pt">On Fri, Feb 4, 2011 at 3:49 PM, Stark Hans-Jörg <<a href="mailto:hansjoerg.stark@fhnw.ch" target="_blank">hansjoerg.stark@fhnw.ch</a>> wrote:</p><div>
<div><p class="MsoNormal" style="margin-left:35.4pt"><span style="font-size:11pt;color:rgb(31, 73, 125)"> </span></p><p class="MsoNormal" style="margin-left:70.8pt"><b><span style="font-size:10pt" lang="DE">Von:</span></b><span style="font-size:10pt" lang="DE"> <a href="mailto:discuss-bounces@lists.osgeo.org" target="_blank">discuss-bounces@lists.osgeo.org</a> [mailto:<a href="mailto:discuss-bounces@lists.osgeo.org" target="_blank">discuss-bounces@lists.osgeo.org</a>] <b>Im Auftrag von </b>JP Glutting<br>
<b>Gesendet:</b> Freitag, 4. Februar 2011 15:34</span></p><div><p class="MsoNormal" style="margin-left:35.4pt"><br><b>An:</b> OSGeo Discussions<br><b>Betreff:</b> Re: [OSGeo-Discuss] Batch geocoding</p></div><p class="MsoNormal" style="margin-left:70.8pt">
</p><p class="MsoNormal" style="margin-left:70.8pt">Hi Hans-Jörg,</p><div><p class="MsoNormal" style="margin-left:70.8pt"> </p></div><div><div><p class="MsoNormal" style="margin-left:70.8pt">I am not aware that Barcelona (the city?) has a very open geodata strategy, but that certainly would be nice. If you know of anyone in the area who might know more, I am more than willing to contact them. </p>
</div><p class="MsoNormal" style="margin-left:35.4pt"><b><i><span style="font-size:11pt;color:rgb(31, 73, 125)" lang="EN-GB">[shj] my mistake. I thought I had read something on this some time ago. Maybe also because Spain has strong support in the FOSS domain.</span></i></b></p>
</div><div><p class="MsoNormal" style="margin-left:70.8pt"><span lang="EN-GB"> </span></p></div><div><div><p class="MsoNormal" style="margin-left:70.8pt">I have the addresses, do you mean the coordinates? The address format is not ideal, but I am pretty happy with them, as they seem to geocode well in the tests I have done.</p>
</div><p class="MsoNormal" style="margin-left:35.4pt"><b><i><span style="font-size:11pt;color:rgb(31, 73, 125)" lang="EN-GB">[shj] yes, addresses along with co-ordinates.</span></i></b></p></div><div><p class="MsoNormal" style="margin-left:70.8pt">
<span lang="EN-GB"> </span></p></div><div><div><p class="MsoNormal" style="margin-left:70.8pt">The Yahoo API allows geocoding of 50k addresses a day, which is plenty for what I need. I am going to try to use that.</p></div>
<p class="MsoNormal" style="margin-left:35.4pt"><b><i><span style="font-size:11pt;color:rgb(31, 73, 125)">[shj] that’ll certainly do.</span></i></b></p></div><div><div><div><p class="MsoNormal" style="margin-left:70.8pt">
</p></div><div><p class="MsoNormal" style="margin-left:70.8pt">Cheers,</p></div><div><p class="MsoNormal" style="margin-bottom:12pt;margin-left:70.8pt">JP</p></div><div><p class="MsoNormal" style="margin-left:70.8pt">
</p><div><p class="MsoNormal" style="margin-left:70.8pt">On Fri, Feb 4, 2011 at 3:26 PM, Stark Hans-Jörg <<a href="mailto:hansjoerg.stark@fhnw.ch" target="_blank">hansjoerg.stark@fhnw.ch</a>> wrote:</p><div><div>
<p class="MsoNormal" style="margin-left:70.8pt"><span style="font-size:11pt;color:rgb(31, 73, 125)">Hi JP</span></p><p class="MsoNormal" style="margin-left:70.8pt"><span style="font-size:11pt;color:rgb(31, 73, 125)"> </span></p>
<p class="MsoNormal" style="margin-left:70.8pt"><span style="font-size:11pt;color:rgb(31, 73, 125)" lang="EN-GB">Barcelona is unfortunately not well covered yet in OA. But I thought that Spain has a very “open” strategy in terms of providing geodata. If you manage to get Barcelona addresses (perhaps from council or any other “official body”) the OA team will insert these into OA and then you can use the REST service.</span></p>
<p class="MsoNormal" style="margin-left:70.8pt"><span style="font-size:11pt;color:rgb(31, 73, 125)" lang="EN-GB"> </span></p><p class="MsoNormal" style="margin-left:70.8pt"><span style="font-size:11pt;color:rgb(31, 73, 125)" lang="EN-GB">Good luck!</span></p>
<p class="MsoNormal" style="margin-left:70.8pt"><span style="font-size:11pt;color:rgb(31, 73, 125)" lang="EN-GB">-hj</span></p><p class="MsoNormal" style="margin-left:70.8pt"><span style="font-size:11pt;color:rgb(31, 73, 125)" lang="EN-GB"> </span></p>
<p class="MsoNormal" style="margin-left:106.2pt"><b><span style="font-size:10pt" lang="DE">Von:</span></b><span style="font-size:10pt" lang="DE"> <a href="mailto:discuss-bounces@lists.osgeo.org" target="_blank">discuss-bounces@lists.osgeo.org</a> [mailto:<a href="mailto:discuss-bounces@lists.osgeo.org" target="_blank">discuss-bounces@lists.osgeo.org</a>] <b>Im Auftrag von </b>JP Glutting<br>
<b>Gesendet:</b> Freitag, 4. Februar 2011 15:24<br><b>An:</b> OSGeo Discussions<br><b>Betreff:</b> Re: [OSGeo-Discuss] Batch geocoding</span></p><div><div><p class="MsoNormal" style="margin-left:106.2pt"> </p><p class="MsoNormal" style="margin-left:106.2pt">
Thanks for all the responses! I will track them all down and see how they work. </p><div><p class="MsoNormal" style="margin-left:106.2pt"> </p></div><div><p class="MsoNormal" style="margin-left:106.2pt">Stark, I have 146,472 addresses in the city of Barcelona. Many of them are duplicates, but at the very least I have 31,514 that need to be coded, although that would leave out many that I want to use. I am in the process of developing filters to clean out apartment numbers, etc., to be able to pull a single coordinate for a whole set of addresses, and there are at least 6,000 that are invalid (from the original 146k, so 140k). It is a lot. I will take a look at openaddresses and do some testing. </p>
</div><div><p class="MsoNormal" style="margin-left:106.2pt"> </p></div><div><p class="MsoNormal" style="margin-left:106.2pt">Thanks!</p></div><div><p class="MsoNormal" style="margin-bottom:12pt;margin-left:106.2pt">
JP</p><div><p class="MsoNormal" style="margin-left:106.2pt">On Fri, Feb 4, 2011 at 3:10 PM, Stark Hans-Jörg <<a href="mailto:hansjoerg.stark@fhnw.ch" target="_blank">hansjoerg.stark@fhnw.ch</a>> wrote:</p><div><div>
<p class="MsoNormal" style="margin-left:106.2pt"><span style="font-size:11pt;color:rgb(31, 73, 125)" lang="EN-GB">The OpenAddresses project (</span><span style="font-size:11pt;color:rgb(31, 73, 125)"><a href="http://www.openaddresses.org" target="_blank"><span lang="EN-GB">www.openaddresses.org</span></a></span><span style="font-size:11pt;color:rgb(31, 73, 125)" lang="EN-GB">) is supposed to solve exactly your problem.</span></p>
<p class="MsoNormal" style="margin-left:106.2pt"><span style="font-size:11pt;color:rgb(31, 73, 125)" lang="EN-GB">You can use the provided geocoding services (</span><a href="http://code.google.com/p/openaddresses/wiki/RESTService" target="_blank"><span lang="EN-GB">http://code.google.com/p/openaddresses/wiki/RESTService</span></a><span style="font-size:11pt;color:rgb(31, 73, 125)" lang="EN-GB">)</span></p>
<p class="MsoNormal" style="margin-left:106.2pt"><span style="font-size:11pt;color:rgb(31, 73, 125)" lang="EN-GB"> </span></p><p class="MsoNormal" style="margin-left:106.2pt"><span style="font-size:11pt;color:rgb(31, 73, 125)" lang="EN-GB">OpenAddresses has some regions where data was donated – there you will get high-quality results. Unfortunately this is not yet globally available…</span></p>
<p class="MsoNormal" style="margin-left:106.2pt"><span style="font-size:11pt;color:rgb(31, 73, 125)" lang="EN-GB"> </span></p><p class="MsoNormal" style="margin-left:106.2pt"><span style="font-size:11pt;color:rgb(31, 73, 125)" lang="EN-GB">Hth</span></p>
<p class="MsoNormal" style="margin-left:106.2pt"><span style="font-size:11pt;color:rgb(31, 73, 125)" lang="EN-GB">-hj</span></p><div><p class="MsoNormal" style="margin-left:106.2pt"><span style="font-size:11pt;color:rgb(31, 73, 125)" lang="EN-GB"> </span></p>
<p class="MsoNormal" style="margin-left:141.6pt"><b><span style="font-size:10pt" lang="DE">Von:</span></b><span style="font-size:10pt" lang="DE"> <a href="mailto:discuss-bounces@lists.osgeo.org" target="_blank">discuss-bounces@lists.osgeo.org</a> [mailto:<a href="mailto:discuss-bounces@lists.osgeo.org" target="_blank">discuss-bounces@lists.osgeo.org</a>] <b>Im Auftrag von </b>JP Glutting<br>
<b>Gesendet:</b> Freitag, 4. Februar 2011 14:34<br><b>An:</b> <a href="mailto:discuss@lists.osgeo.org" target="_blank">discuss@lists.osgeo.org</a><br><b>Betreff:</b> [OSGeo-Discuss] Batch geocoding</span></p><p class="MsoNormal" style="margin-left:141.6pt">
</p></div><p class="MsoNormal" style="margin-left:141.6pt">Hello, </p><div><div><div><p class="MsoNormal" style="margin-left:141.6pt"> </p></div><div><p class="MsoNormal" style="margin-left:141.6pt">I have a large set of addresses (around 150k) that I need to geocode for a study (my Masters thesis on heat-related mortality). I am looking into different solutions, but I can't find anything that seems like it would work properly.</p>
</div><div><p class="MsoNormal" style="margin-left:141.6pt"> </p></div><div><p class="MsoNormal" style="margin-left:141.6pt">I could script a solution using Google's map API, but there is a limit of 2,500 addreses per day (I can get around them with a little patience). </p>
</div><div><p class="MsoNormal" style="margin-left:141.6pt"> </p></div><div><p class="MsoNormal" style="margin-left:141.6pt">Right now the best solution I am looking at geopy for geocoding addresses (<a href="http://code.google.com/p/geopy/" target="_blank">http://code.google.com/p/geopy/</a>). It seems like a good system, I think I can use it to pull addresses out of my database and write back coordinates. There is one thing that I am not sure, about, though, is whether I am actually allowed to use the Google API without my use being liked to a specific web page. The terms of service and form for getting a Google API key require a URL linked to a Google account. In fact, it looks like the API can only be used through a web site:</p>
</div><div><p class="MsoNormal" style="margin-left:141.6pt"> </p></div><blockquote style="margin:5pt 0cm 5pt 30pt"><div><p class="MsoNormal" style="margin-left:141.6pt">"5.2 <u>Account Key</u>. After supplying Google with your account information and the URL of your Maps API Implementation, and accepting the Terms, you will be issued an alphanumeric key assigned to you by Google that is uniquely associated with your Google Account and the URL of your Maps API Implementation. Your Maps API Implementation must import the Google Maps APIs using this key as described in the <a href="http://code.google.com/apis/maps/documentation/" title="Maps APIs Documentation" target="_blank"><span style="color:rgb(0, 0, 204)">Maps APIs Documentation</span></a>, and Google will block requests with an invalid key or invalid URL. You may only obtain and use a key in accordance with these Terms and the <a href="http://code.google.com/apis/maps/documentation/" title="Maps APIs Documentation" target="_blank"><span style="color:rgb(0, 0, 204)">Maps APIs Documentation</span></a>."</p>
</div></blockquote><p class="MsoNormal" style="margin-left:141.6pt"> </p><div><p class="MsoNormal" style="margin-left:141.6pt">So it looks like I can't even get it to work without a URL. </p></div><div><p class="MsoNormal" style="margin-left:141.6pt">
</p></div><div><p class="MsoNormal" style="margin-left:141.6pt">I can always write a script that loops through results extracted from the database, creates URLs and parses the XML results one at a time, but that seems like a fairly inelegant solution. </p>
</div><div><p class="MsoNormal" style="margin-left:141.6pt"> </p></div><div><p class="MsoNormal" style="margin-left:141.6pt">Does anyone have any good ideas about how to geocode a few thousand addresses?</p></div><div>
<p class="MsoNormal" style="margin-left:141.6pt"> </p></div><div><p class="MsoNormal" style="margin-left:141.6pt">Many thanks,</p></div><div><p class="MsoNormal" style="margin-left:141.6pt">JP</p></div></div></div></div>
</div><p class="MsoNormal" style="margin-bottom:12pt;margin-left:106.2pt"><br>_______________________________________________<br>Discuss mailing list<br><a href="mailto:Discuss@lists.osgeo.org" target="_blank">Discuss@lists.osgeo.org</a><br>
<a href="http://lists.osgeo.org/mailman/listinfo/discuss" target="_blank">http://lists.osgeo.org/mailman/listinfo/discuss</a></p></div><p class="MsoNormal" style="margin-left:106.2pt"> </p></div></div></div></div></div>
<p class="MsoNormal" style="margin-bottom:12pt;margin-left:70.8pt"><br>_______________________________________________<br>Discuss mailing list<br><a href="mailto:Discuss@lists.osgeo.org" target="_blank">Discuss@lists.osgeo.org</a><br>
<a href="http://lists.osgeo.org/mailman/listinfo/discuss" target="_blank">http://lists.osgeo.org/mailman/listinfo/discuss</a></p></div><p class="MsoNormal" style="margin-left:70.8pt"> </p></div></div></div></div></div><p class="MsoNormal" style="margin-right:0cm;margin-bottom:12pt;margin-left:35.4pt">
<br>_______________________________________________<br>Discuss mailing list<br><a href="mailto:Discuss@lists.osgeo.org" target="_blank">Discuss@lists.osgeo.org</a><br><a href="http://lists.osgeo.org/mailman/listinfo/discuss" target="_blank">http://lists.osgeo.org/mailman/listinfo/discuss</a></p>
</div><p class="MsoNormal" style="margin-left:35.4pt"> </p></div></div></div></div></div><br>_______________________________________________<br>
Discuss mailing list<br>
<a href="mailto:Discuss@lists.osgeo.org" target="_blank">Discuss@lists.osgeo.org</a><br>
<a href="http://lists.osgeo.org/mailman/listinfo/discuss" target="_blank">http://lists.osgeo.org/mailman/listinfo/discuss</a><br>
<br></blockquote></div></div></div><br>
<br>_______________________________________________<br>
Discuss mailing list<br>
<a href="mailto:Discuss@lists.osgeo.org">Discuss@lists.osgeo.org</a><br>
<a href="http://lists.osgeo.org/mailman/listinfo/discuss" target="_blank">http://lists.osgeo.org/mailman/listinfo/discuss</a><br>
<br></blockquote></div><br></div>