<div dir="ltr">Hi Tom,<div><br></div><div>Thanks for quick answer.</div><div><br></div><div>Attached is the export from my database for the services in concern - WMS version 1.1.1 harvested by pycsw (980 records)</div><div><br></div><div>As I mentioned I collected and stored all the info received from CSW Harvest response issued from pycsw.</div><div><br></div><div>MetadataInserted - column L, metadataUpdate and metadataDeleted - those are 0 since it was a first harvest.</div><div><br></div><div>The column K provides a sum, which is (metadataInserted + metadataUpdated) - metadataDeleted.</div><div><br></div><div>If you sum column K you get <b>16525</b>.</div><div><br></div><div>If you send GetRecords for all to sane <a href="https://bolegweb.geof.unizg.hr/pycsw_wms">endpoint </a>which was used to harvest those 980 WMS services you get <b>231</b></div><div><b><br></b></div><div>What do you think?</div><div><br></div><div>Would like to resolve this since I wish to use your implementation to create metadata for thousands other OGC services I collect.</div><div><br></div><div>Thank you!</div><div>Tomas</div><div><b><br></b></div></div><div class="gmail_extra"><br><div class="gmail_quote">On 3 September 2016 at 19:42, Tom Kralidis <span dir="ltr"><<a href="mailto:tomkralidis@gmail.com" target="_blank">tomkralidis@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi Tomas:<br><div><div><div class="gmail_extra"><br><div class="gmail_quote"><span class="">On Fri, Sep 2, 2016 at 4:26 PM, Tomas Kliment <span dir="ltr"><<a href="mailto:tomas.kliment@gmail.com" target="_blank">tomas.kliment@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi Tom,<div><br></div><div>First of all let me thank you for a great and light CSW implementation, I recently switched from Geonetwork.</div><div><br></div></div></blockquote><div><br></div></span><div>Thank you for the kind words!<br></div><span class=""><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div></div><div>However, in my project <a href="https://bolegweb.geof.unizg.hr" target="_blank">Bolegweb</a> I have planned top use pycsw as a catalogue of metadata harvested from the OGC Services I collected from Google SE using scrapper and crawler.</div><div><br></div><div>Today, I finished and run one PHP script (attached) which sends CSW harvesting request to my <a href="https://bolegweb.geof.unizg.hr/pycsw_wms" target="_blank">pycsw</a> instance for all online WMS 1.1.1 services available in my database. I collect info about metadata inserted, updated and deleted from each service response and collected more than 16 thousands metadata based on sum of CSW responses XML outputs.</div><div><br></div><div>However, when I look at the underneath postgres database, as well as when I try to call GetRecords for all the records I receive only 231 records.</div><div><br></div><div>Could you please advice me what I do wrong, when the pycsw CSW Harvesting responses report more than 16k records, and actually the database contains only 231?</div><div><br></div></div></blockquote><div><br></div></span><div>With the exception of WPS, all other OWS harvesting should store all of a service's resources as well as a record for the service itself (e.g. for a WMS with 16 layers, 16+1 records). Can you send a sample list of services so I can test locally and try to reproduce?<br><br></div><div>Thanks<span class="HOEnZb"><font color="#888888"><br><br></font></span></div><span class="HOEnZb"><font color="#888888"><div>..Tom<br><br></div></font></span><span class=""><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div></div><div>Thank you in advance for any hints,</div><div>Tomas <span><font color="#888888"><br clear="all"><div><br></div>-- <br><div data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr">------------------------------<wbr>------------------------------<wbr>------<br><div><a href="http://about.me/klimeto" style="margin:0px;padding:0px;border:0px;outline:0px;font-size:14px;vertical-align:baseline;color:rgb(43,130,173);text-decoration:none;line-height:18.2000007629395px" target="_blank"><font face="tahoma, sans-serif"></font><table style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;vertical-align:baseline;border-spacing:0px" border="0" cellpadding="0" cellspacing="0"><tbody style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;vertical-align:baseline"><tr style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;vertical-align:baseline"><td colspan="3" style="padding:0px;border:0px;outline:0px;font-style:inherit;font-size:0px;vertical-align:baseline;height:30px"> </td></tr><tr style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;vertical-align:baseline"><td style="padding:0px;border:0px;outline:0px;font-style:inherit;vertical-align:top;line-height:1" align="left" valign="top"><div style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;vertical-align:baseline"><img src="http://d13pix9kaak6wt.cloudfront.net/signature/me-badge.png" alt="Tomas Kliment on about.me" style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;vertical-align:baseline;display:block" height="48" width="48"></div></td><td style="padding:0px;border:0px;outline:0px;font-style:inherit;font-size:0px;vertical-align:baseline;width:8px"> </td><td style="padding:0px;border:0px;outline:0px;font-style:inherit;vertical-align:middle;height:48px;line-height:0.9" align="left" valign="middle"><div style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:bold;font-style:inherit;font-size:18px;vertical-align:baseline;line-height:1;color:rgb(51,51,51)">Ing. Tomas Kliment, PhD.</div><div style="margin:2px 0px 0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;font-size:12px;vertical-align:baseline">about.me/klimeto</div></td></tr><tr style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;vertical-align:baseline"><td colspan="3" style="padding:0px;border:0px;outline:0px;font-style:inherit;font-size:0px;vertical-align:baseline;height:20px"> </td></tr></tbody></table></a><p style="margin-bottom:0.0001pt;background-image:initial;background-repeat:initial"><br></p></div></div></div></div></div><div dir="ltr"><blockquote style="margin:0 0 0 40px;border:none;padding:0px"><div><div><div><div></div></div></div></div></blockquote><div><div dir="ltr"><div dir="ltr"><div dir="ltr">
<div><div></div></div></div></div></div></div></div></div></div></div></div></div>
</font></span></div></div>
</blockquote></span></div><br></div></div></div></div>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr">------------------------------------------------------------------<br><div><a href="http://about.me/klimeto" style="margin:0px;padding:0px;border:0px;outline:0px;font-size:14px;vertical-align:baseline;color:rgb(43,130,173);text-decoration:none;line-height:18.2000007629395px" target="_blank"><font face="tahoma, sans-serif"></font><table border="0" cellpadding="0" cellspacing="0" style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;vertical-align:baseline;border-spacing:0px"><tbody style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;vertical-align:baseline"><tr style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;vertical-align:baseline"><td colspan="3" style="padding:0px;border:0px;outline:0px;font-style:inherit;font-size:0px;vertical-align:baseline;height:30px"> </td></tr><tr style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;vertical-align:baseline"><td align="left" valign="top" style="padding:0px;border:0px;outline:0px;font-style:inherit;vertical-align:top;line-height:1"><div style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;vertical-align:baseline"><img src="http://d13pix9kaak6wt.cloudfront.net/signature/me-badge.png" alt="Tomas Kliment on about.me" width="48" height="48" style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;vertical-align:baseline;display:block"></div></td><td style="padding:0px;border:0px;outline:0px;font-style:inherit;font-size:0px;vertical-align:baseline;width:8px"> </td><td align="left" valign="middle" style="padding:0px;border:0px;outline:0px;font-style:inherit;vertical-align:middle;height:48px;line-height:0.9"><div style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:bold;font-style:inherit;font-size:18px;vertical-align:baseline;line-height:1;color:rgb(51,51,51)">Ing. Tomas Kliment, PhD.</div><div style="margin:2px 0px 0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;font-size:12px;vertical-align:baseline">about.me/klimeto</div></td></tr><tr style="margin:0px;padding:0px;border:0px;outline:0px;font-weight:inherit;font-style:inherit;vertical-align:baseline"><td colspan="3" style="padding:0px;border:0px;outline:0px;font-style:inherit;font-size:0px;vertical-align:baseline;height:20px"> </td></tr></tbody></table></a><p style="margin-bottom:0.0001pt;background-image:initial;background-repeat:initial"><br></p></div></div></div></div></div><div dir="ltr"><blockquote style="margin:0 0 0 40px;border:none;padding:0px"><div><div><div><div></div></div></div></div></blockquote><div><div dir="ltr"><div dir="ltr"><div dir="ltr">
<div><div></div></div></div></div></div></div></div></div></div></div></div></div>
</div>