[pycsw-devel] problems with harvesting not pycsw servers

Wed Dec 5 16:56:59 PST 2018

Hi Tomas,

Thank you for the report.
I will try to reproduce the error and provide some feedback.

Cheers,
Angelos

On 12/4/18 1:30 AM, Tomas Kliment wrote:
> Dear devs,
>
>
> I have deployed the latest version of pycsw from docker repo.
>
> The service is running from here: https://klimeto.com/services/pycsw/latest
>
> I would like to use it as CSW harvesting engine.
>
> However I discovered problems with harvesting the following 2 CSWs:
>
> [1]
> https://rpi.gov.sk/rpi_csw/Service.svc/get?request=getcapabilities&service=csw
>
> [2]
> https://zbgisws.skgeodesy.sk/zbgiscsw/Service.svc/get?request=GetCapabilities&service=CSW
>
> I prepared XML Body for POST request and sent with curl:
>
> [1] curl -X POST -d @post_rpi.xml https://klimeto.com/services/pycsw/latest
> [2]  curl -X POST -d @post_ugkk.xml
> https://klimeto.com/services/pycsw/latest
>
> Both respond in ExceptionError:
>
> <?xml version="1.0" encoding="UTF-8" standalone="no"?>
> <!-- pycsw 2.3.dev0 -->
> <ows:ExceptionReport xmlns:csw="http://www.opengis.net/cat/csw/2.0.2"
> xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:dct="
> http://purl.org/dc/terms/" xmlns:gmd="http://www.isotc211.org/2005/gmd"
> xmlns:gml="http://www.opengis.net/gml" xmlns:ows="http://www.opengis.net/ows"
> xmlns:xs="http://www.w3.org/2001/XMLSchema" xmlns:xsi="
> http://www.w3.org/2001/XMLSchema-instance" language="en-US" version="1.2.0"
> xsi:schemaLocation="http://www.opengis.net/ows
> http://schemas.opengis.net/ows/1.0.0/owsExceptionReport.xsd">
> <ows:Exception exceptionCode="NoApplicableCode" locator="source">
> <ows:ExceptionText>Harvest (insert) failed: (psycopg2.IntegrityError) null
> value in column "identifier" violates not-null constraint
> DETAIL:  Failing row contains (null, csw:Record,
> http://www.opengis.net/cat/csw/2.0.2, local, 2018-12-03T23:10:32Z,
> \x3c457863657074696f6e5265706f727420786d6c6e733d22687474703a2f2f..., An
> unexpected error occurred. Original message: 'No Content-type..., null,
> null, null, null, null, null, null, null, null, null, null, null, null,
> null, null, null, null, null, null, null, null, null, null, null, null,
> null, https://zbgisws.skgeodesy.sk/zbgiscsw/Service.svc/post, null, null,
> null, null, null, null, null, null, null, null, null, null, null, null,
> null, null, null, null, null, null, null, null, 'content':9 'content-typ':8
> 'error':3 'messag':6 'occur':4 'orig..., null).
> [SQL: 'INSERT INTO records (typename, schema, mdsource, insert_date, xml,
> anytext, language, type, title, title_alternate, abstract, keywords,
> keywordstype, parentidentifier, relation, time_begin, time_end,
> topicategory, resourcelanguage, creator, publisher, contributor,
> organization, securityconstraints, accessconstraints, otherconstraints,
> date, date_revision, date_creation, date_publication, date_modified,
> format, source, crs, geodescode, denominator, distancevalue, distanceuom,
> wkt_geometry, servicetype, servicetypeversion, operation, couplingtype,
> operateson, operatesonidentifier, operatesoname, degree, classification,
> conditionapplyingtoaccessanduse, lineage, responsiblepartyrole,
> specificationtitle, specificationdate, specificationdatetype, links,
> anytext_tsvector, wkb_geometry) VALUES (%(typename)s, %(schema)s,
> %(mdsource)s, %(insert_date)s, %(xml)s, %(anytext)s, %(language)s,
> %(type)s, %(title)s, %(title_alternate)s, %(abstract)s, %(keywords)s,
> %(keywordstype)s, %(parentidentifier)s, %(relation)s, %(time_begin)s,
> %(time_end)s, %(topicategory)s, %(resourcelanguage)s, %(creator)s,
> %(publisher)s, %(contributor)s, %(organization)s, %(securityconstraints)s,
> %(accessconstraints)s, %(otherconstraints)s, %(date)s, %(date_revision)s,
> %(date_creation)s, %(date_publication)s, %(date_modified)s, %(format)s,
> %(source)s, %(crs)s, %(geodescode)s, %(denominator)s, %(distancevalue)s,
> %(distanceuom)s, %(wkt_geometry)s, %(servicetype)s, %(servicetypeversion)s,
> %(operation)s, %(couplingtype)s, %(operateson)s, %(operatesonidentifier)s,
> %(operatesoname)s, %(degree)s, %(classification)s,
> %(conditionapplyingtoaccessanduse)s, %(lineage)s, %(responsiblepartyrole)s,
> %(specificationtitle)s, %(specificationdate)s, %(specificationdatetype)s,
> %(links)s, %(anytext_tsvector)s, %(wkb_geometry)s)'] [parameters:
> {'securityconstraints': None, 'date_publication': None, 'couplingtype':
> None, 'conditionapplyingtoaccessanduse': None, 'time_end': None,
> 'date_creation': None, 'wkb_geometry': None, 'keywords': None, 'title':
> None, 'specificationdatetype': None, 'source': '
> https://zbgisws.skgeodesy.sk/zbgiscsw/Service.svc/post', 'classification':
> None, 'topicategory': None, 'parentidentifier': None, 'format': None,
> 'operation': None, 'servicetypeversion': None, 'accessconstraints': None,
> 'wkt_geometry': None, 'xml': b'<ExceptionReport xmlns="
> http://www.opengis.net/ows" xmlns:xsi="
> http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="
> http://www.opengis.net ... (114 characters truncated) ...
> icableCode"><ExceptionText>An unexpected error occurred. Original
> message: \'No Content-type
> provided\'</ExceptionText></Exception></ExceptionReport>',
> 'schema': 'http://www.opengis.net/cat/csw/2.0.2', 'contributor': None,
> 'date_revision': None, 'geodescode': None, 'degree': None, 'servicetype':
> None, 'creator': None, 'operatesonidentifier': None, 'links': None,
> 'typename': 'csw:Record', 'mdsource': 'local', 'otherconstraints': None,
> 'anytext_tsvector': None, 'language': None, 'distancevalue': None, 'crs':
> None, 'organization': None, 'specificationtitle': None, 'publisher': None,
> 'time_begin': None, 'resourcelanguage': None, 'denominator': None,
> 'distanceuom': None, 'anytext': "An unexpected error occurred. Original
> message: 'No Content-type provided'", 'title_alternate': None,
> 'keywordstype': None, 'relation': None, 'responsiblepartyrole': None,
> 'date': None, 'specificationdate': None, 'type': None, 'operateson': None,
> 'operatesoname': None, 'date_modified': None, 'abstract': None, 'lineage':
> None, 'insert_date': '2018-12-03T23:10:32Z'}] (Background on this error at:
> http://sqlalche.me/e/gkpj).</ows:ExceptionText>
> </ows:Exception>
> </ows:ExceptionReport>
>
> Anybody has an idea where the problem with null violation for identifier is
> caused?
>
> Many thanks,
> Tomas
>
> <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail>
> Virus-free.
> www.avast.com
> <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail>
> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>
>
>
> _______________________________________________
> pycsw-devel mailing list
> pycsw-devel at lists.osgeo.org
> https://lists.osgeo.org/mailman/listinfo/pycsw-devel

-- 
Angelos Tzotsos, PhD
Charter Member
Open Source Geospatial Foundation
http://users.ntua.gr/tzotsos

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/pycsw-devel/attachments/20181206/3e8c49a9/attachment.html>