[pycsw-devel] problems with harvesting not pycsw servers

Mon Dec 3 15:30:22 PST 2018

Dear devs,

I have deployed the latest version of pycsw from docker repo.

The service is running from here: https://klimeto.com/services/pycsw/latest

I would like to use it as CSW harvesting engine.

However I discovered problems with harvesting the following 2 CSWs:

[1]
https://rpi.gov.sk/rpi_csw/Service.svc/get?request=getcapabilities&service=csw

[2]
https://zbgisws.skgeodesy.sk/zbgiscsw/Service.svc/get?request=GetCapabilities&service=CSW

I prepared XML Body for POST request and sent with curl:

[1] curl -X POST -d @post_rpi.xml https://klimeto.com/services/pycsw/latest
[2]  curl -X POST -d @post_ugkk.xml
https://klimeto.com/services/pycsw/latest

Both respond in ExceptionError:

<?xml version="1.0" encoding="UTF-8" standalone="no"?>

<ows:ExceptionReport xmlns:csw="http://www.opengis.net/cat/csw/2.0.2"
xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:dct="
http://purl.org/dc/terms/" xmlns:gmd="http://www.isotc211.org/2005/gmd"
xmlns:gml="http://www.opengis.net/gml" xmlns:ows="http://www.opengis.net/ows"
xmlns:xs="http://www.w3.org/2001/XMLSchema" xmlns:xsi="
http://www.w3.org/2001/XMLSchema-instance" language="en-US" version="1.2.0"
xsi:schemaLocation="http://www.opengis.net/ows
http://schemas.opengis.net/ows/1.0.0/owsExceptionReport.xsd">
<ows:Exception exceptionCode="NoApplicableCode" locator="source">
<ows:ExceptionText>Harvest (insert) failed: (psycopg2.IntegrityError) null
value in column "identifier" violates not-null constraint
DETAIL:  Failing row contains (null, csw:Record,
http://www.opengis.net/cat/csw/2.0.2, local, 2018-12-03T23:10:32Z,
\x3c457863657074696f6e5265706f727420786d6c6e733d22687474703a2f2f..., An
unexpected error occurred. Original message: 'No Content-type..., null,
null, null, null, null, null, null, null, null, null, null, null, null,
null, null, null, null, null, null, null, null, null, null, null, null,
null, https://zbgisws.skgeodesy.sk/zbgiscsw/Service.svc/post, null, null,
null, null, null, null, null, null, null, null, null, null, null, null,
null, null, null, null, null, null, null, null, 'content':9 'content-typ':8
'error':3 'messag':6 'occur':4 'orig..., null).
[SQL: 'INSERT INTO records (typename, schema, mdsource, insert_date, xml,
anytext, language, type, title, title_alternate, abstract, keywords,
keywordstype, parentidentifier, relation, time_begin, time_end,
topicategory, resourcelanguage, creator, publisher, contributor,
organization, securityconstraints, accessconstraints, otherconstraints,
date, date_revision, date_creation, date_publication, date_modified,
format, source, crs, geodescode, denominator, distancevalue, distanceuom,
wkt_geometry, servicetype, servicetypeversion, operation, couplingtype,
operateson, operatesonidentifier, operatesoname, degree, classification,
conditionapplyingtoaccessanduse, lineage, responsiblepartyrole,
specificationtitle, specificationdate, specificationdatetype, links,
anytext_tsvector, wkb_geometry) VALUES (%(typename)s, %(schema)s,
%(mdsource)s, %(insert_date)s, %(xml)s, %(anytext)s, %(language)s,
%(type)s, %(title)s, %(title_alternate)s, %(abstract)s, %(keywords)s,
%(keywordstype)s, %(parentidentifier)s, %(relation)s, %(time_begin)s,
%(time_end)s, %(topicategory)s, %(resourcelanguage)s, %(creator)s,
%(publisher)s, %(contributor)s, %(organization)s, %(securityconstraints)s,
%(accessconstraints)s, %(otherconstraints)s, %(date)s, %(date_revision)s,
%(date_creation)s, %(date_publication)s, %(date_modified)s, %(format)s,
%(source)s, %(crs)s, %(geodescode)s, %(denominator)s, %(distancevalue)s,
%(distanceuom)s, %(wkt_geometry)s, %(servicetype)s, %(servicetypeversion)s,
%(operation)s, %(couplingtype)s, %(operateson)s, %(operatesonidentifier)s,
%(operatesoname)s, %(degree)s, %(classification)s,
%(conditionapplyingtoaccessanduse)s, %(lineage)s, %(responsiblepartyrole)s,
%(specificationtitle)s, %(specificationdate)s, %(specificationdatetype)s,
%(links)s, %(anytext_tsvector)s, %(wkb_geometry)s)'] [parameters:
{'securityconstraints': None, 'date_publication': None, 'couplingtype':
None, 'conditionapplyingtoaccessanduse': None, 'time_end': None,
'date_creation': None, 'wkb_geometry': None, 'keywords': None, 'title':
None, 'specificationdatetype': None, 'source': '
https://zbgisws.skgeodesy.sk/zbgiscsw/Service.svc/post', 'classification':
None, 'topicategory': None, 'parentidentifier': None, 'format': None,
'operation': None, 'servicetypeversion': None, 'accessconstraints': None,
'wkt_geometry': None, 'xml': b'<ExceptionReport xmlns="
http://www.opengis.net/ows" xmlns:xsi="
http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="
http://www.opengis.net ... (114 characters truncated) ...
icableCode"><ExceptionText>An unexpected error occurred. Original
message: \'No Content-type
provided\'</ExceptionText></Exception></ExceptionReport>',
'schema': 'http://www.opengis.net/cat/csw/2.0.2', 'contributor': None,
'date_revision': None, 'geodescode': None, 'degree': None, 'servicetype':
None, 'creator': None, 'operatesonidentifier': None, 'links': None,
'typename': 'csw:Record', 'mdsource': 'local', 'otherconstraints': None,
'anytext_tsvector': None, 'language': None, 'distancevalue': None, 'crs':
None, 'organization': None, 'specificationtitle': None, 'publisher': None,
'time_begin': None, 'resourcelanguage': None, 'denominator': None,
'distanceuom': None, 'anytext': "An unexpected error occurred. Original
message: 'No Content-type provided'", 'title_alternate': None,
'keywordstype': None, 'relation': None, 'responsiblepartyrole': None,
'date': None, 'specificationdate': None, 'type': None, 'operateson': None,
'operatesoname': None, 'date_modified': None, 'abstract': None, 'lineage':
None, 'insert_date': '2018-12-03T23:10:32Z'}] (Background on this error at:
http://sqlalche.me/e/gkpj).</ows:ExceptionText>
</ows:Exception>
</ows:ExceptionReport>

Anybody has an idea where the problem with null violation for identifier is
caused?

Many thanks,
Tomas

<https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail>
Virus-free.
www.avast.com
<https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail>
<#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/pycsw-devel/attachments/20181204/9dc4801e/attachment.html>