[MapProxy] 404 error when attempting to seed from arcgis source
EVANS Wayne
Wayne.EVANS at frequentis.com
Wed Feb 8 10:42:06 PST 2017
Hi Holger,
Both those url's you gave me below worked.
I plugged those bounds into the mapproxy.yaml and seed.yaml config files but the MapProxy demo and the seeding process still give the not found error.
The initial seed output has different bounds and srs value than what I have in my config files(Limited to coverage in: -81.92635, 30.28316, -81.74669, 30.43819 (EPSG:4326)) Do you know where this is pulled from?
C:\Python27\Scripts>mapproxy-seed.exe -f mapproxy\mapproxy.yaml -c 7 -s mapproxy\seed.yaml -i
========== Select seeding tasks ==========
florida_duval:
Seeding cache 'frq_duval_florida_ESN_fill_cache' with grid 'bing_grid' in EPSG:3857
Limited to coverage in: -81.92635, 30.28316, -81.74669, 30.43819 (EPSG:4326)
Levels: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15]
Overwriting: no tiles
Seed this task (y/n)?
The first few lines of output from the seed process look OK then it starts the 404 messages. Is it still a bounds issue?
Start seeding process (1 task)
florida_duval:
Seeding cache 'frq_duval_florida_ESN_fill_cache' with grid 'bing_grid' in EPSG:3857
Limited to coverage in: -81.92635, 30.28316, -81.74669, 30.43819 (EPSG:4326)
Levels: [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15]
Overwriting: no tiles
[13:38:25] 0 0.00% -9120000.00000, 3540000.00000, -9100000.00000, 3560000.00000 (0 tiles) ETA: N/A
[13:38:25] 1 0.00% -9120000.00000, 3540000.00000, -9100000.00000, 3560000.00000 (0 tiles) ETA: N/A
[13:38:25] 2 0.00% -9120000.00000, 3540000.00000, -9100000.00000, 3560000.00000 (0 tiles) ETA: N/A
[13:38:25] 3 0.00% -9120000.00000, 3540000.00000, -9100000.00000, 3560000.00000 (0 tiles) ETA: N/A
[13:38:25] 4 0.00% -9120000.00000, 3540000.00000, -9100000.00000, 3560000.00000 (0 tiles) ETA: N/A
[13:38:25] 5 0.00% -9120000.00000, 3540000.00000, -9100000.00000, 3560000.00000 (0 tiles) ETA: N/A
[13:38:25] 6 0.00% -9120000.00000, 3540000.00000, -9100000.00000, 3560000.00000 (0 tiles) ETA: N/A
[13:38:25] 7 0.00% -9120000.00000, 3540000.00000, -9100000.00000, 3560000.00000 (0 tiles) ETA: N/A
[13:38:25] 8 0.00% -9120000.00000, 3540000.00000, -9100000.00000, 3560000.00000 (0 tiles) ETA: N/A
[13:38:25] 9 0.00% -9120000.00000, 3540000.00000, -9100000.00000, 3560000.00000 (0 tiles) ETA: N/A
[13:38:25] 10 0.00% -9120000.00000, 3540000.00000, -9100000.00000, 3560000.00000 (0 tiles) ETA: N/A
[13:38:25] 11 0.00% -9120000.00000, 3540000.00000, -9100000.00000, 3560000.00000 (0 tiles) ETA: N/A
[13:38:25] 12 0.00% -9120000.00000, 3540000.00000, -9100000.00000, 3560000.00000 (0 tiles) ETA: N/A
[2017-02-08 13:38:26,874] mapproxy.source.wms - WARNING - could not retrieve WMS map: HTTP Error "http://hvg-app-d004.abc.dev/arcgis/rest/services/xxx/ESN_Fill_trans/MapServer/export?f=image&format=png&imageSR=3857&bboxSR=3857&bbox=-
9123905.88126,3551187.8971,-9118249.54117,3556844.23719&size=1184,1184": 404
[2017-02-08 13:38:26,874] mapproxy.source.wms - WARNING - could not retrieve WMS map: HTTP Error "http://hvg-app-d004.abc
.dev/arcgis/rest/services/xxx/ESN_Fill_trans/MapServer/export?f=image&format=png&imageSR=3857&bboxSR=3857&bbox=-
9123905.88126,3556079.86691,-9118249.54117,3561736.207&size=1184,1184": 404
Thanks, Wayne
-----Original Message-----
From: Holger Schiebold [mailto:hschiebold at codematix.de]
Sent: Wednesday, February 08, 2017 5:32 AM
To: EVANS Wayne
Cc: mapproxy at lists.osgeo.org
Subject: Re: [MapProxy] 404 error when attempting to seed from arcgis source
Hi Wayne,
what's happening when you call your service with following parameters?
(a bbox that is in your full extent and in your scale area)
http://hvg-app-d004.abc.dev/arcgis/rest/services/xxx/layer_Fill_trans/MapServer/export?f=image&format=png&imageSR=3857&bboxSR=3857&bbox=-9120000,3540000,-9100000,3560000&size=1184,1184
or with an wgs84 extent ?
f=image&format=png&imageSR=4326&bboxSR=4326&bbox=-81.9263539117,30.283163136,-81.7466908549,30.4381872618&size=1184,1184
you know any client which is really working with your arcgis service in your environment? please compare the requests from this client
you may want to check with openlayers client - http://openlayers.org/en/latest/examples/arcgis-image.html?q=arcgis+rest
regards Holger
Am 08.02.2017 um 02:48 schrieb EVANS Wayne:
> Hi Holger
>
> thanks for the prompt response - again!!
>
> Below is the capabilities for the arcGIS server.
>
> I believe the exportmap operation is available on arcGIS server. If I append "/export?...." to the html I get a response (although it always appears to just be a blank white image)...
>
> I will see if the arcGIS provider can add the TileInfo section.
>
> Wayne
>
> {
> "currentVersion": 10.41,
> "serviceDescription": "ESN xxxxx Fill",
> "mapName": "Layers",
> "description": "",
> "copyrightText": "",
> "supportsDynamicLayers": false,
> "layers": [
> {
> "id": 0,
> "name": "ESN",
> "parentLayerId": -1,
> "defaultVisibility": true,
> "subLayerIds": null,
> "minScale": 750000,
> "maxScale": 0
> }
> ],
> "tables": [],
> "spatialReference": {
> "wkid": 102100,
> "latestWkid": 3857
> },
> "singleFusedMapCache": false,
> "initialExtent": {
> "xmin": -9144351.200826334,
> "ymin": 3533431.5821893755,
> "xmax": -9048606.850273667,
> "ymax": 3582239.8957549967,
> "spatialReference": {
> "wkid": 102100,
> "latestWkid": 3857
> }
> },
> "fullExtent": {
> "xmin": -9133699.7483,
> "ymin": 3516915.637699999,
> "xmax": -9059258.3028,
> "ymax": 3579129.216799997,
> "spatialReference": {
> "wkid": 102100,
> "latestWkid": 3857
> }
> },
> "minScale": 750000,
> "maxScale": 0,
> "units": "esriMeters",
> "supportedImageFormatTypes": "PNG32,PNG24,PNG,JPG,DIB,TIFF,EMF,PS,PDF,GIF,SVG,SVGZ,BMP",
> "documentInfo": {
> "Title": "",
> "Author": "",
> "Comments": "",
> "Subject": "",
> "Category": "",
> "AntialiasingMode": "None",
> "TextAntialiasingMode": "Force",
> "Keywords": "ESN xxxxx"
> },
> "capabilities": "Map,Query,Data",
> "supportedQueryFormats": "JSON, AMF, geoJSON",
> "exportTilesAllowed": false,
> "maxRecordCount": 1000,
> "maxImageHeight": 4096,
> "maxImageWidth": 4096,
> "supportedExtensions": ""
> }
>
>
> -----Original Message-----
> From: hschiebold at codematix.de [mailto:hschiebold at codematix.de]
> Sent: Tuesday, February 07, 2017 3:08 PM
> To: EVANS Wayne
> Cc: mapproxy at lists.osgeo.org
> Subject: Re: [MapProxy] 404 error when attempting to seed from arcgis source
>
> can you post the capabilities of your service here? you can xxx sensitive infos
>
> Mapproxy uses the exportMap operation - is this available in your service?
>
> No Tileinfo section for a Arcgis rest service is unusual I think
>
> Regards Holger
>
>> Am 07.02.2017 um 16:52 schrieb EVANS Wayne <Wayne.EVANS at frequentis.com>:
>>
>> Hi Holger
>>
>> Thanks again for digging into this further!
>>
>> I have it working now with the http://server.arcgisonline.com/arcgis/rest/services/World_Street_Map/MapServer url !!
>>
>> The capabilities page for the arcGIS server I am working with does not have the "Tile Info" section. Is this what I am missing? (i.e. this is required by MapProxy to request the tiles to seed? I sent the link to the arcGIS online capabilities page to our arcGIS server provider and questioned whether this information needs to be added to their server also - but they do not know....
>>
>> Thanks, Wayne
>>
>> -----Original Message-----
>> From: Holger Schiebold [mailto:hschiebold at codematix.de]
>> Sent: Sunday, February 05, 2017 7:07 AM
>> To: EVANS Wayne; mapproxy at lists.osgeo.org
>> Subject: Re: [MapProxy] 404 error when attempting to seed from arcgis source
>>
>> f=image is not available at layer level - f=html is available with the
>> layer 0 - that's why ouputformat not supported for this request
>>
>> http://server.arcgisonline.com/arcgis/rest/services/ESRI_StreetMap_World_2D/MapServer/0
>>
>> please have look at the capabilities
>>
>> capabilities example you can find with
>>
>> http://server.arcgisonline.com/arcgis/rest/services/World_Street_Map/MapServer
>>
>> http://server.arcgisonline.com/arcgis/rest/services/World_Street_Map/MapServer/export?f=image&format=png&imageSR=900913&bboxSR=900913&bbox=-9138963.97583,3570373.5912,-9127651.29565,3581686.27139&size=1184,1184
>>
>> is a correct request
>>
>> so with
>> http://server.arcgisonline.com/arcgis/rest/services/World_Street_Map/MapServer
>> in the url parameter it should work
>>
>> so what does your arcgis service answers compared to arcgisonline
>> service for capabilities?
>>
>> http://hvg-app-d004.abc.dev/arcgis/rest/services
>> /xxx/layer_Fill_trans/MapServer
>>
>> because of the 400 i think that this is not the correct onlineresource of your arcgis service
>>
>> http://server.arcgisonline.com/arcgis/rest/services/World_Street_Map/MapServer?f=pjson
>>
>> is a typical capabilities request - that most clients send - this should work with your url
>>
>>
>> regards Holger
>>
>>
>>> Am 03.02.2017 um 16:29 schrieb EVANS Wayne:
>>> Hi Holger / Travis
>>>
>>> Thanks for the prompt replies!
>>>
>>> The xxx in the url was just an attempt to redact some of the info...
>>>
>>> The 900913 projection is not my choice - this has been the projection used since the system was initially set up several years ago...
>>>
>>> I don’t know if the ArcGIS server supports the "Export Map" Operation - I do not control that server but I will check with the owner.
>>>
>>> I tried going down to the layer level on the ArcGIS server but I still get the same error.
>>>
>>> I tried changing the source to the arcgisonline server (I don’t have ssl setup on my mapProxy so I had to use http instead of https):
>>>
>>> sources:
>>> frq_duval_ESN_fill_arcgissource:
>>> type: arcgis
>>> req:
>>> url: http://server.arcgisonline.com/arcgis/rest/services/ESRI_StreetMap_World_2D/MapServer/0
>>>
>>> Now I get a different error. In the debugger console it says:
>>>
>>> [10:15:27.174] GET http://server.arcgisonline.com/arcgis/rest/services/ESRI_StreetMap_World_2D/MapServer/0/export? f=image&format=png&imageSR=900913&bboxSR=900913&bbox=-9138963.97583,3570373.5912,-9127651.29565,3581686.27139&size=1184,1184 [HTTP/1.1 400 Bad Request 129ms]
>>>
>>> In the mapproxy console it says:
>>>
>>> [2017-02-03 10:12:16,211] mapproxy.source.wms - WARNING - could not retrieve WMS map: HTTP Error "http://server.arcgison
>>> line.com/arcgis/rest/services/ESRI_StreetMap_World_2D/MapServer/0/export?f=image&format=png&imageSR=900913&bboxSR=900913
>>> &bbox=-9138963.97583,3570373.5912,-9127651.29565,3581686.27139&size=1184,1184": 400
>>>
>>> On the web page it says :
>>>
>>> Error: Output format not supported.
>>> Code: 400
>>>
>>> Is this because png is not supported?
>>>
>>> I tried changing the services section in my mapproxy.yaml file (from the default # image_formats: ['image/jpeg'], ['image/png']) to just:
>>>
>>> image_formats: ['image/jpeg']
>>>
>>> But it still seems to ask for png in the GET URL....?
>>>
>>> The suggestion to use the arcgis online is a good idea - if I can get that working then I can go back to the local ArcGIS server provider and try and get it working with them.
>>>
>>> Wayne
>>>
>>> -----Original Message-----
>>> From: MapProxy [mailto:mapproxy-bounces at lists.osgeo.org] On Behalf Of Holger Schiebold
>>> Sent: Friday, February 03, 2017 8:07 AM
>>> To: mapproxy at lists.osgeo.org
>>> Subject: Re: [MapProxy] 404 error when attempting to seed from arcgis source
>>>
>>> the "xxx" in the url is correct?
>>>
>>> i would prefer 3857 instead of the unofficial 900913
>>>
>>> does your arcGIS server supports the "Export Map" Operation?
>>>
>>> you can compare your request with arcgisonline rest service for
>>> world_street_map for example - the request paramters generated from
>>> mapproxy delivers an image at St.George
>>>
>>>
>>>> Am 02.02.2017 um 23:17 schrieb EVANS Wayne:
>>>> Hi List,
>>>>
>>>> I am a MapProxy newbie - I have been working with a system that was set up by others to use WMS / tile sources. (I have previously successfully run seeds with WMS sources using locally stored raw data files.)
>>>>
>>>> I am now trying to add an ArcGIS source which is provided by the customers GIS department and will be updated automatically weekly so that we can pull updates via this system rather than having to copy raw data files over.
>>>>
>>>> The MapProxy is running on a Windows7 machine.
>>>>
>>>> I had to upgrade from 1.5 to 1.9.1 before the MapProxy demo would start with the ArcGIS source defined. Now when I try to run a seed I get 404 errors:
>>>>
>>>> An error occured. Retry in 256 seconds: SourceError('HTTP Error "http://hvg-app-d004.abc.dev/arcgis/rest/services
>>>> /xxx/layer_Fill_trans/MapServer/export?f=image&format=png&imageSR=900913&bboxSR=900913&bbox=-9138963.97583,3570373.5912,-9
>>>> 127651.29565,3581686.27139&size=1184,1184": 404',). Retries left: 93
>>>>
>>>> When I copy and paste this URL into a web browser (on the same MapProxy machine) I do not get a 404 - I get a webpage that appears to have a blank white page. This makes me suspect that maybe there is something blocking the traffic from the MapProxy application to the ArcGIS Server??
>>>>
>>>> I do not control either the MapProxy server (PC) or the ArcGIS server - I am the System Engineer in the middle trying to interface between a map update provider and a GeoServer / GeoWebCache based map function on a proprietary application that my company provides. (I am also not the one who architected this solution...)
>>>>
>>>> I also get errors when I click on the png or jpeg Demo link for the same layer on the MapProxy Demo webpage. (Is this pulled from the cache or does it come directly from the source?)
>>>>
>>>> Are the bounds, max image settings etc. configured on the arcgis server critical to getting this to work correctly?
>>>>
>>>> My relevant MapProxy configuration for the arcgis source is:
>>>>
>>>> services:
>>>> demo:
>>>> kml:
>>>> tms:
>>>> # needs no arguments
>>>> wmts:
>>>> wms:
>>>> # srs: ['EPSG:4326', 'EPSG:900913']
>>>> # image_formats: ['image/jpeg', 'image/png']
>>>> md:
>>>> # metadata used in capabilities documents
>>>> title: MapProxy WMS Proxy
>>>> abstract: This is the fantastic MapProxy.
>>>> online_resource: http://mapproxy.org/
>>>> contact:
>>>> person: Your Name Here
>>>> position: Technical Director
>>>> organization:
>>>> address: Fakestreet 123
>>>> city: Somewhere
>>>> postcode: 12345
>>>> country: Germany
>>>> phone: +49(0)000-000000-0
>>>> fax: +49(0)000-000000-0
>>>> email: info at omniscale.de
>>>> access_constraints:
>>>> This service is intended for private and evaluation use only.
>>>> The data is licensed as Creative Commons Attribution-Share Alike 2.0
>>>> (http://creativecommons.org/licenses/by-sa/2.0/)
>>>> fees: 'None'
>>>>
>>>> layers:
>>>> - name: frq_abc_florida_layer_fill_proxy
>>>> title: frq_abc_florida_layer_fill_proxy
>>>> sources: [frq_abc_florida_layer_fill_cache]
>>>>
>>>> caches:
>>>> frq_abc_florida_layer_fill_cache:
>>>> grids: [bing_grid]
>>>> sources: [frq_abc_layer_fill_arcgissource]
>>>> cache:
>>>> type: file
>>>>
>>>>
>>>> sources:
>>>> frq_abc_layer_fill_arcgissource:
>>>> type: arcgis
>>>> req:
>>>> url: http://hvg-app-d004.abc.dev/arcgis/rest/services/xxx/layer_Fill_trans/MapServer
>>>>
>>>> globals:
>>>> # # coordinate transformation options
>>>> # srs:
>>>> # # WMS 1.3.0 requires all coordiates in the correct axis order,
>>>> # # i.e. lon/lat or lat/lon. Use the following settings to
>>>> # # explicitly set a CRS to either North/East or East/North
>>>> # # ordering.
>>>> # axis_order_ne: ['EPSG:9999', 'EPSG:9998']
>>>> # axis_order_en: ['EPSG:0000', 'EPSG:0001']
>>>> # # you can set the proj4 data dir here, if you need custom
>>>> # # epsg definitions. the path must contain a file named 'epsg'
>>>> # # the format of the file is:
>>>> # # <4326> +proj=longlat +ellps=WGS84 +datum=WGS84 +no_defs <>
>>>> # proj_data_dir: '/path to dir that contains epsg file'
>>>>
>>>> # # cache options
>>>> cache:
>>>> # where to store the cached images
>>>> base_dir: './cache_data'
>>>> # where to store lockfiles
>>>> lock_dir: './cache_data/locks'
>>>> # # request x*y tiles in one step
>>>> # meta_size: [4, 4]
>>>> # # add a buffer on all sides (in pixel) when requesting
>>>> # # new images
>>>> # meta_buffer: 80
>>>>
>>>>
>>>> # image/transformation options
>>>> image:
>>>> paletted: false
>>>> #One of nearest, bilinear or bicubic.
>>>> resampling_method: bicubic
>>>>
>>>> Any suggestions you have regarding what could be the cause of these errors would be appreciated!
>>>>
>>>> Thanks, Wayne
>>>>
>>>> _______________________________________________
>>>> MapProxy mailing list
>>>> MapProxy at lists.osgeo.org
>>>> https://lists.osgeo.org/mailman/listinfo/mapproxy
>>> mit freundlichen Grüßen
>>>
>>
>> mit freundlichen Grüßen
>>
>> --
>> Holger Schiebold
>>
>>
>> ____________________
>> codematix GmbH
>> Felsbachstrasse 5/7
>> D-07745 Jena
>> Tel. +49 (3641) 3038-34
>> www.codematix.de
>>
mit freundlichen Grüßen
--
Holger Schiebold
____________________
codematix GmbH
Felsbachstrasse 5/7
D-07745 Jena
Tel. +49 (3641) 3038-34
www.codematix.de
More information about the MapProxy
mailing list