[MapServer-users] Failed to download capabilities:Download of capabilities failed: Connection on mapfile with more than 1000 layers

[Kralidis,Tom (ECCC)]

Option: we could consider adding a mapfile directive to point to a GetCapabilities file (oh disk), which can act as an early out (instead of generating Capabilities XML on the fly).  We would want to test how effective this would be for larger mapfiles (i.e. reading mapfile vs. rendering Capabilities XML).

Feel free to open an issue if this could be helpful/is of interest.

Thanks

..Tom



From: MapServer-users <mapserver-users-bounces at lists.osgeo.org> On Behalf Of Oskar Ravhed
Sent: Tuesday, December 20, 2022 10:01
To: Rahkonen Jukka <jukka.rahkonen at maanmittauslaitos.fi>; Marcin Niemyjski <mniemyjski at cloudferro.com>; mapserver-users at lists.osgeo.org
Subject: Re: [MapServer-users] Failed to download capabilities:Download of capabilities failed: Connection on mapfile with more than 1000 layers

You don't often get email from oskar.ravhed at t-kartor.com<mailto:oskar.ravhed at t-kartor.com>. Learn why this is important<https://aka.ms/LearnAboutSenderIdentification>

Hi it took 40 s



Merry Christmas
On 20/12/2022 15:38, Rahkonen Jukka wrote:
Hi,

The time is not a constant (number of layers * x milliseconds). For example, it is faster to generate the layer BoundingBox into GetCapabilities if the wms_extent metadata is set for the layer https://www.mapserver.org/ogc/wms_server.html<https://can01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.mapserver.org%2Fogc%2Fwms_server.html&data=05%7C01%7CTom.Kralidis%40ec.gc.ca%7C58416ade2edc4ef4f60d08dae29b0d3b%7C740c5fd36e8b41769cc9454dbe4e62c4%7C0%7C0%7C638071454009300660%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=lKZE3%2F%2Bg5NpBH%2BoGyk%2BMy9CXLdtFWjKPqcAye61n2qw%3D&reserved=0> but how much faster it is depends on the data source.

I think that instead of 1200 layers you could have just one time enabled layer https://www.mapserver.org/ogc/wms_time.html<https://can01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.mapserver.org%2Fogc%2Fwms_time.html&data=05%7C01%7CTom.Kralidis%40ec.gc.ca%7C58416ade2edc4ef4f60d08dae29b0d3b%7C740c5fd36e8b41769cc9454dbe4e62c4%7C0%7C0%7C638071454009300660%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=1CtW%2BMfLBUq3DtOZ%2FTX9PzoNjSjgETQ4FDBJ3uRg9kQ%3D&reserved=0>.

-Jukka Rahkonen-

Lähettäjä: MapServer-users <mapserver-users-bounces at lists.osgeo.org><mailto:mapserver-users-bounces at lists.osgeo.org> Puolesta Marcin Niemyjski via MapServer-users
Lähetetty: tiistai 20. joulukuuta 2022 16.18
Vastaanottaja: Oskar Ravhed <oskar.ravhed at t-kartor.com><mailto:oskar.ravhed at t-kartor.com>; mapserver-users at lists.osgeo.org<mailto:mapserver-users at lists.osgeo.org>
Aihe: Re: [MapServer-users] Failed to download capabilities:Download of capabilities failed: Connection on mapfile with more than 1000 layers


Great advice, thank you Oskar.

Could you tell me how long it takes to load the WMS into qgis or GetCap with that many layers?
I am also interested in what purpose you are using the WMS with this amount of data. Could you share it? In my case it is daily Sentinel-1 imagery for the whole world from the beginning of 2021.

Merry Christmas to all,
Marcin

________________________________
From: MapServer-users <mapserver-users-bounces at lists.osgeo.org<mailto:mapserver-users-bounces at lists.osgeo.org>> on behalf of Oskar Ravhed <oskar.ravhed at t-kartor.com<mailto:oskar.ravhed at t-kartor.com>>
Sent: Tuesday, December 20, 2022 1:08 PM
To: mapserver-users at lists.osgeo.org<mailto:mapserver-users at lists.osgeo.org> <mapserver-users at lists.osgeo.org<mailto:mapserver-users at lists.osgeo.org>>
Subject: Re: [MapServer-users] Failed to download capabilities:Download of capabilities failed: Connection on mapfile with more than 1000 layers

Hello!

I have 3234 layers in a service and it works fine. also works fine with
10.000 layers

1 try the getcap in browser
2a if step 1 is success change network timeout in qgis
2b if step 1 does not work change timeouts on server and check mapserver
log

On 20/12/2022 09:59, Jörg Thomsen (WhereGroup) wrote:
> Hi,
>
> funny, how you type twelve.
>
> 1200 are very much and I guess no one has tried this before.
> So to your question: I would say yes.
>
> I suggest to split it into several services / mapfiles. The
> capability-xml ist very big I think and most clients will habe
> problems with it. The usability is bad, the users have to scroll
> through 1200 Layers, puh. And I don't know whether a getMap with
> http-get will work (is there a current length-limit in http-get?).
>
>
> Jörg
>
>
>  Am 20.12.22 um 09:42 schrieb Marcin Niemyjski via MapServer-users:
>> Hello,
>>
>> I have a mapfile which constist of 1200 layers. While loading to qgis
>> error "Failed to download capabilities:Download of capabilities
>> failed: Connection" is recived.
>>
>> Does this happen becaues of quantitu of layers in mapfile? Is there
>> any workaround?
>>
>> Best,
>> Marcin
>>
>> _______________________________________________
>> MapServer-users mailing list
>> MapServer-users at lists.osgeo.org<mailto:MapServer-users at lists.osgeo.org>
>> https://lists.osgeo.org/mailman/listinfo/mapserver-users<https://can01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.osgeo.org%2Fmailman%2Flistinfo%2Fmapserver-users&data=05%7C01%7CTom.Kralidis%40ec.gc.ca%7C58416ade2edc4ef4f60d08dae29b0d3b%7C740c5fd36e8b41769cc9454dbe4e62c4%7C0%7C0%7C638071454009300660%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=UmyXdb30gN1%2FNEvpoBqsr1SwAWBYK3p6VyoMNcgzyKo%3D&reserved=0>
>

_______________________________________________
MapServer-users mailing list
MapServer-users at lists.osgeo.org<mailto:MapServer-users at lists.osgeo.org>
https://lists.osgeo.org/mailman/listinfo/mapserver-users<https://can01.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.osgeo.org%2Fmailman%2Flistinfo%2Fmapserver-users&data=05%7C01%7CTom.Kralidis%40ec.gc.ca%7C58416ade2edc4ef4f60d08dae29b0d3b%7C740c5fd36e8b41769cc9454dbe4e62c4%7C0%7C0%7C638071454009300660%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000%7C%7C%7C&sdata=UmyXdb30gN1%2FNEvpoBqsr1SwAWBYK3p6VyoMNcgzyKo%3D&reserved=0>


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/mapserver-users/attachments/20221220/0d25eb99/attachment-0001.htm>