[mapserver-users] geotiff 48bit with mapserver 7 wms

Tue Apr 25 11:48:17 PDT 2017

Hi Benjamin,

thank you for your tip. QGIS renders the tiles if a set min/max and 
"stretch to min/max".
I did the test with a smaller data set (200 tiles 130MB each).

My problem now is, with all tiles (~18500) the connection times out, 
even with small bounding boxes like:

http://192.168.3.231/?MAP=/maps/MAP/eowcs2.map&&SERVICE=WCS&VERSION=1.0.0&REQUEST=GetCoverage&FORMAT=GEOTIFF&COVERAGE=test&BBOX=646021,5524001,648018,5525998&CRS=EPSG:32718&RESPONSE_CRS=EPSG:32718&WIDTH=4000&HEIGHT=4000

(QGIS always uses the full extent as bbox for the query and times out. 
Even zoomed in. *sick*)

The same data set as WMS, with MINSCALEDENOM MAXSCALEDENOM runs very 
smooth.

I did not find very much help regarding performance improvements and 
mapserver. For WMS you find alot.

Cheers,
David

------ Original Message ------
From: "Schepers, Benjamin" <schepers at rvr-online.de>
To: "'mapserver-users at lists.osgeo.org'" 
<mapserver-users at lists.osgeo.org>
Sent: 4/19/2017 10:31:36 AM
Subject: Re: [mapserver-users] geotiff 48bit with mapserver 7 wms

>Hi David, Hi list,
>
>@David: you said "Well QGIS does show just a black image"
>
>I assume that this is just a layer-specific contrast setting. Maybe 
>just play around with stretching (layer properties -> style -> band 
>rendering), e.g. set "min" to "0" and "max" to "255" (per each band) 
>and then set "contrast enhancement" to "stretch to minmax"
>
>Regards Ben
>
>
>
>Mit freundlichen Grüßen
>Im Auftrag
>
>Benjamin Schepers
>
>
>Geodaten, Stadtplanwerk, Luftbilder
>Kronprinzenstraße 6
>45128 Essen
>Fon: +49 201 2069-232
>Fax: +49 201 2069-369
>schepers at rvr-online.de
>
>
>
>Die Regionaldirektorin
>Kronprinzenstraße 35
>45128 Essen
>Zentrale: +49 (0) 201 2069-0
>Fax: +49 (0) 201 2069-500
>www.metropoleruhr.de
>
>Postfach 10 32 64
>45032 Essen
>
>Steuernummer: RVR 112/5797/0116
>USt.-ldNr.: DE 173867500
>
>Diese E-Mail koennte vertrauliche und/oder rechtlich geschuetzte 
>Informationen enthalten.
>Wenn Sie nicht der richtige Adressat sind oder diese E-Mail irrtuemlich 
>erhalten haben, informieren Sie bitte sofort den Absender und 
>vernichten Sie diese Mail.
>Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser E-Mail 
>sind nicht gestattet.
>This e-mail may contain confidential and/or privileged information.
>If you are not the intended recipient (or have received this e-mail in 
>error) please notify the sender immediately and destroy this e-mail.
>Any unauthorised copying, disclosure or distribution of the material in 
>this e-mail is strictly forbidden.
>-----Ursprüngliche Nachricht-----
>Von: mapserver-users [mailto:mapserver-users-bounces at lists.osgeo.org] 
>Im Auftrag von David
>Gesendet: Dienstag, 18. April 2017 18:01
>An: 'mapserver-users at lists.osgeo.org'
>Betreff: Re: [mapserver-users] geotiff 48bit with mapserver 7 wms
>
>So, i did some testing.
>
>The wms is not serving the images with float32 as data type. It shows 
>the same issue, false colors.
>The wcs is working and serving the float32 data type data.
>For my use-case setting the MAXSIZE higher than the tile dimension was 
>important.
>
>Well QGIS does show just a black image, but GlobalMapper is loading the 
>data.
>
>Just out of curiosity, can somebody explain "WCS_SIZE" "..." to me? Is 
>this the size in pixel x y for the complete TILE_INDEX?
>
>David
>
>
>------ Original Message ------From: "David" <david at impstyle.com>
>To: "'mapserver-users at lists.osgeo.org'"
><mapserver-users at lists.osgeo.org>
>Sent: 4/18/2017 11:07:04 AM
>Subject: Re[2]: [mapserver-users] geotiff 48bit with mapserver 7 wms
>
>>Hi Cora,
>>
>>do you use PROCESSING "SCALE=AUTO" with you LAYER definition?
>>
>>SCALE[_n]=AUTO or min,max
>>This directive instructs the GDAL reader to pre-scale the incoming
>>raster data. It is primarily used to scale 16bit or floating point 
>>data
>>to the range 0-255, but can also be used to constrast stretch 8bit
>>data.
>>
>>http://mapserver.org/input/raster.html#special-processing-directives
>>
>>Cheers David
>>
>>
>>------ Original Message ------
>>From: "Berger, Cora" <cora.berger at bezreg-koeln.nrw.de>
>>To: "'mapserver-users at lists.osgeo.org'"
>><mapserver-users at lists.osgeo.org>
>>Sent: 4/18/2017 10:47:42 AM
>>Subject: Re: [mapserver-users] geotiff 48bit with mapserver 7 wms
>>
>>>Dear David, Steve, Ben, etc.
>>>I am working with MapServer-WCS. I still have problems defining the
>>>correct output formats. Input to most of our WCS are 8bit Geotiffs.
>>>The MapServer WCS-output is either tiff, png or jpeg with 24bit or
>>>Png;mode=8bit with 8 bit (if no output format is defined). The
>>>png;mode=8bit-format changes the imagecolours, so it isn't really
>>>useful. I can't get a colored 8bit Geotiff as output (a
>>>8bit-definition always results in greyscale images). I tried 
>>>different
>>>output format-definitions, none of them worked. I can define a 
>>>palette
>>>for the png-format, but unfortunately not for any other format.
>>>For our WCS it is important that the output-data looks the same like
>>>the input-data. It seems that at the moment MapServer can't just pass
>>>the input-data through... This might be a GDAL issue...
>>>
>>>So if you find a way to define your wished output-format, please 
>>>share
>>>it, maybe it helps me, too. Maybe anybody else has an idea?
>>>
>>>Cora
>>>
>>>
>>>>Message: 1
>>>>Date: Mon, 17 Apr 2017 22:14:28 +0000
>>>>From: David <david at impstyle.com>
>>>>To: mapserver-users at lists.osgeo.org
>>>>Subject: Re: [mapserver-users] geotiff 48bit with mapserver 7 wms
>>>>Message-ID:
>>>><em46e35a97-ef4b-4c1a-83bd-bfc62776fa9c at laptop-dfriedrich>
>>>>Content-Type: text/plain; format=flowed; charset=utf-8
>>>>
>>>>Thank you very much Steve. You helped me to understand the problem!
>>>>
>>>>David F.
>>>>
>>>>------ Original Message ------
>>>>From: "Stephen Woodbridge" <woodbri at swoodbridge.com>
>>>>To: mapserver-users at lists.osgeo.org
>>>>Sent: 4/14/2017 9:54:20 PM
>>>>Subject: Re: [mapserver-users] geotiff 48bit with mapserver 7 wms
>>>>
>>>>>Yeah, technically a geotiff can be any format, but mapserver only
>>>>>supports a limit set for band widths.
>>>>>
>>>>>A new version of Mapcache was just released and it has GDAL support
>>>>>in it  and serves WMS, but I'm not sure if it will do what you 
>>>>>want.
>>>>>
>>>>>Sorry, I'm out of ideas on this.
>>>>>
>>>>>-Steve W
>>>>>
>>>>>On 4/14/2017 6:56 PM, David F. wrote:
>>>>>>I did not reply after my latest test, sorry.
>>>>>>I tried all tiff IMAGEMODE for my data set. None gave me 16 bit at
>>>>>>the gis client.
>>>>>>As far as I understand gtiff is 8 bit.
>>>>>>The only IMAGEMODE for integer is signed INT16 , which is
>>>>>>unfortunately the only supported integer data type. For RGB data
>>>>>>unsigned integer is the only integer data type that makes sense.
>>>>>>Just
>>>>>>if i change the IMAGEMODE to FLOAT32 mapserver will serve more 
>>>>>>than
>>>>>>8
>>>>>>bit per band.
>>>>>>I think i will give gdal and float32 bit a try nevertheless it 
>>>>>>will
>>>>>>double the image size.
>>>>>>Maybe someone else has an idea.
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>On April 14, 2017 1:43:09 PM Stephen Woodbridge
>>>>>><woodbri at swoodbridge.com> wrote:
>>>>>>
>>>>>>>http://mapserver.org/mapfile/outputformat.html
>>>>>>>
>>>>>>>Why not serve them a GTiff format for qgis?
>>>>>>>
>>>>>>>You can define multiple output formats in the mapfile, and let 
>>>>>>>the
>>>>>>>browser use the 8bit png and have qgis request images in gtiff
>>>>>>>format.
>>>>>>>
>>>>>>>-Steve
>>>>>>>
>>>>>>>On 4/13/2017 11:03 AM, David wrote:
>>>>>>>>Hi Steve,
>>>>>>>>
>>>>>>>>thank you very much for your help. The Mapserver is serving the
>>>>>>>>tiles with the correct RGB values now. The problem is, that it 
>>>>>>>>is
>>>>>>>>serving
>>>>>>>>8
>>>>>>>>bit per band and not 16 bit.
>>>>>>>>I need the 16bit because i want to use the wms as a base layer
>>>>>>>>for some further processing with qgis or another gis client. So
>>>>>>>>no problem regarding browsers for me.
>>>>>>>>
>>>>>>>>I will take a look and change the data type to float32 for the
>>>>>>>>tiff files. At least this is an supported OUTPUTFORMAT for
>>>>>>>>mapserver.
>>>>>>>>Any suggestions on this matter are highly appreciated.
>>>>>>>>
>>>>>>>>Cheers,
>>>>>>>>David
>>>>>>>>
>>>>>>>>------ Original Message ------
>>>>>>>>From: mapserver-users-request at lists.osgeo.org
>>>>>>>>To: mapserver-users at lists.osgeo.org
>>>>>>>>Sent: 4/12/2017 4:00:02 PM
>>>>>>>>Subject: mapserver-users Digest, Vol 111, Issue 5
>>>>>>>>
>>>>>>>>>Send mapserver-users mailing list submissions to
>>>>>>>>>    mapserver-users at lists.osgeo.org
>>>>>>>>>
>>>>>>>>>To subscribe or unsubscribe via the World Wide Web, visit
>>>>>>>>>    https://lists.osgeo.org/mailman/listinfo/mapserver-users
>>>>>>>>>or, via email, send a message with subject or body 'help' to
>>>>>>>>>    mapserver-users-request at lists.osgeo.org
>>>>>>>>>
>>>>>>>>>You can reach the person managing the list at
>>>>>>>>>    mapserver-users-owner at lists.osgeo.org
>>>>>>>>>
>>>>>>>>>When replying, please edit your Subject line so it is more
>>>>>>>>>specific than "Re: Contents of mapserver-users digest..."
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>Today's Topics:
>>>>>>>>>
>>>>>>>>>      1. geotiff 48bit with mapserver 7 wms (David)
>>>>>>>>>      2. Re: geotiff 48bit with mapserver 7 wms (Stephen
>>>>>>>>>Woodbridge)
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>----------------------------------------------------------------
>>>>>>>>>------
>>>>>>>>>
>>>>>>>>>Message: 1
>>>>>>>>>Date: Wed, 12 Apr 2017 00:22:12 +0000
>>>>>>>>>From: David <david at impstyle.com>
>>>>>>>>>To: mapserver-users at lists.osgeo.org
>>>>>>>>>Subject: [mapserver-users] geotiff 48bit with mapserver 7 wms
>>>>>>>>>Message-ID:
>>>>>>>>><em5ce0e1b3-00b1-463e-8ad8-90100518d131 at laptop-dfriedrich>
>>>>>>>>>Content-Type: text/plain; charset="utf-8"; Format="flowed"
>>>>>>>>>
>>>>>>>>>Hi there,
>>>>>>>>>
>>>>>>>>>iam having some trouble to serve 48 bit geotiff images with a
>>>>>>>>>mapserver
>>>>>>>>>7 wms. I created to layers for speed purposes with scale
>>>>>>>>>limiters.
>>>>>>>>>The
>>>>>>>>>lowres layer is served well and looks good, it is 24bit geotiff
>>>>>>>>>data(8bit per channel). But if the layer changes to the 
>>>>>>>>>highres,
>>>>>>>>>48bit geotiff data(16bit per channel), the data is shown wrong.
>>>>>>>>>I searched for some hints regarding a similar issue but could
>>>>>>>>>not find something.
>>>>>>>>>
>>>>>>>>>This is a screenshot of the loaded highres layer. It does not
>>>>>>>>>matter if i load a bbox inside the browser, qgis or another wms
>>>>>>>>>client.
>>>>>>>>>The
>>>>>>>>>highres data looks always the same.
>>>>>>>>>
>>>>>>>>>image loaded from highres layer:
>>>>>>>>>http://imgur.com/a/B65cp
>>>>>>>>>
>>>>>>>>>the mapfile:
>>>>>>>>>https://pastebin.com/4G2DZErZ
>>>>>>>>>
>>>>>>>>>the gdalinfo for one 16bit 3-band tile:
>>>>>>>>>https://pastebin.com/kfS0BjmE
>>>>>>>>>
>>>>>>>>>Best Regards,
>>>>>>>>>David
>>>>>>>>>-------------- next part -------------- An HTML attachment was
>>>>>>>>>scrubbed...
>>>>>>>>>URL:
>>>>>>>>><http://lists.osgeo.org/pipermail/mapserver-
>>>>users/attachments/20170412/2cded6b6/attachment-0001.html>
>>>>>>>>>
>>>>>>>>>
>>>******************************
>>>_______________________________________________
>>>mapserver-users mailing list
>>>mapserver-users at lists.osgeo.org
>>>https://lists.osgeo.org/mailman/listinfo/mapserver-users
>_______________________________________________
>mapserver-users mailing list
>mapserver-users at lists.osgeo.org
>https://lists.osgeo.org/mailman/listinfo/mapserver-users
>_______________________________________________
>mapserver-users mailing list
>mapserver-users at lists.osgeo.org
>https://lists.osgeo.org/mailman/listinfo/mapserver-users