[mapserver-users] Variable substitution error with non-ASCII characters

[Rahkonen Jukka]

Hi,

I have been playing with variable substitution inside the DATA part of my mapfile. I have defined variable %sql% which is tranferred inside a WHERE part of the SQL selecting data for me. The next with &sql=highway='bus_stop' works fine.

http://188.64.1.61/cgi-bin/ms_ows?REQUEST=GetMap&SERVICE=WMS&VERSION=1.1.1&WIDTH=563&HEIGHT=437&LAYERS=osm_pisteet&TRANSPARENT=TRUE&FORMAT=image/png&BBOX=-369151.98300283286,6597900.0,1511076.628895184,8057331.444759207&SRS=EPSG:3067&STYLES=&sql=highway='bus_stop'

However, if the variable contains non-ASCII characters the queries will fail. For example &sql=highway='ä'
gives the following error.


<?xml version='1.0' encoding="ISO-8859-1" standalone="no" ?>
<!DOCTYPE ServiceExceptionReport SYSTEM "http://schemas.opengis.net/wms/1.1.1/exception_1_1_1.dtd">
<ServiceExceptionReport version="1.1.1">
<ServiceException>
msDrawMap(): Image handling error. Failed to draw layer named 'osm_pisteet'.
msPostGISLayerWhichShapes(): Query error. Error (ERROR:  invalid byte sequence for encoding "UTF8": 0xe42729
) executing query: select encode(ST_AsBinary(ST_Force_2D("way"),'NDR'),'hex') as geom,"osm_id" from (select (way),osm_id,tags from osm_point where highway='ä') as foo where way && GeomFromText('POLYGON((-367482.152974504 6599569.83002833,-367482.152974504 8055661.61473088,1509406.79886686 8055661.61473088,1509406.79886686 6599569.83002833,-367482.152974504 6599569.83002833))',3067)
</ServiceException>
</ServiceExceptionReport>

Is there any known way to solve the invalid byte sequence error for example by escaping the none-ASCII characters in some way?

-Jukka Rahkonen-