[mapserver-users] Hindi and Thai text rendering

Peter Mallen peter.mallen at airborne.aero
Fri Dec 14 14:54:41 PST 2012 

Hello Everyone,

We are having issues displaying Hindi in Map Server.  The characters
display correctly in text editors we use, as well as excel, open office
documents and in our sqlite database.  Certain characters appear to flip
around when displaying in Map Sever.  We have tried various different
fonts including: arialuni, devangari, gargi, etc.  We have also tried
using several data types: shapefiles, sqlite databases. 

The following is a link showing how the Hindi characters should display:
http://translate.google.com/#hi/en/%E0%A4%AE%E0%A5%87%E0%A4%95%E0%A5%8D%
E0%A4%B8%E0%A4%BF%E0%A4%95%E0%A5%8B%20%E0%A4%B8%E0%A4%BF%E0%A4%9F%E0%A5%
80

I have included a basic Map File where I am using the TEXT tag to
display the Hindi translation using an HTML string of entities.


MAP
  NAME 'Simple'
  STATUS ON
  SIZE 1280 768
	EXTENT -180 -90 180 90

  UNITS MILES

  IMAGECOLOR 0 0 70
  IMAGETYPE PNG

	#CONFIG "MS_ERRORFILE" "/data2/Hindi_Testing/mapserver.log"
#change this to match your configuration
	
	DEBUG 5

	FONTSET fontset.txt  #This will need to be updated to the
location of the users fontset.txt.  We are using arialuni. 
 
  LAYER
         DEBUG 5
    NAME cities1
    TYPE annotation
    STATUS DEFAULT
    
    FEATURE
       POINTS -99.169998 19.42 END
    END
 		  
    CLASS
            #This HTML string is for 'Mexico City' translated into
Hindi.  Mapserver does not display this correctly.
	TEXT
'मेक्सिको&#x0020
;सिटी'

      LABEL
      	FONT "arialuni"
      	TYPE truetype
      	ENCODING 'UTF-8'
      	SIZE 30
      	COLOR 200 200 0
      	POSITION CC
      	PARTIALS FALSE
      	ALIGN center
     
      END
    END

  END

END # Map File



Thank You,

Peter Mallen



-----Original Message-----
From: mapserver-users-bounces at lists.osgeo.org
[mailto:mapserver-users-bounces at lists.osgeo.org] On Behalf Of
mapserver-users-request at lists.osgeo.org
Sent: Tuesday, June 19, 2012 6:01 AM
To: mapserver-users at lists.osgeo.org
Subject: mapserver-users Digest, Vol 53, Issue 42

Send mapserver-users mailing list submissions to
	mapserver-users at lists.osgeo.org

To subscribe or unsubscribe via the World Wide Web, visit
	http://lists.osgeo.org/mailman/listinfo/mapserver-users
or, via email, send a message with subject or body 'help' to
	mapserver-users-request at lists.osgeo.org

You can reach the person managing the list at
	mapserver-users-owner at lists.osgeo.org

When replying, please edit your Subject line so it is more specific than
"Re: Contents of mapserver-users digest..."


Today's Topics:

   1. Hindi and Thai text rendering (Ian Walberg)
   2. Re: Hindi and Thai text rendering (Jeff McKenna)
   3. Re: Hindi and Thai text rendering (Ian Walberg)
   4. Re: Hindi and Thai text rendering (Stephen Woodbridge)
   5. Re: Hindi and Thai text rendering (Ian Walberg)
   6. Mapfile Variables (Matt McClelland)
   7. Re: Hindi and Thai text rendering (Stephen Woodbridge)


----------------------------------------------------------------------

Message: 1
Date: Mon, 18 Jun 2012 17:45:39 -0400
From: "Ian Walberg" <ian.walberg at airborne.aero>
To: <mapserver-users at lists.osgeo.org>,	<mapserver-dev at lists.osgeo.org>
Subject: [mapserver-users] Hindi and Thai text rendering
Message-ID:
	<D12323219CEDB24AA8FAE53FF3F59FB40362BF83 at BE28.exg3.exghost.com>
Content-Type: text/plain; charset="us-ascii"

Hello list,

 

We are seeing some issues displaying Hindi and Thai text, from a quick
search it looks like this may be related to there not being support for
Indic scripts.

 

Can anyone confirm if these are supported? And if they are not are there
any workarounds?

 

Many thanks

 

Ian

-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.osgeo.org/pipermail/mapserver-users/attachments/20120618/7
24b9741/attachment-0001.html>

------------------------------

Message: 2
Date: Mon, 18 Jun 2012 19:06:09 -0300
From: Jeff McKenna <jmckenna at gatewaygeomatics.com>
To: mapserver-users at lists.osgeo.org
Subject: Re: [mapserver-users] Hindi and Thai text rendering
Message-ID: <4FDFA651.80507 at gatewaygeomatics.com>
Content-Type: text/plain; charset=ISO-8859-1

On 12-06-18 6:45 PM, Ian Walberg wrote:
> Hello list,
> 
>  
> 
> We are seeing some issues displaying Hindi and Thai text, from a quick

> search it looks like this may be related to there not being support 
> for Indic scripts.
> 
>  
> 
> Can anyone confirm if these are supported? And if they are not are 
> there any workarounds?
> 

Hello Ian,

I can for sure confirm that Thai text is supported, as it was one of the
languages tested during the initial implementation of the source code
(see the notes at the bottom of
http://www.mapserver.org/mapfile/labelencoding.html).

There's always a chance that things have changed with MapServer 6.0, but
if you provide a small data sample, font, and simple one layer mapfile I
am sure others on this email list can test and provide feedback for you.

-jeff




--
Jeff McKenna
MapServer Consulting and Training Services
http://www.gatewaygeomatics.com/




------------------------------

Message: 3
Date: Mon, 18 Jun 2012 18:46:11 -0400
From: "Ian Walberg" <ian.walberg at airborne.aero>
To: "Jeff McKenna" <jmckenna at gatewaygeomatics.com>,
	<mapserver-users at lists.osgeo.org>
Subject: Re: [mapserver-users] Hindi and Thai text rendering
Message-ID:
	<D12323219CEDB24AA8FAE53FF3F59FB40362BF8A at BE28.exg3.exghost.com>
Content-Type: text/plain;	charset="us-ascii"

Jeff,

That is encouraging, however our concern is that the character rendering
is not supported.

Regards

Ian

-----Original Message-----
From: mapserver-users-bounces at lists.osgeo.org
[mailto:mapserver-users-bounces at lists.osgeo.org] On Behalf Of Jeff
McKenna
Sent: Monday, June 18, 2012 3:06 PM
To: mapserver-users at lists.osgeo.org
Subject: Re: [mapserver-users] Hindi and Thai text rendering

On 12-06-18 6:45 PM, Ian Walberg wrote:
> Hello list,
> 
>  
> 
> We are seeing some issues displaying Hindi and Thai text, from a quick

> search it looks like this may be related to there not being support 
> for Indic scripts.
> 
>  
> 
> Can anyone confirm if these are supported? And if they are not are 
> there any workarounds?
> 

Hello Ian,

I can for sure confirm that Thai text is supported, as it was one of the
languages tested during the initial implementation of the source code
(see the notes at the bottom of
http://www.mapserver.org/mapfile/labelencoding.html).

There's always a chance that things have changed with MapServer 6.0, but
if you provide a small data sample, font, and simple one layer mapfile I
am sure others on this email list can test and provide feedback for you.

-jeff




--
Jeff McKenna
MapServer Consulting and Training Services
http://www.gatewaygeomatics.com/


_______________________________________________
mapserver-users mailing list
mapserver-users at lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


------------------------------

Message: 4
Date: Mon, 18 Jun 2012 23:47:10 -0400
From: Stephen Woodbridge <woodbri at swoodbridge.com>
To: mapserver-users at lists.osgeo.org
Subject: Re: [mapserver-users] Hindi and Thai text rendering
Message-ID: <4FDFF63E.9000407 at swoodbridge.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed

On 6/18/2012 6:46 PM, Ian Walberg wrote:
> Jeff,
>
> That is encouraging, however our concern is that the character
rendering
> is not supported.

Ian,

What do you mean by this statement?

What have you tried? ie: what does you mapfile look like, what font are 
you using, etc?

For this to work you need the following:

1. a mapserver build with fribidi-0.19.2
2. a truetype fone file that supports all the glyphs that you need
3. your mapfile and data configured correctly such that the text in the 
data is appropriately for the ENCODING and that that then matches the
ttf.

-Steve W

> Regards
>
> Ian
>
> -----Original Message-----
> From: mapserver-users-bounces at lists.osgeo.org
> [mailto:mapserver-users-bounces at lists.osgeo.org] On Behalf Of Jeff
> McKenna
> Sent: Monday, June 18, 2012 3:06 PM
> To: mapserver-users at lists.osgeo.org
> Subject: Re: [mapserver-users] Hindi and Thai text rendering
>
> On 12-06-18 6:45 PM, Ian Walberg wrote:
>> Hello list,
>>
>>
>>
>> We are seeing some issues displaying Hindi and Thai text, from a
quick
>
>> search it looks like this may be related to there not being support
>> for Indic scripts.
>>
>>
>>
>> Can anyone confirm if these are supported? And if they are not are
>> there any workarounds?
>>
>
> Hello Ian,
>
> I can for sure confirm that Thai text is supported, as it was one of
the
> languages tested during the initial implementation of the source code
> (see the notes at the bottom of
> http://www.mapserver.org/mapfile/labelencoding.html).
>
> There's always a chance that things have changed with MapServer 6.0,
but
> if you provide a small data sample, font, and simple one layer mapfile
I
> am sure others on this email list can test and provide feedback for
you.
>
> -jeff
>
>
>
>
> --
> Jeff McKenna
> MapServer Consulting and Training Services
> http://www.gatewaygeomatics.com/
>
>
> _______________________________________________
> mapserver-users mailing list
> mapserver-users at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/mapserver-users
> _______________________________________________
> mapserver-users mailing list
> mapserver-users at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>




------------------------------

Message: 5
Date: Mon, 18 Jun 2012 23:51:36 -0400
From: "Ian Walberg" <ian.walberg at airborne.aero>
To: "Stephen Woodbridge" <woodbri at swoodbridge.com>,
	<mapserver-users at lists.osgeo.org>
Subject: Re: [mapserver-users] Hindi and Thai text rendering
Message-ID:
	<D12323219CEDB24AA8FAE53FF3F59FB40362BF96 at BE28.exg3.exghost.com>
Content-Type: text/plain;	charset="us-ascii"

Stephen,

We can provide some examples tomorrow but we are seeing some characters
not matching what is displayed in other applications.

Overall the behaviour appears to match this description
https://github.com/mapserver/mapserver/issues/2591

Regards

Ian

-----Original Message-----
From: mapserver-users-bounces at lists.osgeo.org
[mailto:mapserver-users-bounces at lists.osgeo.org] On Behalf Of Stephen
Woodbridge
Sent: Monday, June 18, 2012 8:47 PM
To: mapserver-users at lists.osgeo.org
Subject: Re: [mapserver-users] Hindi and Thai text rendering

On 6/18/2012 6:46 PM, Ian Walberg wrote:
> Jeff,
>
> That is encouraging, however our concern is that the character 
> rendering is not supported.

Ian,

What do you mean by this statement?

What have you tried? ie: what does you mapfile look like, what font are
you using, etc?

For this to work you need the following:

1. a mapserver build with fribidi-0.19.2 2. a truetype fone file that
supports all the glyphs that you need 3. your mapfile and data
configured correctly such that the text in the data is appropriately for
the ENCODING and that that then matches the ttf.

-Steve W

> Regards
>
> Ian
>
> -----Original Message-----
> From: mapserver-users-bounces at lists.osgeo.org
> [mailto:mapserver-users-bounces at lists.osgeo.org] On Behalf Of Jeff 
> McKenna
> Sent: Monday, June 18, 2012 3:06 PM
> To: mapserver-users at lists.osgeo.org
> Subject: Re: [mapserver-users] Hindi and Thai text rendering
>
> On 12-06-18 6:45 PM, Ian Walberg wrote:
>> Hello list,
>>
>>
>>
>> We are seeing some issues displaying Hindi and Thai text, from a 
>> quick
>
>> search it looks like this may be related to there not being support 
>> for Indic scripts.
>>
>>
>>
>> Can anyone confirm if these are supported? And if they are not are 
>> there any workarounds?
>>
>
> Hello Ian,
>
> I can for sure confirm that Thai text is supported, as it was one of 
> the languages tested during the initial implementation of the source 
> code (see the notes at the bottom of 
> http://www.mapserver.org/mapfile/labelencoding.html).
>
> There's always a chance that things have changed with MapServer 6.0, 
> but if you provide a small data sample, font, and simple one layer 
> mapfile I am sure others on this email list can test and provide
feedback for you.
>
> -jeff
>
>
>
>
> --
> Jeff McKenna
> MapServer Consulting and Training Services 
> http://www.gatewaygeomatics.com/
>
>
> _______________________________________________
> mapserver-users mailing list
> mapserver-users at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/mapserver-users
> _______________________________________________
> mapserver-users mailing list
> mapserver-users at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>


_______________________________________________
mapserver-users mailing list
mapserver-users at lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


------------------------------

Message: 6
Date: Tue, 19 Jun 2012 16:15:12 +1000
From: Matt McClelland <matt at wildwalks.com>
To: mapserver-users at lists.osgeo.org
Subject: [mapserver-users] Mapfile Variables
Message-ID:
	
<CAGbhREnaqcO=btsGghLV+KbiK+9LZXfo9kCEqpxRSAgAMinjQw at mail.gmail.com>
Content-Type: text/plain; charset="iso-8859-1"

Hi All

Is is possible create and use variables within a mapfile?
IE I want to store the colour of a road in one place, then reference
that
colour in the several style tags

EG
$road_colour_inside = "255 0 0 "
then later in the style tags be able to do
color $road_colour_inside

Or something similar.

I am using v6.0

Thanks

Matt  :)
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
<http://lists.osgeo.org/pipermail/mapserver-users/attachments/20120619/a
f7b4f4a/attachment-0001.html>

------------------------------

Message: 7
Date: Tue, 19 Jun 2012 08:59:41 -0400
From: Stephen Woodbridge <woodbri at swoodbridge.com>
To: Ian Walberg <ian.walberg at airborne.aero>
Cc: mapserver-users at lists.osgeo.org
Subject: Re: [mapserver-users] Hindi and Thai text rendering
Message-ID: <4FE077BD.1020407 at swoodbridge.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed

Hi Ian,

The symptoms you are describing are similar to what I have run into with

rendering Arabic. What we found was that the TTF we were using was 
missing some glyphs related to connecting characters in the script. My 
client Identified these and we were able to locate a different font that

had better glyph coverage for Arabic. I don't know anything about Hindi 
and Thai so looking at you results will not help, but it does sounds 
like the basic rendering is working.

Assuming the above is true, then you would need to identify the 
characters that are wrong or missing by there character codes and then 
find a font that has support for those codes. If you think fribidi is 
not handling things correctly, I have found their mailing list to be 
very helpful and they suggested changes to how we used their code in 
mapserver in the past to filter out some zero width space utf8 codes 
that were causing problems for Arabic.

-Steve W

On 6/18/2012 11:51 PM, Ian Walberg wrote:
> Stephen,
>
> We can provide some examples tomorrow but we are seeing some
characters
> not matching what is displayed in other applications.
>
> Overall the behaviour appears to match this description
> https://github.com/mapserver/mapserver/issues/2591
>
> Regards
>
> Ian
>
> -----Original Message-----
> From: mapserver-users-bounces at lists.osgeo.org
> [mailto:mapserver-users-bounces at lists.osgeo.org] On Behalf Of Stephen
> Woodbridge
> Sent: Monday, June 18, 2012 8:47 PM
> To: mapserver-users at lists.osgeo.org
> Subject: Re: [mapserver-users] Hindi and Thai text rendering
>
> On 6/18/2012 6:46 PM, Ian Walberg wrote:
>> Jeff,
>>
>> That is encouraging, however our concern is that the character
>> rendering is not supported.
>
> Ian,
>
> What do you mean by this statement?
>
> What have you tried? ie: what does you mapfile look like, what font
are
> you using, etc?
>
> For this to work you need the following:
>
> 1. a mapserver build with fribidi-0.19.2 2. a truetype fone file that
> supports all the glyphs that you need 3. your mapfile and data
> configured correctly such that the text in the data is appropriately
for
> the ENCODING and that that then matches the ttf.
>
> -Steve W
>
>> Regards
>>
>> Ian
>>
>> -----Original Message-----
>> From: mapserver-users-bounces at lists.osgeo.org
>> [mailto:mapserver-users-bounces at lists.osgeo.org] On Behalf Of Jeff
>> McKenna
>> Sent: Monday, June 18, 2012 3:06 PM
>> To: mapserver-users at lists.osgeo.org
>> Subject: Re: [mapserver-users] Hindi and Thai text rendering
>>
>> On 12-06-18 6:45 PM, Ian Walberg wrote:
>>> Hello list,
>>>
>>>
>>>
>>> We are seeing some issues displaying Hindi and Thai text, from a
>>> quick
>>
>>> search it looks like this may be related to there not being support
>>> for Indic scripts.
>>>
>>>
>>>
>>> Can anyone confirm if these are supported? And if they are not are
>>> there any workarounds?
>>>
>>
>> Hello Ian,
>>
>> I can for sure confirm that Thai text is supported, as it was one of
>> the languages tested during the initial implementation of the source
>> code (see the notes at the bottom of
>> http://www.mapserver.org/mapfile/labelencoding.html).
>>
>> There's always a chance that things have changed with MapServer 6.0,
>> but if you provide a small data sample, font, and simple one layer
>> mapfile I am sure others on this email list can test and provide
> feedback for you.
>>
>> -jeff
>>
>>
>>
>>
>> --
>> Jeff McKenna
>> MapServer Consulting and Training Services
>> http://www.gatewaygeomatics.com/
>>
>>
>> _______________________________________________
>> mapserver-users mailing list
>> mapserver-users at lists.osgeo.org
>> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>> _______________________________________________
>> mapserver-users mailing list
>> mapserver-users at lists.osgeo.org
>> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>>
>
>
> _______________________________________________
> mapserver-users mailing list
> mapserver-users at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/mapserver-users
>




------------------------------

_______________________________________________
mapserver-users mailing list
mapserver-users at lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


End of mapserver-users Digest, Vol 53, Issue 42
***********************************************

More information about the MapServer-users mailing list