Hello Everyone, We are having issues displaying Hindi in Map Server. The characters display correctly in text editors we use, as well as excel, open office documents and in our sqlite database. Certain characters appear to flip around when displaying in Map Sever. We have tried various different fonts including: arialuni, devangari, gargi, etc. We have also tried using several data types: shapefiles, sqlite databases.
The following is a link showing how the Hindi characters should display: http://translate.google.com/#hi/en/%E0%A4%AE%E0%A5%87%E0%A4%95%E0%A5%8D% E0%A4%B8%E0%A4%BF%E0%A4%95%E0%A5%8B%20%E0%A4%B8%E0%A4%BF%E0%A4%9F%E0%A5% 80 I have included a basic Map File where I am using the TEXT tag to display the Hindi translation using an HTML string of entities. MAP NAME 'Simple' STATUS ON SIZE 1280 768 EXTENT -180 -90 180 90 UNITS MILES IMAGECOLOR 0 0 70 IMAGETYPE PNG #CONFIG "MS_ERRORFILE" "/data2/Hindi_Testing/mapserver.log" #change this to match your configuration DEBUG 5 FONTSET fontset.txt #This will need to be updated to the location of the users fontset.txt. We are using arialuni. LAYER DEBUG 5 NAME cities1 TYPE annotation STATUS DEFAULT FEATURE POINTS -99.169998 19.42 END END CLASS #This HTML string is for 'Mexico City' translated into Hindi. Mapserver does not display this correctly. TEXT 'मेक्सिको  ;सिटी' LABEL FONT "arialuni" TYPE truetype ENCODING 'UTF-8' SIZE 30 COLOR 200 200 0 POSITION CC PARTIALS FALSE ALIGN center END END END END # Map File Thank You, Peter Mallen -----Original Message----- From: [email protected] [mailto:[email protected]] On Behalf Of [email protected] Sent: Tuesday, June 19, 2012 6:01 AM To: [email protected] Subject: mapserver-users Digest, Vol 53, Issue 42 Send mapserver-users mailing list submissions to [email protected] To subscribe or unsubscribe via the World Wide Web, visit http://lists.osgeo.org/mailman/listinfo/mapserver-users or, via email, send a message with subject or body 'help' to [email protected] You can reach the person managing the list at [email protected] When replying, please edit your Subject line so it is more specific than "Re: Contents of mapserver-users digest..." Today's Topics: 1. Hindi and Thai text rendering (Ian Walberg) 2. Re: Hindi and Thai text rendering (Jeff McKenna) 3. Re: Hindi and Thai text rendering (Ian Walberg) 4. Re: Hindi and Thai text rendering (Stephen Woodbridge) 5. Re: Hindi and Thai text rendering (Ian Walberg) 6. Mapfile Variables (Matt McClelland) 7. Re: Hindi and Thai text rendering (Stephen Woodbridge) ---------------------------------------------------------------------- Message: 1 Date: Mon, 18 Jun 2012 17:45:39 -0400 From: "Ian Walberg" <[email protected]> To: <[email protected]>, <[email protected]> Subject: [mapserver-users] Hindi and Thai text rendering Message-ID: <[email protected]> Content-Type: text/plain; charset="us-ascii" Hello list, We are seeing some issues displaying Hindi and Thai text, from a quick search it looks like this may be related to there not being support for Indic scripts. Can anyone confirm if these are supported? And if they are not are there any workarounds? Many thanks Ian -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.osgeo.org/pipermail/mapserver-users/attachments/20120618/7 24b9741/attachment-0001.html> ------------------------------ Message: 2 Date: Mon, 18 Jun 2012 19:06:09 -0300 From: Jeff McKenna <[email protected]> To: [email protected] Subject: Re: [mapserver-users] Hindi and Thai text rendering Message-ID: <[email protected]> Content-Type: text/plain; charset=ISO-8859-1 On 12-06-18 6:45 PM, Ian Walberg wrote: > Hello list, > > > > We are seeing some issues displaying Hindi and Thai text, from a quick > search it looks like this may be related to there not being support > for Indic scripts. > > > > Can anyone confirm if these are supported? And if they are not are > there any workarounds? > Hello Ian, I can for sure confirm that Thai text is supported, as it was one of the languages tested during the initial implementation of the source code (see the notes at the bottom of http://www.mapserver.org/mapfile/labelencoding.html). There's always a chance that things have changed with MapServer 6.0, but if you provide a small data sample, font, and simple one layer mapfile I am sure others on this email list can test and provide feedback for you. -jeff -- Jeff McKenna MapServer Consulting and Training Services http://www.gatewaygeomatics.com/ ------------------------------ Message: 3 Date: Mon, 18 Jun 2012 18:46:11 -0400 From: "Ian Walberg" <[email protected]> To: "Jeff McKenna" <[email protected]>, <[email protected]> Subject: Re: [mapserver-users] Hindi and Thai text rendering Message-ID: <[email protected]> Content-Type: text/plain; charset="us-ascii" Jeff, That is encouraging, however our concern is that the character rendering is not supported. Regards Ian -----Original Message----- From: [email protected] [mailto:[email protected]] On Behalf Of Jeff McKenna Sent: Monday, June 18, 2012 3:06 PM To: [email protected] Subject: Re: [mapserver-users] Hindi and Thai text rendering On 12-06-18 6:45 PM, Ian Walberg wrote: > Hello list, > > > > We are seeing some issues displaying Hindi and Thai text, from a quick > search it looks like this may be related to there not being support > for Indic scripts. > > > > Can anyone confirm if these are supported? And if they are not are > there any workarounds? > Hello Ian, I can for sure confirm that Thai text is supported, as it was one of the languages tested during the initial implementation of the source code (see the notes at the bottom of http://www.mapserver.org/mapfile/labelencoding.html). There's always a chance that things have changed with MapServer 6.0, but if you provide a small data sample, font, and simple one layer mapfile I am sure others on this email list can test and provide feedback for you. -jeff -- Jeff McKenna MapServer Consulting and Training Services http://www.gatewaygeomatics.com/ _______________________________________________ mapserver-users mailing list [email protected] http://lists.osgeo.org/mailman/listinfo/mapserver-users ------------------------------ Message: 4 Date: Mon, 18 Jun 2012 23:47:10 -0400 From: Stephen Woodbridge <[email protected]> To: [email protected] Subject: Re: [mapserver-users] Hindi and Thai text rendering Message-ID: <[email protected]> Content-Type: text/plain; charset=ISO-8859-1; format=flowed On 6/18/2012 6:46 PM, Ian Walberg wrote: > Jeff, > > That is encouraging, however our concern is that the character rendering > is not supported. Ian, What do you mean by this statement? What have you tried? ie: what does you mapfile look like, what font are you using, etc? For this to work you need the following: 1. a mapserver build with fribidi-0.19.2 2. a truetype fone file that supports all the glyphs that you need 3. your mapfile and data configured correctly such that the text in the data is appropriately for the ENCODING and that that then matches the ttf. -Steve W > Regards > > Ian > > -----Original Message----- > From: [email protected] > [mailto:[email protected]] On Behalf Of Jeff > McKenna > Sent: Monday, June 18, 2012 3:06 PM > To: [email protected] > Subject: Re: [mapserver-users] Hindi and Thai text rendering > > On 12-06-18 6:45 PM, Ian Walberg wrote: >> Hello list, >> >> >> >> We are seeing some issues displaying Hindi and Thai text, from a quick > >> search it looks like this may be related to there not being support >> for Indic scripts. >> >> >> >> Can anyone confirm if these are supported? And if they are not are >> there any workarounds? >> > > Hello Ian, > > I can for sure confirm that Thai text is supported, as it was one of the > languages tested during the initial implementation of the source code > (see the notes at the bottom of > http://www.mapserver.org/mapfile/labelencoding.html). > > There's always a chance that things have changed with MapServer 6.0, but > if you provide a small data sample, font, and simple one layer mapfile I > am sure others on this email list can test and provide feedback for you. > > -jeff > > > > > -- > Jeff McKenna > MapServer Consulting and Training Services > http://www.gatewaygeomatics.com/ > > > _______________________________________________ > mapserver-users mailing list > [email protected] > http://lists.osgeo.org/mailman/listinfo/mapserver-users > _______________________________________________ > mapserver-users mailing list > [email protected] > http://lists.osgeo.org/mailman/listinfo/mapserver-users > ------------------------------ Message: 5 Date: Mon, 18 Jun 2012 23:51:36 -0400 From: "Ian Walberg" <[email protected]> To: "Stephen Woodbridge" <[email protected]>, <[email protected]> Subject: Re: [mapserver-users] Hindi and Thai text rendering Message-ID: <[email protected]> Content-Type: text/plain; charset="us-ascii" Stephen, We can provide some examples tomorrow but we are seeing some characters not matching what is displayed in other applications. Overall the behaviour appears to match this description https://github.com/mapserver/mapserver/issues/2591 Regards Ian -----Original Message----- From: [email protected] [mailto:[email protected]] On Behalf Of Stephen Woodbridge Sent: Monday, June 18, 2012 8:47 PM To: [email protected] Subject: Re: [mapserver-users] Hindi and Thai text rendering On 6/18/2012 6:46 PM, Ian Walberg wrote: > Jeff, > > That is encouraging, however our concern is that the character > rendering is not supported. Ian, What do you mean by this statement? What have you tried? ie: what does you mapfile look like, what font are you using, etc? For this to work you need the following: 1. a mapserver build with fribidi-0.19.2 2. a truetype fone file that supports all the glyphs that you need 3. your mapfile and data configured correctly such that the text in the data is appropriately for the ENCODING and that that then matches the ttf. -Steve W > Regards > > Ian > > -----Original Message----- > From: [email protected] > [mailto:[email protected]] On Behalf Of Jeff > McKenna > Sent: Monday, June 18, 2012 3:06 PM > To: [email protected] > Subject: Re: [mapserver-users] Hindi and Thai text rendering > > On 12-06-18 6:45 PM, Ian Walberg wrote: >> Hello list, >> >> >> >> We are seeing some issues displaying Hindi and Thai text, from a >> quick > >> search it looks like this may be related to there not being support >> for Indic scripts. >> >> >> >> Can anyone confirm if these are supported? And if they are not are >> there any workarounds? >> > > Hello Ian, > > I can for sure confirm that Thai text is supported, as it was one of > the languages tested during the initial implementation of the source > code (see the notes at the bottom of > http://www.mapserver.org/mapfile/labelencoding.html). > > There's always a chance that things have changed with MapServer 6.0, > but if you provide a small data sample, font, and simple one layer > mapfile I am sure others on this email list can test and provide feedback for you. > > -jeff > > > > > -- > Jeff McKenna > MapServer Consulting and Training Services > http://www.gatewaygeomatics.com/ > > > _______________________________________________ > mapserver-users mailing list > [email protected] > http://lists.osgeo.org/mailman/listinfo/mapserver-users > _______________________________________________ > mapserver-users mailing list > [email protected] > http://lists.osgeo.org/mailman/listinfo/mapserver-users > _______________________________________________ mapserver-users mailing list [email protected] http://lists.osgeo.org/mailman/listinfo/mapserver-users ------------------------------ Message: 6 Date: Tue, 19 Jun 2012 16:15:12 +1000 From: Matt McClelland <[email protected]> To: [email protected] Subject: [mapserver-users] Mapfile Variables Message-ID: <CAGbhREnaqcO=btsgghlv+kbik+9lzxfo9kceqpxrsagamin...@mail.gmail.com> Content-Type: text/plain; charset="iso-8859-1" Hi All Is is possible create and use variables within a mapfile? IE I want to store the colour of a road in one place, then reference that colour in the several style tags EG $road_colour_inside = "255 0 0 " then later in the style tags be able to do color $road_colour_inside Or something similar. I am using v6.0 Thanks Matt :) -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.osgeo.org/pipermail/mapserver-users/attachments/20120619/a f7b4f4a/attachment-0001.html> ------------------------------ Message: 7 Date: Tue, 19 Jun 2012 08:59:41 -0400 From: Stephen Woodbridge <[email protected]> To: Ian Walberg <[email protected]> Cc: [email protected] Subject: Re: [mapserver-users] Hindi and Thai text rendering Message-ID: <[email protected]> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Hi Ian, The symptoms you are describing are similar to what I have run into with rendering Arabic. What we found was that the TTF we were using was missing some glyphs related to connecting characters in the script. My client Identified these and we were able to locate a different font that had better glyph coverage for Arabic. I don't know anything about Hindi and Thai so looking at you results will not help, but it does sounds like the basic rendering is working. Assuming the above is true, then you would need to identify the characters that are wrong or missing by there character codes and then find a font that has support for those codes. If you think fribidi is not handling things correctly, I have found their mailing list to be very helpful and they suggested changes to how we used their code in mapserver in the past to filter out some zero width space utf8 codes that were causing problems for Arabic. -Steve W On 6/18/2012 11:51 PM, Ian Walberg wrote: > Stephen, > > We can provide some examples tomorrow but we are seeing some characters > not matching what is displayed in other applications. > > Overall the behaviour appears to match this description > https://github.com/mapserver/mapserver/issues/2591 > > Regards > > Ian > > -----Original Message----- > From: [email protected] > [mailto:[email protected]] On Behalf Of Stephen > Woodbridge > Sent: Monday, June 18, 2012 8:47 PM > To: [email protected] > Subject: Re: [mapserver-users] Hindi and Thai text rendering > > On 6/18/2012 6:46 PM, Ian Walberg wrote: >> Jeff, >> >> That is encouraging, however our concern is that the character >> rendering is not supported. > > Ian, > > What do you mean by this statement? > > What have you tried? ie: what does you mapfile look like, what font are > you using, etc? > > For this to work you need the following: > > 1. a mapserver build with fribidi-0.19.2 2. a truetype fone file that > supports all the glyphs that you need 3. your mapfile and data > configured correctly such that the text in the data is appropriately for > the ENCODING and that that then matches the ttf. > > -Steve W > >> Regards >> >> Ian >> >> -----Original Message----- >> From: [email protected] >> [mailto:[email protected]] On Behalf Of Jeff >> McKenna >> Sent: Monday, June 18, 2012 3:06 PM >> To: [email protected] >> Subject: Re: [mapserver-users] Hindi and Thai text rendering >> >> On 12-06-18 6:45 PM, Ian Walberg wrote: >>> Hello list, >>> >>> >>> >>> We are seeing some issues displaying Hindi and Thai text, from a >>> quick >> >>> search it looks like this may be related to there not being support >>> for Indic scripts. >>> >>> >>> >>> Can anyone confirm if these are supported? And if they are not are >>> there any workarounds? >>> >> >> Hello Ian, >> >> I can for sure confirm that Thai text is supported, as it was one of >> the languages tested during the initial implementation of the source >> code (see the notes at the bottom of >> http://www.mapserver.org/mapfile/labelencoding.html). >> >> There's always a chance that things have changed with MapServer 6.0, >> but if you provide a small data sample, font, and simple one layer >> mapfile I am sure others on this email list can test and provide > feedback for you. >> >> -jeff >> >> >> >> >> -- >> Jeff McKenna >> MapServer Consulting and Training Services >> http://www.gatewaygeomatics.com/ >> >> >> _______________________________________________ >> mapserver-users mailing list >> [email protected] >> http://lists.osgeo.org/mailman/listinfo/mapserver-users >> _______________________________________________ >> mapserver-users mailing list >> [email protected] >> http://lists.osgeo.org/mailman/listinfo/mapserver-users >> > > > _______________________________________________ > mapserver-users mailing list > [email protected] > http://lists.osgeo.org/mailman/listinfo/mapserver-users > ------------------------------ _______________________________________________ mapserver-users mailing list [email protected] http://lists.osgeo.org/mailman/listinfo/mapserver-users End of mapserver-users Digest, Vol 53, Issue 42 *********************************************** _______________________________________________ mapserver-users mailing list [email protected] http://lists.osgeo.org/mailman/listinfo/mapserver-users
