Hello Everyone, I am re-posting this with a corrected link provided below.
We are having issues displaying Hindi in Map Server. The characters display correctly in text editors we use, as well as excel, open office documents and in our sqlite database. Certain characters appear to flip around when displaying in Map Sever. We have tried various different fonts including: arialuni, devangari, gargi, etc. We have also tried using several data types: shapefiles, sqlite databases. The following is a link showing how the Hindi characters should display: http://translate.google.com/#hi/en/%E0%A4%AE%E0%A5%87%E0%A4%95%E0%A5%8D% E0%A4%B8%E0%A4%BF%E0%A4%95%E0%A5%8B%20%E0%A4%B8%E0%A4%BF%E0%A4%9F%E0%A5% 80 I have included a basic Map File where I am using the TEXT tag to display the Hindi translation using an HTML string of entities. MAP NAME 'Simple' STATUS ON SIZE 1280 768 EXTENT -180 -90 180 90 UNITS MILES IMAGECOLOR 0 0 70 IMAGETYPE PNG #CONFIG "MS_ERRORFILE" "/data2/Hindi_Testing/mapserver.log" #change this to match your configuration DEBUG 5 FONTSET fontset.txt #This will need to be updated to the location of the users fontset.txt. We are using arialuni. LAYER DEBUG 5 NAME cities1 TYPE annotation STATUS DEFAULT FEATURE POINTS -99.169998 19.42 END END CLASS #This HTML string is for 'Mexico City' translated into Hindi. Mapserver does not display this correctly. TEXT 'मेक्सिको  ;सिटी' LABEL FONT "arialuni" TYPE truetype ENCODING 'UTF-8' SIZE 30 COLOR 200 200 0 POSITION CC PARTIALS FALSE ALIGN center END END END END # Map File Thank You, Peter Mallen -----Original Message----- From: [email protected] [mailto:[email protected]] On Behalf Of [email protected] Sent: Friday, December 14, 2012 3:05 PM To: [email protected] Subject: mapserver-users Digest, Vol 59, Issue 24 Send mapserver-users mailing list submissions to [email protected] To subscribe or unsubscribe via the World Wide Web, visit http://lists.osgeo.org/mailman/listinfo/mapserver-users or, via email, send a message with subject or body 'help' to [email protected] You can reach the person managing the list at [email protected] When replying, please edit your Subject line so it is more specific than "Re: Contents of mapserver-users digest..." Today's Topics: 1. Re: Reclassify raster cell values (ALT SHN) 2. Raster color table (ALT SHN) 3. Re: Hindi and Thai text rendering (Peter Mallen) ---------------------------------------------------------------------- Message: 1 Date: Fri, 14 Dec 2012 22:48:13 +0000 From: ALT SHN <[email protected]> To: Rahkonen Jukka <[email protected]> Cc: "[email protected]" <[email protected]> Subject: Re: [mapserver-users] Reclassify raster cell values Message-ID: <CAGFOAzz-RdXUGvO1H=2hjrig4q0fjlcbuy0gaou7ceawb20...@mail.gmail.com> Content-Type: text/plain; charset="iso-8859-1" Thank you Rahknonen, However this is not quite what I expected. If I reclassify a particular value, all other cells disapear. This leads me to another question (I'll open another topic too). the PROCESSING LUT command can be used as a way to build a indexed color table for 8bit rasters. Is there a way to import a color table ? Thank you Andr? 2012/12/10 Rahkonen Jukka <[email protected]> > Hi, > > It should be possible to do what you want by using the PROCESSING LUT > option. > http://www.mapserver.org/input/raster.html > > -Jukka Rahkonen- > > ________________________________ > > ALT SHN wrote: > > > Hello Everyone, > > > First time Mapserver user here, and I would appreciate some advice > regarding this problem: > > > I have a Tile Index of single band TIFF rasters (0-255). The rasters > > are > displayer fast, and accuratly. However these rasters cover a sea shore > area, this means that half the rasters are sea territory, wich is > represented in black (0 cell values) > > > Is there way, in the Mapfile to reclassify the 0 cells to 255 in > > order > to turn them white? I know I can always pre process the rasters, but > I'm talking about forty + files... > > > Thanks in advance, > > Cheers, > > Andr? Mano > > -- > --------------------------------------------------------------- > Associa??o Leonel Trindade > SOCIEDADE DE HIST?RIA NATURAL > > Apartado 25 2564-909 Torres Vedras Portugal Sede e Biblioteca: rua > Cavaleiros da Espora Dourada, 27A 2560 Torres Vedras > > Laborat?rio de Paleontologia e Paleoecologia: Pol?gono Industrial do > Alto do Ameal 2565-641 Ramalhal http://alt-shn.blogspot.com > www.alt-shn.org<http://www.alt-shn.org> > -- --------------------------------------------------------------- Associa??o Leonel Trindade SOCIEDADE DE HIST?RIA NATURAL Apartado 25 2564-909 Torres Vedras Portugal Sede e Biblioteca: rua Cavaleiros da Espora Dourada, 27A 2560 Torres Vedras Laborat?rio de Paleontologia e Paleoecologia: Pol?gono Industrial do Alto do Ameal 2565-641 Ramalhal http://alt-shn.blogspot.com www.alt-shn.org -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.osgeo.org/pipermail/mapserver-users/attachments/20121214/d e8b3112/attachment-0001.html> ------------------------------ Message: 2 Date: Fri, 14 Dec 2012 22:52:09 +0000 From: ALT SHN <[email protected]> To: [email protected] Subject: [mapserver-users] Raster color table Message-ID: <cagfoazzutq-scrmu9z19j+znso3x4xaj2mm729nouxafk1c...@mail.gmail.com> Content-Type: text/plain; charset="iso-8859-1" Hi, Is there a way to associate a color table to a 8bit raster so Mapserver doesn't render it in grayscale? In the Mapserver documentation, a pallete is refered, but for what I understood, this applies to the output format, not to a particular raster. Is there a workarround for this situation? (other than converting the raster to RGB) Thank you, Andr? Mano -- --------------------------------------------------------------- Associa??o Leonel Trindade SOCIEDADE DE HIST?RIA NATURAL Apartado 25 2564-909 Torres Vedras Portugal Sede e Biblioteca: rua Cavaleiros da Espora Dourada, 27A 2560 Torres Vedras Laborat?rio de Paleontologia e Paleoecologia: Pol?gono Industrial do Alto do Ameal 2565-641 Ramalhal http://alt-shn.blogspot.com www.alt-shn.org -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.osgeo.org/pipermail/mapserver-users/attachments/20121214/b 4370911/attachment-0001.html> ------------------------------ Message: 3 Date: Fri, 14 Dec 2012 17:54:41 -0500 From: "Peter Mallen" <[email protected]> To: <[email protected]> Subject: Re: [mapserver-users] Hindi and Thai text rendering Message-ID: <[email protected]> Content-Type: text/plain; charset="us-ascii" Hello Everyone, We are having issues displaying Hindi in Map Server. The characters display correctly in text editors we use, as well as excel, open office documents and in our sqlite database. Certain characters appear to flip around when displaying in Map Sever. We have tried various different fonts including: arialuni, devangari, gargi, etc. We have also tried using several data types: shapefiles, sqlite databases. The following is a link showing how the Hindi characters should display: http://translate.google.com/#hi/en/%E0%A4%AE%E0%A5%87%E0%A4%95%E0%A5%8D% E0%A4%B8%E0%A4%BF%E0%A4%95%E0%A5%8B%20%E0%A4%B8%E0%A4%BF%E0%A4%9F%E0%A5% 80 I have included a basic Map File where I am using the TEXT tag to display the Hindi translation using an HTML string of entities. MAP NAME 'Simple' STATUS ON SIZE 1280 768 EXTENT -180 -90 180 90 UNITS MILES IMAGECOLOR 0 0 70 IMAGETYPE PNG #CONFIG "MS_ERRORFILE" "/data2/Hindi_Testing/mapserver.log" #change this to match your configuration DEBUG 5 FONTSET fontset.txt #This will need to be updated to the location of the users fontset.txt. We are using arialuni. LAYER DEBUG 5 NAME cities1 TYPE annotation STATUS DEFAULT FEATURE POINTS -99.169998 19.42 END END CLASS #This HTML string is for 'Mexico City' translated into Hindi. Mapserver does not display this correctly. TEXT 'मेक्सिको  ;सिटी' LABEL FONT "arialuni" TYPE truetype ENCODING 'UTF-8' SIZE 30 COLOR 200 200 0 POSITION CC PARTIALS FALSE ALIGN center END END END END # Map File Thank You, Peter Mallen -----Original Message----- From: [email protected] [mailto:[email protected]] On Behalf Of [email protected] Sent: Tuesday, June 19, 2012 6:01 AM To: [email protected] Subject: mapserver-users Digest, Vol 53, Issue 42 Send mapserver-users mailing list submissions to [email protected] To subscribe or unsubscribe via the World Wide Web, visit http://lists.osgeo.org/mailman/listinfo/mapserver-users or, via email, send a message with subject or body 'help' to [email protected] You can reach the person managing the list at [email protected] When replying, please edit your Subject line so it is more specific than "Re: Contents of mapserver-users digest..." Today's Topics: 1. Hindi and Thai text rendering (Ian Walberg) 2. Re: Hindi and Thai text rendering (Jeff McKenna) 3. Re: Hindi and Thai text rendering (Ian Walberg) 4. Re: Hindi and Thai text rendering (Stephen Woodbridge) 5. Re: Hindi and Thai text rendering (Ian Walberg) 6. Mapfile Variables (Matt McClelland) 7. Re: Hindi and Thai text rendering (Stephen Woodbridge) ---------------------------------------------------------------------- Message: 1 Date: Mon, 18 Jun 2012 17:45:39 -0400 From: "Ian Walberg" <[email protected]> To: <[email protected]>, <[email protected]> Subject: [mapserver-users] Hindi and Thai text rendering Message-ID: <[email protected]> Content-Type: text/plain; charset="us-ascii" Hello list, We are seeing some issues displaying Hindi and Thai text, from a quick search it looks like this may be related to there not being support for Indic scripts. Can anyone confirm if these are supported? And if they are not are there any workarounds? Many thanks Ian -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.osgeo.org/pipermail/mapserver-users/attachments/20120618/7 24b9741/attachment-0001.html> ------------------------------ Message: 2 Date: Mon, 18 Jun 2012 19:06:09 -0300 From: Jeff McKenna <[email protected]> To: [email protected] Subject: Re: [mapserver-users] Hindi and Thai text rendering Message-ID: <[email protected]> Content-Type: text/plain; charset=ISO-8859-1 On 12-06-18 6:45 PM, Ian Walberg wrote: > Hello list, > > > > We are seeing some issues displaying Hindi and Thai text, from a quick > search it looks like this may be related to there not being support > for Indic scripts. > > > > Can anyone confirm if these are supported? And if they are not are > there any workarounds? > Hello Ian, I can for sure confirm that Thai text is supported, as it was one of the languages tested during the initial implementation of the source code (see the notes at the bottom of http://www.mapserver.org/mapfile/labelencoding.html). There's always a chance that things have changed with MapServer 6.0, but if you provide a small data sample, font, and simple one layer mapfile I am sure others on this email list can test and provide feedback for you. -jeff -- Jeff McKenna MapServer Consulting and Training Services http://www.gatewaygeomatics.com/ ------------------------------ Message: 3 Date: Mon, 18 Jun 2012 18:46:11 -0400 From: "Ian Walberg" <[email protected]> To: "Jeff McKenna" <[email protected]>, <[email protected]> Subject: Re: [mapserver-users] Hindi and Thai text rendering Message-ID: <[email protected]> Content-Type: text/plain; charset="us-ascii" Jeff, That is encouraging, however our concern is that the character rendering is not supported. Regards Ian -----Original Message----- From: [email protected] [mailto:[email protected]] On Behalf Of Jeff McKenna Sent: Monday, June 18, 2012 3:06 PM To: [email protected] Subject: Re: [mapserver-users] Hindi and Thai text rendering On 12-06-18 6:45 PM, Ian Walberg wrote: > Hello list, > > > > We are seeing some issues displaying Hindi and Thai text, from a quick > search it looks like this may be related to there not being support > for Indic scripts. > > > > Can anyone confirm if these are supported? And if they are not are > there any workarounds? > Hello Ian, I can for sure confirm that Thai text is supported, as it was one of the languages tested during the initial implementation of the source code (see the notes at the bottom of http://www.mapserver.org/mapfile/labelencoding.html). There's always a chance that things have changed with MapServer 6.0, but if you provide a small data sample, font, and simple one layer mapfile I am sure others on this email list can test and provide feedback for you. -jeff -- Jeff McKenna MapServer Consulting and Training Services http://www.gatewaygeomatics.com/ _______________________________________________ mapserver-users mailing list [email protected] http://lists.osgeo.org/mailman/listinfo/mapserver-users ------------------------------ Message: 4 Date: Mon, 18 Jun 2012 23:47:10 -0400 From: Stephen Woodbridge <[email protected]> To: [email protected] Subject: Re: [mapserver-users] Hindi and Thai text rendering Message-ID: <[email protected]> Content-Type: text/plain; charset=ISO-8859-1; format=flowed On 6/18/2012 6:46 PM, Ian Walberg wrote: > Jeff, > > That is encouraging, however our concern is that the character rendering > is not supported. Ian, What do you mean by this statement? What have you tried? ie: what does you mapfile look like, what font are you using, etc? For this to work you need the following: 1. a mapserver build with fribidi-0.19.2 2. a truetype fone file that supports all the glyphs that you need 3. your mapfile and data configured correctly such that the text in the data is appropriately for the ENCODING and that that then matches the ttf. -Steve W > Regards > > Ian > > -----Original Message----- > From: [email protected] > [mailto:[email protected]] On Behalf Of Jeff > McKenna > Sent: Monday, June 18, 2012 3:06 PM > To: [email protected] > Subject: Re: [mapserver-users] Hindi and Thai text rendering > > On 12-06-18 6:45 PM, Ian Walberg wrote: >> Hello list, >> >> >> >> We are seeing some issues displaying Hindi and Thai text, from a quick > >> search it looks like this may be related to there not being support >> for Indic scripts. >> >> >> >> Can anyone confirm if these are supported? And if they are not are >> there any workarounds? >> > > Hello Ian, > > I can for sure confirm that Thai text is supported, as it was one of the > languages tested during the initial implementation of the source code > (see the notes at the bottom of > http://www.mapserver.org/mapfile/labelencoding.html). > > There's always a chance that things have changed with MapServer 6.0, but > if you provide a small data sample, font, and simple one layer mapfile I > am sure others on this email list can test and provide feedback for you. > > -jeff > > > > > -- > Jeff McKenna > MapServer Consulting and Training Services > http://www.gatewaygeomatics.com/ > > > _______________________________________________ > mapserver-users mailing list > [email protected] > http://lists.osgeo.org/mailman/listinfo/mapserver-users > _______________________________________________ > mapserver-users mailing list > [email protected] > http://lists.osgeo.org/mailman/listinfo/mapserver-users > ------------------------------ Message: 5 Date: Mon, 18 Jun 2012 23:51:36 -0400 From: "Ian Walberg" <[email protected]> To: "Stephen Woodbridge" <[email protected]>, <[email protected]> Subject: Re: [mapserver-users] Hindi and Thai text rendering Message-ID: <[email protected]> Content-Type: text/plain; charset="us-ascii" Stephen, We can provide some examples tomorrow but we are seeing some characters not matching what is displayed in other applications. Overall the behaviour appears to match this description https://github.com/mapserver/mapserver/issues/2591 Regards Ian -----Original Message----- From: [email protected] [mailto:[email protected]] On Behalf Of Stephen Woodbridge Sent: Monday, June 18, 2012 8:47 PM To: [email protected] Subject: Re: [mapserver-users] Hindi and Thai text rendering On 6/18/2012 6:46 PM, Ian Walberg wrote: > Jeff, > > That is encouraging, however our concern is that the character > rendering is not supported. Ian, What do you mean by this statement? What have you tried? ie: what does you mapfile look like, what font are you using, etc? For this to work you need the following: 1. a mapserver build with fribidi-0.19.2 2. a truetype fone file that supports all the glyphs that you need 3. your mapfile and data configured correctly such that the text in the data is appropriately for the ENCODING and that that then matches the ttf. -Steve W > Regards > > Ian > > -----Original Message----- > From: [email protected] > [mailto:[email protected]] On Behalf Of Jeff > McKenna > Sent: Monday, June 18, 2012 3:06 PM > To: [email protected] > Subject: Re: [mapserver-users] Hindi and Thai text rendering > > On 12-06-18 6:45 PM, Ian Walberg wrote: >> Hello list, >> >> >> >> We are seeing some issues displaying Hindi and Thai text, from a >> quick > >> search it looks like this may be related to there not being support >> for Indic scripts. >> >> >> >> Can anyone confirm if these are supported? And if they are not are >> there any workarounds? >> > > Hello Ian, > > I can for sure confirm that Thai text is supported, as it was one of > the languages tested during the initial implementation of the source > code (see the notes at the bottom of > http://www.mapserver.org/mapfile/labelencoding.html). > > There's always a chance that things have changed with MapServer 6.0, > but if you provide a small data sample, font, and simple one layer > mapfile I am sure others on this email list can test and provide feedback for you. > > -jeff > > > > > -- > Jeff McKenna > MapServer Consulting and Training Services > http://www.gatewaygeomatics.com/ > > > _______________________________________________ > mapserver-users mailing list > [email protected] > http://lists.osgeo.org/mailman/listinfo/mapserver-users > _______________________________________________ > mapserver-users mailing list > [email protected] > http://lists.osgeo.org/mailman/listinfo/mapserver-users > _______________________________________________ mapserver-users mailing list [email protected] http://lists.osgeo.org/mailman/listinfo/mapserver-users ------------------------------ Message: 6 Date: Tue, 19 Jun 2012 16:15:12 +1000 From: Matt McClelland <[email protected]> To: [email protected] Subject: [mapserver-users] Mapfile Variables Message-ID: <CAGbhREnaqcO=btsgghlv+kbik+9lzxfo9kceqpxrsagamin...@mail.gmail.com> Content-Type: text/plain; charset="iso-8859-1" Hi All Is is possible create and use variables within a mapfile? IE I want to store the colour of a road in one place, then reference that colour in the several style tags EG $road_colour_inside = "255 0 0 " then later in the style tags be able to do color $road_colour_inside Or something similar. I am using v6.0 Thanks Matt :) -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.osgeo.org/pipermail/mapserver-users/attachments/20120619/a f7b4f4a/attachment-0001.html> ------------------------------ Message: 7 Date: Tue, 19 Jun 2012 08:59:41 -0400 From: Stephen Woodbridge <[email protected]> To: Ian Walberg <[email protected]> Cc: [email protected] Subject: Re: [mapserver-users] Hindi and Thai text rendering Message-ID: <[email protected]> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Hi Ian, The symptoms you are describing are similar to what I have run into with rendering Arabic. What we found was that the TTF we were using was missing some glyphs related to connecting characters in the script. My client Identified these and we were able to locate a different font that had better glyph coverage for Arabic. I don't know anything about Hindi and Thai so looking at you results will not help, but it does sounds like the basic rendering is working. Assuming the above is true, then you would need to identify the characters that are wrong or missing by there character codes and then find a font that has support for those codes. If you think fribidi is not handling things correctly, I have found their mailing list to be very helpful and they suggested changes to how we used their code in mapserver in the past to filter out some zero width space utf8 codes that were causing problems for Arabic. -Steve W On 6/18/2012 11:51 PM, Ian Walberg wrote: > Stephen, > > We can provide some examples tomorrow but we are seeing some characters > not matching what is displayed in other applications. > > Overall the behaviour appears to match this description > https://github.com/mapserver/mapserver/issues/2591 > > Regards > > Ian > > -----Original Message----- > From: [email protected] > [mailto:[email protected]] On Behalf Of Stephen > Woodbridge > Sent: Monday, June 18, 2012 8:47 PM > To: [email protected] > Subject: Re: [mapserver-users] Hindi and Thai text rendering > > On 6/18/2012 6:46 PM, Ian Walberg wrote: >> Jeff, >> >> That is encouraging, however our concern is that the character >> rendering is not supported. > > Ian, > > What do you mean by this statement? > > What have you tried? ie: what does you mapfile look like, what font are > you using, etc? > > For this to work you need the following: > > 1. a mapserver build with fribidi-0.19.2 2. a truetype fone file that > supports all the glyphs that you need 3. your mapfile and data > configured correctly such that the text in the data is appropriately for > the ENCODING and that that then matches the ttf. > > -Steve W > >> Regards >> >> Ian >> >> -----Original Message----- >> From: [email protected] >> [mailto:[email protected]] On Behalf Of Jeff >> McKenna >> Sent: Monday, June 18, 2012 3:06 PM >> To: [email protected] >> Subject: Re: [mapserver-users] Hindi and Thai text rendering >> >> On 12-06-18 6:45 PM, Ian Walberg wrote: >>> Hello list, >>> >>> >>> >>> We are seeing some issues displaying Hindi and Thai text, from a >>> quick >> >>> search it looks like this may be related to there not being support >>> for Indic scripts. >>> >>> >>> >>> Can anyone confirm if these are supported? And if they are not are >>> there any workarounds? >>> >> >> Hello Ian, >> >> I can for sure confirm that Thai text is supported, as it was one of >> the languages tested during the initial implementation of the source >> code (see the notes at the bottom of >> http://www.mapserver.org/mapfile/labelencoding.html). >> >> There's always a chance that things have changed with MapServer 6.0, >> but if you provide a small data sample, font, and simple one layer >> mapfile I am sure others on this email list can test and provide > feedback for you. >> >> -jeff >> >> >> >> >> -- >> Jeff McKenna >> MapServer Consulting and Training Services >> http://www.gatewaygeomatics.com/ >> >> >> _______________________________________________ >> mapserver-users mailing list >> [email protected] >> http://lists.osgeo.org/mailman/listinfo/mapserver-users >> _______________________________________________ >> mapserver-users mailing list >> [email protected] >> http://lists.osgeo.org/mailman/listinfo/mapserver-users >> > > > _______________________________________________ > mapserver-users mailing list > [email protected] > http://lists.osgeo.org/mailman/listinfo/mapserver-users > ------------------------------ _______________________________________________ mapserver-users mailing list [email protected] http://lists.osgeo.org/mailman/listinfo/mapserver-users End of mapserver-users Digest, Vol 53, Issue 42 *********************************************** ------------------------------ _______________________________________________ mapserver-users mailing list [email protected] http://lists.osgeo.org/mailman/listinfo/mapserver-users End of mapserver-users Digest, Vol 59, Issue 24 *********************************************** _______________________________________________ mapserver-users mailing list [email protected] http://lists.osgeo.org/mailman/listinfo/mapserver-users
