Re: How to create a unicode capable table??
I'm not at all familiar with SQL Server, but you need to make sure that the encoding/charset you use in MySQL is the same as used in SQL S. If not the same, then you might need to transcode the data before migrating. Collation is less important than encoding. - if you get the charset wrong, then your data can become garbled. The collation can be changed after the fact. The encoding/charset you would typically use in a multilingual environment is utf8. [In fact, you can use this all the time, unless you've got a good reason not to]. The utf8 charset has the default collation of utf8_general_ci. - That collation is less than perfect, - utf8_unicode_ci is more accurate, but slower. However, collation might not be an issue for you. See http://dev.mysql.com/doc/refman/5.1/en/charset-unicode-sets.html. hth. ~mm On Thu, Dec 4, 2008 at 1:01 PM, Ali, Saqib [EMAIL PROTECTED] wrote: Hello, Any thoughts on this? Thanks. On Tue, Nov 25, 2008 at 8:14 PM, Ali, Saqib [EMAIL PROTECTED] wrote: What Charset and Collation should I use while creating a mysql table such that it can take data from unicode SQL Server DB table? Thanks saqib http://doctrina.wordpress.com/ -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Arabic text storing problem
i have one problem with Arabic text. I have created database with charaterset utf8. when i insatal sql file all the content which is arabic that content stored as arabic. but when i retrieve When you retrieve this content, how are you viewing it? - browser? terminal? For the browser, it needs to be told what encoding your data is in - UTF-8. So, your data could be perfect - just the browser might be interpreting it as ASCII etc. If viewing the results through the browser, do View -Set Encoding - UTF-8 this content it is display something like ASCII value(٠عاÙÙSØ(c) ادارØ(c) اÙÙ^Ù,ت). one more thing that when i edit any fields with arabic text. are you editing through a web interface - a web form? If so, the web page on which the web form sits needs to be in UTF-8.- otherwise it'll send wrongly encoded strings back to the database. [btw / off topic. Solaris 10 has a great utility for determining the encoding of any text file. The utility is auto_ef [auto encoding finder]. So you could output to a text the contents of your db and run auto_ef on it. It'll tell you definitively the content encoding. Free Solaris download for x86 platforms at developers.sun.com/sxde ] ~mm it is storing the text like (??), but when i retrieve it display proper rabic text. my table structure like that CREATE TABLE `mdl_jobs` ( `id` int(11) NOT NULL auto_increment, `company` varchar(200) collate utf8_unicode_ci default NULL, `position` varchar(200) collate utf8_unicode_ci default NULL, `location` varchar(100) collate utf8_unicode_ci default NULL, `emp_status` tinyint(1) default '1', `qualification` varchar(200) collate utf8_unicode_ci default NULL, `descr` text collate utf8_unicode_ci, `posteddate` bigint(10) unsigned default NULL, `expdate` bigint(10) unsigned default NULL, `status` int(11) default '0', PRIMARY KEY (`id`) ) ENGINE=MyISAM DEFAULT CHARSET=utf8 COLLATE=utf8_unicode_ci AUTO_INCREMENT=27 ; -- -- Dumping data for table `mdl_jobs` -- Please help me...
Re: Arabic text storing problem
Thanks for the link Is there standalone jar/zip Just for auto_ef Not that I know of. Since I work on Solaris most of the time, it's not an issue for me. It's probably a bit much to install an OS just for a single utility... Company allegiance aside [I work for Sun], the Solaris Express Developer Edition [x86] is a wonderfully simple install. ~mm Thanks again Martin-- - Original Message - From: Michael Monaghan [EMAIL PROTECTED] To: Bharat [EMAIL PROTECTED] Cc: mysql@lists.mysql.com Sent: Wednesday, November 14, 2007 9:39 AM Subject: Re: Arabic text storing problem i have one problem with Arabic text. I have created database with charaterset utf8. when i insatal sql file all the content which is arabic that content stored as arabic. but when i retrieve When you retrieve this content, how are you viewing it? - browser? terminal? For the browser, it needs to be told what encoding your data is in - UTF-8. So, your data could be perfect - just the browser might be interpreting it as ASCII etc. If viewing the results through the browser, do View -Set Encoding - UTF-8 this content it is display something like ASCII value(٠عاÙÙSØ(c) ادارØ(c) اÙÙ^Ù,ت). one more thing that when i edit any fields with arabic text. are you editing through a web interface - a web form? If so, the web page on which the web form sits needs to be in UTF-8.- otherwise it'll send wrongly encoded strings back to the database. [btw / off topic. Solaris 10 has a great utility for determining the encoding of any text file. The utility is auto_ef [auto encoding finder]. So you could output to a text the contents of your db and run auto_ef on it. It'll tell you definitively the content encoding. Free Solaris download for x86 platforms at developers.sun.com/sxde ] ~mm it is storing the text like (??), but when i retrieve it display proper rabic text. my table structure like that CREATE TABLE `mdl_jobs` ( `id` int(11) NOT NULL auto_increment, `company` varchar(200) collate utf8_unicode_ci default NULL, `position` varchar(200) collate utf8_unicode_ci default NULL, `location` varchar(100) collate utf8_unicode_ci default NULL, `emp_status` tinyint(1) default '1', `qualification` varchar(200) collate utf8_unicode_ci default NULL, `descr` text collate utf8_unicode_ci, `posteddate` bigint(10) unsigned default NULL, `expdate` bigint(10) unsigned default NULL, `status` int(11) default '0', PRIMARY KEY (`id`) ) ENGINE=MyISAM DEFAULT CHARSET=utf8 COLLATE=utf8_unicode_ci AUTO_INCREMENT=27 ; -- -- Dumping data for table `mdl_jobs` -- Please help me...
Re: To see Asian Characters in mysql
I can't speak to your GUI tool, but here's some general pointers: 1. You have to be absolutely sure that your system can in fact render Myanmar. - so ensure that at least your browser can view proper Myanmar characters - see http://www.columbia.edu/kermit/utf8.html. This page has a sample Burmese string in UTF-8. [I'm assuming Burmese = Myanmar] Make sure you can render this string. If you can't, you need to download the right fonts. Although i changed utf 8 charset and utf8_unicode_ci collation and also changed Application fonts ( Tools, Options, General Options) to our language, Myanmar, in MySQL query browser, i can\'t type our fonts. Alternatively, i input our fonts to a mysql table from a java application. i can input and output our fonts in application program, but, i can only see ??? characters in MySQL browser\'s table. How can i store and retrieve our fonts in mysql??? 2. You need to check if your database does in fact have UTF-8 encoded content, do the following. Just setting the db character set to UTF-8, doesn't mean that the db actually has UTF-8 characters. So, try: # mysql -e select FIELDS from TABLE output.txt - making *sure* that the output contains some of your Myanmar characters. Then open output.txt in a browser and set the character encoding to UTF-8. [View-Character Encoding-UTF-8 in Firefox]. If the content renders properly then you can be sure that the content in the database is in fact UTF-8. - therefore the problem lies with the viewer application/GUI you are using. If the content does not render properly, - then your input data to the db is not UTF-8 - problem lies in your Java application. Hope this helps. by the way - there's a very useful java internationalization forum at http://forum.java.sun.com/forum.jspa?forumID=16 ~mm Thanks for any help!!! purple. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED] -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: multilanguage web application with mysql database?
I have many tables like the table Person:below, in mysql database. person_id, first_name,last_name, mi, gb_first_name, gb_last_name, b5_first_name, b5_last_name, gender, dob where different columns storing strings in different encodings. All the strings/fields etc. need to be in the *same* encoding - UTF-8 Only UTF-8 can handle all languages. At anytime, a web user can switch the language and the application will get the values in the right columns to generate web pages. The purpose of Multi-language tables is to make multilanguage dynamic content management easier for web applications. For example, to add a person record, the user enter the English name, then switch the session language to gb2312, gb2312 is an encoding - not a language. enter the Chinese name in gb2312, and then switch the session language to big5, big5 is an encoding - not a language enter the name in big5. And then commit the data into the database. The whole thing sounds complicated but can be treated as a pattern and let a framework to take care of those and the code can be as clean as a single language app. I actually have the framework that works well for me with mysql database. I didn't do anything about language encoding in mysql database, it just worked for me. At least with english, gb2312 and big5 altogether in a table like table Person above. I noticed that (english, gb2312, big5, Jp) cannot work together (where jp is any kind of japaness language encoding). My approach seems fine with most western languages So after all such experimental work, I still don't know how to make a real multi language web app such that the languages are switchable within the same session. Any suggestions? Any web application known to be able to solve the problem? Thanks Everything needs to be in UTF-8. - the database - application logic - and all web interfaces. Forget about big5, gb2312, shift_jis etc! Also, web forms submit content in the encoding of the web page. So make sure your http content-type header is set to UTF-8 for all web pages. I'm not sure what technology you're using - php/java etc? By default, most web servers/applications serve content as ISO-8859-1encoding - which only works for western European languages. - unless you specifically tell it otherwise. In a JSP for example, you need to put this directive at the top of a page: %@ page contentType=text/html;charset=UTF-8 pageEncoding=UTF-8 % This article is useful - http://java.sun.com/developer/technicalArticles/Intl/HTTPCharset/index.html even if you're not using Java technology. ~mm
Re: Mmultiple languages in the MySQL database
On 9/28/06, Jerry Schwartz [EMAIL PROTECTED] wrote: We have multiple Western languages in our UTF-8 data base, without a problem. Right now I'm working on adding Chinese data, but my major problem is reading back what's in there to find out if it went in correctly :( One thing I've done in the past to verify this exact issue, is to simply run something like: # mysql -e select fields from table output.txt - making sure that the the output contains some non-ASCII characters - preferably non-Latin too. Then open output.txt in a browser and set the character encoding to UTF-8. [View-Character Encoding-UTF-8 in Firefox]. If the content renders properly [provided you've got the right fonts obviously], then you can be sure that the content went in properly. ~mm Regards, Jerry Schwartz Global Information Incorporated 195 Farmington Ave. Farmington, CT 06032 860.674.8796 / FAX: 860.674.8341 -Original Message- Wrom: DULHPQQWOYIYZUNNYCGPKYLEJGDGVCJVTLBXFGGMEPYO Sent: Thursday, September 28, 2006 1:36 AM To: mysql@lists.mysql.com Subject: Mmultiple languages in the MySQL database How do I store multiple languages in the MySQL database. Is there any configuration in MySql database server to support multilingual data. Normally if I use UTF-8 character encoding in database, it supports multiple languages. But it is not happening in MySql. Thanks Krish -- View this message in context: http://www.nabble.com/Mmultiple-languages-in-the-MySQL-databas e-tf2348859.html#a6540543 Sent from the MySQL - General mailing list archive at Nabble.com. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe: http://lists.mysql.com/[EMAIL PROTECTED] -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED] -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Mmultiple languages in the MySQL database
One thing I've done in the past to verify this exact issue, is to simply run something like: # mysql -e select fields from table output.txt - making sure that the the output contains some non-ASCII characters - preferably non-Latin too. Then open output.txt in a browser and set the character encoding to UTF-8. [View-Character Encoding-UTF-8 in Firefox]. If the content renders properly [provided you've got the right fonts obviously], then you can be sure that the content went in properly. Or alternatively there's a nice Solaris 10 utility - auto_ef [auto encoding-finder], to which you pass a file as a parameter and it will tell you the encoding. http://docs.sun.com/app/docs/doc/819-2246/6n4i34qee?a=view#DESCRIPTION ~mm ~mm Regards, Jerry Schwartz Global Information Incorporated 195 Farmington Ave. Farmington, CT 06032 860.674.8796 / FAX: 860.674.8341 -Original Message- Wrom: DULHPQQWOYIYZUNNYCGPKYLEJGDGVCJVTLBXFGGMEPYO Sent: Thursday, September 28, 2006 1:36 AM To: mysql@lists.mysql.com Subject: Mmultiple languages in the MySQL database How do I store multiple languages in the MySQL database. Is there any configuration in MySql database server to support multilingual data. Normally if I use UTF-8 character encoding in database, it supports multiple languages. But it is not happening in MySql. Thanks Krish -- View this message in context: http://www.nabble.com/Mmultiple-languages-in-the-MySQL-databas e-tf2348859.html#a6540543 Sent from the MySQL - General mailing list archive at Nabble.com. -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe: http://lists.mysql.com/[EMAIL PROTECTED] -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe: http://lists.mysql.com/[EMAIL PROTECTED] -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Restarting MySQL on Solaris 8?
- Original Message - From: Jay Paulson [EMAIL PROTECTED] To: mysql@lists.mysql.com Sent: Friday, September 08, 2006 9:51 PM Subject: Restarting MySQL on Solaris 8? A couple questions since I'm not a Solaris person I really don't know how to do the following and was hoping that someone could help me out (Google isn't much help on this). How does one start the MySQL daemon on Solaris 8? (it's running MySQL 3.23.49) How does one tell Solaris 8 to start the MySQL daemon on boot? When you've got the first problem fixed To have MySQL [or any application] restart at boot time, you need to copying the start script to /etc/rc3.d Start scripts in the rc3.d dir all start with 'S' followed by a number, like: S53mysql. As root, copy the /usr/local/mysql/support-files/mysql.server script to /etc/rc3.d, and rename it as say S53mysql. This should fix the boot problem. ~mm Lastly, tried running /usr/local/bin/safe_mysqld but got the following error: TIMESTAMP mysqld ended Thanks for any help! -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe: http://lists.mysql.com/[EMAIL PROTECTED] -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED] -- MySQL General Mailing List For list archives: http://lists.mysql.com/mysql To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]
Re: Running Two Different Versions of MySQL
Ah yes, the docs. - Thank you. ~mm On 5/30/06, sheeri kritzer [EMAIL PROTECTED] wrote: http://dev.mysql.com/doc/refman/5.0/en/multiple-servers.html -Sheeri On 5/29/06, Michael Monaghan [EMAIL PROTECTED] wrote: Hi, I have a machine [Solaris 9 x86] that has MySQL v3.22.xx installed. I am not familiar with the applications [quite a few] that use this instance. I need to install an application that requires a newer version of MySQL. I plan to install v5.x. separately - rather than upgrade the old version. What sort of gotchas/possible conflicts should I be aware of? Port numbers, config files etc.? Thanks, ~mm
Running Two Different Versions of MySQL
Hi, I have a machine [Solaris 9 x86] that has MySQL v3.22.xx installed. I am not familiar with the applications [quite a few] that use this instance. I need to install an application that requires a newer version of MySQL. I plan to install v5.x. separately - rather than upgrade the old version. What sort of gotchas/possible conflicts should I be aware of? Port numbers, config files etc.? Thanks, ~mm