Re: How to create a unicode capable table??

2008-12-05 Thread Michael Monaghan
I'm not at all familiar with SQL Server, but you need to make sure that the
encoding/charset you use in MySQL is the same as used in SQL S.

If not the same, then you might need to transcode the data before migrating.

Collation is less important than encoding. - if you get the charset wrong,
then your data can become garbled. The collation can be changed after the
fact.

The encoding/charset you would typically use in a multilingual environment
is utf8. [In fact, you can use this all the time, unless you've got a good
reason not to]. The utf8 charset has the default collation of
utf8_general_ci. - That collation is less than perfect, - utf8_unicode_ci is
more accurate, but slower. However, collation might not be an issue for you.
See http://dev.mysql.com/doc/refman/5.1/en/charset-unicode-sets.html.


hth.
~mm

On Thu, Dec 4, 2008 at 1:01 PM, Ali, Saqib [EMAIL PROTECTED] wrote:

 Hello,

 Any thoughts on this? Thanks.

 On Tue, Nov 25, 2008 at 8:14 PM, Ali, Saqib [EMAIL PROTECTED] wrote:
  What Charset and Collation should I use while creating a mysql table
  such that it can take data from unicode SQL Server DB table?
 
  Thanks
  saqib
  http://doctrina.wordpress.com/
 

 --
 MySQL General Mailing List
 For list archives: http://lists.mysql.com/mysql
 To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]




Re: Arabic text storing problem

2007-11-14 Thread Michael Monaghan
 i have one problem with Arabic text. I have created database with
 charaterset utf8. when i insatal sql file all the content which is arabic
 that content stored as arabic. but when i retrieve


When you retrieve this content, how are you viewing it? - browser? terminal?

For the browser, it needs to be told what encoding your data is in - UTF-8.

So, your data could be perfect - just the browser might be interpreting it
as ASCII etc.

If viewing the results through the browser, do View -Set Encoding - UTF-8

this content it is display something like ASCII value(٠عاÙÙSØ(c)
 ادارØ(c) اÙÙ^Ù,ت).

 one more thing that when i edit any fields with arabic text.


are you editing through a web interface - a web form?

If so, the web page on which the web form sits needs to be in UTF-8.-
otherwise it'll send wrongly encoded strings back to the database.

[btw / off topic. Solaris 10 has a great utility for determining the
encoding of any text file. The utility is auto_ef [auto encoding finder].
So you could output to a text the contents of your db and run auto_ef on it.
It'll tell you definitively the content encoding.
Free Solaris download for x86 platforms at developers.sun.com/sxde ]

~mm






 it is storing the text like (??), but when i retrieve it display
 proper rabic text.

 my table structure like that


 CREATE TABLE `mdl_jobs` (
  `id` int(11) NOT NULL auto_increment,
  `company` varchar(200) collate utf8_unicode_ci default NULL,
  `position` varchar(200) collate utf8_unicode_ci default NULL,
  `location` varchar(100) collate utf8_unicode_ci default NULL,
  `emp_status` tinyint(1) default '1',
  `qualification` varchar(200) collate utf8_unicode_ci default NULL,
  `descr` text collate utf8_unicode_ci,
  `posteddate` bigint(10) unsigned default NULL,
  `expdate` bigint(10) unsigned default NULL,
  `status` int(11) default '0',
  PRIMARY KEY  (`id`)
 ) ENGINE=MyISAM  DEFAULT CHARSET=utf8 COLLATE=utf8_unicode_ci
 AUTO_INCREMENT=27 ;

 --
 -- Dumping data for table `mdl_jobs`
 --




 Please help me...


Re: Arabic text storing problem

2007-11-14 Thread Michael Monaghan
 Thanks for the link
 Is there standalone jar/zip Just for auto_ef


Not that I know of.
Since I work on Solaris most of the time, it's not an issue for me.
It's probably a bit much to install an OS just for a single utility...

Company allegiance aside [I work for Sun], the Solaris Express Developer
Edition [x86] is a wonderfully simple install.

~mm



 Thanks again
 Martin--
 - Original Message -
 From: Michael Monaghan [EMAIL PROTECTED]
 To: Bharat [EMAIL PROTECTED]
 Cc: mysql@lists.mysql.com
 Sent: Wednesday, November 14, 2007 9:39 AM
 Subject: Re: Arabic text storing problem


   i have one problem with Arabic text. I have created database with
   charaterset utf8. when i insatal sql file all the content which is
 arabic
   that content stored as arabic. but when i retrieve
 
 
  When you retrieve this content, how are you viewing it? - browser?
 terminal?
 
  For the browser, it needs to be told what encoding your data is in -
 UTF-8.
 
  So, your data could be perfect - just the browser might be interpreting
 it
  as ASCII etc.
 
  If viewing the results through the browser, do View -Set Encoding -
 UTF-8
 
  this content it is display something like ASCII value(٠عاÙÙSØ(c)
   ادارØ(c) اÙÙ^Ù,ت).
  
   one more thing that when i edit any fields with arabic text.
 
 
  are you editing through a web interface - a web form?
 
  If so, the web page on which the web form sits needs to be in UTF-8.-
  otherwise it'll send wrongly encoded strings back to the database.
 
  [btw / off topic. Solaris 10 has a great utility for determining the
  encoding of any text file. The utility is auto_ef [auto encoding
 finder].
  So you could output to a text the contents of your db and run auto_ef on
 it.
  It'll tell you definitively the content encoding.
  Free Solaris download for x86 platforms at developers.sun.com/sxde ]
 
  ~mm
 
 
 
 
 
 
   it is storing the text like (??), but when i retrieve it
 display
   proper rabic text.
  
   my table structure like that
  
  
   CREATE TABLE `mdl_jobs` (
`id` int(11) NOT NULL auto_increment,
`company` varchar(200) collate utf8_unicode_ci default NULL,
`position` varchar(200) collate utf8_unicode_ci default NULL,
`location` varchar(100) collate utf8_unicode_ci default NULL,
`emp_status` tinyint(1) default '1',
`qualification` varchar(200) collate utf8_unicode_ci default NULL,
`descr` text collate utf8_unicode_ci,
`posteddate` bigint(10) unsigned default NULL,
`expdate` bigint(10) unsigned default NULL,
`status` int(11) default '0',
PRIMARY KEY  (`id`)
   ) ENGINE=MyISAM  DEFAULT CHARSET=utf8 COLLATE=utf8_unicode_ci
   AUTO_INCREMENT=27 ;
  
   --
   -- Dumping data for table `mdl_jobs`
   --
  
  
  
  
   Please help me...
 




Re: To see Asian Characters in mysql

2007-07-29 Thread Michael Monaghan
I can't speak to your GUI tool, but here's some general pointers:

1. You have to be absolutely sure that your system can in fact render Myanmar.
- so ensure that at least your browser can view proper Myanmar
characters - see http://www.columbia.edu/kermit/utf8.html.
This page has a sample Burmese string in UTF-8. [I'm assuming Burmese = Myanmar]

Make sure you can render this string. If you can't, you need to
download the right fonts.

 Although i changed utf 8 charset and utf8_unicode_ci collation and
 also changed Application fonts (
 Tools, Options, General Options) to our language, Myanmar, in MySQL
 query browser, i can\'t type our fonts.
 Alternatively, i input our fonts to a mysql table from a java
 application. i can input and output our fonts in application program,
 but, i can only see ??? characters in MySQL browser\'s table. How can i
 store and retrieve our fonts in mysql???

2. You need to check if your database does in fact have UTF-8 encoded
content, do the
following. Just setting the db character set to UTF-8, doesn't mean
that the db actually has UTF-8 characters.

So, try:

# mysql -e select FIELDS from TABLE  output.txt

- making *sure* that the output contains some of your Myanmar characters.

Then open output.txt in a browser and set the character encoding to UTF-8.

[View-Character Encoding-UTF-8 in Firefox].

If the content renders properly then you can be sure that the content in the
database is in fact UTF-8. - therefore the problem lies with the
viewer application/GUI you are using.

If the content does not render properly, - then your input data to the
db is not UTF-8 - problem lies in your Java application.

Hope this helps.

by the way - there's a very useful java internationalization forum at
http://forum.java.sun.com/forum.jspa?forumID=16

~mm





 Thanks for any help!!!

 purple.

 --
 MySQL General Mailing List
 For list archives: http://lists.mysql.com/mysql
 To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



-- 
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Re: multilanguage web application with mysql database?

2007-05-04 Thread Michael Monaghan


I have many tables like the table Person:below, in mysql database.

person_id, first_name,last_name, mi, gb_first_name, gb_last_name,
b5_first_name, b5_last_name, gender, dob

where different columns storing strings in different encodings.



All the strings/fields etc. need to be in the *same* encoding - UTF-8

Only UTF-8 can handle all languages.

At anytime, a web user can switch the language and the application will get

the values in the right columns to generate web pages. The purpose of
Multi-language tables is to make multilanguage dynamic content management
easier for web applications.  For example, to add a person record, the user
enter the English name, then switch the session language to gb2312,



gb2312 is an encoding - not a language.

enter the Chinese name in gb2312, and then switch the session language to

big5,



big5 is an encoding - not a language

enter the name in big5. And then commit the data into the database. The

whole thing sounds complicated but can be treated as a pattern and let a
framework to take care of those and the code can be as clean as a single
language app. I actually have the framework that works well for me with
mysql database.

I didn't do anything about language encoding in mysql database, it just
worked for me. At least with english, gb2312 and big5 altogether in a table
like table Person above. I noticed that (english, gb2312, big5, Jp) cannot
work together (where jp is any kind of japaness language encoding).  My
approach seems fine with most western languages

So after all such experimental work, I still don't know how to make a real
multi language web app such that the languages are switchable within the
same session.

Any suggestions?  Any web application known to be able to solve the
problem? Thanks



Everything needs to be in UTF-8.
- the database
- application logic
- and all web interfaces.

Forget about big5, gb2312, shift_jis etc!

Also, web forms submit content in the encoding of the web page. So make sure
your http content-type header is set to UTF-8 for all web pages.

I'm not sure what technology you're using - php/java etc?
By default, most web servers/applications serve content as
ISO-8859-1encoding - which only works for western European languages. -
unless you specifically tell it otherwise.

In a JSP for example, you need to put this directive at the top of a page:
%@ page contentType=text/html;charset=UTF-8 pageEncoding=UTF-8 %


This article is useful -
http://java.sun.com/developer/technicalArticles/Intl/HTTPCharset/index.html
even if you're not using Java technology.

~mm


Re: Mmultiple languages in the MySQL database

2006-09-28 Thread Michael Monaghan

On 9/28/06, Jerry Schwartz [EMAIL PROTECTED] wrote:

We have multiple Western languages in our UTF-8 data base, without a
problem. Right now I'm working on adding Chinese data, but my major problem
is reading back what's in there to find out if it went in correctly :(


One thing I've done in the past to verify this exact issue, is to
simply run something like:

# mysql -e select fields from table  output.txt

- making sure that the the output contains some non-ASCII characters -
preferably non-Latin too.

Then open output.txt in a browser and set the character encoding to UTF-8.
[View-Character Encoding-UTF-8 in Firefox].

If the content renders properly [provided you've got the right fonts
obviously], then you can be sure that the content went in properly.

~mm



Regards,

Jerry Schwartz
Global Information Incorporated
195 Farmington Ave.
Farmington, CT 06032

860.674.8796 / FAX: 860.674.8341


 -Original Message-
 Wrom: DULHPQQWOYIYZUNNYCGPKYLEJGDGVCJVTLBXFGGMEPYO
 Sent: Thursday, September 28, 2006 1:36 AM
 To: mysql@lists.mysql.com
 Subject: Mmultiple languages in the MySQL database



 How do I store multiple languages in the MySQL database. Is there any
 configuration in MySql database server to support multilingual data.
 Normally if I use UTF-8 character encoding in database, it
 supports multiple
 languages. But it is not happening in MySql.
  Thanks
 Krish
 --
 View this message in context:
 http://www.nabble.com/Mmultiple-languages-in-the-MySQL-databas
 e-tf2348859.html#a6540543
 Sent from the MySQL - General mailing list archive at Nabble.com.


 --
 MySQL General Mailing List
 For list archives: http://lists.mysql.com/mysql
 To unsubscribe:
 http://lists.mysql.com/[EMAIL PROTECTED]






--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]




--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Re: Mmultiple languages in the MySQL database

2006-09-28 Thread Michael Monaghan

 One thing I've done in the past to verify this exact issue, is to
 simply run something like:

 # mysql -e select fields from table  output.txt

 - making sure that the the output contains some non-ASCII characters -
 preferably non-Latin too.

 Then open output.txt in a browser and set the character
 encoding to UTF-8.
 [View-Character Encoding-UTF-8 in Firefox].

 If the content renders properly [provided you've got the right fonts
 obviously], then you can be sure that the content went in properly.


Or alternatively there's a nice Solaris 10 utility - auto_ef [auto
encoding-finder], to which you pass a file as a parameter and it will
tell you the encoding.
http://docs.sun.com/app/docs/doc/819-2246/6n4i34qee?a=view#DESCRIPTION

~mm


 ~mm

 
  Regards,
 
  Jerry Schwartz
  Global Information Incorporated
  195 Farmington Ave.
  Farmington, CT 06032
 
  860.674.8796 / FAX: 860.674.8341
 
 
   -Original Message-
   Wrom: DULHPQQWOYIYZUNNYCGPKYLEJGDGVCJVTLBXFGGMEPYO
   Sent: Thursday, September 28, 2006 1:36 AM
   To: mysql@lists.mysql.com
   Subject: Mmultiple languages in the MySQL database
  
  
  
   How do I store multiple languages in the MySQL database.
 Is there any
   configuration in MySql database server to support
 multilingual data.
   Normally if I use UTF-8 character encoding in database, it
   supports multiple
   languages. But it is not happening in MySql.
Thanks
   Krish
   --
   View this message in context:
   http://www.nabble.com/Mmultiple-languages-in-the-MySQL-databas
   e-tf2348859.html#a6540543
   Sent from the MySQL - General mailing list archive at Nabble.com.
  
  
   --
   MySQL General Mailing List
   For list archives: http://lists.mysql.com/mysql
   To unsubscribe:
   http://lists.mysql.com/[EMAIL PROTECTED]
  
  
 
 
 
 
  --
  MySQL General Mailing List
  For list archives: http://lists.mysql.com/mysql
  To unsubscribe:
 http://lists.mysql.com/[EMAIL PROTECTED]
 
 







--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Re: Restarting MySQL on Solaris 8?

2006-09-12 Thread Michael Monaghan

 - Original Message -
 From: Jay Paulson [EMAIL PROTECTED]
 To: mysql@lists.mysql.com
 Sent: Friday, September 08, 2006 9:51 PM
 Subject: Restarting MySQL on Solaris 8?

A couple questions since I'm not a Solaris person I really don't know how
to
 do the following and was hoping that someone could help me out (Google
 isn't
 much help on this).

 How does one start the MySQL daemon on Solaris 8? (it's running MySQL
 3.23.49)

 How does one tell Solaris 8 to start the MySQL daemon on boot?


When you've got the first problem fixed 

To have MySQL [or any application] restart at boot time, you need to
copying the start script to /etc/rc3.d

Start scripts in the rc3.d dir all start with 'S' followed by a
number, like: S53mysql.

As root, copy the
/usr/local/mysql/support-files/mysql.server script to /etc/rc3.d, and
rename it as say S53mysql.

This should fix the boot problem.

~mm


 Lastly, tried running /usr/local/bin/safe_mysqld but got the following
 error:

 TIMESTAMP mysqld ended

 Thanks for any help!

 --
 MySQL General Mailing List
 For list archives: http://lists.mysql.com/mysql
 To unsubscribe:
 http://lists.mysql.com/[EMAIL PROTECTED]



 --
 MySQL General Mailing List
 For list archives: http://lists.mysql.com/mysql
 To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]




--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe:http://lists.mysql.com/[EMAIL PROTECTED]



Re: Running Two Different Versions of MySQL

2006-05-30 Thread Michael Monaghan

Ah yes, the docs.

- Thank you.

~mm

On 5/30/06, sheeri kritzer [EMAIL PROTECTED] wrote:


http://dev.mysql.com/doc/refman/5.0/en/multiple-servers.html

-Sheeri

On 5/29/06, Michael Monaghan [EMAIL PROTECTED] wrote:
 Hi,

 I have a machine [Solaris 9 x86] that has MySQL v3.22.xx installed.
 I am not familiar with the applications [quite a few] that use this
 instance.

 I need to install an application that requires a newer version of MySQL.

 I plan to install v5.x. separately - rather than upgrade the old
version.

 What sort of gotchas/possible conflicts should I be aware of? Port
numbers,
 config files etc.?

 Thanks,
 ~mm





Running Two Different Versions of MySQL

2006-05-29 Thread Michael Monaghan

Hi,

I have a machine [Solaris 9 x86] that has MySQL v3.22.xx installed.
I am not familiar with the applications [quite a few] that use this
instance.

I need to install an application that requires a newer version of MySQL.

I plan to install v5.x. separately - rather than upgrade the old version.

What sort of gotchas/possible conflicts should I be aware of? Port numbers,
config files etc.?

Thanks,
~mm