Re: [xwiki-users] 4-byte UTF and XWiki (MySQL utf8mb4 encoding)

2016-04-10 Thread Thomas Mortagne
On Fri, Apr 8, 2016 at 8:51 PM, Debajit Adhikary wrote: > I have changed my MySQL database columns to support utf8mb4 (4-byte > unicode), and I can render chinese characters etc correctly now. Chinese characters work fine with uft8 too. > > When I upgrade my XWiki to a

Re: [xwiki-users] 4-byte UTF and XWiki (MySQL utf8mb4 encoding)

2016-04-08 Thread Debajit Adhikary
I have changed my MySQL database columns to support utf8mb4 (4-byte unicode), and I can render chinese characters etc correctly now. When I upgrade my XWiki to a newer version in the future, will this cause issues in the upgrade? (I am guessing there may be database schema changes in a future

Re: [xwiki-users] 4-byte UTF and XWiki (MySQL utf8mb4 encoding)

2016-04-07 Thread Sergiu Dumitriu
It will be almost impossible to use utf8mb4 with XWiki, because of the terrible way mysql is designed. Here's the reason why: mysql imposes several hard limits on the maximum size of several things: length of indexes, length of rows. These lengths, unfortunately, are not computed as the maximum

Re: [xwiki-users] 4-byte UTF and XWiki (MySQL utf8mb4 encoding)

2016-04-07 Thread Thomas Mortagne
XWiki use utf8_bin for subwikis (and recommend it for main wiki in the documentation) right now. Since we use than in the hope it support everything you should definitely open a jira issue. On Thu, Apr 7, 2016 at 2:17 AM, Debajit Adhikary wrote: > I have an XWiki

Re: [xwiki-users] 4-byte UTF and XWiki (MySQL utf8mb4 encoding)

2016-04-06 Thread Debajit Adhikary
Some more information: On my Mac, when I try to set up XWiki with MySQL, I ran the following: # Install mysql and start brew update brew install mysql mysql.server start # Now I can connect as "mysql -uroot" # Create a new MySQL database for XWiki # see

[xwiki-users] 4-byte UTF and XWiki (MySQL utf8mb4 encoding)

2016-04-06 Thread Debajit Adhikary
I have an XWiki installation, and I noticed that emoji's were not getting saved correctly and were rendering as question marks in XWiki. This is caused by MySQL's default encoding which is "utf8" and not "utf8mb4" (4-byte UTF to store the full unicode character set) To fix this, I am in the