Re: Emojis in text

2019-06-13 Thread macjimbo via 4D_Tech
Thank you all very much indeed. I can confirm that the "[[:^ascii:]]" worked perfectly for me (I didn't try the one with the single brackets) and the simple use of match regex also worked like a charm. Thanks again for helping me fix this annoying issue. James -- Sent from:

Re: Emojis in text

2019-06-13 Thread Narinder Chandi via 4D_Tech
ists.4d.com> on behalf of 4D Tech Mailing List <4d_tech@lists.4d.com> Reply-To: 4D Tech Mailing List <4d_tech@lists.4d.com> Date: Thursday, 13 June 2019 at 01:41 To: 4D Tech Mailing List <4d_tech@lists.4d.com> Cc: Keisuke Miyako Subject: Re: Emojis in text according to

Re: Emojis in text

2019-06-12 Thread Keisuke Miyako via 4D_Tech
according to https://unicode.org/reports/tr51/#Property_Stability an Emoji is \p{RI} \p{RI} | \p{Emoji} ( \p{EMod} | \x{FE0F} \x{20E3}? | [\x{E0020}-\x{E007E}]+ \x{E007F} )? (\x{200D} \p{Emoji} ( \p{EMod} | \x{FE0F} \x{20E3}? )?)+ no kidding. but the ICU in 4D does not

Re: Emojis in text

2019-06-12 Thread Narinder Chandi via 4D_Tech
- From: 4D_Tech <4d_tech-boun...@lists.4d.com> on behalf of 4D Tech Mailing List <4d_tech@lists.4d.com> Reply-To: 4D Tech Mailing List <4d_tech@lists.4d.com> Date: Wednesday, 12 June 2019 at 22:52 To: 4D Tech Mailing List <4d_tech@lists.4d.com> Cc: macjimbo Subject: Re: Em

Re: Emojis in text

2019-06-12 Thread macjimbo via 4D_Tech
Thanks for your help with this Narinder I'm still struggling, mostly because I don't know how to use Regex properly. None of the regex patterns I can find online for removing emojis seem to work at all. I would be quite happy just to restrict the text to alphanumeric and the kind of special

Re: Emojis in text

2019-06-12 Thread Narinder Chandi via 4D_Tech
...@toolbox.uk.com> Subject: Re: Emojis in text James, Hi. I encountered a similar problem a while back although the client sending the request to MySQL was PHP rather than 4D. My solution was to use Regex to replace the emoji characters. Try Googling for something li

Re: Emojis in text

2019-06-12 Thread Narinder Chandi via 4D_Tech
ng List <4d_tech@lists.4d.com> Date: Wednesday, 12 June 2019 at 11:59 To: 4D Tech Mailing List <4d_tech@lists.4d.com> Cc: James Knight Subject: Emojis in text Hi I’ve just integrated our system with a review website, importing review scores and comments to store in our d

Emojis in text

2019-06-12 Thread James Knight via 4D_Tech
Hi I’ve just integrated our system with a review website, importing review scores and comments to store in our database. This is done via a JSON API. The comments will often include emoticons and unfortunately these choke our MySQL implementation (MyConnect plugin) because (I think) it