[rt-users] Full text search/index - Migrate to Postgres or MySQL + Sphinx?

2014-03-13 Thread Cena, Stephen (ext. 300)
We currently run two RT 4.0.19 systems on Ubuntu 12.04LTS and MySQL 5.5.35. 
Management is now asking me to enable full text searching on the sites so we 
can search inside the body of the tickets. From what I've read, our current 
configuration won't support it due to MySQL 5.5.x not supporting it natively. 
It looks like I have two options:
*   Migrate our databases from MySQL 5.5.x to Postgres SQL to get the full 
text index functionality
   *Create a new MySQL Server that has the Sphinx add-on running  restore 
my databases into that.

Has anyone had to do this before? Suggestions? Warnings?

Stephen J. Cena
Systems Administrator - MIS/IT Dept
Quality Vision International
850 Hudson Ave
Rochester,NY 14620
Phone: 585-544-0450 x300
* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *
Please report email problems to: postmas...@qvii.com

QVII MIS/IT Dept - We do what we must because we can.
Thank you for helping us help you help us all.
* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *


-- 
RT Training London, March 19-20 and Dallas May 20-21
http://bestpractical.com/training

Re: [rt-users] Full text search/index - Migrate to Postgres or MySQL + Sphinx?

2014-03-13 Thread Mark Goodge

On 13/03/2014 14:00, Cena, Stephen (ext. 300) wrote:

We currently run two RT 4.0.19 systems on Ubuntu 12.04LTS and MySQL
5.5.35. Management is now asking me to enable full text searching on the
sites so we can search inside the body of the tickets. From what I've
read, our current configuration won't support it due to MySQL 5.5.x not
supporting it natively.


MySQL has supported fulltext indexes since version 5.0. What makes you 
think otherwise?


Mark
--
My blog: http://mark.goodge.co.uk
--
RT Training London, March 19-20 and Dallas May 20-21
http://bestpractical.com/training


Re: [rt-users] Full text search/index - Migrate to Postgres or MySQL + Sphinx?

2014-03-13 Thread Kevin Falcone
On Thu, Mar 13, 2014 at 02:06:40PM +, Mark Goodge wrote:
 On 13/03/2014 14:00, Cena, Stephen (ext. 300) wrote:
  We currently run two RT 4.0.19 systems on Ubuntu 12.04LTS and MySQL
  5.5.35. Management is now asking me to enable full text searching on the
  sites so we can search inside the body of the tickets. From what I've
  read, our current configuration won't support it due to MySQL 5.5.x not
  supporting it natively.
 
 MySQL has supported fulltext indexes since version 5.0. What makes you 
 think otherwise?

It supported InnoDB Full Text indexing in 5.0?

As was posted quite recently, here's a decent recap of the technical
hurdles in using native 5.6 InnoDB indexing as it finally reaches
maturity.

http://www.gossamer-threads.com/lists/rt/users/114057#114057

We've come up with some possible workarounds for this, but I'm not
sure when we'll have engineering resources to pursue them.

Stephen - if you'd like to remain on a packaged mysql platform,
several people have reported success using mariadb which ships with a
sphinx plugin (there's some small shenanigans because packaged sphinx ships
with bigids requiring bigint ids in RT, but that's documented in the
list archives).

I also know that users have built 12.04 mysql/sphinx debs (we're still
running on an older LTS version of Ubuntu).

-kevin


pgpamusvp0KFk.pgp
Description: PGP signature
-- 
RT Training London, March 19-20 and Dallas May 20-21
http://bestpractical.com/training

Re: [rt-users] Full text search/index - Migrate to Postgres or MySQL + Sphinx?

2014-03-13 Thread Parish, Brent

I personally went the Sphinx route because I already have so much MySQL running 
(and familiarity with) here.

I documented most of it here:  
http://parishnetworks.blogspot.com/2013/10/using-mysql-and-sphinx-for-rt-full-text.html

- Brent


-Original Message-
From: rt-users-boun...@lists.bestpractical.com 
[mailto:rt-users-boun...@lists.bestpractical.com] On Behalf Of Mark Goodge
Sent: Thursday, March 13, 2014 10:07 AM
To: rt-users@lists.bestpractical.com
Subject: Re: [rt-users] Full text search/index - Migrate to Postgres or MySQL + 
Sphinx?

On 13/03/2014 14:00, Cena, Stephen (ext. 300) wrote:
 We currently run two RT 4.0.19 systems on Ubuntu 12.04LTS and MySQL 
 5.5.35. Management is now asking me to enable full text searching on 
 the sites so we can search inside the body of the tickets. From what 
 I've read, our current configuration won't support it due to MySQL 
 5.5.x not supporting it natively.

MySQL has supported fulltext indexes since version 5.0. What makes you think 
otherwise?

Mark
--
My blog: http://mark.goodge.co.uk
--
RT Training London, March 19-20 and Dallas May 20-21 
http://bestpractical.com/training
-- 
RT Training London, March 19-20 and Dallas May 20-21
http://bestpractical.com/training


Re: [rt-users] Full text search/index - Migrate to Postgres or MySQL + Sphinx?

2014-03-13 Thread Mark Goodge

On 13/03/2014 14:32, Kevin Falcone wrote:

On Thu, Mar 13, 2014 at 02:06:40PM +, Mark Goodge wrote:

On 13/03/2014 14:00, Cena, Stephen (ext. 300) wrote:

We currently run two RT 4.0.19 systems on Ubuntu 12.04LTS and MySQL
5.5.35. Management is now asking me to enable full text searching on the
sites so we can search inside the body of the tickets. From what I've
read, our current configuration won't support it due to MySQL 5.5.x not
supporting it natively.


MySQL has supported fulltext indexes since version 5.0. What makes you
think otherwise?


It supported InnoDB Full Text indexing in 5.0?


No; you need to use MyISAM until 5.6.

But that should not be an issue here; I know that RT uses InnoDB by 
default but there should be no reason why the table you want to search 
can't be converted to MyISAM.


Mark
--
My blog: http://mark.goodge.co.uk
--
RT Training London, March 19-20 and Dallas May 20-21
http://bestpractical.com/training


Re: [rt-users] Full text search/index - Migrate to Postgres or MySQL + Sphinx?

2014-03-13 Thread k...@rice.edu
On Thu, Mar 13, 2014 at 02:47:10PM +, Mark Goodge wrote:
 On 13/03/2014 14:32, Kevin Falcone wrote:
 On Thu, Mar 13, 2014 at 02:06:40PM +, Mark Goodge wrote:
 On 13/03/2014 14:00, Cena, Stephen (ext. 300) wrote:
 We currently run two RT 4.0.19 systems on Ubuntu 12.04LTS and MySQL
 5.5.35. Management is now asking me to enable full text searching on the
 sites so we can search inside the body of the tickets. From what I've
 read, our current configuration won't support it due to MySQL 5.5.x not
 supporting it natively.
 
 MySQL has supported fulltext indexes since version 5.0. What makes you
 think otherwise?
 
 It supported InnoDB Full Text indexing in 5.0?
 
 No; you need to use MyISAM until 5.6.
 
 But that should not be an issue here; I know that RT uses InnoDB by
 default but there should be no reason why the table you want to
 search can't be converted to MyISAM.
 
 Mark

Hi Mark,

I do not use MySQL here, but the table that is to be indexed can be
very large and I certainly would not want to wait for a myisamchk to
complete after a crash. The sphinx option is the only viable one for
use with mysql. Moving to PostgreSQL would work but as suggested by
others, if your expertise is with MySQL, stick with MySQL.

Regards,
Ken
-- 
RT Training London, March 19-20 and Dallas May 20-21
http://bestpractical.com/training


Re: [rt-users] Full text search/index - Migrate to Postgres or MySQL + Sphinx?

2014-03-13 Thread Alex Vandiver
On Thu, 2014-03-13 at 14:47 +, Mark Goodge wrote:
 I know that RT uses InnoDB by default but there should be no reason why
 the table you want to search can't be converted to MyISAM.

There's a very straightforward reason why RT uses InnoDB: database-level
transactions.  Converting the Attachments table to MyISAM would break a
notable number of internals.
 - Alex

-- 
RT Training London, March 19-20 and Dallas May 20-21
http://bestpractical.com/training


Re: [rt-users] Full text search/index - Migrate to Postgres or MySQL + Sphinx?

2014-03-13 Thread Guadagnino Cristiano
Cena, Stephen (ext. 300) ha scritto:
We currently run two RT 4.0.19 systems on Ubuntu 12.04LTS and MySQL 5.5.35. 
Management is now asking me to enable full text searching on the sites so we 
can search inside the body of the tickets. From what I've read, our current 
configuration won't support it due to MySQL 5.5.x not supporting it natively. 
It looks like I have two options:

  *   Migrate our databases from MySQL 5.5.x to Postgres SQL to get the full 
text index functionality
  *   Create a new MySQL Server that has the Sphinx add-on running  restore my 
databases into that.


Has anyone had to do this before? Suggestions? Warnings?



Stephen,
we initially (RT 3.8.x) wrote an extension to use Sphinx without the need to 
integrate it into mysql. You can find it on Wikia, but I would not encourage 
you to use it (and it will not work in newer versions of RT).

When migrating to RT 4.0.x we tried the migration to Postgres. The migration 
was successful, but we were disappointed with the performance of postgres when 
doing full-text searches. I guess we were too used to the stellar performance 
of Sphinx.

Finally we settled with mysql+sphinxSE, and we are very happy with it.

Bye
Cris
--

Cristiano Guadagnino

Servizio Data Administration
___
Bankadati Servizi Informatici Soc.Cons.P.A.
Gruppo bancario Credito Valtellinese
Via Trento, 22 - 23100 SONDRIO
tel +39 0342522172  - fax +39 0342522992
guadagnino.cristi...@creval.it
www.creval.ithttp://www.creval.it

Il presente messaggio non è di natura personale ma inviato per esigenze 
lavorative; l'eventuale messaggio di risposta potrà essere conosciuto anche da 
altri soggetti diversi dall'originatore di questo messaggio per dette esigenze 
o per controllo aziendale. Questo messaggio, corredato dei relativi allegati, 
contiene informazioni da considerarsi strettamente riservate, ed è destinato 
esclusivamente al destinatario sopra indicato, il quale è l'unico autorizzato 
ad usarlo, copiarlo e, sotto la propria responsabilità, diffonderlo. Chiunque 
ricevesse questo messaggio per errore o comunque lo leggesse senza esserne 
legittimato è avvertito che trattenerlo, copiarlo, divulgarlo, distribuirlo a 
persone diverse dal destinatario è severamente proibito, ed è pregato di 
rinviarlo immediatamente al mittente distruggendone l'originale.

-- 
RT Training London, March 19-20 and Dallas May 20-21
http://bestpractical.com/training

Re: [rt-users] Full text search/index - Migrate to Postgres or MySQL + Sphinx?

2014-03-13 Thread Cena, Stephen (ext. 300)
 
Referring to: rt-users Digest, Vol 120, Issue 13, articles 8,9,10,11,13,14,15:

Thanks to those who responded. First, no; I did not know that full text 
indexing was supported after 5.0. I thought that was a 5.6 up  coming feature. 
I must not have a full grasp of how it works, because if MySQL has it built in 
why would I need to add on Sphinx? I do have much more familiarity with MySQL 
over Postgres which is one reason to stay with it. I've never used Postgres 
before.  I think Kevin's answer might be the easiest. I tried swapping out for 
MariaDB before, but got tripped up over table names being case sensitive. I'm 
trying to keep everything as simple as possible  I'd rather not dive into 
building my own MySQL.

I'll look into this some more and see what I can come up with. Thanks again to 
those who answered!

Stephen J. Cena
Systems Administrator - MIS/IT Dept
Quality Vision International
850 Hudson Ave
Rochester,NY 14620
Phone: 585-544-0450 x300
* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *
Please report email problems to: postmas...@qvii.com

QVII MIS/IT Dept - We do what we must because we can.
Thank you for helping us help you help us all.
* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *
-- 
RT Training London, March 19-20 and Dallas May 20-21
http://bestpractical.com/training