Rt search does not work with sphinx main+delta index

RT Users
1

I am having trouble with RT fulltext searches. I am using RT 4.0.17 with Mysql and Sphinx 4.0.8.
Sphinx is configured to use a main+delta index (configuration attached). Main index is created once every morning, while the delta index is created every 5 minutes.
If I search using the “search” command line tool from Sphinx everything is correct.

Fulltext search with RT 4.0.10 instead seemed to return only the results from the main index, disregarding anything from the delta index.
So I updated to the latest RT release (4.0.17) just to be sure. Now fulltext search with RT does not return anything at all!!

Example from the CLI:

search CrevalPublic --rsort=date -q -l 500

This returns 73 hits on the main index and 39 ihits on the delta index.

Simple search with RT:

fulltext:CrevalPublic any

This returns 0 results.

Any suggestions?

T.I.A.
Bye
Cris
Cristiano Guadagnino
Servizio Data Administration
Bankadati S.I.
Gruppo Credito Valtellinese
Tel. +39-0342-522172

Nota di riservatezza: Il presente messaggio non è di natura personale ma inviato per esigenze lavorative; l’eventuale messaggio di risposta potrà essere conosciuto anche da altri soggetti diversi dall’originatore di questo messaggio per dette esigenze o per controllo aziendale. Questo messaggio, corredato dei relativi allegati, contiene informazioni da considerarsi strettamente riservate, ed è destinato esclusivamente al destinatario sopra indicato, il quale è l’unico autorizzato ad usarlo, copiarlo e, sotto la propria responsabilità, diffonderlo. Chiunque ricevesse questo messaggio per errore o comunque lo leggesse senza esserne legittimato è avvertito che trattenerlo, copiarlo, divulgarlo, distribuirlo a persone diverse dal destinatario è severamente proibito, ed è pregato di rinviarlo immediatamente al mittente distruggendone l’originale.

sphinx.conf (2.99 KB)

2

Well, it turned out that the problem with 4.0.17 not returning any result was due to a stale searchd process.
Restarting the daemon reverted behavior to that of RT 4.0.10, which was anyway wrong.

So, to restate it clearly: RT is only returning results from the main index, completely ignoring the delta index.

Please help.

Bye
Cris

Guadagnino Cristiano wrote:
I am having trouble with RT fulltext searches. I am using RT 4.0.17 with Mysql and Sphinx 4.0.8.
Sphinx is configured to use a main+delta index (configuration attached). Main index is created once every morning, while the delta index is created every 5 minutes.
If I search using the “search” command line tool from Sphinx everything is correct.

Fulltext search with RT 4.0.10 instead seemed to return only the results from the main index, disregarding anything from the delta index.
So I updated to the latest RT release (4.0.17) just to be sure. Now fulltext search with RT does not return anything at all!!

Example from the CLI:

search CrevalPublic --rsort=date -q -l 500

This returns 73 hits on the main index and 39 ihits on the delta index.

Simple search with RT:

fulltext:CrevalPublic any

This returns 0 results.

Any suggestions?

T.I.A.
Bye
Cris
Cristiano Guadagnino
Servizio Data Administration
Bankadati S.I.
Gruppo Credito Valtellinese

Cristiano Guadagnino
Servizio Data Administration
Bankadati S.I.
Gruppo Credito Valtellinese

3

Hi,

RT defines index in the CONNECTION attribute of the table, so you have to
adjust it to use several indexes, see the following doc:

http://sphinxsearch.com/docs/2.0.9/sphinxse-using.html

It’s not clear how, but it implies that you can do the following:

ALTER TABLE t1 CONNECTION=“sphinx://NEWHOST:NEWPORT/index1,index2,index3”;On Wed, Sep 11, 2013 at 11:07 AM, Guadagnino Cristiano < guadagnino.cristiano@creval.it> wrote:

Well, it turned out that the problem with 4.0.17 not returning any result
was due to a stale searchd process.
Restarting the daemon reverted behavior to that of RT 4.0.10, which was
anyway wrong.

So, to restate it clearly: RT is only returning results from the main
index, completely ignoring the delta index.

Please help.

Bye
Cris

Guadagnino Cristiano wrote:

I am having trouble with RT fulltext searches. I am using RT 4.0.17 with
Mysql and Sphinx 4.0.8.
Sphinx is configured to use a main+delta index (configuration attached).
Main index is created once every morning, while the delta index is created
every 5 minutes.
If I search using the “search” command line tool from Sphinx everything is
correct.

Fulltext search with RT 4.0.10 instead seemed to return only the
results from the main index, disregarding anything from the delta index.
So I updated to the latest RT release (4.0.17) just to be sure. Now
fulltext search with RT does not return anything at all!!

*Example from the CLI: *

search CrevalPublic --rsort=date -q -l 500

This returns 73 hits on the main index and 39 ihits on the delta index.

Simple search with RT:

fulltext:CrevalPublic any

This returns 0 results.

Any suggestions?

T.I.A.
Bye
Cris

Cristiano Guadagnino
Servizio Data Administration
Bankadati S.I.
Gruppo Credito Valtellinese

**

–
Cristiano Guadagnino
Servizio Data Administration
Bankadati S.I.
Gruppo Credito Valtellinese

**

Best regards, Ruslan.

4

Ruslan,
first of all thank you very much for your help.
Your solution worked like a charm!

Now, reading the document you sent me I see that Sphinx allows to override the index (or indexes) name on the query text.
I tried it and it is actually working very well: it’s sufficient to append “;index=indexname1,indexname2” to the query text.

Don’t you think it would be nice (and better from a usability point of view) to add a new configuration option to RT_Config.pm so that RT administrators that want to fine-tune their Sphinx configuration don’t have to ALTER the AttachmentsIndex table? You should only change RT code so that every query sent to Sphinx gets the new token appended.
Well, just my 2 cents :-).

Thank you
Bye
Cris

Da: Ruslan Zakirov ruz@bestpractical.commailto:ruz@bestpractical.com
Inviato: Wed Sep 11 2013 14:25:56 GMT+0200 (CEST)
A: Guadagnino Cristiano guadagnino.cristiano@creval.itmailto:guadagnino.cristiano@creval.it
Oggetto: Re: [rt-users] Rt search does not work with sphinx main+delta index
Hi,

RT defines index in the CONNECTION attribute of the table, so you have to adjust it to use several indexes, see the following doc:

http://sphinxsearch.com/docs/2.0.9/sphinxse-using.html

It’s not clear how, but it implies that you can do the following:

ALTER TABLE t1 CONNECTION=“sphinx://NEWHOST:NEWPORT/index1,index2,index3”;On Wed, Sep 11, 2013 at 11:07 AM, Guadagnino Cristiano <guadagnino.cristiano@creval.itmailto:guadagnino.cristiano@creval.it> wrote:
Well, it turned out that the problem with 4.0.17 not returning any result was due to a stale searchd process.
Restarting the daemon reverted behavior to that of RT 4.0.10, which was anyway wrong.

So, to restate it clearly: RT is only returning results from the main index, completely ignoring the delta index.

Please help.

Bye
Cris

Guadagnino Cristiano wrote:
I am having trouble with RT fulltext searches. I am using RT 4.0.17 with Mysql and Sphinx 4.0.8.
Sphinx is configured to use a main+delta index (configuration attached). Main index is created once every morning, while the delta index is created every 5 minutes.
If I search using the “search” command line tool from Sphinx everything is correct.

Fulltext search with RT 4.0.10 instead seemed to return only the results from the main index, disregarding anything from the delta index.
So I updated to the latest RT release (4.0.17) just to be sure. Now fulltext search with RT does not return anything at all!!

Example from the CLI:

search CrevalPublic --rsort=date -q -l 500

This returns 73 hits on the main index and 39 ihits on the delta index.

Simple search with RT:

fulltext:CrevalPublic any

This returns 0 results.

Any suggestions?

T.I.A.
Bye
Cris
Cristiano Guadagnino
Servizio Data Administration
Bankadati S.I.
Gruppo Credito Valtellinese

Cristiano Guadagnino
Servizio Data Administration
Bankadati S.I.
Gruppo Credito Valtellinese

Best regards, Ruslan.

Cristiano Guadagnino
Servizio Data Administration
Bankadati S.I.
Gruppo Credito Valtellinese
Tel. +39-0342-522172