Re: squat broken after upgrade from 2.4 to 2.5?

2016-06-20 Thread Bron Gondwana via Info-cyrus 
This could very well be a bug in the upgrade :(  It would be great to have a 
test case to check this.  I can't do that today, but maybe ellie can do 
something.

Sadly our bug tracking situtation for Cyrus is a mess at the moment, but I'm 
hoping to have that cleaned up soon.

Bron.

On Mon, Jun 20, 2016, at 19:33, Wolfgang Breyha via Info-cyrus wrote:
> Hi!
> 
> I upgraded some backend hosts from 2.4.18 to 2.5.8. Currently they are all
> still running with index version 12.
> 
> Some of these mailboxes have squatter activated as annotation and my
> cyrus.conf has
> squatter  cmd="squatter -asir *" at=0500
> 
> I see that it runs at night and logs entries like:
> Jun 20 05:00:15 lauren squatter[27593]: indexing mailbox user.
> 
> There are no errors in the log from squatter.
> 
> But today I recognized on my own mailbox that squatter returns nothing while
> searching with thunderbird. The resulting imap request looked like:
> <1466414132<18 UID Search UNDELETED (OR (OR OR TO "search" HEADER CC "search"
> SUBJECT "search") BODY "search")
> <1466414132>* SEARCH
> 18 OK Completed (0 msgs in 0.010 secs)
> 
> I then moved the current squat db and the same search returned 214 messages.
> 
> Rebuiling the squat db and searching again resulted in the exact same 214
> messages.
> 
> It seems that something changed within the squat DB and 2.5 can't search in
> the old 2.4 DBs. That's bad in two ways.
> 
> *) search doesn't fail with an error and simply returns no result. no fallback
> to searching without squat db.
> *) the squat db is not refreshed/rebuilt after upgrade.
> 
> Is this a bug or is something broken on my side?
> 
> Greetings, Wolfgang
> -- 
> Wolfgang Breyha  | http://www.blafasel.at/
> Vienna University Computer Center | Austria
> 
> 
> Cyrus Home Page: http://www.cyrusimap.org/
> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
> To Unsubscribe:
> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus


-- 
  Bron Gondwana
  br...@fastmail.fm

Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: stock centos 7 based Cyrus-imapd not working - troubleshooting suggestions?

2016-06-20 Thread Simon Matter via Info-cyrus 
> Trying to troubleshoot a centos 7/Cyrus-imap configuration.   The process
> is not running correctly - the /var/log/maillog fills up with messages and
> once this grep string is executed this is what is seen:
>
> grep -v Fatal maillog | grep -v abnormally | grep -v "ptions not presen"
>
> Jun 18 12:23:42 mail master[20269]: setrlimit: Unable to set file
> descriptors limit to -1: Operation not permitted
> Jun 18 12:23:42 mail master[20269]: retrying with 4096 (current max)
> Jun 18 12:23:42 mail ctl_cyrusdb[20277]: recovering cyrus databases
> Jun 18 12:23:42 mail ctl_cyrusdb[20277]: done recovering cyrus databases
> Jun 18 12:23:42 mail master[20269]: unable to setsocketopt(IP_TOS):
> Operation not supported
> Jun 18 12:23:42 mail ctl_cyrusdb[20314]: checkpointing cyrus databases
> Jun 18 12:23:42 mail ctl_cyrusdb[20314]: done checkpointing cyrus
> databases

AFAIK those messages are normal and don't show any real problem. What
exactly does not work?

Regards,
Simon

>
>
>
> The firewall is off (to attempt to see if the setsocketopt would go away):
> # systemctl status firewalld
>   firewalld.service - firewalld - dynamic firewall daemon
> Loaded: loaded (/usr/lib/systemd/system/firewalld.service; disabled;
> vendor preset: enabled)
> Active: inactive (dead)
>
> And SELinux is set to not stop things.
> # getenforce
> Permissive
>
>
>
> strace /usr/lib/cyrus-imapd/cyrus-master isn't really being helpful either
>
> (lots snipped)
> access("/etc/system-fips", F_OK)= -1 ENOENT (No such file or
> directory)
> open("/etc/imapd.conf", O_RDONLY)   = 3
> fstat(3, {st_mode=S_IFREG|0644, st_size=692, ...}) = 0
> mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) =
> 0x7f259e1b8000
> read(3, "configdirectory: /var/lib/imap\np"..., 4096) = 692
> read(3, "", 4096)   = 0
> close(3)= 0
> munmap(0x7f259e1b8000, 4096)= 0
> uname({sys="Linux", node="mail.example.com", ...}) = 0
> close(0)= 0
> open("/dev/null", O_RDWR)   = 0
> close(1)= 0
> open("/dev/null", O_RDWR)   = 1
> close(2)= 0
> open("/dev/null", O_RDWR)   = 2
> close(3)= -1 EBADF (Bad file descriptor)
> dup(0)  = 3
> close(4)= -1 EBADF (Bad file descriptor)
> dup(0)  = 4
> setrlimit(RLIMIT_NOFILE, {rlim_cur=RLIM64_INFINITY,
> rlim_max=RLIM64_INFINITY}) = -1 EPERM (Operation not permitted)
> open("/etc/localtime", O_RDONLY|O_CLOEXEC) = 5
> fstat(5, {st_mode=S_IFREG|0644, st_size=3559, ...}) = 0
> fstat(5, {st_mode=S_IFREG|0644, st_size=3559, ...}) = 0
> mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) =
> 0x7f259e1b8000
> read(5, "TZif2\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\6\0\0\0\6\0\0\0\0"...,
> 4096) = 3559
> lseek(5, -2272, SEEK_CUR)   = 1287
> read(5, "TZif2\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\0\7\0\0\0\7\0\0\0\0"...,
> 4096) = 2272
> close(5)= 0
> munmap(0x7f259e1b8000, 4096)= 0
> (lots more snipped)
>
> Nothing in the strace output for setsocketopt.
>
>
> Suggestions on what to do to figure out why on
> # cat /etc/redhat-release
> CentOS Linux release 7.2.1511 (Core)
>
> the installed packages
>
> # rpm -q -a | grep cyrus
> cyrus-imapd-2.4.17-8.el7_1.x86_64
> cyrus-sasl-devel-2.1.26-20.el7_2.x86_64
> cyrus-sasl-lib-2.1.26-20.el7_2.x86_64
> cyrus-imapd-utils-2.4.17-8.el7_1.x86_64
> cyrus-imapd-devel-2.4.17-8.el7_1.x86_64
> cyrus-sasl-plain-2.1.26-20.el7_2.x86_64
> cyrus-sasl-2.1.26-20.el7_2.x86_64
> cyrus-sasl-scram-2.1.26-20.el7_2.x86_64
> cyrus-sasl-md5-2.1.26-20.el7_2.x86_64
>
> are not working.
> 
> Cyrus Home Page: http://www.cyrusimap.org/
> List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
> To Unsubscribe:
> https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus
>



Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

squat broken after upgrade from 2.4 to 2.5?

2016-06-20 Thread Wolfgang Breyha via Info-cyrus 
Hi!

I upgraded some backend hosts from 2.4.18 to 2.5.8. Currently they are all
still running with index version 12.

Some of these mailboxes have squatter activated as annotation and my
cyrus.conf has
squatter  cmd="squatter -asir *" at=0500

I see that it runs at night and logs entries like:
Jun 20 05:00:15 lauren squatter[27593]: indexing mailbox user.

There are no errors in the log from squatter.

But today I recognized on my own mailbox that squatter returns nothing while
searching with thunderbird. The resulting imap request looked like:
<1466414132<18 UID Search UNDELETED (OR (OR OR TO "search" HEADER CC "search"
SUBJECT "search") BODY "search")
<1466414132>* SEARCH
18 OK Completed (0 msgs in 0.010 secs)

I then moved the current squat db and the same search returned 214 messages.

Rebuiling the squat db and searching again resulted in the exact same 214
messages.

It seems that something changed within the squat DB and 2.5 can't search in
the old 2.4 DBs. That's bad in two ways.

*) search doesn't fail with an error and simply returns no result. no fallback
to searching without squat db.
*) the squat db is not refreshed/rebuilt after upgrade.

Is this a bug or is something broken on my side?

Greetings, Wolfgang
-- 
Wolfgang Breyha  | http://www.blafasel.at/
Vienna University Computer Center | Austria


Cyrus Home Page: http://www.cyrusimap.org/
List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/
To Unsubscribe:
https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus