Io socket ssl pm 1177 global error undefined ssl object

It seems caused by a stalled IMAP connection (at least for me)…

++++ Verifying [INBOX] -> [INBOX]
Sending: 4068 STATUS INBOX (UIDNEXT)
Sent 29 bytes
Read:   * STATUS INBOX (UIDNEXT 4142)
        4068 OK Completed
Host2: uidnext is 4142
Host1: found that msg INBOX/9582 equals Host2 INBOX/664
Host1: flags init msg INBOX/9582 flags( Seen NonJunk category.Perso ) Host2 msg INBOX/664 flags( Seen )
Host1: flags filt msg INBOX/9582 flags( Seen ) Host2 msg INBOX/664 flags( Seen )
Host1: size msg INBOX/9582 = 3140 <> 3140 = Host2 INBOX/664
Host1: found that msg INBOX/9583 equals Host2 INBOX/665
Host1: flags init msg INBOX/9583 flags( Seen NonJunk category.Perso category.Perso.remy20 ) Host2 msg INBOX/665 flags( Seen )
Host1: flags filt msg INBOX/9583 flags( Seen ) Host2 msg INBOX/665 flags( Seen )
Host1: size msg INBOX/9583 = 37381 <> 37381 = Host2 INBOX/665
Host1: found that msg INBOX/9584 equals Host2 INBOX/666
Host1: flags init msg INBOX/9584 flags( Seen NonJunk category.Perso ) Host2 msg INBOX/666 flags( Seen )
Host1: flags filt msg INBOX/9584 flags( Seen ) Host2 msg INBOX/666 flags( Seen )
Host1: size msg INBOX/9584 = 7038 <> 7038 = Host2 INBOX/666
Host1: found that msg INBOX/9585 equals Host2 INBOX/667
Host1: flags init msg INBOX/9585 flags( Seen ) Host2 msg INBOX/667 flags( Seen )
Host1: flags filt msg INBOX/9585 flags( Seen ) Host2 msg INBOX/667 flags( Seen )
Host1: size msg INBOX/9585 = 8403 <> 8403 = Host2 INBOX/667
Host1: found that msg INBOX/9586 equals Host2 INBOX/668
Host1: flags init msg INBOX/9586 flags( NonJunk category.Perso ) Host2 msg INBOX/668 flags( NonJunk )
Host1: flags filt msg INBOX/9586 flags(  ) Host2 msg INBOX/668 flags( NonJunk )
Host2: flags msg INBOX/668 replacing h2 flags( NonJunk ) with h1 flags(  )
Sending: 4069 UID STORE 668 FLAGS.SILENT ()
Sent 36 bytes
ERROR: timeout waiting 120s for data from server at /usr/share/perl5/Mail/IMAPClient.pm line 1893.
        Mail::IMAPClient::__read_more(Mail::IMAPClient=HASH(0x5564453014d8), IO::Socket::SSL=GLOB(0x556445302250), 120) called at /usr/share/perl5/Mail/IMAPClient.pm li
ne 1859
        Mail::IMAPClient::_read_more(Mail::IMAPClient=HASH(0x5564453014d8), IO::Socket::SSL=GLOB(0x556445302250), 120) called at /usr/share/perl5/Mail/IMAPClient.pm lin
e 1670
        Mail::IMAPClient::_read_line(Mail::IMAPClient=HASH(0x5564453014d8)) called at /usr/share/perl5/Mail/IMAPClient.pm line 1406
        Mail::IMAPClient::_get_response(Mail::IMAPClient=HASH(0x5564453014d8), 4069, undef) called at /usr/share/perl5/Mail/IMAPClient.pm line 1340
        Mail::IMAPClient::_imap_command_do(Mail::IMAPClient=HASH(0x5564453014d8), "UID STORE 668 FLAGS.SILENT ()") called at /usr/share/perl5/Mail/IMAPClient.pm line 12
38
        Mail::IMAPClient::_imap_command(Mail::IMAPClient=HASH(0x5564453014d8), "UID STORE 668 FLAGS.SILENT ()") called at /usr/share/perl5/Mail/IMAPClient.pm line 1450
        Mail::IMAPClient::_imap_uid_command(Mail::IMAPClient=HASH(0x5564453014d8), "STORE", 668, "FLAGS.SILENT ()") called at /usr/share/perl5/Mail/IMAPClient.pm line 2
338
        Mail::IMAPClient::store(Mail::IMAPClient=HASH(0x5564453014d8), 668, "FLAGS.SILENT ()") called at /opt/imapsync/imapsync line 6112
        main::sync_flags(HASH(0x55644229d030), "INBOX", 9586, "NonJunk category.Perso", "INBOX", 668, "NonJunk", "") called at /opt/imapsync/imapsync line 6058
        main::sync_flags_fir(HASH(0x55644229d030), "INBOX", 9586, "INBOX", 668, "", HASH(0x556445c26b78), HASH(0x5564454b4358)) called at /opt/imapsync/imapsync line 27
69
        main::single_sync(HASH(0x55644229d030), HASH(0x5564408014d8), HASH(0x55644229d498)) called at /opt/imapsync/imapsync line 1250
reconnecting to os-gravelines-1.webmsg.me, last error: timeout waiting 120s for data from server
Connecting with IO::Socket::SSL PeerAddr os-gravelines-1.webmsg.me PeerPort 993 Proto tcp Timeout 120 Debug 1 SSL_cipher_list DEFAULT:!DH SSL_verify_mode 0 SSL_verifycn
_scheme imap
DEBUG: .../IO/Socket/SSL.pm:3010: new ctx 93889243497008
DEBUG: .../IO/Socket/SSL.pm:762: socket not yet connected
DEBUG: .../IO/Socket/SSL.pm:1177: global error: Undefined SSL object
DEBUG: .../IO/Socket/SSL.pm:1177: global error: Undefined SSL object
DEBUG: .../IO/Socket/SSL.pm:764: socket connected
DEBUG: .../IO/Socket/SSL.pm:787: ssl handshake not started
DEBUG: .../IO/Socket/SSL.pm:829: using SNI with hostname os-gravelines-1.webmsg.me
DEBUG: .../IO/Socket/SSL.pm:880: set socket to non-blocking to enforce timeout=120
DEBUG: .../IO/Socket/SSL.pm:894: call Net::SSLeay::connect
DEBUG: .../IO/Socket/SSL.pm:897: done Net::SSLeay::connect -> 1
DEBUG: .../IO/Socket/SSL.pm:952: ssl handshake done
Connected to os-gravelines-1.webmsg.me
DEBUG: .../IO/Socket/SSL.pm:3059: free ctx 93889080230576 open=93889243497008 93889080230576 93889209037856                                                             
DEBUG: .../IO/Socket/SSL.pm:3070: OK free ctx 93889080230576
Read:   * OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE STARTTLS AUTH=PLAIN SASL-IR] os-gravelines-1.webmsg.me Cyrus IMAP 3.4.2-dirty-Debian-3.4.2-1~bpo11+1 server ready
Sending: 4070 LOGIN <<<REDACTED>>> [Redact: Count=4070 Showcredentials=OFF]
Sent 41 bytes
Read:   4070 OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE ACL ANNOTATE-EXPERIMENT-1 BINARY CATENATE CHILDREN CONDSTORE CREATE-SPECIAL-USE ESEARCH ESORT LIST-EXTENDED LIS
T-MYRIGHTS LIST-STATUS MAILBOX-REFERRALS METADATA MOVE MULTIAPPEND NAMESPACE OBJECTID QRESYNC QUOTA RIGHTS=kxten SAVEDATE SEARCH=FUZZY SORT SORT=DISPLAY SPECIAL-USE STA
TUS=SIZE THREAD=ORDEREDSUBJECT THREAD=REFERENCES UIDPLUS UNSELECT URLAUTH URLAUTH=BINARY WITHIN DIGEST=SHA1 LIST-METADATA NO_ATOMIC_RENAME PREVIEW=FUZZY SCAN SORT=MODSE
Q SORT=UID THREAD=REFS X-CREATEDMODSEQ X-REPLICATION XLIST XMOVE LOGINDISABLED XCONVERSATIONS COMPRESS=DEFLATE X-QUOTA=STORAGE X-QUOTA=MESSAGE X-QUOTA=X-ANNOTATION-STOR
AGE X-QUOTA=X-NUM-FOLDERS IDLE] User logged in SESSIONID=<cyrus-1637308599-80986-1-11610858836795431422>
Sending: 4071 SELECT INBOX
Sent 19 bytes
Read:   * 4100 EXISTS
        * 0 RECENT
        * FLAGS (Answered Flagged Draft Deleted Seen $Forwarded $label3 $MDNSent $toreply NonJunk Junk)
        * OK [PERMANENTFLAGS (Answered Flagged Draft Deleted Seen $Forwarded $label3 $MDNSent $toreply NonJunk Junk *)] Ok
        * OK [UNSEEN 10] Ok
        * OK [UIDVALIDITY 1628200824] Ok
        * OK [UIDNEXT 4142] Ok
        * OK [HIGHESTMODSEQ 479815] Ok
        * OK [URLMECH INTERNAL] Ok
        * OK [ANNOTATIONS 65536] Ok
        4071 OK [READ-WRITE] Completed
reconnect success(1) on try #1/3
Sending: 4072 UID STORE 668 FLAGS.SILENT ()
Sent 36 bytes
Read:   4072 OK Completed
Host1: size msg INBOX/9586 = 1081199 <> 1081199 = Host2 INBOX/668
Host1: found that msg INBOX/9587 equals Host2 INBOX/669
Host1: flags init msg INBOX/9587 flags( NonJunk category.Perso ) Host2 msg INBOX/669 flags( NonJunk )
Host1: flags filt msg INBOX/9587 flags(  ) Host2 msg INBOX/669 flags( NonJunk )
Host2: flags msg INBOX/669 replacing h2 flags( NonJunk ) with h1 flags(  )
Sending: 4073 UID STORE 669 FLAGS.SILENT ()
Sent 36 bytes
...

What seems suspicious is what happens just befor ethe connection stalls:

Host2: flags msg INBOX/668 replacing h2 flags( NonJunk ) with h1 flags(  )
Sending: 4069 UID STORE 668 FLAGS.SILENT ()
Sent 36 bytes

I’m replacing IMAP flags, probably because I have the following option in my script : --regexflag 's/.*?(?:([\$]S+s?)|$)/defined($1)?$1:q()/eg'

This is because on Host1 (Dovecot), I have too much IMAP flags defined (I have a sieve script that defines flags for anything) and on Host2 (Cyrus) I cannot define as many flags (there is a hard limit of acout 200 flags in Cyrus).

Effectively, on Host2, I have a segfault of Cyrus IMAP

DEBUG: . /IO/Socket/SSL.pm:1177: global error: Undefined SSL object

mendel5 opened this issue 2 years ago · comments

I receive a debugging statement when working with imapsync. My imapsync is running on a Linux Mint 20.1 system.

Here is my command (partially adjusted to not reveal my credentials):
./imapsync —host1 ‘imap.old-hosting-provider.com’ —port1 993 —user1 ‘old.email@mydomain1.com’ —password1 ‘mypassword1’ —host2 ‘imap.new-hosting-provider.com’ —port2 993 —user2 ‘new.email@mydomain2.com’ —password2 ‘mypassword2’ —ssl1 —sslargs1 SSL_verify_mode=1 —sslargs1 SSL_version=TLSv1_2 —ssl2 —sslargs2 SSL_verify_mode=1 —sslargs2 SSL_version=TLSv1_3 —expunge1 —subscribeall

The debug statement:

This debug message appears 4 times, twice for the connection to host1 and twice for the connection to host2.

However, the TLS encryption for both connections — TLS1.2 to host1 and TLS1.3 to host2 — works correctly. I have checked that by using Wireshark to inspect my own traffic. The transfer of the emails from host1 to host2 finishes successfully despite the error message.

If you need any other info please let me know.

Do you have a real concrete example I can reproduce? Something like:

but with an other host than test1.lamiral.info, a one that fails and I can play with.

I tried to reproduce the issue with the following command:

There is no debug statement. It seems that the issue cannot be reproduced by using only this command. An actual login to a mailbox including the transfer of e-mails might be necessary to reproduce the debug message.

I tried to reproduce the issue with the following command:

There is no debug statement. It seems that the issue cannot be reproduced by using only this command.

An actual login to a mailbox including the transfer of e-mails might be necessary to reproduce the debug message.

You’re right, I can not reproduce the error myself, but I get another one: imap.old-hosting-provider.com doesn’t resolve at all.
Can you give a real concrete example I can reproduce, Is imap.old-hosting-provider.com the real hostname?

I tried to add it to the previous command but the error message can still not be reproduced.

Is imap.old-hosting-provider.com the real hostname?

No, it’s not the real hostname. I just used it as an example.

Can you give a real concrete example I can reproduce

Yes. Can I contact you via email at gilles@lamiral.info ?

The debug statement

originates from the Perl module IO::Socket::SSL .

As can be seen in the first comment, the version of IO::Socket::SSL that has been used is 2.067 . At the time of writing this comment, the current version is 2.071 . Maybe the debug message has been fixed in the meantime.

Links to IO::Socket::SSL :

Since the debug message does not orignate from imapsync but from IO::Socket::SSL , I will close this issue.

Unfortunately, the corresponding issue over at IO::Socket::SSL has been closed as well, because they argue there is something wrong in the caller program. Link: [https://github.com/noxxi/p5-io-socket-ssl/issues/109]

I happened to find this thread because it occurs randomly during transfers. I could not find any pattern, just that it always appears twice. I can create a detailed log for you, just let me know what debug options to set.

I can create a detailed log for you, just let me know what debug options to set.

Hi @OldGrumpy-de , as far as I know the issue does not originate from imapsync, so gilleslamiral cannot do much about it.

Maybe we can reopen the issue at noxxi/p5-io-socket-ssl#109

It looks for me like the method blocking with called on an object which is not yet or no longer an SSL object. But that’s all I can get from the error message. It is unlikely that the problem is caused by imapsync directly though since imapclient does not use IO::Socket::SSL directly.

Unfortunately it looks like there are not enough information for others to reproduce the problem, which make debugging and fixing it a problem hard. The severity seems to be low though, i.e. just an error message without any reported side effects.

I’ll fix it when I’ll encounter it reproductively with a bad side effect.

All right, thanks for the feedback from both of you.

I have the same error (DEBUG: . /IO/Socket/SSL.pm:1177: global error: Undefined SSL object​) but imapsync is executed without any ssl specific flag. It didn’t occur before. Also, it sems either very slow to sync, or it is stalling on the INBOX folder (running a partial sync with most of the mails synchronized before). The message just appear many times as in a loop and the sync does not progress.

I’ll try to provide more useful logs with —debugssl=4 —debugimap

It seems caused by a stalled IMAP connection (at least for me).

bpo11+1 server ready Sending: 4070 LOGIN >> [Redact: Count=4070 Showcredentials=OFF] Sent 41 bytes Read: 4070 OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE ACL ANNOTATE-EXPERIMENT-1 BINARY CATENATE CHILDREN CONDSTORE CREATE-SPECIAL-USE ESEARCH ESORT LIST-EXTENDED LIS T-MYRIGHTS LIST-STATUS MAILBOX-REFERRALS METADATA MOVE MULTIAPPEND NAMESPACE OBJECTID QRESYNC QUOTA RIGHTS=kxten SAVEDATE SEARCH=FUZZY SORT SORT=DISPLAY SPECIAL-USE STA TUS=SIZE THREAD=ORDEREDSUBJECT THREAD=REFERENCES UIDPLUS UNSELECT URLAUTH URLAUTH=BINARY WITHIN DIGEST=SHA1 LIST-METADATA NO_ATOMIC_RENAME PREVIEW=FUZZY SCAN SORT=MODSE Q SORT=UID THREAD=REFS X-CREATEDMODSEQ X-REPLICATION XLIST XMOVE LOGINDISABLED XCONVERSATIONS COMPRESS=DEFLATE X-QUOTA=STORAGE X-QUOTA=MESSAGE X-QUOTA=X-ANNOTATION-STOR AGE X-QUOTA=X-NUM-FOLDERS IDLE] User logged in SESSIONID= Sending: 4071 SELECT INBOX Sent 19 bytes Read: * 4100 EXISTS * 0 RECENT * FLAGS (Answered Flagged Draft Deleted Seen $Forwarded $label3 $MDNSent $toreply NonJunk Junk) * OK [PERMANENTFLAGS (Answered Flagged Draft Deleted Seen $Forwarded $label3 $MDNSent $toreply NonJunk Junk *)] Ok * OK [UNSEEN 10] Ok * OK [UIDVALIDITY 1628200824] Ok * OK [UIDNEXT 4142] Ok * OK [HIGHESTMODSEQ 479815] Ok * OK [URLMECH INTERNAL] Ok * OK [ANNOTATIONS 65536] Ok 4071 OK [READ-WRITE] Completed reconnect success(1) on try #1/3 Sending: 4072 UID STORE 668 FLAGS.SILENT () Sent 36 bytes Read: 4072 OK Completed Host1: size msg INBOX/9586 = 1081199 <> 1081199 = Host2 INBOX/668 Host1: found that msg INBOX/9587 equals Host2 INBOX/669 Host1: flags init msg INBOX/9587 flags( NonJunk category.Perso ) Host2 msg INBOX/669 flags( NonJunk ) Host1: flags filt msg INBOX/9587 flags( ) Host2 msg INBOX/669 flags( NonJunk ) Host2: flags msg INBOX/669 replacing h2 flags( NonJunk ) with h1 flags( ) Sending: 4073 UID STORE 669 FLAGS.SILENT () Sent 36 bytes . «>

What seems suspicious is what happens just befor ethe connection stalls:

I’m replacing IMAP flags, probably because I have the following option in my script : —regexflag ‘s/.*?(?:([\$]S+s?)|$)/defined($1)?$1:q()/eg’

This is because on Host1 (Dovecot), I have too much IMAP flags defined (I have a sieve script that defines flags for anything) and on Host2 (Cyrus) I cannot define as many flags (there is a hard limit of acout 200 flags in Cyrus).

Effectively, on Host2, I have a segfault of Cyrus IMAP

Источник

DEBUG: . /IO/Socket/SSL.pm:1177: global error: Undefined SSL object #293

I receive a debugging statement when working with imapsync. My imapsync is running on a Linux Mint 20.1 system.

Here is my command (partially adjusted to not reveal my credentials):
./imapsync —host1 ‘imap.old-hosting-provider.com’ —port1 993 —user1 ‘old.email@mydomain1.com’ —password1 ‘mypassword1’ —host2 ‘imap.new-hosting-provider.com’ —port2 993 —user2 ‘new.email@mydomain2.com’ —password2 ‘mypassword2’ —ssl1 —sslargs1 SSL_verify_mode=1 —sslargs1 SSL_version=TLSv1_2 —ssl2 —sslargs2 SSL_verify_mode=1 —sslargs2 SSL_version=TLSv1_3 —expunge1 —subscribeall

The debug statement:

This debug message appears 4 times, twice for the connection to host1 and twice for the connection to host2.

However, the TLS encryption for both connections — TLS1.2 to host1 and TLS1.3 to host2 — works correctly. I have checked that by using Wireshark to inspect my own traffic. The transfer of the emails from host1 to host2 finishes successfully despite the error message.

If you need any other info please let me know.

The text was updated successfully, but these errors were encountered:

Do you have a real concrete example I can reproduce? Something like:

but with an other host than test1.lamiral.info, a one that fails and I can play with.

I tried to reproduce the issue with the following command:

There is no debug statement. It seems that the issue cannot be reproduced by using only this command. An actual login to a mailbox including the transfer of e-mails might be necessary to reproduce the debug message.

I tried to reproduce the issue with the following command:

There is no debug statement. It seems that the issue cannot be reproduced by using only this command.

An actual login to a mailbox including the transfer of e-mails might be necessary to reproduce the debug message.

You’re right, I can not reproduce the error myself, but I get another one: imap.old-hosting-provider.com doesn’t resolve at all.
Can you give a real concrete example I can reproduce, Is imap.old-hosting-provider.com the real hostname?

I tried to add it to the previous command but the error message can still not be reproduced.

Is imap.old-hosting-provider.com the real hostname?

No, it’s not the real hostname. I just used it as an example.

Can you give a real concrete example I can reproduce

Yes. Can I contact you via email at gilles@lamiral.info ?

The debug statement

originates from the Perl module IO::Socket::SSL .

As can be seen in the first comment, the version of IO::Socket::SSL that has been used is 2.067 . At the time of writing this comment, the current version is 2.071 . Maybe the debug message has been fixed in the meantime.

Links to IO::Socket::SSL :

Since the debug message does not orignate from imapsync but from IO::Socket::SSL , I will close this issue.

Unfortunately, the corresponding issue over at IO::Socket::SSL has been closed as well, because they argue there is something wrong in the caller program. Link: [https://github.com/noxxi/p5-io-socket-ssl/issues/109]

I happened to find this thread because it occurs randomly during transfers. I could not find any pattern, just that it always appears twice. I can create a detailed log for you, just let me know what debug options to set.

I can create a detailed log for you, just let me know what debug options to set.

Hi @OldGrumpy-de , as far as I know the issue does not originate from imapsync, so gilleslamiral cannot do much about it.

Maybe we can reopen the issue at noxxi/p5-io-socket-ssl#109

It looks for me like the method blocking with called on an object which is not yet or no longer an SSL object. But that’s all I can get from the error message. It is unlikely that the problem is caused by imapsync directly though since imapclient does not use IO::Socket::SSL directly.

Unfortunately it looks like there are not enough information for others to reproduce the problem, which make debugging and fixing it a problem hard. The severity seems to be low though, i.e. just an error message without any reported side effects.

I’ll fix it when I’ll encounter it reproductively with a bad side effect.

All right, thanks for the feedback from both of you.

I have the same error (DEBUG: . /IO/Socket/SSL.pm:1177: global error: Undefined SSL object​) but imapsync is executed without any ssl specific flag. It didn’t occur before. Also, it sems either very slow to sync, or it is stalling on the INBOX folder (running a partial sync with most of the mails synchronized before). The message just appear many times as in a loop and the sync does not progress.

I’ll try to provide more useful logs with —debugssl=4 —debugimap

It seems caused by a stalled IMAP connection (at least for me).

bpo11+1 server ready Sending: 4070 LOGIN >> [Redact: Count=4070 Showcredentials=OFF] Sent 41 bytes Read: 4070 OK [CAPABILITY IMAP4rev1 LITERAL+ ID ENABLE ACL ANNOTATE-EXPERIMENT-1 BINARY CATENATE CHILDREN CONDSTORE CREATE-SPECIAL-USE ESEARCH ESORT LIST-EXTENDED LIS T-MYRIGHTS LIST-STATUS MAILBOX-REFERRALS METADATA MOVE MULTIAPPEND NAMESPACE OBJECTID QRESYNC QUOTA RIGHTS=kxten SAVEDATE SEARCH=FUZZY SORT SORT=DISPLAY SPECIAL-USE STA TUS=SIZE THREAD=ORDEREDSUBJECT THREAD=REFERENCES UIDPLUS UNSELECT URLAUTH URLAUTH=BINARY WITHIN DIGEST=SHA1 LIST-METADATA NO_ATOMIC_RENAME PREVIEW=FUZZY SCAN SORT=MODSE Q SORT=UID THREAD=REFS X-CREATEDMODSEQ X-REPLICATION XLIST XMOVE LOGINDISABLED XCONVERSATIONS COMPRESS=DEFLATE X-QUOTA=STORAGE X-QUOTA=MESSAGE X-QUOTA=X-ANNOTATION-STOR AGE X-QUOTA=X-NUM-FOLDERS IDLE] User logged in SESSIONID= Sending: 4071 SELECT INBOX Sent 19 bytes Read: * 4100 EXISTS * 0 RECENT * FLAGS (Answered Flagged Draft Deleted Seen $Forwarded $label3 $MDNSent $toreply NonJunk Junk) * OK [PERMANENTFLAGS (Answered Flagged Draft Deleted Seen $Forwarded $label3 $MDNSent $toreply NonJunk Junk *)] Ok * OK [UNSEEN 10] Ok * OK [UIDVALIDITY 1628200824] Ok * OK [UIDNEXT 4142] Ok * OK [HIGHESTMODSEQ 479815] Ok * OK [URLMECH INTERNAL] Ok * OK [ANNOTATIONS 65536] Ok 4071 OK [READ-WRITE] Completed reconnect success(1) on try #1/3 Sending: 4072 UID STORE 668 FLAGS.SILENT () Sent 36 bytes Read: 4072 OK Completed Host1: size msg INBOX/9586 = 1081199 <> 1081199 = Host2 INBOX/668 Host1: found that msg INBOX/9587 equals Host2 INBOX/669 Host1: flags init msg INBOX/9587 flags( NonJunk category.Perso ) Host2 msg INBOX/669 flags( NonJunk ) Host1: flags filt msg INBOX/9587 flags( ) Host2 msg INBOX/669 flags( NonJunk ) Host2: flags msg INBOX/669 replacing h2 flags( NonJunk ) with h1 flags( ) Sending: 4073 UID STORE 669 FLAGS.SILENT () Sent 36 bytes . «>

What seems suspicious is what happens just befor ethe connection stalls:

I’m replacing IMAP flags, probably because I have the following option in my script : —regexflag ‘s/.*?(?:([\$]S+s?)|$)/defined($1)?$1:q()/eg’

This is because on Host1 (Dovecot), I have too much IMAP flags defined (I have a sieve script that defines flags for anything) and on Host2 (Cyrus) I cannot define as many flags (there is a hard limit of acout 200 flags in Cyrus).

Effectively, on Host2, I have a segfault of Cyrus IMAP

Источник

office login issues — tried everything #310

Hi,
first I would like to say thank you for this amazing software.

I’m having trouble syncing from dovecot to office365,
I’ve done this before, but right now office365 does not want to authenticate.
I have tried all sorts of arguments without any success.
for example I have tested:

• —office2
• tried all office365 imap servers in your documentation
• double checked if IMAP auth is enabled in office365.(also checked in powershell, to be sure. Results below. )
• no special characters in passwd
• disabled 2factor auth
• disabled security defaults
• tried to give admin fullaccess to user mailbox and use the «—authuser2 user_admin@domain.com —user2 user_to_be_migrated@domain.com»
• tried —ssl1
• verified that basic auth is allowed for IMAP, SMTP, POP
• tried the webversion of imapsync/X

1AppDataLocalTemppar-6c6f63616c61646d696ecache-9a559c19df46e5030e9dbee73dfad88436183ffdinclib/Mail/IMAPClient.pm line 1298. Mail::IMAPClient::_imap_command(Mail::IMAPClient=HASH(0x6af8850), «LOGIN username@domain.com SuperSecretMaskedPass») called at C:UsersLOCALA

1AppDataLocalTemppar-6c6f63616c61646d696ecache-9a559c19df46e5030e9dbee73dfad88436183ffdinclib/Mail/IMAPClient.pm line 601 Mail::IMAPClient::login(Mail::IMAPClient=HASH(0x6af8850)) called at script/imapsync line 7704 main::authenticate_imap(Mail::IMAPClient=HASH(0x6af8850), «outlook.office365.com», 993, «username@domain.com», «SuperSecretMaskedPass», 1, undef, 1, . ) called at script/imapsync line 7587 main::login_imap(«outlook.office365.com», 993, «username@domain.com», «SuperSecretMaskedPass», 1, undef, 1, 100, . ) called at script/imapsync line 1904 main::single_sync(HASH(0x57af510), HASH(0x55b2b80), HASH(0x5e45608)) called at script/imapsync line 1250 require main called at /PAR.pm line 647 PAR::_run_member(Archive::Zip::ZipFileMember=HASH(0x3bc30c0), 1) called at script/main.pl line 26 require main called at /PAR.pm line 647 PAR::_run_member(Archive::Zip::ZipFileMember=HASH(0x3bbc3a0)) called at /PAR.pm line 434 PAR::import(«PAR») called at -e line 594 eval <. >called at -e line 42 __par_pl::BEGIN() called at script/imapsync line 0 eval <. >called at script/imapsync line 0 Host2 info: authmech [LOGIN] user [username@domain.com] authuser [] IsUnconnected [] Host2 failure: Error login on [outlook.office365.com] with user [username@domain.com] auth [LOGIN]: 2 NO LOGIN failed. Host2: failed login on [outlook.office365.com] with user [username@domain.com] auth [LOGIN] Host1 Buffer I/O: 4096 ++++ Listing 1 errors encountered during the sync ( avoid this listing with —noerrorsdump ). Err 1/1: Host2 failure: Error login on [outlook.office365.com] with user [username@domain.com] auth [LOGIN]: 2 NO LOGIN failed. The most frequent error is ERR_AUTHENTICATION_FAILURE_USER2 Exiting with return value 162 (EXIT_AUTHENTICATION_FAILURE_USER2) 1/50 nb_errors/max_errors PID 76852 Removing pidfile C:UsersLOCALA

1AppDataLocalTemp/imapsync.pid Disconnecting from host1 mail.domain.com user1 username@domain.com*superuser Sending: 3 LOGOUT Sent 10 bytes Read: * BYE Logging out 3 OK Logout completed (0.001 + 0.000 secs). Log file is LOG_imapsync/2021_12_05_15_00_11_069_username@domain.com_superuser_username@domain.com.txt ( to change it, use —logfile filepath ; or use —nolog to turn off logging )»>

Here is powershell output for the office365 user:

This is not related to imapsync. I tested ncat.
Results:

Basic auth allowed verified:

Very strange.
Something in the office environment is preventing me from connecting.
But it’s not the security defaults, or IMAP enable/disable feature.
its something else. something new.

I do have one cutover migration batch running with different mailboxes. I know I cannot run an IMAP migration at the same time as a cutover migration is running. So maybe this is the issue.

I tested another Tenant in office365. and that was successful. No issues with another tenant.
i’m out of options. as you can see I tried a lot of things.

The text was updated successfully, but these errors were encountered:

Источник

imapsync --host1 imap.old_account.ch   --user1 old_user   --password1 'oldpassword'   
         --host2 imap.gmail.com        --user2 new.user@gmail.com  --password2 'newpassword'  
         --automap --justfolders --dry "$@"

...
Host1: SSL default mode is like --sslargs1 "SSL_verify_mode=0", meaning for host1 SSL_VERIFY_NONE, ie, do not check the certificate server.
Host1: Use --sslargs1 SSL_verify_mode=1 to have SSL_VERIFY_PEER, ie, check the certificate server of host1
Host1: will try to use LOGIN authentication on host1
Host1: imap connection timeout is 120 seconds
Host1: IMAP server [imap.old_account.ch] port [993] user [old_user]
Host1: connecting and login on host1 [imap.old_account.ch] port [993] with user [old_user]
DEBUG: .../IO/Socket/SSL.pm:1177: global error: Undefined SSL object
DEBUG: .../IO/Socket/SSL.pm:1177: global error: Undefined SSL object
Host1 IP address: xxx.yyy.zzz.ttt
Host1 banner: * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN] Dovecot ready.
Host1 capability before authentication: IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE AUTH=PLAIN AUTH=LOGIN AUTH
Host1: imap.old_account.ch says it has CAPABILITY for AUTHENTICATE LOGIN
Host1: success login on [imap.old_account.ch] with user [old_user] auth [LOGIN]
...

...
Host2: SSL default mode is like --sslargs2 "SSL_verify_mode=0", meaning for host2 SSL_VERIFY_NONE, ie, do not check the certificate server.
Host2: Use --sslargs2 SSL_verify_mode=1 to have SSL_VERIFY_PEER, ie, check the certificate server of host2
Host2: will try to use LOGIN authentication on host2
Host2: imap connection timeout is 120 seconds
Host2: IMAP server [imap.gmail.com] port [993] user [new.user@gmail.com]
Host2: connecting and login on host2 [imap.gmail.com] port [993] with user [new.user@gmail.com]
Host2 IP address: 108.177.119.109
Host2 banner: * OK Gimap ready for requests from xxx.yyy.zzz.ttt ek19mb91982044edb
Host2 capability before authentication: IMAP4rev1 UNSELECT IDLE NAMESPACE QUOTA ID XLIST CHILDREN X-GM-EXT-1 XYZZY SASL-IR AUTH=XOAUTH2 AUTH=PLAIN AUTH=PLAIN-CLIENTTOKEN AUTH=OAUTHBEARER AUTH=XOAUTH AUTH
Host2: connecting and login on host2 [imap.gmail.com] port [993] with user [new.user@gmail.com]
DEBUG: .../IO/Socket/SSL.pm:1177: global error: Undefined SSL object
DEBUG: .../IO/Socket/SSL.pm:1177: global error: Undefined SSL object
Host2 IP address: 108.177.119.109
Host2 banner: * OK Gimap ready for requests from xxx.yyy.zzz.ttt ek19mb91982044edb
Host2 capability before authentication: IMAP4rev1 UNSELECT IDLE NAMESPACE QUOTA ID XLIST CHILDREN X-GM-EXT-1 XYZZY SASL-IR AUTH=XOAUTH2 AUTH=PLAIN AUTH=PLAIN-CLIENTTOKEN AUTH=OAUTHBEARER AUTH=XOAUTH AUTH
Host2 info: authmech [LOGIN] user [new.user@gmail.com] authuser [] IsUnconnected []
Host2 failure: Error login on [imap.gmail.com] with user [new.user@gmail.com] auth [LOGIN]: 2 NO [AUTHENTICATIONFAILED] Invalid credentials (Failure)
Exiting with return value 16 (EXIT_AUTHENTICATION_FAILURE) 1/50 nb_errors/max_errors
Disconnecting from host1 imap.old_account.ch user1 old_user

1 ответ

Despite not being familiar with those Linuxes and their age, I have the following thoughts:

1.   In the past two years, the use of SSL 3.0 has been deprecated.   Many libraries, server configs and websites have either turned it off or removed any support for it.  Linux usually uses the openssl library for this function. 

2.   TLS 1.0 is starting to be turned off on sites, but it isn’t common.

3.    I think you’re needing to make configuration changes to turn off SSL 2.0 and 3.0 support.  While you’re there you may also find some ciphers won’t work either.    This page has some recommendations for what to use today: https://wiki.mozilla.org/Security/TLS_Configurations Opens a new window

4.  Perl, openssl and other included things tend to be very old versions in Linux distributions.  Depending on where this line of Ubuntu is on the spectrum of things, the versions of perl, openssl may be too old to know about some things you need.   Your choices then are to step up to the next Linux line.   Or download, build and maintain your versions of perl and openssl and whatever other dependencies are there.   

4.  Perl, openssl and other included things tend to be very old versions in Linux distributions.  Depending on where this line of Ubuntu is on the spectrum of things, the versions of perl, openssl may be too old to know about some things you need.   Your choices then are to step up to the next Linux line.   Or download, build and maintain your versions of perl and openssl and whatever other dependencies are there.   

Thank you, Jim! You are correct, it is a known bug with SSL version number/s in the Perl SSL.pm file (at least according to multiple other posts online). I did try editing the file with Nano to *only* use SSLv3 (suggested on Server Fault), but for whatever reason, it did not work. 

To my knowledge, Ubuntu is the only Debian flavor that AWS offers as a free instance to deploy, hence my choosing it. Any quick link/s you can point me to for how to «build and maintain» a newer version of Perl that might work?? I’m still noob with Linux. 

To date, I have avoided doing that since my Linux world is all production based on CentOS 5/6/7 and I like to type «yum update».   If you don’t know they are Red Hat distributions.

1.  yum is the RPM/package manager command.   So I’d first look to see if there is an alternate perl package for you.

2. In addition you may be able to expand your collection of repositories to do the same.

3. If you want to get the source, it’s usually an excise like this:

a. download the desired package and unzip/unpack the tar ball into a directory tree for working with.

Extra step: make clean     <- this will clean any cruft that may be in the tree.  

One to all of these:

a. make config  or make autoconfig or xmkmf   # this looks around at your system and figures out all kinds of details. 

b. make world or make   (build it)

Between those two you may have to find additional yum packages to install for things that can’t be found. 

f. make test (to test the installation; move on when it is happy.  Iterate when it complains about missing things, usually another yum/rpm package to install.)  

e. make -n install (run through the install process, but don’t actually do it.   Looking at details of where it will install and permissions.)    Common places are the /usr/local tree to avoid overwriting /usr/bin /usr/sbin/ /usr/lib versions.  Update PATH environment variable config files as necessary.

(drop the -n when you want actually do it.)

I was able to find a resolution by deleting this faulty AWS instance and deploying a new one, again of Ubuntu Server 14.04, only this time I followed these instructions to get sendEmail working (I think the instructions I originally used were the issue): https://ubuntuforums.org/showthread.php?t=1127478 Opens a new window

sudo apt-get install sendemail 
sudo apt-get install libio-socket-ssl-perl