Have you tried another client? Thunderbird does NOT necessarily process expunges immediately. Depends on what else it is doing in the background. So you can't click delete in the UI and not immediately see anything on the backend and definitively correlate the two. Another option is to ensure debug logging is enabled for Dovecot so you can see what the FTS code is doing. "log_debug = category=fts" and/or "mail_debug = yes" will help in that regard. michael> On 11/02/2021 9:16 AM Shawn Heisey <elyograg at elyograg.org> wrote: > > > On 10/28/21 8:00 AM, Shawn Heisey wrote: > > Also, when I send a message with Thunderbird, which deletes the > > message in Drafts and adds one to Sent, I am not seeing a delete > > request in the Solr log.? I do see the add. So this isn't limited to > > just the shift-delete workflow. > > > I have confirmed this with multiple attempts. > > I start a new message in Thunderbird.? Then I wait around for that > message to be auto-saved to Drafts.? When that happens, I see an "add" > request in the solr log. > > Then I send the message.? At that point, I see another add in Solr's > log.? Based on the message number in the add request, I know that this > time the add happens in the Sent folder.? But despite the fact that > Thunderbird deletes the message from Drafts, Solr never sees a delete > request.? My dovecot version has been updated since the last time I > indicated what version it is.? Now it is "2:2.3.17-3+ubuntu20.04" from > the dovecot repo, not the ubuntu repo.? The same thing happened with 2.3.16. > > As I mentioned in the first message on this thread, when shift-delete is > used in Thunderbird to delete messages, that also never sends a delete > to Solr. > > Something somewhere is misbehaving.? Is it Thunderbird accessing IMAP > incorrectly, or is it Dovecot? > > I will do a packet capture to see if maybe dovecot is sending requests > that are not logged by Solr.? That seems unlikely -- even bad requests > should result in some kind of entry in the solr log. > > Thanks, > Shawn
On 11/3/21 12:38 PM, Michael Slusarz wrote:> Have you tried another client?I only have two clients configured:? Thunderbird 78.13.0 on Linux and Thunderbird 91.2.1 on Windows.? Behavior is the same on both. I will see if I can get another client configured.? Windows Mail is included on Windows 10, so I can try that.? I have a client system running Ubuntu, and I bet that there are a LOT of mail clients available there.> Thunderbird does NOT necessarily process expunges immediately. Depends on what else it is doing in the background. So you can't click delete in the UI and not immediately see anything on the backend and definitively correlate the two.The message is deleted by dovecot immediately.? I double checked this by purging a message on my Linux client and saw the message immediately disappear on my Windows client.? It happened even faster than I would have expected.? IMAP seems to be a very good protocol!? I can't say it definitively without more evidence, but the problem *seems* to be in FTS, not imap or core dovecot.> Another option is to ensure debug logging is enabled for Dovecot so you can see what the FTS code is doing. "log_debug = category=fts" and/or "mail_debug = yes" will help in that regard.When I have some real time available, I will look into debug logging.? I'm going to have to research exactly where to put those config options. Thanks, Shawn
On 11/3/21 12:38 PM, Michael Slusarz wrote:> Have you tried another client?I tried evolution on Linux. I can't work out how to do an expunge in evolution.? I'm not sure that it CAN do it.? Whenever I delete a message, even with shift-delete, it is moved to the Trash folder (with delete and add sent to Solr), and then emptying the trash does delete from Solr.? This is exactly how Thunderbird works with "normal" deletes. I use shift-delete in Thunderbird a lot.? Because when I delete a message, I really want it gone, I do not want another step to remember later -- emptying the trash folder. The FTS behavior on sending a message with Thunderbird seems completely wrong.? When I send a message with evolution, I do see a delete in the solr log, but there are still two results in a query for the special text I included in the message, so something is still not quite right. I couldn't get Windows Mail to connect to my email account. Even with their advanced settings.? I enter all the right information, and it just fails to connect.? There are only "Use SSL" checkboxes, and I have no idea what port/security settings it's using.? I can't tell it to use STARTTLS instead of mandatory TLS, or to use port 143 for imap and 587 for submission.? I think that I did see a successful imap login in the mail.log from the attempt to add the account, but I had other clients running so it is difficult to be sure about that. I will have to close all my other clients (which includes an Android client) and try the connect again.? When the account setup fails to connect, it doesn't have an option to add the account anyway (which Thunderbird does have), so I can't edit the account settings. The android client seems to not have an expunge option for deleting messages either.? It goes through Trash. Thanks, Shawn