I just came on to post this same exact issue.
I have many legit emails that are getting marked ‘soft reject’, not sure when it started.
But, Greylist is disabled, I think by default as I have never changed it.
This is a major issue for me as these emails are being popped off a server, so they cannot be resent I do not think so they are lost.
Not sure if this is directed to me, but my messages are being received at my email host, so they are already accepted from the original sender. I then pop them off that server to my locally hosted NethServer, so I am unsure in that case if they resend or not, not sure how long I have to wait. These are important emails, and they have already been 3 hours without a resend.
The major issue here is that they are being soft-rejected in the first place, as Greylist is disabled.
Is there a way to completely disable soft rejects? I have Greyisting off, and this is still hapenning, and the tolerance is very low.
For example, this one legit and important email got soft reject blocked with these values, and it doesn’t send again as it it popped off the server.
SUBJECT_ENDS_SPACES (0.5)
MV_CASE (0.5)
MIME_GOOD (-0.1) [text/plain]
RCVD_NO_TLS_LAST (0.1)
RCVD_COUNT_THREE (0) [3]
PREVIOUSLY_DELIVERED (0) [sam@mydomain.com]
TO_DOM_EQ_FROM_DOM (0)
FROM_EQ_ENVFROM (0)
FROM_NO_DN (0)
GENERIC_REPUTATION (0) [0.70799681856587]
RCPT_COUNT_ONE (0) [1]
TO_DN_NONE (0)
MIME_TRACE (0) [0:+]
I am having similar problems, getting legit emails ‘soft reject’, and they don’t resend (I am pulling them off the server with the connector with IMAP. I also get ‘soft reject’ from domains that are whitelisted in From Domain. Not sure how that can happen, but it is.
The file /etc/rspamd/override.d/greylist.conf does not exist, I tried creating it and adding the single line enabled = false; and restarted rspamd and I continue to get ‘soft reject’ emails that are never resent.
Strange It should not be possible, we need logs. I put one of my email in SenderWhiteList then I used rspamc to valid the email like getmail does
[root@prometheus ~]# config setprop rspamd SenderWhiteList stephane@domain.org
[root@prometheus ~]# signal-event nethserver-mail-filter-save
[root@prometheus ~]# rspamc < /var/lib/nethserver/vmail/stephdl@domain.org/Maildir/cur/1580832365.M477139P9350.prometheus.domain.org,S=6478,W=6603:2,
Results for file: stdin (0.675 seconds)
[Metric: default]
Action: no action
Spam: false
Score: 0.00 / 19.90
Symbol: FROM_WHITELIST (0.00)[stephane@domain.org]
Message-ID: 274f4e6f-0f25-9c7e-9fc4-bc7b81d04e61@domain.org
Message - smtp_message: Matched map: FROM_WHITELIST
test it on your side, workable on my server
once you has made this, please go to the terminal
[root@prometheus ~]# rspamadm configdump | less
then issue / and search by greylist (use n and N to navigate)
this is what I have
greylist {
ipv6_mask = 64;
whitelist_domains_url [
"/etc/rspamd/local.d/greylist-whitelist-domains.inc",
"/etc/rspamd/local.d/maps.d/greylist-whitelist-domains.inc",
]
expire = 86400;
key_prefix = "rg";
enabled = false;
ipv4_mask = 19;
message = "Try again later";
max_data_len = 10000;
action = "soft reject";
servers = "/var/run/redis-rspamd/rspamd";
timeout = 300;
}
like you see the module is disabled
Yes, I have the exact same output, and without the file /etc/rspamd/override.d/greylist.conf I still have enabled = false, but I still get many ‘soft reject’ emails. Even from whitelisted domains.
As per your post above, I don’t know how to test on these emails as you suggest as the email does not exist because it was blocked with a soft reject.
I just figured that we have the option to disabled greylisting with Nethgui and Cockpit inside the slider, go on the left it disables completely Greylisting 
Yes, mine has always been to the far left, and says Greylist disabled.
But, still many, many emails get soft reject.
sorry in Logs I trust, in human never, please output some maillog lines
1 Like
Yes, here is the logs from one of the emails in question.
‘theirdomain.com’ is in the From Domain whitelist, and greylisting is off, neither seem to be working;
**EDIT I just noticed theirdomain.com is NOT in the whitelist as it was overwritten when I did a bulk import. It is added now, so this may help. BUT, greylisting is OFF, so it still should not have been a soft reject. That is still the issue.
maillog
Feb 4 09:20:11 my-local rspamd[2921]: ; csession; rspamd_protocol_http_reply: regexp statistics: 0 pcre regexps scanned, 3 regexps matched, 184 regexps total, 96 regexps cached, 0B scanned using pcre, 117.15KiB scanned total
Feb 4 09:20:11 my-local rspamd[2921]: <911e08>; csession; rspamd_task_timeout: processing of task time out: 8.0 second spent; forced processing
Feb 4 09:20:11 my-local rspamd[2921]: <911e08>; csession; rspamd_add_passthrough_result: BL0PR11MB3443121296F51F0FD905CE41E3030@BL0PR11MB3443.namprd11.prod.outlook.com: set pre-result to ‘soft reject’ (no score): ‘timeout processing message’ from task timeout(0)
Feb 4 09:20:11 my-local rspamd[2921]: <911e08>; csession; rspamd_redis_connected: skip obtaining bayes tokens for BAYES_HAM of classifier bayes: not enough learns 113; 200 required
Feb 4 09:20:11 my-local rspamd[2921]: <47748b>; csession; rspamd_task_timeout: processing of task time out: 8.0 second spent; forced processing
Feb 4 09:20:11 my-local rspamd[2921]: <47748b>; csession; rspamd_add_passthrough_result: BL0PR11MB3443121296F51F0FD905CE41E3030@BL0PR11MB3443.namprd11.prod.outlook.com: set pre-result to ‘soft reject’ (no score): ‘timeout processing message’ from task timeout(0)
Feb 4 09:20:11 my-local rspamd[2921]: <911e08>; csession; rspamd_stat_classifiers_process: skip statistics as HAM class is missing
Feb 4 09:20:11 my-local rspamd[2921]: <47748b>; csession; rspamd_redis_connected: skip obtaining bayes tokens for BAYES_HAM of classifier bayes: not enough learns 113; 200 required
Feb 4 09:20:11 my-local rspamd[2921]: <47748b>; csession; rspamd_stat_classifiers_process: skip statistics as HAM class is missing
Feb 4 09:20:11 my-local rspamd[2921]: <911e08>; csession; rspamd_task_write_log: id: BL0PR11MB3443121296F51F0FD905CE41E3030@BL0PR11MB3443.namprd11.prod.outlook.com, ip: 127.0.0.1, from: lesley@theirdomain.com, (default: F (soft reject): [0.10/15.00] [MIME_BASE64_TEXT(0.10){},MIME_GOOD(-0.10){multipart/related;multipart/alternative;text/plain;},RCVD_NO_TLS_LAST(0.10){},FROM_EQ_ENVFROM(0.00){},FROM_HAS_DN(0.00){},GENERIC_REPUTATION(0.00){0.85681098255335;},HAS_XOIP(0.00){},MIME_TRACE(0.00){0:+;1:+;2:+;3:~;4:~;},RCPT_COUNT_THREE(0.00){4;},RCVD_COUNT_SEVEN(0.00){8;},TO_DN_ALL(0.00){}]), len: 62311, time: 8027.618ms, dns req: 13, digest: <5e010f5b4798f98035501f1e34e56e6c>, mime_rcpts: <sam@mydomain.com,John@theirdomain.com,tonia@mydomain.com,…>, file: stdin, forced: soft reject “timeout processing message”; score=nan (set by task timeout)
Feb 4 09:20:11 my-local rspamd[2921]: <911e08>; csession; rspamd_protocol_http_reply: regexp statistics: 0 pcre regexps scanned, 3 regexps matched, 184 regexps total, 95 regexps cached, 0B scanned using pcre, 48.53KiB scanned total
Feb 4 09:20:11 my-local rspamd[2921]: <47748b>; csession; rspamd_task_write_log: id: BL0PR11MB3443121296F51F0FD905CE41E3030@BL0PR11MB3443.namprd11.prod.outlook.com, ip: 127.0.0.1, from: lesley@theirdomain.com, (default: F (soft reject): [0.10/15.00] [MIME_BASE64_TEXT(0.10){},MIME_GOOD(-0.10){multipart/related;multipart/alternative;text/plain;},RCVD_NO_TLS_LAST(0.10){},FROM_EQ_ENVFROM(0.00){},FROM_HAS_DN(0.00){},GENERIC_REPUTATION(0.00){0.85681098255335;},HAS_XOIP(0.00){},MIME_TRACE(0.00){0:+;1:+;2:+;3:~;4:~;},RCPT_COUNT_THREE(0.00){4;},RCVD_COUNT_SEVEN(0.00){8;},TO_DN_ALL(0.00){}]), len: 62313, time: 8024.957ms, dns req: 13, digest: <5e010f5b4798f98035501f1e34e56e6c>, mime_rcpts: <sam@mydomain.com,John@theirdomain.com,tonia@mydomain.com,…>, file: stdin, forced: soft reject “timeout processing message”; score=nan (set by task timeout)
Feb 4 09:20:11 my-local rspamd[2921]: <47748b>; csession; rspamd_protocol_http_reply: regexp statistics: 0 pcre regexps scanned, 3 regexps matched, 184 regexps total, 95 regexps cached, 0B scanned using pcre, 48.53KiB scanned total
Feb 4 09:20:11 my-local dovecot: lda(wayne@mydomain.com): sieve: msgid=05c31c83d563421185d38a76e5e0341f@279193683: marked message to be discarded if not explicitly delivered (discard action)
Feb 4 09:20:11 my-local getmail: msg 3/3 (105834 bytes) msgid 1580749373/15 from bounce@engage.vmware.com delivered to MDA_external command dovecot-lda ()
Feb 4 09:20:11 my-local rspamd[2921]: <6bf78a>; csession; rspamd_task_timeout: processing of task time out: 8.0 second spent; forced processing
Feb 4 09:20:11 my-local rspamd[2921]: <6bf78a>; csession; rspamd_add_passthrough_result: BL0PR11MB3443121296F51F0FD905CE41E3030@BL0PR11MB3443.namprd11.prod.outlook.com: set pre-result to ‘soft reject’ (no score): ‘timeout processing message’ from task timeout(0)
Feb 4 09:20:11 my-local rspamd[2921]: <6bf78a>; csession; rspamd_redis_connected: skip obtaining bayes tokens for BAYES_HAM of classifier bayes: not enough learns 113; 200 required
Feb 4 09:20:11 my-local rspamd[2921]: <6bf78a>; csession; rspamd_stat_classifiers_process: skip statistics as HAM class is missing
Feb 4 09:20:11 my-local rspamd[2921]: <6bf78a>; csession; rspamd_task_write_log: id: BL0PR11MB3443121296F51F0FD905CE41E3030@BL0PR11MB3443.namprd11.prod.outlook.com, ip: 127.0.0.1, from: lesley@theirdomain.com, (default: F (soft reject): [0.10/15.00] [MIME_BASE64_TEXT(0.10){},MIME_GOOD(-0.10){multipart/related;multipart/alternative;text/plain;},RCVD_NO_TLS_LAST(0.10){},FROM_EQ_ENVFROM(0.00){},FROM_HAS_DN(0.00){},GENERIC_REPUTATION(0.00){0.85681098255335;},HAS_XOIP(0.00){},MIME_TRACE(0.00){0:+;1:+;2:+;3:~;4:~;},RCPT_COUNT_THREE(0.00){4;},RCVD_COUNT_SEVEN(0.00){8;},TO_DN_ALL(0.00){}]), len: 62309, time: 8011.808ms, dns req: 13, digest: <5e010f5b4798f98035501f1e34e56e6c>, mime_rcpts: <sam@mydomain.com,John@theirdomain.com,tonia@mydomain.com,…>, file: stdin, forced: soft reject “timeout processing message”; score=nan (set by task timeout)
Feb 4 09:20:11 my-local rspamd[2921]: <6bf78a>; csession; rspamd_protocol_http_reply: regexp statistics: 0 pcre regexps scanned, 3 regexps matched, 184 regexps total, 95 regexps cached, 0B scanned using pcre, 48.52KiB scanned total
Feb 4 09:20:11 my-local dovecot: lda(tonia@mydomain.com): sieve: msgid=BL0PR11MB3443121296F51F0FD905CE41E3030@BL0PR11MB3443.namprd11.prod.outlook.com: marked message to be discarded if not explicitly delivered (discard action)
Feb 4 09:20:11 my-local getmail: msg 273/273 (63115 bytes) msgid 1065791181/224885 from lesley@theirdomain.com delivered to MDA_external command dovecot-lda ()
Feb 4 09:20:11 my-local dovecot: lda(sam@mydomain.com): sieve: msgid=BL0PR11MB3443121296F51F0FD905CE41E3030@BL0PR11MB3443.namprd11.prod.outlook.com: marked message to be discarded if not explicitly delivered (discard action)
Feb 4 09:20:11 my-local getmail: msg 1940/1940 (63111 bytes) msgid 1580479319/812068 from lesley@theirdomain.com delivered to MDA_external command dovecot-lda ()
Feb 4 09:20:11 my-local dovecot: lda(lisa@mydomain.com): sieve: msgid=BL0PR11MB3443121296F51F0FD905CE41E3030@BL0PR11MB3443.namprd11.prod.outlook.com: marked message to be discarded if not explicitly delivered (discard action)
Feb 4 09:20:11 my-local getmail: msg 88/88 (63113 bytes) msgid 1107176617/87923 from lesley@theirdomain.com delivered to MDA_external command dovecot-lda ()
1 Like
I am not sure it is greylisting your problem, this is an email rejected by greylist
Feb 3 19:02:35 prometheus rspamd[1742]: <b0febf>; proxy; rspamd_add_passthrough_result: <NM666760DDE5563C048francet_mkt_prod1@nl.la1
ere.fr>: set pre-result to 'soft reject' (no score): 'Try again later' from greylist(1)
Feb 3 19:02:35 prometheus rspamd[1742]: <b0febf>; proxy; rspamd_task_write_log: id: <NM666760DDE5563C048francet_mkt_prod1@nl.la1ere.
fr>, qid: <4EFAB18012AC9>, ip: 82.165.159.39, from: <bounces@nl.la1ere.fr>, (default: F (soft reject): [17.89/19.90] [BAYES_SPAM(5.10
){100.00%;},SPAM_FLAG(5.00){},UNITEDINTERNET_SPAM(5.00){},RBL_SPAMHAUS_SBL(2.00){82.165.159.39:from;},XM_CASE(0.50){},FORGED_SENDER(0
.30){region@nl.la1ere.fr;bounces@nl.la1ere.fr;},BAD_REP_POLICIES(0.10){},MIME_GOOD(-0.10){multipart/alternative;text/plain;},MX_GOOD(
-0.01){cached: a.mx.p4.neolane.net;},ASN(0.00){asn:8560, ipnet:82.165.0.0/16, country:DE;},DKIM_TRACE(0.00){nl.la1ere.fr:+;},DMARC_PO
LICY_ALLOW(0.00){nl.la1ere.fr;none;},DMARC_POLICY_ALLOW_WITH_FAILURES(0.00){},FROM_HAS_DN(0.00){},FROM_NEQ_ENVFROM(0.00){region@nl.la
1ere.fr;bounces@nl.la1ere.fr;},GREYLIST(0.00){greylisted;Mon, 03 Feb 2020 18:07:35 GMT;new record;},HAS_REPLYTO(0.00){contact@nl.la1e
re.fr;},IP_REPUTATION_HAM(0.00){asn: 8560(-0.13), country: DE(-0.00), ip: 82.165.159.39(0.00);},MID_RHS_MATCH_FROM(0.00){},MIME_TRACE
(0.00){0:+;1:+;2:~;},PRECEDENCE_BULK(0.00){},PREVIOUSLY_DELIVERED(0.00){sylvie@domain.org},RCPT_COUNT_ONE(0.00){1;},RCVD_COUNT_T
WO(0.00){2;},RCVD_TLS_LAST(0.00){},REPLYTO_DN_EQ_FROM_DN(0.00){},REPLYTO_DOM_EQ_FROM_DOM(0.00){},R_DKIM_ALLOW(0.00){nl.la1ere.fr:s=ne
olane;},R_SPF_SOFTFAIL(0.00){~all;},TO_DN_NONE(0.00){},TO_MATCH_ENVRCPT_ALL(0.00){}]), len: 78251, time: 421.811ms, dns req: 74, dige
st: <c5d82b1e8a90debba26aedb520245b21>, rcpts: <sylvie@domain.org>, mime_rcpts: <sylvie@domain.org>, forced: soft reject "Try
again later"; score=nan (set by greylist)
as you can see rspamd states what is the module who did the soft reject
Now I’m really confused, it is not greylisting, it is greylist?
Can we tell why it was greylisted, or rejected by greylist, this is a perfectly legitimate email, and is very important from a customer?
Will the fact that this domain is now on the whitelist help here? But doesn’t help in the case of a different or new customer sending a similar email.
you issued a task timeout
We need to split this thread, we have maybe two different issues and without log evidences we cannot find something interesting…we come back later
I would like you try to increase the task_timeout = 8s; in /etc/rspamd/rspamd.conf
It is a template so any settings change in the filter panel will erase your change.
Lets say 15s
think to restart rspamd after
cc @davidep
we have a timeout of 120s for getMail, in theory we should have the same
That is for that one specific message.
I am definitely having the issue in this thread, soft-reject emails with getmail. There are a couple possible issues, from my understanding there shoudn’t be soft rejects with greylisting disabled, but there are, and if they are timeouts, then why are they being labeled as ‘soft rejects’ in the webinterface. Also, there should be a way to completely disable soft rejects when using getmail, as they cannot be resent so are essentially lost.
Simply you reach a task timeout of rspamd, your email has needed more than 8s to be fetched by getMail, then rspamd issued a try again later it is a safe protocol and the good approach
Then that’s the issue, it never ‘tries again later’.
1 Like
I have made this change and will report back.
1 Like