I’m using a smarthost that refuses to send emails with no FROM address specified.
Apparently by default dovecot sends auto replies without that FROM header set. That’s on purpose, to keep mail loops happening, but in my case that’s needed because of the smarthost policy.
The fix is here, it forces dovecot to specify a FROM address :