Correct way to completely remove issued certificate(s) for a domain

Actually, this is incorrect. Let's Encrypt will not send you expiration reminders about revoked certificates.

This thread has been going for a number of years now, and i think the original question is fully resolved. I'm going to close this one now, but everyone feel free to open a new one if you have more questions.