Do not close threads without possibility of appeal

[emilfihlman]

Sure, here's an example:

Make the letsencrypt_bot on Freenode mention ##letsencrypt instead of mindless spamming

…