The Unicode is likely to be in /etc/nginx rather than /etc/letsencrypt.
I think all of the Unicode+nginx bugs have been fixed by now, but 0.31 is a very old release that doesn't have those fixes. If you can, try upgrading to the latest Certbot using the Debian instructions (snap) or pip instructions.
Otherwise, try look for that errant Unicode in /etc/nginx/.