I found something!
This looks similar to my issue: Can't renew cert behind Cloudflare. (LEMP + LetsEncrypt + Cloudflare)