Let’s Encrypt don’t use public recursive resolvers. They run their own, and they only observe TTL to a maximum of 60 seconds. If your TTL is 0, it won’t cache at all.
Effectively, there is no cache to purge. Whatever your authoritative nameservers are sending, that’s what Let’s Encrypt will see.