2 Let's Encrypt certificates found

If there’s no reference to that directory in your configuration files, sure. But you should also remember: the /live/ directory contains symbolic links to the actual files in the /archive/ directory. Just removing the symbolic links will leave residual files in the /archive/ directory, so perhaps you should look in that directory too.

Also, what’s the harm in just leaving the directory?