On that computer? Without reinstalling it and erasing /etc/letsencrypt/ or something?
Right -- the keys directory only contains private keys. The certificates are stored in archive, with links in live.
The keys directory can also contain keys from attempts to issue certificates that failed because of validation issues or whatever, though.