Certbot renew says Not yet due for renewal; email says otherwise

Help
1

Please fill out the fields below so we can help you better. Note: you must provide your domain name to get help. Domain names for issued certificates are all made public in Certificate Transparency logs (e.g. crt.sh | example.com), so withholding your domain name here does not increase secrecy, but only makes it harder for us to provide help.

My domain is: www.waltr.net (Ipv4) www.waltr.org (ipv6)

I ran this command: certbot renew

It produced this output:
Saving debug log to /var/log/letsencrypt/letsencrypt.log

Processing /usr/local/etc/letsencrypt/renewal/www.waltr.net-0001.conf

Certificate not yet due for renewal

The following certificates are not due for renewal yet:

/usr/local/etc/letsencrypt/live/www.waltr.net-0001/fullchain.pem expires on 2022-03-26 (skipped)

No renewals were attempted.

My web server is (include version): apache 2.4.51 (FreeBSD 12.2-Release-p7 )

The operating system my web server runs on is (include version): FreeBSD 12.2-Release-p7
My hosting provider, if applicable, is: myself. privately owned.

I can login to a root shell on my machine (yes or no, or I don't know): yes

I'm using a control panel to manage my site (no, or provide the name and version of the control panel): NO

The version of my client is (e.g. output of certbot --version or certbot-auto --version if you're using Certbot): certbot 1.18.0

Additional Details:

I upgraded the server to FreeBSD release 12 not long ago. I have been having chronic issues with certbot/certificates. During the upgrade I may have messed something up in the lets encrypt system.

Here are the directory structures:

tree
.
|-- DUMMY
|   |-- www.waltr.net.conf
|   `-- www.waltr.org.conf
|-- accounts [error opening dir]
|-- archive [error opening dir]
|-- csr
|   |-- 0000_csr-certbot.pem
|   |-- 0001_csr-certbot.pem
|   |-- 0002_csr-certbot.pem
|   |-- 0003_csr-certbot.pem
|   |-- 0004_csr-certbot.pem
|   |-- 0005_csr-certbot.pem
|   |-- 0006_csr   . . .
. . .
|   |-- 1802_csr-certbot.pem
|   |-- 1803_csr-certbot.pem
|   `-- 1804_csr-certbot.pem
. . .
|-- live
|   |-- README
|   |-- ipv4.waltr.org
|   |   |-- README
|   |   |-- cert.pem -> ../../archive/ipv4.waltr.org/cert15.pem
|   |   |-- chain.pem -> ../../archive/ipv4.waltr.org/chain15.pem
|   |   |-- fullchain.pem -> ../../archive/ipv4.waltr.org/fullchain15.pem
|   |   `-- privkey.pem -> ../../archive/ipv4.waltr.org/privkey15.pem
|   |-- waltr.net
|   |   |-- cert.pem -> ../../archive/waltr.net/cert25.pem
|   |   |-- chain.pem -> ../../archive/waltr.net/chain25.pem
|   |   |-- fullchain.pem -> ../../archive/waltr.net/fullchain25.pem
|   |   `-- privkey.pem -> ../../archive/waltr.net/privkey25.pem
|   |-- www.waltr.net
|   |   |-- cert.pem -> ../../archive/www.waltr.net/cert24.pem
|   |   |-- chain.pem -> ../../archive/www.waltr.net/chain24.pem
|   |   |-- fullchain.pem -> ../../archive/www.waltr.net/fullchain24.pem
|   |   `-- privkey.pem -> ../../archive/www.waltr.net/privkey24.pem
|   |-- www.waltr.net-0001
|   |   |-- README
|   |   |-- cert.pem -> ../../archive/www.waltr.net-0001/cert1.pem
|   |   |-- chain.pem -> ../../archive/www.waltr.net-0001/chain1.pem
|   |   |-- fullchain.pem -> ../../archive/www.waltr.net-0001/fullchain1.pem
|   |   `-- privkey.pem -> ../../archive/www.waltr.net-0001/privkey1.pem
|   |-- www.waltr.net-0002
|   |   |-- README
|   |   |-- cert.pem -> ../../archive/www.waltr.net-0002/cert2.pem
|   |   |-- chain.pem -> ../../archive/www.waltr.net-0002/chain2.pem
|   |   |-- fullchain.pem -> ../../archive/www.waltr.net-0002/fullchain2.pem
|   |   `-- privkey.pem -> ../../archive/www.waltr.net-0002/privkey2.pem
|   `-- www.waltr.org
|       |-- README
|       |-- cert.pem -> ../../archive/www.waltr.org/cert10.pem
|       |-- chain.pem -> ../../archive/www.waltr.org/chain10.pem
|       |-- fullchain.pem -> ../../archive/www.waltr.org/fullchain10.pem
|       `-- privkey.pem -> ../../archive/www.waltr.org/privkey10.pem
|-- options-ssl-apache.conf
|-- renewal
|   `-- www.waltr.net-0001.conf
`-- renewal-hooks
    |-- deploy
    |-- post
    `-- pre

35 directories, 3964 files

httpd.conf points the SSLCertificate file to ....letsencrypt/live/... and this is consistent.

After the upgrade, certbot began complaining and started making -0001 -0002 etc.

Any ideas on how I can clean this up and get things working right?
Thanks.

2 Likes
2

Please read the entire email, including any documentation linked in it.

4 Likes
3

I did read the entire email and that documentation brought me here.
I have something messed up in the configuration and certbot is not looking in the right place.

Message is the standard let's encrypt renewal message:
Hello, Your certificate (or certificates) for the names listed below will expire in 11 days (on 24 Feb 22 16:45 +0000). Please make sure to renew your certificate before then. . . that means renewing 30 days before expiration. See Integration Guide - Let's Encrypt for details. waltr.net www.waltr.net For any questions or support, please visit: https://community.letsencrypt.org/ ...

4

@waltr You have gotten certs with a variety of domain name combinations. The warning email looks like it is for the cert your Apache server is currently sending. It is the one issued on Nov26. See this SSL Checker site and your cert history here.

In your cert history, which cert has the best list of domain names? (you use .net, .org, with and without www, ...)

5 Likes
5

Did you also read the following documentation, which is listed below the link to this Community?

It explains exactly what is going on here.

4 Likes
6

@MikeMcQ, Thanks. Appreciate the help. The SSL Checker site confirms what the message is saying. The present served certs will expire in 10 days.

The problem seems to be a coordination issue between what certbot is trying to renew and what apache is actually serving. There seems to be a disconnect somewhere and I can't find it.

I think the cert issues started when I upgraded FreeBSD and revised the certs to segregate two virtual servers. I wanted to keep IPV6 and IPV4 servers segregated until I had a clear integration/migration plan. Before this everything worked ok, but there were some glitches. I was an early adopter of LE and probably had something wrong from the start. It stopped working with the change to Virtual Servers and the addition of IPV6 native addressing.

The active registered domains are:
waltr.org (ipv6 branch)
waltr.net (ipv4 branch)

The web sites are: www.waltr.[org or net] and a more generic waltr.[org or net]

apache is looking for certs at for the .org and .net in different LE directories. Should I combine them?
At this point, I'm thinking I should just delete everything and start from scratch.

#   SSLEngine Switch:
#   enable/Disable SSL for this virtual host
    SSLEngine on

#  Server Ceriificate (.pem)
    SSLCertificateFile "/usr/local/etc/letsencrypt/live/www.waltr.org/cert.pem"

# Server Private Key:
    SSLCertificateKeyFile "/usr/local/etc/letsencrypt/live/www.waltr.org/privkey.pem"

#  Server Certificate Chain:
    SSLCertificateChainFile "/usr/local/etc/letsencrypt/live/www.waltr.org/chain.pem"

</VirtualHost>
1 Like
7

@Osiris, This is not helpful. I can read and comprehend the email. certbot is refusing to renew saying the certs are not ready to renew. There is something misconfigured and I can't find it. The email is correct, the certs that it is seeing are going to expire but I can't get certbot to renew them and won't be able to do this until I get the misconfiguration fixed which where I need assistance.

8

This means you should install the renewed certificates.

What's the output of certbot certificates?

4 Likes
9

Found the following certs:
Certificate Name: www.waltr.net-0001
Serial Number: 32c4fe6a7ffe5cef06c28b5ffb7b3329fdd
Key Type: RSA
Domains: www.waltr.net www.waltr.org
Expiry Date: 2022-03-26 15:46:31+00:00 (VALID: 40 days)
Certificate Path: /usr/local/etc/letsencrypt/live/www.waltr.net-0001/fullchain.pem
Private Key Path: /usr/local/etc/letsencrypt/live/www.waltr.net-0001/privkey.pem

It appears that certbot has created and is using the certs in live/www.waltr.net-0001/ while the Vhost is configured to use /live/www.www.waltr.org/...

So, the question is why did certbot do this? It looks like it has created a number of directories:
740 Feb 16 2019 README
512 Aug 23 03:07 ipv4.waltr.org
512 Nov 20 12:55 waltr.net
512 Dec 9 11:44 www.waltr.net
512 Dec 26 10:46 www.waltr.net-0001
512 Nov 26 11:45 www.waltr.net-0002
512 Nov 20 12:55 www.waltr.org

The one most consistent with the output of crt.sh is the -0001.
I could probably fix the immediate problem by switching the server over to the -0001 directory, but then I need to do some garbage collection without breaking something else. My preference is to get this cleaned up so it can be re-automated.

10

If certbot certificates only shows that one certificate, it means certbot only knows of that certificate.

Check if its renewal works (certbot renew --dry-run), check it has all the FQDNs you need (it does not have apexes), and install it in your webserver.

Otherwise, get a new one with all the names you need and be careful that there are rate limits. Use --dry-run if not sure.

3 Likes
11

Welcome to the Let's Encrypt Community, Walter :slightly_smiling_face:

What are the outputs of the following commands:

sudo ls -lRa /usr/local/etc/letsencrypt
sudo apachectl -S

We'll get this straightened out.

:gloves:

4 Likes
12

This is interesting:

image
image957×511 98.5 KB

4 Likes
13

Then you would also understand that the email you're getting is specifically for this certificate: crt.sh | 5684051684 which also contains the hostname waltr.net next to the hostname www.waltr.net. As all the more recent certificates either just contain www.waltr.net (5 times on a single day!?), these certs are not considered a renewal, so the expiry email is send. From your posts I could not find out your understanding of this.

Anyway, your Certbot configuration seems to be properly messed up. Your /live/ and/or /archive/ directory is containing the remnants of 5 certificates issued in the past, but for which there seems to be no renewal configuration file in /renewal/ ? This usually wouldn't happen: if Certbot is used to delete certificates, it removes all the files, from /renewal/ and /live/ and /archive/. Did you perhaps manually change things inside the /etc/letsencrypt/ directory?

I've edited your OP so it uses three backticks (```) instead of the quote (>) function of Discourse, so the indentation of the tree output is preserved. (Which is a good idea by the way, the tree output :slight_smile: )

What is the DUMMY directory? That isn't a directory generated by Certbot. And it looks like it might contain renewal configuration files? Perhaps from previously issued certificates? Begins to look like some seriously manual tampering with the /etc/letsencrypt/ directory. :slight_smile: (Not saying it was you, but someone probably did.)

5 Likes
14

@Osiris has described your messed up folders. But, I think you should combine your DNS so you do not have separate names for IPv4 and IPv6.

In fact, you already have both A and AAAA records for one domain name but just one or the other for the others (with one CNAME to a diff domain). Making them all look like www.waltr.net would probably be much easier for you. You would then have all domain names in one VirtualHost in Apache and getting and renewing certs would be easier.

Your current DNS:

Name:   waltr.net       canonical name = rugs.hopto.org.
Name:   rugs.hopto.org
Address: 47.12.27.250

Name:   waltr.org
Address: 2600:6c46:777f:a1ba:1e6f:65ff:fec2:bf17

Name:   www.waltr.net
Address: 47.12.27.250
Address: 2600:6c46:777f:a1ba:1e6f:65ff:fec2:bf17

Name:   www.waltr.org
Address: 2600:6c46:777f:a1ba:1e6f:65ff:fec2:bf17
3 Likes
15

As I think I said, this all became a problem after an OS upgrade (FreeBSD 11.x to 12.0) and a revision to enable IPV6 native. The upgrade was done remotely and there was an issue with moving local files. I suspect the upgrade problem and/or my changes to the httpd.conf and extra/httpd-vhost.conf created problems. I probably created that directory to preserve a few files at the time I first started working to resolve the present problems. I have found that having a way to recover operational data generally saves a lot of grief when things go wrong, which they have done in this case. the DUMMY/ directory was a holding directory to permit recovery of files if needed. We get this figured out, it will be removed. As for the crt.sh site, I didn't know about this until yesterday so that was a very important clue and good information.

certbot wasn't happy which may have been due to an upgrade of python from v2 to v3 or not. Problems like this are usually multi-factorial. It really became a problem last summer and my work around then was to open the un-encrypted doors until I could get this figured out. I do appreciate your input and the support I'm getting here.

1 Like
16

The main question is: are you currently happy with the single certificate available in Certbot?

Although IMO you seem to be missing the hostnames without the www subdomain (i.e. waltr.net and waltr.org) and also the subdomain ipv4.waltr.org seems to be gone..

3 Likes
17

At some point in the past, you either (i) added (or removed) a name from your certificate(s), or (ii) got an entirely new certificate with overlapping domain(s) to an existing certificate. This caused two things to happen:

  1. Certbot added the numbers (0001, 0001, etc) because of a name collision. This is messy and confusing to everyone who tries to deal with it. This is (unfortunately) the way Certbot chose to organize the files on your disk. Every directory could have an active certificate in there. The one with the latest number should be the most recently configured certificate, but - again - all directories could have existing Certificates.

  2. The courtesy "reminder" emails from LetsEncrypt are sent from a system that has no idea if you replaced/updated the Certificate with a newer one. What confuses many people, is this order of events:

    • Get a Certificate for: Domain A, Domain B
    • Renew that Certificate for: Domain A, Domain B, Domain C
    • Get a warning about this certificate expiring: Domain A, Domain B
    • Certbot says no renewals are necessary.

As far as LetsEncrypt (cloud) is concerned, DomainA+DomainB is about to expire.
As far as Certbot (local) is concerned, no renewals are needed because DomainA+DomainB+DomainC replaced that other certificate.

It's possible there are other things happening. I've seen upgrades to Python and operating systems somehow trigger the directory versioning "thing". The same can happen when people try to do a manual backup/cleanup/etc. When that has happened, it's basically the same exact situation I described above.

The easiest thing to do is just audit Certbot and your services, to just make sure they are using a currently managed certificate, and upgrade everything to use the current options. If you want to return to a system without prefixes, I would backup /etc/letsencrypt for safety, but then delete the directory and just start from scratch.

4 Likes
18

@MikeMcQ , I agree. My ISP in the north woods has only recently released IPV6 on the world. Although I am supposed to have a "static" IPV4 address, the vendor's definition of static is it may change. They are better than the prior vendor who did not offer a static address at all. Hence the CNAME to a ddns service as a failsafe. The DNS registrar (name.com) uses an alternative "ANAME" which I haven't investigated well. Maybe later. The CNAME method served me reasonably well for a long time and before LE a privately signed key worked until the browsers changed. I used Thawte for a while and was a "thawte notary" before that. But. my knowledge of these things is more superficial than I like.

I have no problem with consolidating them but I need a definitive way to get to the site (ssh is fine) via IPV6 for when IPV4 addresses change, usually at 2AM. I don't open my router to the outside WAN so the only access I have is indirectly from a server inside.

Output of apachectl -S:
/usr/local/etc/letsencrypt # apachectl -S
VirtualHost configuration:
*:5000 www.waltr.net (/usr/local/etc/apache24/extra/httpd-vhosts.conf:76)
*:443 is a NameVirtualHost
default server waltr.net (/usr/local/etc/apache24/extra/httpd-vhosts.conf:52)
port 443 namevhost waltr.net (/usr/local/etc/apache24/extra/httpd-vhosts.conf:52)
alias www.waltr.net
port 443 namevhost waltr.org (/usr/local/etc/apache24/extra/httpd-vhosts.conf:63)
alias www.waltr.org
alias ipv6.waltr.org
port 443 namevhost www.waltr.net (/usr/local/etc/apache24/extra/httpd-ssl.conf:122)
port 443 namevhost www.waltr.org (/usr/local/etc/apache24/extra/httpd-ssl.conf:302)
*:80 is a NameVirtualHost
default server waltr.net (/usr/local/etc/apache24/extra/httpd-vhosts.conf:43)
port 80 namevhost waltr.net (/usr/local/etc/apache24/extra/httpd-vhosts.conf:43)
alias www.waltr.net
port 80 namevhost d.waltr.org (/usr/local/etc/apache24/Includes/wsgi.conf:14)
ServerRoot: "/usr/local"
Main DocumentRoot: "/www/data"
Main ErrorLog: "/var/log/httpd-error.log"
Mutex ssl-stapling: using_defaults
Mutex ssl-cache: using_defaults
Mutex default: dir="/var/run/" mechanism=default
Mutex mpm-accept: using_defaults
Mutex ssl-stapling-refresh: using_defaults
Mutex rewrite-map: using_defaults
PidFile: "/var/run/httpd.pid"
Define: DUMP_VHOSTS
Define: DUMP_RUN_CFG
User: name="www" id=80
Group: name="www" id=80

--
ls -lRa /usr/local/etc/letsencrypt
(somewhat truncated for brevity)
ls -lRa /usr/local/etc/letsencrypt
total 160

drwxr-xr-x  10 root  wheel    512 Feb 14 14:28 .
drwxr-xr-x  42 root  wheel   2560 Nov 20 12:43 ..
-rw-r--r--   1 root  wheel     64 Nov 26 12:11 .updated-options-ssl-apache-conf-digest.txt
drwxr-xr-x   2 root  wheel    512 Dec 26 12:22 DUMMY
drwx------   6 root  wheel    512 Jan 18  2019 accounts
drwx------   9 root  wheel    512 Dec 26 10:46 archive
drwxr-xr-x   2 root  wheel  57856 Dec 26 12:41 csr
drwx------   2 root  wheel  57856 Dec 26 12:41 keys
drwx------   8 root  wheel    512 Dec 26 10:46 live
-rw-r--r--   1 root  wheel    924 Nov 26 12:11 options-ssl-apache.conf
drwxr-xr-x   2 root  wheel    512 Dec 26 12:22 renewal
drwxr-xr-x   5 root  wheel    512 Apr 12  2018 renewal-hooks

/usr/local/etc/letsencrypt/DUMMY:
total 8
drwxr-xr-x   2 root  wheel  512 Dec 26 12:22 .
drwxr-xr-x  10 root  wheel  512 Feb 14 14:28 ..
-rw-r--r--   1 root  wheel    0 Dec  8 21:06 www.waltr.net.conf
-rw-r--r--   1 root  wheel    0 Dec 26 10:47 www.waltr.org.conf

/usr/local/etc/letsencrypt/accounts:
total 24
drwx------   6 root  wheel  512 Jan 18  2019 .
drwxr-xr-x  10 root  wheel  512 Feb 14 14:28 ..
drwx------   3 root  wheel  512 Apr 12  2018 acme-staging-v02.api.letsencrypt.org
drwx------   3 root  wheel  512 Mar 27  2017 acme-staging.api.letsencrypt.org
drwx------   3 root  wheel  512 Aug 21  2016 acme-v01.api.letsencrypt.org
drwx------   2 root  wheel  512 Jan 18  2019 acme-v02.api.letsencrypt.org

/usr/local/etc/letsencrypt/accounts/acme-staging-v02.api.letsencrypt.org:
total 12
drwx------  3 root  wheel  512 Apr 12  2018 .
drwx------  6 root  wheel  512 Jan 18  2019 ..
drwx------  3 root  wheel  512 Apr 12  2018 directory

/usr/local/etc/letsencrypt/accounts/acme-staging-v02.api.letsencrypt.org/directory:
total 12
drwx------  3 root  wheel  512 Apr 12  2018 .
drwx------  3 root  wheel  512 Apr 12  2018 ..
drwx------  2 root  wheel  512 Apr 12  2018 c3a8a86f93efdbe97b60c900fe925417

/usr/local/etc/letsencrypt/accounts/acme-staging-v02.api.letsencrypt.org/directory/c3a8a86f93efdbe97b60c900fe925417:
total 20
drwx------  2 root  wheel   512 Apr 12  2018 .
drwx------  3 root  wheel   512 Apr 12  2018 ..
-rw-r--r--  1 root  wheel    69 Apr 12  2018 meta.json
-r--------  1 root  wheel  1632 Apr 12  2018 private_key.json
-rw-r--r--  1 root  wheel   578 Apr 12  2018 regr.json

/usr/local/etc/letsencrypt/accounts/acme-staging.api.letsencrypt.org:
total 12
drwx------  3 root  wheel  512 Mar 27  2017 .
drwx------  6 root  wheel  512 Jan 18  2019 ..
drwx------  3 root  wheel  512 Mar 27  2017 directory

/usr/local/etc/letsencrypt/accounts/acme-staging.api.letsencrypt.org/directory:
total 12
drwx------  3 root  wheel  512 Mar 27  2017 .
drwx------  3 root  wheel  512 Mar 27  2017 ..
drwx------  2 root  wheel  512 Mar 27  2017 88f5ff6431dc4631acfc56b07e019a10

/usr/local/etc/letsencrypt/accounts/acme-staging.api.letsencrypt.org/directory/88f5ff6431dc4631acfc56b07e019a10:
total 20
drwx------  2 root  wheel   512 Mar 27  2017 .
drwx------  3 root  wheel   512 Mar 27  2017 ..
-rw-r--r--  1 root  wheel    69 Mar 27  2017 meta.json
-r--------  1 root  wheel  1632 Mar 27  2017 private_key.json
-rw-r--r--  1 root  wheel   711 Mar 27  2017 regr.json

/usr/local/etc/letsencrypt/accounts/acme-v01.api.letsencrypt.org:
total 12
drwx------  3 root  wheel  512 Aug 21  2016 .
drwx------  6 root  wheel  512 Jan 18  2019 ..
drwx------  3 root  wheel  512 Aug 21  2016 directory

/usr/local/etc/letsencrypt/accounts/acme-v01.api.letsencrypt.org/directory:
total 12
drwx------  3 root  wheel  512 Aug 21  2016 .
drwx------  3 root  wheel  512 Aug 21  2016 ..
drwx------  2 root  wheel  512 Aug 21  2016 118eec532b84acd036ed67411d8635f4

/usr/local/etc/letsencrypt/accounts/acme-v01.api.letsencrypt.org/directory/118eec532b84acd036ed67411d8635f4:
total 20
drwx------  2 root  wheel   512 Aug 21  2016 .
drwx------  3 root  wheel   512 Aug 21  2016 ..
-rw-r--r--  1 root  wheel    69 Aug 21  2016 meta.json
-r--------  1 root  wheel  1632 Aug 21  2016 private_key.json
-rw-r--r--  1 root  wheel   746 Aug 21  2016 regr.json

/usr/local/etc/letsencrypt/accounts/acme-v02.api.letsencrypt.org:
total 8
drwx------  2 root  wheel  512 Jan 18  2019 .
drwx------  6 root  wheel  512 Jan 18  2019 ..
lrwxr-xr-x  1 root  wheel   74 Jan 18  2019 directory -> /usr/local/etc/letsencrypt/accounts/acme-v01.api.letsencrypt.org/directory

/usr/local/etc/letsencrypt/archive:
total 36
drwx------   9 root  wheel   512 Dec 26 10:46 .
drwxr-xr-x  10 root  wheel   512 Feb 14 14:28 ..
drwxr-xr-x   2 root  wheel  1536 Aug 23 03:07 ipv4.waltr.org
drwxr-xr-x   2 root  wheel  2560 Nov 20 12:55 waltr.net
drwxr-xr-x   2 root  wheel  2560 Dec  9 11:31 www.waltr.net
drwxr-xr-x   2 root  wheel   512 Dec 26 10:46 www.waltr.net-0001
drwxr-xr-x   2 root  wheel   512 Feb 16  2019 www.waltr.net-0001-holding
drwxr-xr-x   2 root  wheel   512 Nov 26 11:45 www.waltr.net-0002-holding
drwxr-xr-x   2 root  wheel  1024 Nov 20 12:55 www.waltr.org

/usr/local/etc/letsencrypt/archive/ipv4.waltr.org:
total 252
drwxr-xr-x  2 root  wheel  1536 Aug 23 03:07 .
drwx------  9 root  wheel   512 Dec 26 10:46 ..
-rw-r--r--  1 root  wheel  1907 Feb 16  2019 cert1.pem
-rw-r--r--  1 root  wheel  1907 Jul  6  2020 cert10.pem
-rw-r--r--  1 root  wheel  1907 Sep 14  2020 cert11.pem
-rw-r--r--  1 root  wheel  1907 Nov 14  2020 cert12.pem
-rw-r--r--  1 root  wheel  1838 Jan 14  2021 cert13.pem
-rw-r--r--  1 root  wheel  1842 Mar 16  2021 cert14.pem
-rw-r--r--  1 root  wheel  1842 Aug 23 03:07 cert15.pem
-rw-r--r--  1 root  wheel  1907 Apr 26  2019 cert2.pem
-rw-r--r--  1 root  wheel  1907 Jun 26  2019 cert3.pem
-rw-r--r--  1 root  wheel  1911 Aug 26  2019 cert4.pem
-rw-r--r--  1 root  wheel  1907 Oct 26  2019 cert5.pem
-rw-r--r--  1 root  wheel  1911 Dec 25  2019 cert6.pem
-rw-r--r--  1 root  wheel  1911 Feb 23  2020 cert7.pem
-rw-r--r--  1 root  wheel  1911 Mar  6  2020 cert8.pem
-rw-r--r--  1 root  wheel  1907 May  6  2020 cert9.pem
-rw-r--r--  1 root  wheel  1647 Feb 16  2019 chain1.pem
-rw-r--r--  1 root  wheel  1647 Jul  6  2020 chain10.pem
-rw-r--r--  1 root  wheel  1647 Sep 14  2020 chain11.pem
-rw-r--r--  1 root  wheel  1647 Nov 14  2020 chain12.pem
-rw-r--r--  1 root  wheel  1586 Jan 14  2021 chain13.pem
-rw-r--r--  1 root  wheel  1586 Mar 16  2021 chain14.pem
-rw-r--r--  1 root  wheel  3750 Aug 23 03:07 chain15.pem
-rw-r--r--  1 root  wheel  1647 Apr 26  2019 chain2.pem
-rw-r--r--  1 root  wheel  1647 Jun 26  2019 chain3.pem
-rw-r--r--  1 root  wheel  1647 Aug 26  2019 chain4.pem
-rw-r--r--  1 root  wheel  1647 Oct 26  2019 chain5.pem
-rw-r--r--  1 root  wheel  1647 Dec 25  2019 chain6.pem
-rw-r--r--  1 root  wheel  1647 Feb 23  2020 chain7.pem
-rw-r--r--  1 root  wheel  1647 Mar  6  2020 chain8.pem
-rw-r--r--  1 root  wheel  1647 May  6  2020 chain9.pem
-rw-r--r--  1 root  wheel  3554 Feb 16  2019 fullchain1.pem
-rw-r--r--  1 root  wheel  3554 Jul  6  2020 fullchain10.pem
-rw-r--r--  1 root  wheel  3554 Sep 14  2020 fullchain11.pem
-rw-r--r--  1 root  wheel  3554 Nov 14  2020 fullchain12.pem
-rw-r--r--  1 root  wheel  3424 Jan 14  2021 fullchain13.pem
-rw-r--r--  1 root  wheel  3428 Mar 16  2021 fullchain14.pem
-rw-r--r--  1 root  wheel  5592 Aug 23 03:07 fullchain15.pem
-rw-r--r--  1 root  wheel  3554 Apr 26  2019 fullchain2.pem
-rw-r--r--  1 root  wheel  3554 Jun 26  2019 fullchain3.pem
-rw-r--r--  1 root  wheel  3558 Aug 26  2019 fullchain4.pem
-rw-r--r--  1 root  wheel  3554 Oct 26  2019 fullchain5.pem
-rw-r--r--  1 root  wheel  3558 Dec 25  2019 fullchain6.pem
-rw-r--r--  1 root  wheel  3558 Feb 23  2020 fullchain7.pem
-rw-r--r--  1 root  wheel  3558 Mar  6  2020 fullchain8.pem
-rw-r--r--  1 root  wheel  3554 May  6  2020 fullchain9.pem
-rw-------  1 root  wheel  1704 Feb 16  2019 privkey1.pem
-rw-------  1 root  wheel  1704 Jul  6  2020 privkey10.pem
-rw-------  1 root  wheel  1704 Sep 14  2020 privkey11.pem
-rw-------  1 root  wheel  1704 Nov 14  2020 privkey12.pem
-rw-------  1 root  wheel  1704 Jan 14  2021 privkey13.pem
-rw-------  1 root  wheel  1704 Mar 16  2021 privkey14.pem
-rw-------  1 root  wheel  1708 Aug 23 03:07 privkey15.pem
-rw-------  1 root  wheel  1704 Apr 26  2019 privkey2.pem
-rw-------  1 root  wheel  1704 Jun 26  2019 privkey3.pem
-rw-------  1 root  wheel  1704 Aug 26  2019 privkey4.pem
-rw-------  1 root  wheel  1704 Oct 26  2019 privkey5.pem
-rw-------  1 root  wheel  1708 Dec 25  2019 privkey6.pem
-rw-------  1 root  wheel  1704 Feb 23  2020 privkey7.pem
-rw-------  1 root  wheel  1704 Mar  6  2020 privkey8.pem
-rw-------  1 root  wheel  1704 May  6  2020 privkey9.pem

/usr/local/etc/letsencrypt/archive/waltr.net:
total 412
drwxr-xr-x  2 root  wheel  2560 Nov 20 12:55 .
drwx------  9 root  wheel   512 Dec 26 10:46 ..
-rw-r--r--  1 root  wheel  1781 Aug 21  2016 cert1.pem
-rw-r--r--  1 root  wheel  2134 Apr 11  2018 cert10.pem
-rw-r--r--  1 root  wheel  2134 Jun 10  2018 cert11.pem
-rw-r--r--  1 root  wheel  2139 Aug  9  2018 cert12.pem
-rw-r--r--  1 root  wheel  2139 Oct  8  2018 cert13.pem
-rw-r--r--  1 root  wheel  1899 Dec  7  2018 cert14.pem
-rw-r--r--  1 root  wheel  1899 Feb 15  2019 cert15.pem
-rw-r--r--  1 root  wheel  1899 Apr 26  2019 cert16.pem
-rw-r--r--  1 root  wheel  1895 Jun 26  2019 cert17.pem
-rw-r--r--  1 root  wheel  1895 Aug 26  2019 cert18.pem
-rw-r--r--  1 root  wheel  1911 Oct 14  2019 cert19.pem
-rw-r--r--  1 root  wheel  1781 Nov 12  2016 cert2.pem
-rw-r--r--  1 root  wheel  1956 Oct 14  2019 cert20.pem
-rw-r--r--  1 root  wheel  1960 Feb  2  2020 cert21.pem
-rw-r--r--  1 root  wheel  1956 May 13  2020 cert22.pem
-rw-r--r--  1 root  wheel  1956 Nov 15  2020 cert23.pem
-rw-r--r--  1 root  wheel  1891 Apr 30  2021 cert24.pem
-rw-r--r--  1 root  wheel  1887 Nov 20 12:55 cert25.pem
-rw-r--r--  1 root  wheel  1781 Jan 14  2017 cert3.pem
-rw-r--r--  1 root  wheel  1781 Mar 15  2017 cert4.pem
-rw-r--r--  1 root  wheel  1781 May 15  2017 cert5.pem
-rw-r--r--  1 root  wheel  1781 Jul 14  2017 cert6.pem
-rw-r--r--  1 root  wheel  1781 Sep 12  2017 cert7.pem
-rw-r--r--  1 root  wheel  1781 Nov 11  2017 cert8.pem
-rw-r--r--  1 root  wheel  1781 Jan 10  2018 cert9.pem
-rw-r--r--  1 root  wheel  1647 Aug 21  2016 chain1.pem
-rw-r--r--  1 root  wheel  1647 Apr 11  2018 chain10.pem
-rw-r--r--  1 root  wheel  1647 Jun 10  2018 chain11.pem
-rw-r--r--  1 root  wheel  1647 Aug  9  2018 chain12.pem
-rw-r--r--  1 root  wheel  1647 Oct  8  2018 chain13.pem
-rw-r--r--  1 root  wheel  1647 Dec  7  2018 chain14.pem
-rw-r--r--  1 root  wheel  1647 Feb 15  2019 chain15.pem
-rw-r--r--  1 root  wheel  1647 Apr 26  2019 chain16.pem
-rw-r--r--  1 root  wheel  1647 Jun 26  2019 chain17.pem
-rw-r--r--  1 root  wheel  1647 Aug 26  2019 chain18.pem
-rw-r--r--  1 root  wheel  1647 Oct 14  2019 chain19.pem
-rw-r--r--  1 root  wheel  1647 Nov 12  2016 chain2.pem
-rw-r--r--  1 root  wheel  1647 Oct 14  2019 chain20.pem
-rw-r--r--  1 root  wheel  1647 Feb  2  2020 chain21.pem
-rw-r--r--  1 root  wheel  1647 May 13  2020 chain22.pem
-rw-r--r--  1 root  wheel  1647 Nov 15  2020 chain23.pem
-rw-r--r--  1 root  wheel  1586 Apr 30  2021 chain24.pem
-rw-r--r--  1 root  wheel  3750 Nov 20 12:55 chain25.pem
-rw-r--r--  1 root  wheel  1647 Jan 14  2017 chain3.pem
-rw-r--r--  1 root  wheel  1647 Mar 15  2017 chain4.pem
-rw-r--r--  1 root  wheel  1647 May 15  2017 chain5.pem
-rw-r--r--  1 root  wheel  1647 Jul 14  2017 chain6.pem
-rw-r--r--  1 root  wheel  1647 Sep 12  2017 chain7.pem
-rw-r--r--  1 root  wheel  1647 Nov 11  2017 chain8.pem
-rw-r--r--  1 root  wheel  1647 Jan 10  2018 chain9.pem
-rw-r--r--  1 root  wheel  3428 Aug 21  2016 fullchain1.pem
-rw-r--r--  1 root  wheel  3781 Apr 11  2018 fullchain10.pem
-rw-r--r--  1 root  wheel  3781 Jun 10  2018 fullchain11.pem
-rw-r--r--  1 root  wheel  3786 Aug  9  2018 fullchain12.pem
-rw-r--r--  1 root  wheel  3786 Oct  8  2018 fullchain13.pem
-rw-r--r--  1 root  wheel  3546 Dec  7  2018 fullchain14.pem
-rw-r--r--  1 root  wheel  3546 Feb 15  2019 fullchain15.pem
-rw-r--r--  1 root  wheel  3546 Apr 26  2019 fullchain16.pem
-rw-r--r--  1 root  wheel  3542 Jun 26  2019 fullchain17.pem
-rw-r--r--  1 root  wheel  3542 Aug 26  2019 fullchain18.pem
-rw-r--r--  1 root  wheel  3558 Oct 14  2019 fullchain19.pem
-rw-r--r--  1 root  wheel  3428 Nov 12  2016 fullchain2.pem
-rw-r--r--  1 root  wheel  3603 Oct 14  2019 fullchain20.pem
-rw-r--r--  1 root  wheel  3607 Feb  2  2020 fullchain21.pem
-rw-r--r--  1 root  wheel  3603 May 13  2020 fullchain22.pem
-rw-r--r--  1 root  wheel  3603 Nov 15  2020 fullchain23.pem
-rw-r--r--  1 root  wheel  3477 Apr 30  2021 fullchain24.pem
-rw-r--r--  1 root  wheel  5637 Nov 20 12:55 fullchain25.pem
-rw-r--r--  1 root  wheel  3428 Jan 14  2017 fullchain3.pem
-rw-r--r--  1 root  wheel  3428 Mar 15  2017 fullchain4.pem
-rw-r--r--  1 root  wheel  3428 May 15  2017 fullchain5.pem
-rw-r--r--  1 root  wheel  3428 Jul 14  2017 fullchain6.pem
-rw-r--r--  1 root  wheel  3428 Sep 12  2017 fullchain7.pem
-rw-r--r--  1 root  wheel  3428 Nov 11  2017 fullchain8.pem
-rw-r--r--  1 root  wheel  3428 Jan 10  2018 fullchain9.pem
-rw-r--r--  1 root  wheel  1704 Aug 21  2016 privkey1.pem
-rw-r--r--  1 root  wheel  1704 Apr 11  2018 privkey10.pem
-rw-r--r--  1 root  wheel  1704 Jun 10  2018 privkey11.pem
-rw-r--r--  1 root  wheel  1708 Aug  9  2018 privkey12.pem
-rw-r--r--  1 root  wheel  1704 Oct  8  2018 privkey13.pem
-rw-r--r--  1 root  wheel  1704 Dec  7  2018 privkey14.pem
-rw-r--r--  1 root  wheel  1704 Feb 15  2019 privkey15.pem
-rw-r--r--  1 root  wheel  1708 Apr 26  2019 privkey16.pem
-rw-r--r--  1 root  wheel  1704 Jun 26  2019 privkey17.pem
-rw-r--r--  1 root  wheel  1704 Aug 26  2019 privkey18.pem
-rw-r--r--  1 root  wheel  1704 Oct 14  2019 privkey19.pem
-rw-r--r--  1 root  wheel  1704 Nov 12  2016 privkey2.pem
-rw-r--r--  1 root  wheel  1708 Oct 14  2019 privkey20.pem
-rw-r--r--  1 root  wheel  1704 Feb  2  2020 privkey21.pem
-rw-r--r--  1 root  wheel  1708 May 13  2020 privkey22.pem
-rw-r--r--  1 root  wheel  1704 Nov 15  2020 privkey23.pem
-rw-r--r--  1 root  wheel  1708 Apr 30  2021 privkey24.pem
-rw-r--r--  1 root  wheel  1704 Nov 20 12:55 privkey25.pem
-rw-r--r--  1 root  wheel  1704 Jan 14  2017 privkey3.pem
-rw-r--r--  1 root  wheel  1704 Mar 15  2017 privkey4.pem
-rw-r--r--  1 root  wheel  1704 May 15  2017 privkey5.pem
-rw-r--r--  1 root  wheel  1708 Jul 14  2017 privkey6.pem
-rw-r--r--  1 root  wheel  1704 Sep 12  2017 privkey7.pem
-rw-r--r--  1 root  wheel  1704 Nov 11  2017 privkey8.pem
-rw-r--r--  1 root  wheel  1704 Jan 10  2018 privkey9.pem

/usr/local/etc/letsencrypt/archive/www.waltr.net:
total 396
drwxr-xr-x  2 root  wheel  2560 Dec  9 11:31 .
drwx------  9 root  wheel   512 Dec 26 10:46 ..
-rw-r--r--  1 root  wheel  1793 Aug 22  2016 cert1.pem
-rw-r--r--  1 root  wheel  2151 Apr 11  2018 cert10.pem
-rw-r--r--  1 root  wheel  2191 Apr 29  2018 cert11.pem
-rw-r--r--  1 root  wheel  2191 Jun 29  2018 cert12.pem
-rw-r--r--  1 root  wheel  2191 Aug 28  2018 cert13.pem
-rw-r--r--  1 root  wheel  2191 Oct 27  2018 cert14.pem
-rw-r--r--  1 root  wheel  1948 Dec 26  2018 cert15.pem
-rw-r--r--  1 root  wheel  1907 Feb 16  2019 cert16.pem
-rw-r--r--  1 root  wheel  1948 Mar 10  2019 cert17.pem
-rw-r--r--  1 root  wheel  1948 Oct 26  2019 cert18.pem
-rw-r--r--  1 root  wheel  1944 Dec 25  2019 cert19.pem
-rw-r--r--  1 root  wheel  1793 Nov 12  2016 cert2.pem
-rw-r--r--  1 root  wheel  1948 Feb 23  2020 cert20.pem
-rw-r--r--  1 root  wheel  1948 May 13  2020 cert21.pem
-rw-r--r--  1 root  wheel  1948 Nov 15  2020 cert22.pem
-rw-r--r--  1 root  wheel  1879 Jan 17  2021 cert23.pem
-rw-r--r--  1 root  wheel  1846 Dec  9 11:30 cert24.pem
-rw-r--r--  1 root  wheel  1793 Jan 14  2017 cert3.pem
-rw-r--r--  1 root  wheel  1793 Mar 15  2017 cert4.pem
-rw-r--r--  1 root  wheel  1793 May 14  2017 cert5.pem
-rw-r--r--  1 root  wheel  1789 Jul 14  2017 cert6.pem
-rw-r--r--  1 root  wheel  1789 Sep 12  2017 cert7.pem
-rw-r--r--  1 root  wheel  1789 Nov 11  2017 cert8.pem
-rw-r--r--  1 root  wheel  1789 Jan 10  2018 cert9.pem
-rw-r--r--  1 root  wheel  1647 Aug 22  2016 chain1.pem
-rw-r--r--  1 root  wheel  1647 Apr 11  2018 chain10.pem
-rw-r--r--  1 root  wheel  1647 Apr 29  2018 chain11.pem
-rw-r--r--  1 root  wheel  1647 Jun 29  2018 chain12.pem
-rw-r--r--  1 root  wheel  1647 Aug 28  2018 chain13.pem
-rw-r--r--  1 root  wheel  1647 Oct 27  2018 chain14.pem
-rw-r--r--  1 root  wheel  1647 Dec 26  2018 chain15.pem
-rw-r--r--  1 root  wheel  1647 Feb 16  2019 chain16.pem
-rw-r--r--  1 root  wheel  1647 Mar 10  2019 chain17.pem
-rw-r--r--  1 root  wheel  1647 Oct 26  2019 chain18.pem
-rw-r--r--  1 root  wheel  1647 Dec 25  2019 chain19.pem
-rw-r--r--  1 root  wheel  1647 Nov 12  2016 chain2.pem
-rw-r--r--  1 root  wheel  1647 Feb 23  2020 chain20.pem
-rw-r--r--  1 root  wheel  1647 May 13  2020 chain21.pem
-rw-r--r--  1 root  wheel  1647 Nov 15  2020 chain22.pem
-rw-r--r--  1 root  wheel  1586 Jan 17  2021 chain23.pem
-rw-r--r--  1 root  wheel  3749 Dec  9 11:28 chain24.pem
-rw-r--r--  1 root  wheel  1647 Jan 14  2017 chain3.pem
-rw-r--r--  1 root  wheel  1647 Mar 15  2017 chain4.pem
-rw-r--r--  1 root  wheel  1647 May 14  2017 chain5.pem
-rw-r--r--  1 root  wheel  1647 Jul 14  2017 chain6.pem
-rw-r--r--  1 root  wheel  1647 Sep 12  2017 chain7.pem
-rw-r--r--  1 root  wheel  1647 Nov 11  2017 chain8.pem
-rw-r--r--  1 root  wheel  1647 Jan 10  2018 chain9.pem
-rw-r--r--  1 root  wheel  3440 Aug 22  2016 fullchain1.pem
-rw-r--r--  1 root  wheel  3798 Apr 11  2018 fullchain10.pem
-rw-r--r--  1 root  wheel  3838 Apr 29  2018 fullchain11.pem
-rw-r--r--  1 root  wheel  3838 Jun 29  2018 fullchain12.pem
-rw-r--r--  1 root  wheel  3838 Aug 28  2018 fullchain13.pem
-rw-r--r--  1 root  wheel  3838 Oct 27  2018 fullchain14.pem
-rw-r--r--  1 root  wheel  3595 Dec 26  2018 fullchain15.pem
-rw-r--r--  1 root  wheel  3554 Feb 16  2019 fullchain16.pem
-rw-r--r--  1 root  wheel  3595 Mar 10  2019 fullchain17.pem
-rw-r--r--  1 root  wheel  3595 Oct 26  2019 fullchain18.pem
-rw-r--r--  1 root  wheel  3591 Dec 25  2019 fullchain19.pem
-rw-r--r--  1 root  wheel  3440 Nov 12  2016 fullchain2.pem
-rw-r--r--  1 root  wheel  3595 Feb 23  2020 fullchain20.pem
-rw-r--r--  1 root  wheel  3595 May 13  2020 fullchain21.pem
-rw-r--r--  1 root  wheel  3595 Nov 15  2020 fullchain22.pem
-rw-r--r--  1 root  wheel  3465 Jan 17  2021 fullchain23.pem
-rw-r--r--  1 root  wheel  5595 Dec  9 11:26 fullchain24.pem
-rw-r--r--  1 root  wheel  3440 Jan 14  2017 fullchain3.pem
-rw-r--r--  1 root  wheel  3440 Mar 15  2017 fullchain4.pem
-rw-r--r--  1 root  wheel  3440 May 14  2017 fullchain5.pem
-rw-r--r--  1 root  wheel  3436 Jul 14  2017 fullchain6.pem
-rw-r--r--  1 root  wheel  3436 Sep 12  2017 fullchain7.pem
-rw-r--r--  1 root  wheel  3436 Nov 11  2017 fullchain8.pem
-rw-r--r--  1 root  wheel  3436 Jan 10  2018 fullchain9.pem
-rw-r--r--  1 root  wheel  1704 Aug 22  2016 privkey1.pem
-rw-r--r--  1 root  wheel  1704 Apr 11  2018 privkey10.pem
-rw-r--r--  1 root  wheel  1704 Apr 29  2018 privkey11.pem
-rw-r--r--  1 root  wheel  1708 Jun 29  2018 privkey12.pem
-rw-r--r--  1 root  wheel  1704 Aug 28  2018 privkey13.pem
-rw-r--r--  1 root  wheel  1704 Oct 27  2018 privkey14.pem
-rw-r--r--  1 root  wheel  1704 Dec 26  2018 privkey15.pem
-rw-------  1 root  wheel  1704 Feb 16  2019 privkey16.pem
-rw-------  1 root  wheel  1704 Mar 10  2019 privkey17.pem
-rw-------  1 root  wheel  1704 Oct 26  2019 privkey18.pem
-rw-------  1 root  wheel  1704 Dec 25  2019 privkey19.pem
-rw-r--r--  1 root  wheel  1704 Nov 12  2016 privkey2.pem
-rw-------  1 root  wheel  1704 Feb 23  2020 privkey20.pem
-rw-------  1 root  wheel  1704 May 13  2020 privkey21.pem
-rw-------  1 root  wheel  1704 Nov 15  2020 privkey22.pem
-rw-------  1 root  wheel  1704 Jan 17  2021 privkey23.pem
-rw-------  1 root  wheel  1704 Dec  9 11:31 privkey24.pem
-rw-r--r--  1 root  wheel  1704 Jan 14  2017 privkey3.pem
-rw-r--r--  1 root  wheel  1708 Mar 15  2017 privkey4.pem
-rw-r--r--  1 root  wheel  1708 May 14  2017 privkey5.pem
-rw-r--r--  1 root  wheel  1704 Jul 14  2017 privkey6.pem
-rw-r--r--  1 root  wheel  1704 Sep 12  2017 privkey7.pem
-rw-r--r--  1 root  wheel  1704 Nov 11  2017 privkey8.pem
-rw-r--r--  1 root  wheel  1704 Jan 10  2018 privkey9.pem

/usr/local/etc/letsencrypt/archive/www.waltr.net-0001:
total 28
drwxr-xr-x  2 root  wheel   512 Dec 26 10:46 .
drwx------  9 root  wheel   512 Dec 26 10:46 ..
-rw-r--r--  1 root  wheel  1858 Dec 26 10:46 cert1.pem
-rw-r--r--  1 root  wheel  3749 Dec 26 10:46 chain1.pem
-rw-r--r--  1 root  wheel  5607 Dec 26 10:46 fullchain1.pem
-rw-------  1 root  wheel  1708 Dec 26 10:46 privkey1.pem

/usr/local/etc/letsencrypt/archive/www.waltr.net-0001-holding:
total 24
drwxr-xr-x  2 root  wheel   512 Feb 16  2019 .
drwx------  9 root  wheel   512 Dec 26 10:46 ..
-rw-r--r--  1 root  wheel  1907 Feb 16  2019 cert1.pem
-rw-r--r--  1 root  wheel  1647 Feb 16  2019 chain1.pem
-rw-r--r--  1 root  wheel  3554 Feb 16  2019 fullchain1.pem
-rw-------  1 root  wheel  1704 Feb 16  2019 privkey1.pem

/usr/local/etc/letsencrypt/archive/www.waltr.net-0002-holding:
total 48
drwxr-xr-x  2 root  wheel   512 Nov 26 11:45 .
drwx------  9 root  wheel   512 Dec 26 10:46 ..
-rw-r--r--  1 root  wheel  1838 Nov 22 05:23 cert1.pem
-rw-r--r--  1 root  wheel  1846 Nov 26 11:45 cert2.pem
-rw-r--r--  1 root  wheel  3750 Nov 22 05:23 chain1.pem
-rw-r--r--  1 root  wheel  3749 Nov 26 11:45 chain2.pem
-rw-r--r--  1 root  wheel  5588 Nov 22 05:23 fullchain1.pem
-rw-r--r--  1 root  wheel  5595 Nov 26 11:45 fullchain2.pem
-rw-------  1 root  wheel  1708 Nov 22 05:23 privkey1.pem
-rw-------  1 root  wheel  1704 Nov 26 11:45 privkey2.pem

/usr/local/etc/letsencrypt/archive/www.waltr.org:
total 172
drwxr-xr-x  2 root  wheel  1024 Nov 20 12:55 .
drwx------  9 root  wheel   512 Dec 26 10:46 ..
-rw-r--r--  1 root  wheel  1907 Feb 16  2019 cert1.pem
-rw-r--r--  1 root  wheel  1858 Nov 20 12:55 cert10.pem
-rw-r--r--  1 root  wheel  1903 Oct 15  2019 cert2.pem
-rw-r--r--  1 root  wheel  1927 Nov 24  2019 cert3.pem
-rw-r--r--  1 root  wheel  1923 Feb  2  2020 cert4.pem
-rw-r--r--  1 root  wheel  1927 Mar  6  2020 cert5.pem
-rw-r--r--  1 root  wheel  1927 May 13  2020 cert6.pem
-rw-r--r--  1 root  wheel  1927 Nov 14  2020 cert7.pem
-rw-r--r--  1 root  wheel  1858 Jan 16  2021 cert8.pem
-rw-r--r--  1 root  wheel  1858 Apr 30  2021 cert9.pem
-rw-r--r--  1 root  wheel  1647 Feb 16  2019 chain1.pem
-rw-r--r--  1 root  wheel  3750 Nov 20 12:55 chain10.pem
-rw-r--r--  1 root  wheel  1647 Oct 15  2019 chain2.pem
-rw-r--r--  1 root  wheel  1647 Nov 24  2019 chain3.pem
-rw-r--r--  1 root  wheel  1647 Feb  2  2020 chain4.pem
-rw-r--r--  1 root  wheel  1647 Mar  6  2020 chain5.pem
-rw-r--r--  1 root  wheel  1647 May 13  2020 chain6.pem
-rw-r--r--  1 root  wheel  1647 Nov 14  2020 chain7.pem
-rw-r--r--  1 root  wheel  1586 Jan 16  2021 chain8.pem
-rw-r--r--  1 root  wheel  1586 Apr 30  2021 chain9.pem
-rw-r--r--  1 root  wheel  3554 Feb 16  2019 fullchain1.pem
-rw-r--r--  1 root  wheel  5608 Nov 20 12:55 fullchain10.pem
-rw-r--r--  1 root  wheel  3550 Oct 15  2019 fullchain2.pem
-rw-r--r--  1 root  wheel  3574 Nov 24  2019 fullchain3.pem
-rw-r--r--  1 root  wheel  3570 Feb  2  2020 fullchain4.pem
-rw-r--r--  1 root  wheel  3574 Mar  6  2020 fullchain5.pem
-rw-r--r--  1 root  wheel  3574 May 13  2020 fullchain6.pem
-rw-r--r--  1 root  wheel  3574 Nov 14  2020 fullchain7.pem
-rw-r--r--  1 root  wheel  3444 Jan 16  2021 fullchain8.pem
-rw-r--r--  1 root  wheel  3444 Apr 30  2021 fullchain9.pem
-rw-------  1 root  wheel  1704 Feb 16  2019 privkey1.pem
-rw-------  1 root  wheel  1704 Nov 20 12:55 privkey10.pem
-rw-------  1 root  wheel  1708 Oct 15  2019 privkey2.pem
-rw-------  1 root  wheel  1708 Nov 24  2019 privkey3.pem
-rw-------  1 root  wheel  1704 Feb  2  2020 privkey4.pem
-rw-------  1 root  wheel  1704 Mar  6  2020 privkey5.pem
-rw-------  1 root  wheel  1704 May 13  2020 privkey6.pem
-rw-------  1 root  wheel  1704 Nov 14  2020 privkey7.pem
-rw-------  1 root  wheel  1704 Jan 16  2021 privkey8.pem
-rw-------  1 root  wheel  1704 Apr 30  2021 privkey9.pem

/usr/local/etc/letsencrypt/csr:
total 7284
drwxr-xr-x   2 root  wheel  57856 Dec 26 12:41 .
drwxr-xr-x  10 root  wheel    512 Feb 14 14:28 ..
-rw-r--r--   1 root  wheel    956 Aug 21  2016 0000_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 Aug 21  2016 0001_csr-certbot.pem
-rw-r--r--   1 root  wheel    956 Aug 22  2016 0002_csr-certbot.pem
-rw-r--r--   1 root  wheel    956 Nov 12  2016 0003_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 Nov 12  2016 0004_csr-certbot.pem
-rw-r--r--   1 root  wheel    956 Nov 12  2016 0005_csr-certbot.pem
-rw-r--r--   1 root  wheel    956 Jan 14  2017 0006_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 Jan 14  2017 0007_csr-certbot.pem
-rw-r--r--   1 root  wheel    956 Jan 14  2017 0008_csr-certbot.pem
-rw-r--r--   1 root  wheel    956 Mar 15  2017 0009_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 Mar 15  2017 0010_csr-certbot.pem
-rw-r--r--   1 root  wheel    956 Mar 15  2017 0011_csr-certbot.pem
-rw-r--r--   1 root  wheel    956 Mar 27  2017 0012_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 Mar 27  2017 0013_csr-certbot.pem
-rw-r--r--   1 root  wheel    956 Mar 27  2017 0014_csr-certbot.pem
-rw-r--r--   1 root  wheel    956 May 14  2017 0015_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 May 14  2017 0016_csr-certbot.pem
-rw-r--r--   1 root  wheel    956 May 14  2017 0017_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 May 15  2017 0018_csr-certbot.pem
-rw-r--r--   1 root  wheel    956 Jul 14  2017 0019_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 Jul 14  2017 0020_csr-certbot.pem
-rw-r--r--   1 root  wheel    956 Jul 14  2017 0021_csr-certbot.pem
-rw-r--r--   1 root  wheel    956 Sep 12  2017 0022_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 Sep 12  2017 0023_csr-certbot.pem
-rw-r--r--   1 root  wheel    956 Sep 12  2017 0024_csr-certbot.pem
-rw-r--r--   1 root  wheel    956 Nov 11  2017 0025_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 Nov 11  2017 0026_csr-certbot.pem
-rw-r--r--   1 root  wheel    956 Nov 11  2017 0027_csr-certbot.pem
-rw-r--r--   1 root  wheel    956 Jan 10  2018 0028_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 Jan 10  2018 0029_csr-certbot.pem
-rw-r--r--   1 root  wheel    956 Jan 10  2018 0030_csr-certbot.pem
-rw-r--r--   1 root  wheel    956 Apr 11  2018 0031_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 Apr 11  2018 0032_csr-certbot.pem
-rw-r--r--   1 root  wheel    956 Apr 11  2018 0033_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Apr 12  2018 0034_csr-certbot.pem
-rw-r--r--   1 root  wheel    936 Apr 12  2018 0035_csr-certbot.pem

....

-rw-r--r--   1 root  wheel    972 Oct  9 03:06 1688_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Oct  9 03:06 1689_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 Oct  9 03:06 1690_csr-certbot.pem
-rw-r--r--   1 root  wheel    972 Oct 10 03:03 1691_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Oct 10 03:03 1692_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 Oct 10 03:03 1693_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Nov  7 03:02 1694_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 Nov  7 03:02 1695_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Nov  8 03:03 1696_csr-certbot.pem
-rw-r--r--   1 root  wheel    972 Nov  8 03:03 1697_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Nov  8 03:03 1698_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 Nov  8 03:03 1699_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Nov  9 03:06 1700_csr-certbot.pem
-rw-r--r--   1 root  wheel    972 Nov  9 03:06 1701_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Nov  9 03:06 1702_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 Nov  9 03:06 1703_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Nov 10 03:01 1704_csr-certbot.pem
-rw-r--r--   1 root  wheel    972 Nov 10 03:01 1705_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Nov 10 03:01 1706_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 Nov 10 03:01 1707_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Nov 11 03:05 1708_csr-certbot.pem
-rw-r--r--   1 root  wheel    972 Nov 11 03:06 1709_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Nov 11 03:06 1710_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 Nov 11 03:06 1711_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Nov 12 03:06 1712_csr-certbot.pem
-rw-r--r--   1 root  wheel    972 Nov 12 03:06 1713_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Nov 12 03:06 1714_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 Nov 12 03:06 1715_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Nov 13 03:01 1716_csr-certbot.pem
-rw-r--r--   1 root  wheel    972 Nov 13 03:01 1717_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Nov 13 03:01 1718_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 Nov 13 03:01 1719_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Nov 14 03:02 1720_csr-certbot.pem
-rw-r--r--   1 root  wheel    972 Nov 14 03:03 1721_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Nov 14 03:03 1722_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 Nov 14 03:03 1723_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Nov 15 03:01 1724_csr-certbot.pem
-rw-r--r--   1 root  wheel    972 Nov 15 03:01 1725_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Nov 15 03:01 1726_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 Nov 15 03:01 1727_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Nov 16 03:02 1728_csr-certbot.pem
-rw-r--r--   1 root  wheel    972 Nov 16 03:02 1729_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Nov 16 03:02 1730_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 Nov 16 03:02 1731_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Nov 17 03:06 1732_csr-certbot.pem
-rw-r--r--   1 root  wheel    972 Nov 17 03:06 1733_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Nov 17 03:06 1734_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 Nov 17 03:07 1735_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Nov 18 03:05 1736_csr-certbot.pem
-rw-r--r--   1 root  wheel    972 Nov 18 03:06 1737_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Nov 18 03:06 1738_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 Nov 18 03:06 1739_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Nov 19 03:04 1740_csr-certbot.pem
-rw-r--r--   1 root  wheel    972 Nov 19 03:04 1741_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Nov 19 03:04 1742_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 Nov 19 03:04 1743_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Nov 20 03:02 1744_csr-certbot.pem
-rw-r--r--   1 root  wheel    972 Nov 20 03:02 1745_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Nov 20 03:02 1746_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 Nov 20 03:03 1747_csr-certbot.pem
-rw-r--r--   1 root  wheel    972 Nov 20 12:31 1748_csr-certbot.pem
-rw-r--r--   1 root  wheel    972 Nov 20 12:33 1749_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Nov 20 12:44 1750_csr-certbot.pem
-rw-r--r--   1 root  wheel    972 Nov 20 12:44 1751_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Nov 20 12:45 1752_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 Nov 20 12:45 1753_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Nov 20 12:55 1754_csr-certbot.pem
-rw-r--r--   1 root  wheel    972 Nov 20 12:55 1755_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Nov 20 12:55 1756_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 Nov 20 12:55 1757_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Nov 21 03:08 1758_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Nov 21 03:08 1759_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Nov 22 03:05 1760_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Nov 22 03:05 1761_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Nov 22 05:20 1762_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Nov 22 05:20 1763_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Nov 22 05:23 1764_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Nov 23 03:00 1765_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Nov 23 03:00 1766_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Nov 24 03:07 1767_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Nov 24 03:08 1768_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Nov 25 03:04 1769_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Nov 25 03:04 1770_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Nov 26 03:07 1771_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Nov 26 03:07 1772_csr-certbot.pem
-rw-r--r--   1 root  wheel    936 Nov 26 11:45 1773_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Nov 27 03:03 1774_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Nov 27 03:03 1775_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Nov 28 03:03 1776_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Nov 28 03:03 1777_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Nov 29 03:02 1778_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Nov 29 03:02 1779_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Nov 30 03:00 1780_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Nov 30 03:00 1781_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Dec  1 03:02 1782_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Dec  1 03:02 1783_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Dec  4 03:05 1784_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Dec  4 03:05 1785_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Dec  5 03:04 1786_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Dec  5 03:04 1787_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Dec  6 03:07 1788_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Dec  6 03:07 1789_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Dec  7 03:00 1790_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Dec  7 03:00 1791_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Dec  8 03:07 1792_csr-certbot.pem
-rw-r--r--   1 root  wheel    964 Dec  8 03:07 1793_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Dec  8 20:16 1794_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Dec  8 20:16 1795_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Dec  8 20:17 1796_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Dec  8 20:24 1797_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Dec  8 20:39 1798_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Dec  8 21:06 1799_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Dec  9 10:09 1800_csr-certbot.pem
-rw-r--r--   1 root  wheel    944 Dec 26 10:46 1801_csr-certbot.pem
-rw-r--r--   1 root  wheel    924 Dec 26 10:47 1802_csr-certbot.pem
-rw-r--r--   1 root  wheel    911 Dec 26 12:00 1803_csr-certbot.pem
-rw-r--r--   1 root  wheel   1013 Dec 26 12:41 1804_csr-certbot.pem

/usr/local/etc/letsencrypt/keys:
total 7284
drwx------   2 root  wheel  57856 Dec 26 12:41 .
drwxr-xr-x  10 root  wheel    512 Feb 14 14:28 ..
-rw-------   1 root  wheel   1704 Aug 21  2016 0000_key-certbot.pem
-rw-------   1 root  wheel   1704 Aug 21  2016 0001_key-certbot.pem
-rw-------   1 root  wheel   1704 Aug 22  2016 0002_key-certbot.pem
-rw-------   1 root  wheel   1704 Nov 12  2016 0003_key-certbot.pem
-rw-------   1 root  wheel   1704 Nov 12  2016 0004_key-certbot.pem
-rw-------   1 root  wheel   1704 Nov 12  2016 0005_key-certbot.pem
-rw-------   1 root  wheel   1704 Jan 14  2017 0006_key-certbot.pem
-rw-------   1 root  wheel   1704 Jan 14  2017 0007_key-certbot.pem
-rw-------   1 root  wheel   1704 Jan 14  2017 0008_key-certbot.pem
-rw-------   1 root  wheel   1704 Mar 15  2017 0009_key-certbot.pem
-rw-------   1 root  wheel   1704 Mar 15  2017 0010_key-certbot.pem
-rw-------   1 root  wheel   1708 Mar 15  2017 0011_key-certbot.pem
-rw-------   1 root  wheel   1708 Mar 27  2017 0012_key-certbot.pem
-rw-------   1 root  wheel   1704 Mar 27  2017 0013_key-certbot.pem
-rw-------   1 root  wheel   1704 Mar 27  2017 0014_key-certbot.pem
-rw-------   1 root  wheel   1704 May 14  2017 0015_key-certbot.pem
-rw-------   1 root  wheel   1704 May 14  2017 0016_key-certbot.pem
-rw-------   1 root  wheel   1708 May 14  2017 0017_key-certbot.pem
-rw-------   1 root  wheel   1704 May 15  2017 0018_key-certbot.pem
-rw-------   1 root  wheel   1704 Jul 14  2017 0019_key-certbot.pem
-rw-------   1 root  wheel   1708 Jul 14  2017 0020_key-certbot.pem
-rw-------   1 root  wheel   1704 Jul 14  2017 0021_key-certbot.pem
-rw-------   1 root  wheel   1704 Sep 12  2017 0022_key-certbot.pem
-rw-------   1 root  wheel   1704 Sep 12  2017 0023_key-certbot.pem
-rw-------   1 root  wheel   1704 Sep 12  2017 0024_key-certbot.pem
-rw-------   1 root  wheel   1708 Nov 11  2017 0025_key-certbot.pem
-rw-------   1 root  wheel   1704 Nov 11  2017 0026_key-certbot.pem
-rw-------   1 root  wheel   1704 Nov 11  2017 0027_key-certbot.pem
-rw-------   1 root  wheel   1704 Jan 10  2018 0028_key-certbot.pem
-rw-------   1 root  wheel   1704 Jan 10  2018 0029_key-certbot.pem
-rw-------   1 root  wheel   1704 Jan 10  2018 0030_key-certbot.pem
-rw-------   1 root  wheel   1704 Apr 11  2018 0031_key-certbot.pem
-rw-------   1 root  wheel   1704 Apr 11  2018 0032_key-certbot.pem
-rw-------   1 root  wheel   1704 Apr 11  2018 0033_key-certbot.pem
-rw-------   1 root  wheel   1704 Apr 12  2018 0034_key-certbot.pem
-rw-------   1 root  wheel   1704 Apr 12  2018 0035_key-certbot.pem
-rw-------   1 root  wheel   1708 Apr 12  2018 0036_key-certbot.pem
-rw-------   1 root  wheel   1704 Apr 12  2018 0037_key-certbot.pem
-rw-------   1 root  wheel   1704 Apr 12  2018 0038_key-certbot.pem
-rw-------   1 root  wheel   1704 Apr 29  2018 0039_key-certbot.pem
-rw-------   1 root  wheel   1704 Apr 29  2018 0040_key-certbot.pem
-rw-------   1 root  wheel   1704 Jun 10  2018 0041_key-certbot.pem
-rw-------   1 root  wheel   1704 Jun 12  2018 0042_key-certbot.pem
-rw-------   1 root  wheel   1708 Jun 13  2018 0043_key-certbot.pem
-rw-------   1 root  wheel   1704 Jun 14  2018 0044_key-certbot.pem
-rw-------   1 root  wheel   1708 Jun 15  2018 0045_key-certbot.pem
-rw-------   1 root  wheel   1704 Jun 16  2018 0046_key-certbot.pem
-rw-------   1 root  wheel   1704 Jun 17  2018 0047_key-certbot.pem
-rw-------   1 root  wheel   1708 Jun 18  2018 0048_key-certbot.pem
-rw-------   1 root  wheel   1704 Jun 19  2018 0049_key-certbot.pem
-rw-------   1 root  wheel   1704 Jun 20  2018 0050_key-certbot.pem
-rw-------   1 root  wheel   1704 Jun 21  2018 0051_key-certbot.pem
-rw-------   1 root  wheel   1704 Jun 22  2018 0052_key-certbot.pem
-rw-------   1 root  wheel   1704 Jun 23  2018 0053_key-certbot.pem
-rw-------   1 root  wheel   1704 Jun 24  2018 0054_key-certbot.pem
-rw-------   1 root  wheel   1704 Jun 25  2018 0055_key-certbot.pem
-rw-------   1 root  wheel   1704 Jun 26  2018 0056_key-certbot.pem
-rw-------   1 root  wheel   1704 Jun 27  2018 0057_key-certbot.pem
-rw-------   1 root  wheel   1704 Jun 28  2018 0058_key-certbot.pem
-rw-------   1 root  wheel   1704 Jun 29  2018 0059_key-certbot.pem
-rw-------   1 root  wheel   1708 Jun 29  2018 0060_key-certbot.pem
-rw-------   1 root  wheel   1704 Jun 30  2018 0061_key-certbot.pem
-rw-------   1 root  wheel   1704 Jul  1  2018 0062_key-certbot.pem
-rw-------   1 root  wheel   1704 Jul  2  2018 0063_key-certbot.pem
-rw-------   1 root  wheel   1704 Jul  2  2018 0064_key-certbot.pem
-rw-------   1 root  wheel   1704 Jul  3  2018 0065_key-certbot.pem
-rw-------   1 root  wheel   1704 Jul  4  2018 0066_key-certbot.pem
-rw-------   1 root  wheel   1704 Jul  5  2018 0067_key-certbot.pem
-rw-------   1 root  wheel   1704 Jul  6  2018 0068_key-certbot.pem
-rw-------   1 root  wheel   1704 Jul  7  2018 0069_key-certbot.pem
-rw-------   1 root  wheel   1708 Jul  8  2018 0070_key-certbot.pem

...

-rw-------   1 root  wheel   1704 Dec  8 20:16 1794_key-certbot.pem
-rw-------   1 root  wheel   1704 Dec  8 20:16 1795_key-certbot.pem
-rw-------   1 root  wheel   1704 Dec  8 20:17 1796_key-certbot.pem
-rw-------   1 root  wheel   1708 Dec  8 20:24 1797_key-certbot.pem
-rw-------   1 root  wheel   1704 Dec  8 20:39 1798_key-certbot.pem
-rw-------   1 root  wheel   1700 Dec  8 21:06 1799_key-certbot.pem
-rw-------   1 root  wheel   1704 Dec  9 10:09 1800_key-certbot.pem
-rw-------   1 root  wheel   1708 Dec 26 10:46 1801_key-certbot.pem
-rw-------   1 root  wheel   1704 Dec 26 10:47 1802_key-certbot.pem
-rw-------   1 root  wheel   1704 Dec 26 12:00 1803_key-certbot.pem
-rw-------   1 root  wheel   1704 Dec 26 12:41 1804_key-certbot.pem

/usr/local/etc/letsencrypt/live:
total 36
drwx------   8 root  wheel  512 Dec 26 10:46 .
drwxr-xr-x  10 root  wheel  512 Feb 14 14:28 ..
-rw-r--r--   1 root  wheel  740 Feb 16  2019 README
drwxr-xr-x   2 root  wheel  512 Aug 23 03:07 ipv4.waltr.org
drwxr-xr-x   2 root  wheel  512 Nov 20 12:55 waltr.net
drwxr-xr-x   2 root  wheel  512 Dec  9 11:44 www.waltr.net
drwxr-xr-x   2 root  wheel  512 Dec 26 10:46 www.waltr.net-0001
drwxr-xr-x   2 root  wheel  512 Nov 26 11:45 www.waltr.net-0002
drwxr-xr-x   2 root  wheel  512 Nov 20 12:55 www.waltr.org

/usr/local/etc/letsencrypt/live/ipv4.waltr.org:
total 12
drwxr-xr-x  2 root  wheel  512 Aug 23 03:07 .
drwx------  8 root  wheel  512 Dec 26 10:46 ..
-rw-r--r--  1 root  wheel  692 Feb 16  2019 README
lrwxr-xr-x  1 root  wheel   39 Aug 23 03:07 cert.pem -> ../../archive/ipv4.waltr.org/cert15.pem
lrwxr-xr-x  1 root  wheel   40 Aug 23 03:07 chain.pem -> ../../archive/ipv4.waltr.org/chain15.pem
lrwxr-xr-x  1 root  wheel   44 Aug 23 03:07 fullchain.pem -> ../../archive/ipv4.waltr.org/fullchain15.pem
lrwxr-xr-x  1 root  wheel   42 Aug 23 03:07 privkey.pem -> ../../archive/ipv4.waltr.org/privkey15.pem

/usr/local/etc/letsencrypt/live/waltr.net:
total 8
drwxr-xr-x  2 root  wheel  512 Nov 20 12:55 .
drwx------  8 root  wheel  512 Dec 26 10:46 ..
lrwxr-xr-x  1 root  wheel   34 Nov 20 12:55 cert.pem -> ../../archive/waltr.net/cert25.pem
lrwxr-xr-x  1 root  wheel   35 Nov 20 12:55 chain.pem -> ../../archive/waltr.net/chain25.pem
lrwxr-xr-x  1 root  wheel   39 Nov 20 12:55 fullchain.pem -> ../../archive/waltr.net/fullchain25.pem
lrwxr-xr-x  1 root  wheel   37 Nov 20 12:55 privkey.pem -> ../../archive/waltr.net/privkey25.pem

/usr/local/etc/letsencrypt/live/www.waltr.net:
total 8
drwxr-xr-x  2 root  wheel  512 Dec  9 11:44 .
drwx------  8 root  wheel  512 Dec 26 10:46 ..
lrwxr-xr-x  1 root  wheel   38 Dec  9 11:42 cert.pem -> ../../archive/www.waltr.net/cert24.pem
lrwxr-xr-x  1 root  wheel   39 Dec  9 11:43 chain.pem -> ../../archive/www.waltr.net/chain24.pem
lrwxr-xr-x  1 root  wheel   43 Dec  9 11:42 fullchain.pem -> ../../archive/www.waltr.net/fullchain24.pem
lrwxr-xr-x  1 root  wheel   41 Dec  9 11:44 privkey.pem -> ../../archive/www.waltr.net/privkey24.pem

/usr/local/etc/letsencrypt/live/www.waltr.net-0001:
total 12
drwxr-xr-x  2 root  wheel  512 Dec 26 10:46 .
drwx------  8 root  wheel  512 Dec 26 10:46 ..
-rw-r--r--  1 root  wheel  692 Dec 26 10:46 README
lrwxr-xr-x  1 root  wheel   42 Dec 26 10:46 cert.pem -> ../../archive/www.waltr.net-0001/cert1.pem
lrwxr-xr-x  1 root  wheel   43 Dec 26 10:46 chain.pem -> ../../archive/www.waltr.net-0001/chain1.pem
lrwxr-xr-x  1 root  wheel   47 Dec 26 10:46 fullchain.pem -> ../../archive/www.waltr.net-0001/fullchain1.pem
lrwxr-xr-x  1 root  wheel   45 Dec 26 10:46 privkey.pem -> ../../archive/www.waltr.net-0001/privkey1.pem

/usr/local/etc/letsencrypt/live/www.waltr.net-0002:
total 12
drwxr-xr-x  2 root  wheel  512 Nov 26 11:45 .
drwx------  8 root  wheel  512 Dec 26 10:46 ..
-rw-r--r--  1 root  wheel  692 Nov 22 05:23 README
lrwxr-xr-x  1 root  wheel   42 Nov 26 11:45 cert.pem -> ../../archive/www.waltr.net-0002/cert2.pem
lrwxr-xr-x  1 root  wheel   43 Nov 26 11:45 chain.pem -> ../../archive/www.waltr.net-0002/chain2.pem
lrwxr-xr-x  1 root  wheel   47 Nov 26 11:45 fullchain.pem -> ../../archive/www.waltr.net-0002/fullchain2.pem
lrwxr-xr-x  1 root  wheel   45 Nov 26 11:45 privkey.pem -> ../../archive/www.waltr.net-0002/privkey2.pem

/usr/local/etc/letsencrypt/live/www.waltr.org:
total 12
drwxr-xr-x  2 root  wheel  512 Nov 20 12:55 .
drwx------  8 root  wheel  512 Dec 26 10:46 ..
-rw-r--r--  1 root  wheel  692 Feb 16  2019 README
lrwxr-xr-x  1 root  wheel   38 Nov 20 12:55 cert.pem -> ../../archive/www.waltr.org/cert10.pem
lrwxr-xr-x  1 root  wheel   39 Nov 20 12:55 chain.pem -> ../../archive/www.waltr.org/chain10.pem
lrwxr-xr-x  1 root  wheel   43 Nov 20 12:55 fullchain.pem -> ../../archive/www.waltr.org/fullchain10.pem
lrwxr-xr-x  1 root  wheel   41 Nov 20 12:55 privkey.pem -> ../../archive/www.waltr.org/privkey10.pem

/usr/local/etc/letsencrypt/renewal:
total 12
drwxr-xr-x   2 root  wheel  512 Dec 26 12:22 .
drwxr-xr-x  10 root  wheel  512 Feb 14 14:28 ..
-rw-r--r--   1 root  wheel  580 Dec 26 10:46 www.waltr.net-0001.conf

/usr/local/etc/letsencrypt/renewal-hooks:
total 20
drwxr-xr-x   5 root  wheel  512 Apr 12  2018 .
drwxr-xr-x  10 root  wheel  512 Feb 14 14:28 ..
drwxr-xr-x   2 root  wheel  512 Apr 12  2018 deploy
drwxr-xr-x   2 root  wheel  512 Apr 12  2018 post
drwxr-xr-x   2 root  wheel  512 Apr 12  2018 pre

/usr/local/etc/letsencrypt/renewal-hooks/deploy:
total 8
drwxr-xr-x  2 root  wheel  512 Apr 12  2018 .
drwxr-xr-x  5 root  wheel  512 Apr 12  2018 ..

/usr/local/etc/letsencrypt/renewal-hooks/post:
total 8
drwxr-xr-x  2 root  wheel  512 Apr 12  2018 .
drwxr-xr-x  5 root  wheel  512 Apr 12  2018 ..

/usr/local/etc/letsencrypt/renewal-hooks/pre:
total 8
drwxr-xr-x  2 root  wheel  512 Apr 12  2018 .
drwxr-xr-x  5 root  wheel  512 Apr 12  2018 ..
#

I am happy to start this process from scratch if you think it better and faster to just delete it all and rebuild as you suggest.

Walt.

1 Like
19

I believe this is exactly what happened and what I thought should be the solution, but I wasn't sure what else I'd mess up if I did this.
a. I did upgrade from python 2.7 to python 3.8 that's about the time certbot wasn't happy.
b. I looked at the upgrade logs on the old OS version and found that I reinstalled certbot from a pkg and then from ports so there was something happening even then.
c. The OS upgrade didn't help.

Thank you for the excellent explanation. This clears up how the mechanisms are working and makes it much easier to analyze and fix the problem. The bimodal solution (use the current -0001 or clear everything and start from scratch are both equally good).

3 Likes
20

This "numbering" situation has bitten me a few times too. Certbot doesn't get everything right, but it does get most things right for the widest amount of users.

The important thing to remember is that your system still has all the certificates, so it's not terribly hard to unpack all this. certbot certificates will show you the "Certificate Name" for all the active certs, along with the domain names on the cert and the file system paths.

3 Likes