Unable to renew Lets Encrypt certificate

Help
1

Please fill out the fields below so we can help you better. Note: you must provide your domain name to get help. Domain names for issued certificates are all made public in Certificate Transparency logs (e.g. crt.sh | example.com), so withholding your domain name here does not increase secrecy, but only makes it harder for us to provide help.

My domain is: worldfixer.com

I ran this command: sudo certbot --nginx -d example.com -d www.example.com

It produced this output: Saving debug log to /var/log/letsencrypt/letsencrypt.log
Error while running nginx -c /etc/nginx/nginx.conf -t.

nginx: [emerg] BIO_new_file("/etc/letsencrypt/live/worldfixer.com/fullchain.pem") failed (SSL: error:02001002:system library:fopen:No such file or directory:fopen('/etc/letsencrypt/live/worldfixer.com/fullchain.pem','r') error:2006D080:BIO routines:BIO_new_file:no such file)
nginx: configuration file /etc/nginx/nginx.conf test failed

The nginx plugin is not working; there may be problems with your existing configuration.
The error was: MisconfigurationError('Error while running nginx -c /etc/nginx/nginx.conf -t.\n\nnginx: [emerg] BIO_new_file("/etc/letsencrypt/live/worldfixer.com/fullchain.pem") failed (SSL: error:02001002:system library:fopen:No such file or directory:fopen('/etc/letsencrypt/live/worldfixer.com/fullchain.pem','r') error:2006D080:BIO routines:BIO_new_file:no such file)\nnginx: configuration file /etc/nginx/nginx.conf test failed\n',)

My web server is (include version): NGinx,

The operating system my web server runs on is (include version): Nginx

My hosting provider, if applicable, is: Digital Ocean

I can login to a root shell on my machine (yes or no, or I don't know): yes

I'm using a control panel to manage my site (no, or provide the name and version of the control panel): yes

The version of my client is (e.g. output of certbot --version or certbot-auto --version if you're using Certbot): don't unsterday this question

The problem arose from my previous Let's encrypt certification expiring after 90days and the system didn't auto renewal.

I then ran the script: sudo certbot renew --dry-run

And received this error:

I received this error:
Domain: www.worldfixer.com
Type: unauthorized
Detail: 134.122.77.70: Invalid response from
https://www.worldfixer.com/.well-known/acme-challenge/SfLxB5pZoYICvDv7-TnLu1Yhq71lddk6G14M98q62Hk:
"\r\n<!-- Last Published: Wed Feb 16
2022 13:53:"

To fix these errors, please make sure that your domain name was
entered correctly and the DNS A/AAAA record(s) for that domain
contain(s) the right IP address.

After that, I deleted the existing files for
ssl_certificate /etc/letsencrypt/live/worldfixer.com/fullchain.pem

ssl_certificate_key /etc/letsencrypt/live/worldfixer.com/privkey.pem

However, now I'm unable to add a Let's Encrypt certification back to the IP Address. Any help?

1 Like
2

You broke nginx when you deleted files it relies on. There is rarely a need to delete these to fix problems and when you do you need to remove them from nginx first.

Now, how did you delete them? Using the certbot command or just the operating system?

4 Likes
4

Ugh. I'm dumb.

I ran this command: sudo bash -c 'grep -R live/example.com /etc/{nginx,httpd,apache2}'

Based on this doc: User Guide — Certbot 1.27.0 documentation

Following the procedures in the section: Safely deleting certificates
(User Guide — Certbot 1.27.0 documentation)

5

I don't know about that but you did not follow all the steps. The grep command you show would not have deleted anything.

We need to know what you have done, to know how to fix it. What does this show?

ls -lR /etc/letsencrypt

Please add 3 backticks (```) before and after the output like this
```
output of command
```

4 Likes
6

I end up getting all of this. It cuts things off further up:

-rw------- 1 root root 1704 Jul 21  2021 1438_key-certbot.pem
-rw------- 1 root root 1704 Jul 21  2021 1439_key-certbot.pem
-rw------- 1 root root 1704 Jul 22  2021 1440_key-certbot.pem
-rw------- 1 root root 1704 Jul 22  2021 1441_key-certbot.pem
-rw------- 1 root root 1704 Jul 22  2021 1442_key-certbot.pem
-rw------- 1 root root 1704 Jul 22  2021 1443_key-certbot.pem
-rw------- 1 root root 1704 Jul 23  2021 1444_key-certbot.pem
-rw------- 1 root root 1704 Jul 23  2021 1445_key-certbot.pem
-rw------- 1 root root 1708 Jul 23  2021 1446_key-certbot.pem
-rw------- 1 root root 1704 Jul 23  2021 1447_key-certbot.pem
-rw------- 1 root root 1704 Jul 24  2021 1448_key-certbot.pem
-rw------- 1 root root 1704 Jul 24  2021 1449_key-certbot.pem
-rw------- 1 root root 1704 Jul 24  2021 1450_key-certbot.pem
-rw------- 1 root root 1704 Jul 24  2021 1451_key-certbot.pem
-rw------- 1 root root 1704 Jul 25  2021 1452_key-certbot.pem
-rw------- 1 root root 1704 Jul 25  2021 1453_key-certbot.pem
-rw------- 1 root root 1704 Jul 25  2021 1454_key-certbot.pem
-rw------- 1 root root 1708 Jul 25  2021 1455_key-certbot.pem
-rw------- 1 root root 1708 Jul 26  2021 1456_key-certbot.pem
-rw------- 1 root root 1704 Jul 26  2021 1457_key-certbot.pem
-rw------- 1 root root 1704 Jul 26  2021 1458_key-certbot.pem
-rw------- 1 root root 1704 Jul 26  2021 1459_key-certbot.pem
-rw------- 1 root root 1704 Jul 27  2021 1460_key-certbot.pem
-rw------- 1 root root 1704 Jul 27  2021 1461_key-certbot.pem
-rw------- 1 root root 1704 Jul 27  2021 1462_key-certbot.pem
-rw------- 1 root root 1708 Jul 27  2021 1463_key-certbot.pem
-rw------- 1 root root 1704 Jul 28  2021 1464_key-certbot.pem
-rw------- 1 root root 1704 Jul 28  2021 1465_key-certbot.pem
-rw------- 1 root root 1704 Jul 28  2021 1466_key-certbot.pem
-rw------- 1 root root 1704 Jul 28  2021 1467_key-certbot.pem
-rw------- 1 root root 1704 Jul 29  2021 1468_key-certbot.pem
-rw------- 1 root root 1704 Jul 29  2021 1469_key-certbot.pem
-rw------- 1 root root 1704 Jul 29  2021 1470_key-certbot.pem
-rw------- 1 root root 1704 Jul 29  2021 1471_key-certbot.pem
-rw------- 1 root root 1704 Jul 30  2021 1472_key-certbot.pem
-rw------- 1 root root 1704 Jul 30  2021 1473_key-certbot.pem
-rw------- 1 root root 1704 Jul 30  2021 1474_key-certbot.pem
-rw------- 1 root root 1704 Jul 30  2021 1475_key-certbot.pem
-rw------- 1 root root 1704 Jul 31  2021 1476_key-certbot.pem
-rw------- 1 root root 1704 Jul 31  2021 1477_key-certbot.pem
-rw------- 1 root root 1704 Jul 31  2021 1478_key-certbot.pem
-rw------- 1 root root 1704 Jul 31  2021 1479_key-certbot.pem
-rw------- 1 root root 1704 Aug  1  2021 1480_key-certbot.pem
-rw------- 1 root root 1708 Aug  1  2021 1481_key-certbot.pem
-rw------- 1 root root 1704 Aug  1  2021 1482_key-certbot.pem
-rw------- 1 root root 1708 Aug  1  2021 1483_key-certbot.pem
-rw------- 1 root root 1704 Aug  2  2021 1484_key-certbot.pem
-rw------- 1 root root 1708 Aug  2  2021 1485_key-certbot.pem
-rw------- 1 root root 1704 Aug  2  2021 1486_key-certbot.pem
-rw------- 1 root root 1704 Aug  2  2021 1487_key-certbot.pem
-rw------- 1 root root 1704 Aug  3  2021 1488_key-certbot.pem
-rw------- 1 root root 1704 Aug  3  2021 1489_key-certbot.pem
-rw------- 1 root root 1704 Aug  3  2021 1490_key-certbot.pem
-rw------- 1 root root 1704 Aug  3  2021 1491_key-certbot.pem
-rw------- 1 root root 1704 Aug  4  2021 1492_key-certbot.pem
-rw------- 1 root root 1704 Aug  4  2021 1493_key-certbot.pem
-rw------- 1 root root 1704 Aug  4  2021 1494_key-certbot.pem
-rw------- 1 root root 1704 Aug  4  2021 1495_key-certbot.pem
-rw------- 1 root root 1704 Aug  5  2021 1496_key-certbot.pem
-rw------- 1 root root 1708 Aug  5  2021 1497_key-certbot.pem
-rw------- 1 root root 1704 Aug  5  2021 1498_key-certbot.pem
-rw------- 1 root root 1708 Aug  5  2021 1499_key-certbot.pem
-rw------- 1 root root 1704 Aug  6  2021 1500_key-certbot.pem
-rw------- 1 root root 1704 Aug  6  2021 1501_key-certbot.pem
-rw------- 1 root root 1704 Aug  6  2021 1502_key-certbot.pem
-rw------- 1 root root 1704 Aug  6  2021 1503_key-certbot.pem
-rw------- 1 root root 1704 Aug  7  2021 1504_key-certbot.pem
-rw------- 1 root root 1704 Aug  7  2021 1505_key-certbot.pem
-rw------- 1 root root 1704 Aug  7  2021 1506_key-certbot.pem
-rw------- 1 root root 1704 Aug  7  2021 1507_key-certbot.pem
-rw------- 1 root root 1704 Aug  8  2021 1508_key-certbot.pem
-rw------- 1 root root 1704 Aug  8  2021 1509_key-certbot.pem
-rw------- 1 root root 1704 Aug  8  2021 1510_key-certbot.pem
-rw------- 1 root root 1704 Aug  8  2021 1511_key-certbot.pem
-rw------- 1 root root 1704 Aug  9  2021 1512_key-certbot.pem
-rw------- 1 root root 1704 Aug  9  2021 1513_key-certbot.pem
-rw------- 1 root root 1704 Aug  9  2021 1514_key-certbot.pem
-rw------- 1 root root 1704 Aug  9  2021 1515_key-certbot.pem
-rw------- 1 root root 1704 Aug 10  2021 1516_key-certbot.pem
-rw------- 1 root root 1704 Aug 10  2021 1517_key-certbot.pem
-rw------- 1 root root 1704 Aug 10  2021 1518_key-certbot.pem
-rw------- 1 root root 1704 Aug 10  2021 1519_key-certbot.pem
-rw------- 1 root root 1704 Aug 11  2021 1520_key-certbot.pem
-rw------- 1 root root 1704 Aug 11  2021 1521_key-certbot.pem
-rw------- 1 root root 1704 Aug 11  2021 1522_key-certbot.pem
-rw------- 1 root root 1708 Aug 11  2021 1523_key-certbot.pem
-rw------- 1 root root 1704 Aug 12  2021 1524_key-certbot.pem
-rw------- 1 root root 1704 Aug 12  2021 1525_key-certbot.pem
-rw------- 1 root root 1704 Aug 12  2021 1526_key-certbot.pem
-rw------- 1 root root 1704 Aug 12  2021 1527_key-certbot.pem
-rw------- 1 root root 1704 Aug 13  2021 1528_key-certbot.pem
-rw------- 1 root root 1704 Aug 13  2021 1529_key-certbot.pem
-rw------- 1 root root 1704 Aug 13  2021 1530_key-certbot.pem
-rw------- 1 root root 1704 Aug 13  2021 1531_key-certbot.pem
-rw------- 1 root root 1704 Aug 14  2021 1532_key-certbot.pem
-rw------- 1 root root 1704 Aug 14  2021 1533_key-certbot.pem
-rw------- 1 root root 1708 Aug 14  2021 1534_key-certbot.pem
-rw------- 1 root root 1704 Aug 14  2021 1535_key-certbot.pem
-rw------- 1 root root 1704 Aug 15  2021 1536_key-certbot.pem
-rw------- 1 root root 1704 Aug 15  2021 1537_key-certbot.pem
-rw------- 1 root root 1704 Aug 15  2021 1538_key-certbot.pem
-rw------- 1 root root 1704 Aug 15  2021 1539_key-certbot.pem
-rw------- 1 root root 1704 Aug 16  2021 1540_key-certbot.pem
-rw------- 1 root root 1704 Aug 16  2021 1541_key-certbot.pem
-rw------- 1 root root 1704 Aug 16  2021 1542_key-certbot.pem
-rw------- 1 root root 1704 Aug 16  2021 1543_key-certbot.pem
-rw------- 1 root root 1704 Aug 17  2021 1544_key-certbot.pem
-rw------- 1 root root 1704 Aug 17  2021 1545_key-certbot.pem
-rw------- 1 root root 1704 Aug 17  2021 1546_key-certbot.pem
-rw------- 1 root root 1704 Aug 17  2021 1547_key-certbot.pem
-rw------- 1 root root 1704 Aug 18  2021 1548_key-certbot.pem
-rw------- 1 root root 1704 Aug 18  2021 1549_key-certbot.pem
-rw------- 1 root root 1704 Aug 18  2021 1550_key-certbot.pem
-rw------- 1 root root 1704 Aug 18  2021 1551_key-certbot.pem
-rw------- 1 root root 1704 Aug 19  2021 1552_key-certbot.pem
-rw------- 1 root root 1704 Aug 19  2021 1553_key-certbot.pem
-rw------- 1 root root 1704 Aug 19  2021 1554_key-certbot.pem
-rw------- 1 root root 1704 Aug 19  2021 1555_key-certbot.pem
-rw------- 1 root root 1708 Aug 20  2021 1556_key-certbot.pem
-rw------- 1 root root 1708 Aug 20  2021 1557_key-certbot.pem
-rw------- 1 root root 1704 Aug 20  2021 1558_key-certbot.pem
-rw------- 1 root root 1704 Aug 20  2021 1559_key-certbot.pem
-rw------- 1 root root 1704 Aug 21  2021 1560_key-certbot.pem
-rw------- 1 root root 1708 Aug 21  2021 1561_key-certbot.pem
-rw------- 1 root root 1704 Aug 21  2021 1562_key-certbot.pem
-rw------- 1 root root 1704 Aug 21  2021 1563_key-certbot.pem
-rw------- 1 root root 1704 Aug 22  2021 1564_key-certbot.pem
-rw------- 1 root root 1704 Aug 22  2021 1565_key-certbot.pem
-rw------- 1 root root 1708 Aug 22  2021 1566_key-certbot.pem
-rw------- 1 root root 1704 Aug 22  2021 1567_key-certbot.pem
-rw------- 1 root root 1704 Aug 23  2021 1568_key-certbot.pem
-rw------- 1 root root 1704 Aug 23  2021 1569_key-certbot.pem
-rw------- 1 root root 1704 Aug 23  2021 1570_key-certbot.pem
-rw------- 1 root root 1704 Aug 23  2021 1571_key-certbot.pem
-rw------- 1 root root 1704 Aug 24  2021 1572_key-certbot.pem
-rw------- 1 root root 1704 Aug 24  2021 1573_key-certbot.pem
-rw------- 1 root root 1704 Aug 24  2021 1574_key-certbot.pem
-rw------- 1 root root 1704 Aug 24  2021 1575_key-certbot.pem
-rw------- 1 root root 1704 Aug 25  2021 1576_key-certbot.pem
-rw------- 1 root root 1704 Aug 25  2021 1577_key-certbot.pem
-rw------- 1 root root 1704 Aug 25  2021 1578_key-certbot.pem
-rw------- 1 root root 1704 Aug 25  2021 1579_key-certbot.pem
-rw------- 1 root root 1704 Aug 26  2021 1580_key-certbot.pem
-rw------- 1 root root 1704 Aug 26  2021 1581_key-certbot.pem
-rw------- 1 root root 1704 Aug 26  2021 1582_key-certbot.pem
-rw------- 1 root root 1704 Aug 26  2021 1583_key-certbot.pem
-rw------- 1 root root 1708 Aug 27  2021 1584_key-certbot.pem
-rw------- 1 root root 1704 Aug 27  2021 1585_key-certbot.pem
-rw------- 1 root root 1704 Aug 27  2021 1586_key-certbot.pem
-rw------- 1 root root 1704 Aug 27  2021 1587_key-certbot.pem
-rw------- 1 root root 1708 Aug 28  2021 1588_key-certbot.pem
-rw------- 1 root root 1704 Aug 28  2021 1589_key-certbot.pem
-rw------- 1 root root 1704 Aug 28  2021 1590_key-certbot.pem
-rw------- 1 root root 1704 Aug 28  2021 1591_key-certbot.pem
-rw------- 1 root root 1704 Aug 29  2021 1592_key-certbot.pem
-rw------- 1 root root 1704 Aug 29  2021 1593_key-certbot.pem
-rw------- 1 root root 1704 Aug 29  2021 1594_key-certbot.pem
-rw------- 1 root root 1704 Aug 29  2021 1595_key-certbot.pem
-rw------- 1 root root 1704 Aug 30  2021 1596_key-certbot.pem
-rw------- 1 root root 1704 Aug 30  2021 1597_key-certbot.pem
-rw------- 1 root root 1704 Aug 30  2021 1598_key-certbot.pem
-rw------- 1 root root 1704 Aug 30  2021 1599_key-certbot.pem
-rw------- 1 root root 1708 Aug 31  2021 1600_key-certbot.pem
-rw------- 1 root root 1704 Aug 31  2021 1601_key-certbot.pem
-rw------- 1 root root 1704 Aug 31  2021 1602_key-certbot.pem
-rw------- 1 root root 1708 Aug 31  2021 1603_key-certbot.pem
-rw------- 1 root root 1704 Sep  1  2021 1604_key-certbot.pem
-rw------- 1 root root 1704 Sep  1  2021 1605_key-certbot.pem
-rw------- 1 root root 1704 Sep  1  2021 1606_key-certbot.pem
-rw------- 1 root root 1704 Sep  1  2021 1607_key-certbot.pem
-rw------- 1 root root 1708 Sep  2  2021 1608_key-certbot.pem
-rw------- 1 root root 1704 Sep  2  2021 1609_key-certbot.pem
-rw------- 1 root root 1704 Sep  2  2021 1610_key-certbot.pem
-rw------- 1 root root 1704 Sep  2  2021 1611_key-certbot.pem
-rw------- 1 root root 1708 Sep  3  2021 1612_key-certbot.pem
-rw------- 1 root root 1704 Sep  3  2021 1613_key-certbot.pem
-rw------- 1 root root 1704 Sep  3  2021 1614_key-certbot.pem
-rw------- 1 root root 1704 Sep  3  2021 1615_key-certbot.pem
-rw------- 1 root root 1704 Sep  4  2021 1616_key-certbot.pem
-rw------- 1 root root 1704 Sep  4  2021 1617_key-certbot.pem
-rw------- 1 root root 1704 Sep  4  2021 1618_key-certbot.pem
-rw------- 1 root root 1704 Sep  4  2021 1619_key-certbot.pem
-rw------- 1 root root 1704 Sep  5  2021 1620_key-certbot.pem
-rw------- 1 root root 1704 Sep  5  2021 1621_key-certbot.pem
-rw------- 1 root root 1708 Sep  5  2021 1622_key-certbot.pem
-rw------- 1 root root 1704 Sep  5  2021 1623_key-certbot.pem
-rw------- 1 root root 1704 Sep  6  2021 1624_key-certbot.pem
-rw------- 1 root root 1704 Sep  6  2021 1625_key-certbot.pem
-rw------- 1 root root 1704 Sep  6  2021 1626_key-certbot.pem
-rw------- 1 root root 1704 Sep  6  2021 1627_key-certbot.pem
-rw------- 1 root root 1704 Sep  7  2021 1628_key-certbot.pem
-rw------- 1 root root 1704 Sep  7  2021 1629_key-certbot.pem
-rw------- 1 root root 1700 Sep  7  2021 1630_key-certbot.pem
-rw------- 1 root root 1704 Sep  7  2021 1631_key-certbot.pem
-rw------- 1 root root 1704 Sep  8  2021 1632_key-certbot.pem
-rw------- 1 root root 1704 Sep  8  2021 1633_key-certbot.pem
-rw------- 1 root root 1704 Sep  8  2021 1634_key-certbot.pem
-rw------- 1 root root 1704 Sep  8  2021 1635_key-certbot.pem
-rw------- 1 root root 1704 Sep  9  2021 1636_key-certbot.pem
-rw------- 1 root root 1704 Sep  9  2021 1637_key-certbot.pem
-rw------- 1 root root 1704 Sep  9  2021 1638_key-certbot.pem
-rw------- 1 root root 1708 Sep  9  2021 1639_key-certbot.pem
-rw------- 1 root root 1704 Sep 10  2021 1640_key-certbot.pem
-rw------- 1 root root 1704 Sep 10  2021 1641_key-certbot.pem
-rw------- 1 root root 1700 Sep 10  2021 1642_key-certbot.pem
-rw------- 1 root root 1704 Sep 10  2021 1643_key-certbot.pem
-rw------- 1 root root 1704 Sep 11  2021 1644_key-certbot.pem
-rw------- 1 root root 1704 Sep 11  2021 1645_key-certbot.pem
-rw------- 1 root root 1704 Sep 11  2021 1646_key-certbot.pem
-rw------- 1 root root 1704 Sep 11  2021 1647_key-certbot.pem
-rw------- 1 root root 1704 Sep 12  2021 1648_key-certbot.pem
-rw------- 1 root root 1708 Sep 12  2021 1649_key-certbot.pem
-rw------- 1 root root 1704 Sep 12  2021 1650_key-certbot.pem
-rw------- 1 root root 1704 Sep 12  2021 1651_key-certbot.pem
-rw------- 1 root root 1704 Sep 13  2021 1652_key-certbot.pem
-rw------- 1 root root 1704 Sep 13  2021 1653_key-certbot.pem
-rw------- 1 root root 1704 Sep 13  2021 1654_key-certbot.pem
-rw------- 1 root root 1704 Sep 13  2021 1655_key-certbot.pem
-rw------- 1 root root 1704 Sep 14  2021 1656_key-certbot.pem
-rw------- 1 root root 1704 Sep 14  2021 1657_key-certbot.pem
-rw------- 1 root root 1708 Sep 14  2021 1658_key-certbot.pem
-rw------- 1 root root 1704 Sep 14  2021 1659_key-certbot.pem
-rw------- 1 root root 1704 Sep 15  2021 1660_key-certbot.pem
-rw------- 1 root root 1704 Sep 15  2021 1661_key-certbot.pem
-rw------- 1 root root 1704 Sep 15  2021 1662_key-certbot.pem
-rw------- 1 root root 1704 Sep 15  2021 1663_key-certbot.pem
-rw------- 1 root root 1704 Sep 16  2021 1664_key-certbot.pem
-rw------- 1 root root 1704 Sep 16  2021 1665_key-certbot.pem
-rw------- 1 root root 1704 Sep 16  2021 1666_key-certbot.pem
-rw------- 1 root root 1704 Sep 16  2021 1667_key-certbot.pem
-rw------- 1 root root 1704 Sep 17  2021 1668_key-certbot.pem
-rw------- 1 root root 1704 Sep 17  2021 1669_key-certbot.pem
-rw------- 1 root root 1704 Sep 17  2021 1670_key-certbot.pem
-rw------- 1 root root 1708 Sep 17  2021 1671_key-certbot.pem
-rw------- 1 root root 1708 Sep 18  2021 1672_key-certbot.pem
-rw------- 1 root root 1704 Sep 18  2021 1673_key-certbot.pem
-rw------- 1 root root 1704 Sep 18  2021 1674_key-certbot.pem
-rw------- 1 root root 1704 Sep 18  2021 1675_key-certbot.pem
-rw------- 1 root root 1704 Sep 19  2021 1676_key-certbot.pem
-rw------- 1 root root 1704 Sep 19  2021 1677_key-certbot.pem
-rw------- 1 root root 1704 Sep 19  2021 1678_key-certbot.pem
-rw------- 1 root root 1704 Sep 19  2021 1679_key-certbot.pem
-rw------- 1 root root 1708 Sep 20  2021 1680_key-certbot.pem
-rw------- 1 root root 1704 Sep 20  2021 1681_key-certbot.pem
-rw------- 1 root root 1704 Sep 20  2021 1682_key-certbot.pem
-rw------- 1 root root 1704 Sep 20  2021 1683_key-certbot.pem
-rw------- 1 root root 1708 Sep 21  2021 1684_key-certbot.pem
-rw------- 1 root root 1704 Sep 21  2021 1685_key-certbot.pem
-rw------- 1 root root 1704 Sep 21  2021 1686_key-certbot.pem
-rw------- 1 root root 1704 Sep 21  2021 1687_key-certbot.pem
-rw------- 1 root root 1704 Sep 22  2021 1688_key-certbot.pem
-rw------- 1 root root 1704 Sep 22  2021 1689_key-certbot.pem
-rw------- 1 root root 1704 Sep 22  2021 1690_key-certbot.pem
-rw------- 1 root root 1708 Sep 22  2021 1691_key-certbot.pem
-rw------- 1 root root 1708 Sep 23  2021 1692_key-certbot.pem
-rw------- 1 root root 1704 Sep 23  2021 1693_key-certbot.pem
-rw------- 1 root root 1704 Sep 23  2021 1694_key-certbot.pem
-rw------- 1 root root 1704 Sep 23  2021 1695_key-certbot.pem
-rw------- 1 root root 1704 Sep 24  2021 1696_key-certbot.pem
-rw------- 1 root root 1704 Sep 24  2021 1697_key-certbot.pem
-rw------- 1 root root 1704 Sep 24  2021 1698_key-certbot.pem
-rw------- 1 root root 1704 Sep 24  2021 1699_key-certbot.pem
-rw------- 1 root root 1708 Sep 25  2021 1700_key-certbot.pem
-rw------- 1 root root 1704 Sep 25  2021 1701_key-certbot.pem
-rw------- 1 root root 1708 Sep 25  2021 1702_key-certbot.pem
-rw------- 1 root root 1704 Sep 25  2021 1703_key-certbot.pem
-rw------- 1 root root 1708 Sep 26  2021 1704_key-certbot.pem
-rw------- 1 root root 1708 Sep 26  2021 1705_key-certbot.pem
-rw------- 1 root root 1704 Sep 26  2021 1706_key-certbot.pem
-rw------- 1 root root 1704 Sep 26  2021 1707_key-certbot.pem
-rw------- 1 root root 1708 Sep 27  2021 1708_key-certbot.pem
-rw------- 1 root root 1704 Sep 27  2021 1709_key-certbot.pem
-rw------- 1 root root 1704 Sep 27  2021 1710_key-certbot.pem
-rw------- 1 root root 1708 Sep 27  2021 1711_key-certbot.pem
-rw------- 1 root root 1708 Sep 28  2021 1712_key-certbot.pem
-rw------- 1 root root 1704 Sep 28  2021 1713_key-certbot.pem
-rw------- 1 root root 1704 Sep 28  2021 1714_key-certbot.pem
-rw------- 1 root root 1704 Sep 28  2021 1715_key-certbot.pem
-rw------- 1 root root 1704 Sep 29  2021 1716_key-certbot.pem
-rw------- 1 root root 1704 Sep 29  2021 1717_key-certbot.pem
-rw------- 1 root root 1704 Sep 29  2021 1718_key-certbot.pem
-rw------- 1 root root 1704 Sep 29  2021 1719_key-certbot.pem
-rw------- 1 root root 1704 Sep 30  2021 1720_key-certbot.pem
-rw------- 1 root root 1704 Sep 30  2021 1721_key-certbot.pem
-rw------- 1 root root 1708 Sep 30  2021 1722_key-certbot.pem
-rw------- 1 root root 1704 Sep 30  2021 1723_key-certbot.pem
-rw------- 1 root root 1704 Oct  1  2021 1724_key-certbot.pem
-rw------- 1 root root 1704 Oct  1  2021 1725_key-certbot.pem
-rw------- 1 root root 1704 Oct  1  2021 1726_key-certbot.pem
-rw------- 1 root root 1704 Oct  1  2021 1727_key-certbot.pem
-rw------- 1 root root 1704 Oct  2  2021 1728_key-certbot.pem
-rw------- 1 root root 1704 Oct  2  2021 1729_key-certbot.pem
-rw------- 1 root root 1704 Oct  2  2021 1730_key-certbot.pem
-rw------- 1 root root 1708 Oct  2  2021 1731_key-certbot.pem
-rw------- 1 root root 1704 Oct  3  2021 1732_key-certbot.pem
-rw------- 1 root root 1704 Oct  3  2021 1733_key-certbot.pem
-rw------- 1 root root 1708 Oct  3  2021 1734_key-certbot.pem
-rw------- 1 root root 1704 Oct  3  2021 1735_key-certbot.pem
-rw------- 1 root root 1708 Oct  4  2021 1736_key-certbot.pem
-rw------- 1 root root 1704 Oct  4  2021 1737_key-certbot.pem
-rw------- 1 root root 1704 Oct  5  2021 1738_key-certbot.pem
-rw------- 1 root root 1704 Oct  5  2021 1739_key-certbot.pem
-rw------- 1 root root 1704 Oct  5  2021 1740_key-certbot.pem
-rw------- 1 root root 1708 Oct  5  2021 1741_key-certbot.pem
-rw------- 1 root root 1704 Oct  5  2021 1742_key-certbot.pem
-rw------- 1 root root 1708 Oct  5  2021 1743_key-certbot.pem
-rw------- 1 root root 1704 Oct  6  2021 1744_key-certbot.pem
-rw------- 1 root root 1708 Oct  6  2021 1745_key-certbot.pem
-rw------- 1 root root 1704 Oct  6  2021 1746_key-certbot.pem
-rw------- 1 root root 1704 Oct  6  2021 1747_key-certbot.pem
-rw------- 1 root root 1708 Oct  7  2021 1748_key-certbot.pem
-rw------- 1 root root 1704 Oct  7  2021 1749_key-certbot.pem
-rw------- 1 root root 1704 Oct  7  2021 1750_key-certbot.pem
-rw------- 1 root root 1704 Oct  7  2021 1751_key-certbot.pem
-rw------- 1 root root 1704 Oct  8  2021 1752_key-certbot.pem
-rw------- 1 root root 1704 Oct  8  2021 1753_key-certbot.pem
-rw------- 1 root root 1704 Oct  8  2021 1754_key-certbot.pem
-rw------- 1 root root 1708 Oct  8  2021 1755_key-certbot.pem
-rw------- 1 root root 1704 Oct  9  2021 1756_key-certbot.pem
-rw------- 1 root root 1708 Oct  9  2021 1757_key-certbot.pem
-rw------- 1 root root 1704 Oct  9  2021 1758_key-certbot.pem
-rw------- 1 root root 1708 Oct  9  2021 1759_key-certbot.pem
-rw------- 1 root root 1704 Oct 10  2021 1760_key-certbot.pem
-rw------- 1 root root 1704 Oct 10  2021 1761_key-certbot.pem
-rw------- 1 root root 1704 Oct 10  2021 1762_key-certbot.pem
-rw------- 1 root root 1704 Oct 10  2021 1763_key-certbot.pem
-rw------- 1 root root 1708 Oct 11  2021 1764_key-certbot.pem
-rw------- 1 root root 1704 Oct 11  2021 1765_key-certbot.pem
-rw------- 1 root root 1704 Oct 11  2021 1766_key-certbot.pem
-rw------- 1 root root 1708 Oct 11  2021 1767_key-certbot.pem
-rw------- 1 root root 1704 Oct 12  2021 1768_key-certbot.pem
-rw------- 1 root root 1704 Oct 12  2021 1769_key-certbot.pem
-rw------- 1 root root 1704 Oct 12  2021 1770_key-certbot.pem
-rw------- 1 root root 1704 Oct 12  2021 1771_key-certbot.pem
-rw------- 1 root root 1708 Oct 13  2021 1772_key-certbot.pem
-rw------- 1 root root 1708 Oct 13  2021 1773_key-certbot.pem
-rw------- 1 root root 1704 Oct 13  2021 1774_key-certbot.pem
-rw------- 1 root root 1704 Oct 13  2021 1775_key-certbot.pem
-rw------- 1 root root 1704 Oct 14  2021 1776_key-certbot.pem
-rw------- 1 root root 1704 Oct 14  2021 1777_key-certbot.pem
-rw------- 1 root root 1704 Oct 14  2021 1778_key-certbot.pem
-rw------- 1 root root 1704 Oct 14  2021 1779_key-certbot.pem
-rw------- 1 root root 1708 Oct 15  2021 1780_key-certbot.pem
-rw------- 1 root root 1708 Oct 15  2021 1781_key-certbot.pem
-rw------- 1 root root 1704 Oct 15  2021 1782_key-certbot.pem
-rw------- 1 root root 1704 Oct 15  2021 1783_key-certbot.pem
-rw------- 1 root root 1704 Oct 16  2021 1784_key-certbot.pem
-rw------- 1 root root 1704 Oct 16  2021 1785_key-certbot.pem
-rw------- 1 root root 1704 Oct 16  2021 1786_key-certbot.pem
-rw------- 1 root root 1704 Oct 16  2021 1787_key-certbot.pem
-rw------- 1 root root 1708 Oct 17  2021 1788_key-certbot.pem
-rw------- 1 root root 1704 Oct 17  2021 1789_key-certbot.pem
-rw------- 1 root root 1704 Oct 17  2021 1790_key-certbot.pem
-rw------- 1 root root 1704 Oct 17  2021 1791_key-certbot.pem
-rw------- 1 root root 1704 Oct 18  2021 1792_key-certbot.pem
-rw------- 1 root root 1704 Oct 18  2021 1793_key-certbot.pem
-rw------- 1 root root 1708 Oct 18  2021 1794_key-certbot.pem
-rw------- 1 root root 1704 Oct 18  2021 1795_key-certbot.pem
-rw------- 1 root root 1708 Oct 19  2021 1796_key-certbot.pem
-rw------- 1 root root 1708 Oct 19  2021 1797_key-certbot.pem
-rw------- 1 root root 1704 Oct 19  2021 1798_key-certbot.pem
-rw------- 1 root root 1708 Oct 19  2021 1799_key-certbot.pem
-rw------- 1 root root 1704 Oct 20  2021 1800_key-certbot.pem
-rw------- 1 root root 1704 Oct 20  2021 1801_key-certbot.pem
-rw------- 1 root root 1704 Oct 20  2021 1802_key-certbot.pem
-rw------- 1 root root 1704 Oct 20  2021 1803_key-certbot.pem
-rw------- 1 root root 1708 Oct 21  2021 1804_key-certbot.pem
-rw------- 1 root root 1704 Oct 21  2021 1805_key-certbot.pem
-rw------- 1 root root 1704 Oct 21  2021 1806_key-certbot.pem
-rw------- 1 root root 1704 Oct 21  2021 1807_key-certbot.pem
-rw------- 1 root root 1704 Oct 22  2021 1808_key-certbot.pem
-rw------- 1 root root 1704 Oct 22  2021 1809_key-certbot.pem
-rw------- 1 root root 1704 Oct 22  2021 1810_key-certbot.pem
-rw------- 1 root root 1704 Oct 22  2021 1811_key-certbot.pem
-rw------- 1 root root 1704 Oct 23  2021 1812_key-certbot.pem
-rw------- 1 root root 1704 Oct 23  2021 1813_key-certbot.pem
-rw------- 1 root root 1704 Oct 23  2021 1814_key-certbot.pem
-rw------- 1 root root 1704 Oct 23  2021 1815_key-certbot.pem
-rw------- 1 root root 1704 Oct 24  2021 1816_key-certbot.pem
-rw------- 1 root root 1704 Oct 24  2021 1817_key-certbot.pem
-rw------- 1 root root 1704 Oct 24  2021 1818_key-certbot.pem
-rw------- 1 root root 1704 Oct 24  2021 1819_key-certbot.pem
-rw------- 1 root root 1708 Oct 25  2021 1820_key-certbot.pem
-rw------- 1 root root 1704 Oct 25  2021 1821_key-certbot.pem
-rw------- 1 root root 1704 Oct 25  2021 1822_key-certbot.pem
-rw------- 1 root root 1708 Oct 25  2021 1823_key-certbot.pem
-rw------- 1 root root 1708 Oct 26  2021 1824_key-certbot.pem
-rw------- 1 root root 1704 Oct 26  2021 1825_key-certbot.pem
-rw------- 1 root root 1704 Oct 26  2021 1826_key-certbot.pem
-rw------- 1 root root 1704 Oct 26  2021 1827_key-certbot.pem
-rw------- 1 root root 1708 Oct 27  2021 1828_key-certbot.pem
-rw------- 1 root root 1704 Oct 27  2021 1829_key-certbot.pem
-rw------- 1 root root 1704 Oct 27  2021 1830_key-certbot.pem
-rw------- 1 root root 1704 Oct 27  2021 1831_key-certbot.pem
-rw------- 1 root root 1704 Oct 28  2021 1832_key-certbot.pem
-rw------- 1 root root 1704 Oct 28  2021 1833_key-certbot.pem
-rw------- 1 root root 1704 Oct 28  2021 1834_key-certbot.pem
-rw------- 1 root root 1704 Oct 28  2021 1835_key-certbot.pem
-rw------- 1 root root 1704 Oct 29  2021 1836_key-certbot.pem
-rw------- 1 root root 1704 Oct 29  2021 1837_key-certbot.pem
-rw------- 1 root root 1704 Oct 29  2021 1838_key-certbot.pem
-rw------- 1 root root 1704 Oct 29  2021 1839_key-certbot.pem
-rw------- 1 root root 1704 Oct 30  2021 1840_key-certbot.pem
-rw------- 1 root root 1708 Oct 30  2021 1841_key-certbot.pem
-rw------- 1 root root 1708 Oct 30  2021 1842_key-certbot.pem
-rw------- 1 root root 1704 Oct 30  2021 1843_key-certbot.pem
-rw------- 1 root root 1704 Oct 31  2021 1844_key-certbot.pem
-rw------- 1 root root 1704 Oct 31  2021 1845_key-certbot.pem
-rw------- 1 root root 1704 Oct 31  2021 1846_key-certbot.pem
-rw------- 1 root root 1708 Oct 31  2021 1847_key-certbot.pem
-rw------- 1 root root 1704 Nov  1  2021 1848_key-certbot.pem
-rw------- 1 root root 1708 Nov  1  2021 1849_key-certbot.pem
-rw------- 1 root root 1704 Nov  1  2021 1850_key-certbot.pem
-rw------- 1 root root 1704 Nov  1  2021 1851_key-certbot.pem
-rw------- 1 root root 1704 Nov  2  2021 1852_key-certbot.pem
-rw------- 1 root root 1704 Nov  2  2021 1853_key-certbot.pem
-rw------- 1 root root 1704 Nov  2  2021 1854_key-certbot.pem
-rw------- 1 root root 1704 Nov  2  2021 1855_key-certbot.pem
-rw------- 1 root root 1704 Nov  3  2021 1856_key-certbot.pem
-rw------- 1 root root 1708 Nov  3  2021 1857_key-certbot.pem
-rw------- 1 root root 1704 Nov  3  2021 1858_key-certbot.pem
-rw------- 1 root root 1704 Nov  3  2021 1859_key-certbot.pem
-rw------- 1 root root 1704 Nov  4  2021 1860_key-certbot.pem
-rw------- 1 root root 1704 Nov  4  2021 1861_key-certbot.pem
-rw------- 1 root root 1704 Nov  4  2021 1862_key-certbot.pem
-rw------- 1 root root 1704 Nov  4  2021 1863_key-certbot.pem
-rw------- 1 root root 1704 Nov  5  2021 1864_key-certbot.pem
-rw------- 1 root root 1704 Nov  5  2021 1865_key-certbot.pem
-rw------- 1 root root 1708 Nov  5  2021 1866_key-certbot.pem
-rw------- 1 root root 1704 Nov  5  2021 1867_key-certbot.pem
-rw------- 1 root root 1708 Nov  6  2021 1868_key-certbot.pem
-rw------- 1 root root 1704 Nov  6  2021 1869_key-certbot.pem
-rw------- 1 root root 1704 Nov  6  2021 1870_key-certbot.pem
-rw------- 1 root root 1704 Nov  6  2021 1871_key-certbot.pem
-rw------- 1 root root 1704 Nov  7  2021 1872_key-certbot.pem
-rw------- 1 root root 1704 Nov  7  2021 1873_key-certbot.pem
-rw------- 1 root root 1704 Nov  7  2021 1874_key-certbot.pem
-rw------- 1 root root 1700 Nov  7  2021 1875_key-certbot.pem
-rw------- 1 root root 1704 Nov  8  2021 1876_key-certbot.pem
-rw------- 1 root root 1704 Nov  8  2021 1877_key-certbot.pem
-rw------- 1 root root 1704 Nov  8  2021 1878_key-certbot.pem
-rw------- 1 root root 1704 Nov  8  2021 1879_key-certbot.pem
-rw------- 1 root root 1704 Nov  9  2021 1880_key-certbot.pem
-rw------- 1 root root 1704 Nov  9  2021 1881_key-certbot.pem
-rw------- 1 root root 1704 Nov  9  2021 1882_key-certbot.pem
-rw------- 1 root root 1704 Nov  9  2021 1883_key-certbot.pem
-rw------- 1 root root 1704 Nov 10  2021 1884_key-certbot.pem
-rw------- 1 root root 1704 Nov 10  2021 1885_key-certbot.pem
-rw------- 1 root root 1704 Nov 10  2021 1886_key-certbot.pem
-rw------- 1 root root 1704 Nov 10  2021 1887_key-certbot.pem
-rw------- 1 root root 1704 Nov 11  2021 1888_key-certbot.pem
-rw------- 1 root root 1708 Nov 11  2021 1889_key-certbot.pem
-rw------- 1 root root 1704 Nov 11  2021 1890_key-certbot.pem
-rw------- 1 root root 1704 Nov 11  2021 1891_key-certbot.pem
-rw------- 1 root root 1704 Nov 12  2021 1892_key-certbot.pem
-rw------- 1 root root 1704 Nov 12  2021 1893_key-certbot.pem
-rw------- 1 root root 1704 Nov 12  2021 1894_key-certbot.pem
-rw------- 1 root root 1704 Nov 12  2021 1895_key-certbot.pem
-rw------- 1 root root 1708 Nov 13  2021 1896_key-certbot.pem
-rw------- 1 root root 1708 Nov 13  2021 1897_key-certbot.pem
-rw------- 1 root root 1704 Nov 13  2021 1898_key-certbot.pem
-rw------- 1 root root 1708 Nov 13  2021 1899_key-certbot.pem
-rw------- 1 root root 1704 Nov 14  2021 1900_key-certbot.pem
-rw------- 1 root root 1704 Nov 14  2021 1901_key-certbot.pem
-rw------- 1 root root 1704 Nov 14  2021 1902_key-certbot.pem
-rw------- 1 root root 1708 Nov 14  2021 1903_key-certbot.pem
-rw------- 1 root root 1704 Nov 15  2021 1904_key-certbot.pem
-rw------- 1 root root 1708 Nov 15  2021 1905_key-certbot.pem
-rw------- 1 root root 1704 Nov 15  2021 1906_key-certbot.pem
-rw------- 1 root root 1704 Nov 15  2021 1907_key-certbot.pem
-rw------- 1 root root 1704 Nov 16  2021 1908_key-certbot.pem
-rw------- 1 root root 1704 Nov 16  2021 1909_key-certbot.pem
-rw------- 1 root root 1704 Nov 16  2021 1910_key-certbot.pem
-rw------- 1 root root 1704 Nov 16  2021 1911_key-certbot.pem
-rw------- 1 root root 1708 Nov 17  2021 1912_key-certbot.pem
-rw------- 1 root root 1704 Nov 17  2021 1913_key-certbot.pem
-rw------- 1 root root 1708 Nov 17  2021 1914_key-certbot.pem
-rw------- 1 root root 1704 Nov 17  2021 1915_key-certbot.pem
-rw------- 1 root root 1704 Nov 18  2021 1916_key-certbot.pem
-rw------- 1 root root 1704 Nov 18  2021 1917_key-certbot.pem
-rw------- 1 root root 1704 Nov 18  2021 1918_key-certbot.pem
-rw------- 1 root root 1708 Nov 18  2021 1919_key-certbot.pem
-rw------- 1 root root 1704 Nov 19  2021 1920_key-certbot.pem
-rw------- 1 root root 1704 Nov 19  2021 1921_key-certbot.pem
-rw------- 1 root root 1704 Nov 19  2021 1922_key-certbot.pem
-rw------- 1 root root 1704 Nov 19  2021 1923_key-certbot.pem
-rw------- 1 root root 1704 Nov 20  2021 1924_key-certbot.pem
-rw------- 1 root root 1704 Nov 20  2021 1925_key-certbot.pem
-rw------- 1 root root 1708 Nov 20  2021 1926_key-certbot.pem
-rw------- 1 root root 1704 Nov 20  2021 1927_key-certbot.pem
-rw------- 1 root root 1704 Nov 21  2021 1928_key-certbot.pem
-rw------- 1 root root 1704 Nov 21  2021 1929_key-certbot.pem
-rw------- 1 root root 1704 Nov 21  2021 1930_key-certbot.pem
-rw------- 1 root root 1704 Nov 21  2021 1931_key-certbot.pem
-rw------- 1 root root 1700 Nov 22  2021 1932_key-certbot.pem
-rw------- 1 root root 1704 Nov 22  2021 1933_key-certbot.pem
-rw------- 1 root root 1704 Nov 22  2021 1934_key-certbot.pem
-rw------- 1 root root 1704 Nov 22  2021 1935_key-certbot.pem
-rw------- 1 root root 1704 Nov 23  2021 1936_key-certbot.pem
-rw------- 1 root root 1704 Nov 23  2021 1937_key-certbot.pem
-rw------- 1 root root 1704 Nov 23  2021 1938_key-certbot.pem
-rw------- 1 root root 1704 Nov 23  2021 1939_key-certbot.pem
-rw------- 1 root root 1704 Nov 24  2021 1940_key-certbot.pem
-rw------- 1 root root 1704 Nov 24  2021 1941_key-certbot.pem
-rw------- 1 root root 1704 Nov 24  2021 1942_key-certbot.pem
-rw------- 1 root root 1700 Nov 24  2021 1943_key-certbot.pem
-rw------- 1 root root 1704 Nov 25  2021 1944_key-certbot.pem
-rw------- 1 root root 1708 Nov 25  2021 1945_key-certbot.pem
-rw------- 1 root root 1704 Nov 25  2021 1946_key-certbot.pem
-rw------- 1 root root 1708 Nov 25  2021 1947_key-certbot.pem
-rw------- 1 root root 1704 Nov 26 07:47 1948_key-certbot.pem
-rw------- 1 root root 1708 Nov 26 07:47 1949_key-certbot.pem
-rw------- 1 root root 1704 Nov 26 20:13 1950_key-certbot.pem
-rw------- 1 root root 1708 Nov 26 20:13 1951_key-certbot.pem
-rw------- 1 root root 1704 Nov 27 00:22 1952_key-certbot.pem
-rw------- 1 root root 1704 Nov 27 00:22 1953_key-certbot.pem
-rw------- 1 root root 1704 Nov 27 21:54 1954_key-certbot.pem
-rw------- 1 root root 1704 Nov 27 21:54 1955_key-certbot.pem
-rw------- 1 root root 1704 Nov 28 11:17 1956_key-certbot.pem
-rw------- 1 root root 1708 Nov 28 11:17 1957_key-certbot.pem
-rw------- 1 root root 1704 Nov 28 23:48 1958_key-certbot.pem
-rw------- 1 root root 1704 Nov 28 23:48 1959_key-certbot.pem
-rw------- 1 root root 1704 Nov 29 11:57 1960_key-certbot.pem
-rw------- 1 root root 1704 Nov 29 11:57 1961_key-certbot.pem
-rw------- 1 root root 1704 Nov 29 15:45 1962_key-certbot.pem
-rw------- 1 root root 1704 Nov 29 15:45 1963_key-certbot.pem
-rw------- 1 root root 1704 Nov 30 03:25 1964_key-certbot.pem
-rw------- 1 root root 1708 Nov 30 03:26 1965_key-certbot.pem
-rw------- 1 root root 1704 Nov 30 12:28 1966_key-certbot.pem
-rw------- 1 root root 1704 Nov 30 12:28 1967_key-certbot.pem
-rw------- 1 root root 1704 Dec  1 06:55 1968_key-certbot.pem
-rw------- 1 root root 1704 Dec  1 06:56 1969_key-certbot.pem
-rw------- 1 root root 1704 Dec  1 16:12 1970_key-certbot.pem
-rw------- 1 root root 1704 Dec  1 16:12 1971_key-certbot.pem
-rw------- 1 root root 1704 Dec  2 09:39 1972_key-certbot.pem
-rw------- 1 root root 1704 Dec  2 09:39 1973_key-certbot.pem
-rw------- 1 root root 1704 Dec  2 22:14 1974_key-certbot.pem
-rw------- 1 root root 1704 Dec  2 22:14 1975_key-certbot.pem
-rw------- 1 root root 1704 Dec  3 03:56 1976_key-certbot.pem
-rw------- 1 root root 1704 Dec  3 03:57 1977_key-certbot.pem
-rw------- 1 root root 1704 Dec  3 20:47 1978_key-certbot.pem
-rw------- 1 root root 1704 Dec  3 20:47 1979_key-certbot.pem
-rw------- 1 root root 1704 Dec  4 11:33 1980_key-certbot.pem
-rw------- 1 root root 1704 Dec  4 11:33 1981_key-certbot.pem
-rw------- 1 root root 1704 Dec  4 23:12 1982_key-certbot.pem
-rw------- 1 root root 1704 Dec  4 23:12 1983_key-certbot.pem
-rw------- 1 root root 1704 Dec  5 05:18 1984_key-certbot.pem
-rw------- 1 root root 1704 Dec  5 05:18 1985_key-certbot.pem
-rw------- 1 root root 1704 Dec  5 20:13 1986_key-certbot.pem
-rw------- 1 root root 1704 Dec  5 20:13 1987_key-certbot.pem
-rw------- 1 root root 1704 Dec  6 08:47 1988_key-certbot.pem
-rw------- 1 root root 1704 Dec  6 08:47 1989_key-certbot.pem
-rw------- 1 root root 1704 Dec  6 18:06 1990_key-certbot.pem
-rw------- 1 root root 1704 Dec  6 18:06 1991_key-certbot.pem
-rw------- 1 root root 1704 Dec  7 00:24 1992_key-certbot.pem
-rw------- 1 root root 1704 Dec  7 00:24 1993_key-certbot.pem
-rw------- 1 root root 1704 Dec  7 12:54 1994_key-certbot.pem
-rw------- 1 root root 1708 Dec  7 12:54 1995_key-certbot.pem
-rw------- 1 root root 1708 Dec  8 00:27 1996_key-certbot.pem
-rw------- 1 root root 1704 Dec  8 00:27 1997_key-certbot.pem
-rw------- 1 root root 1704 Dec  8 20:23 1998_key-certbot.pem
-rw------- 1 root root 1704 Dec  8 20:23 1999_key-certbot.pem
-rw------- 1 root root 1704 Dec  9 00:28 2000_key-certbot.pem
-rw------- 1 root root 1704 Dec  9 00:28 2001_key-certbot.pem
-rw------- 1 root root 1704 Dec  9 19:26 2002_key-certbot.pem
-rw------- 1 root root 1704 Dec  9 19:26 2003_key-certbot.pem
-rw------- 1 root root 1704 Dec 10 11:51 2004_key-certbot.pem
-rw------- 1 root root 1704 Dec 10 11:52 2005_key-certbot.pem
-rw------- 1 root root 1704 Dec 10 21:03 2006_key-certbot.pem
-rw------- 1 root root 1708 Dec 10 21:03 2007_key-certbot.pem
-rw------- 1 root root 1704 Dec 11 06:14 2008_key-certbot.pem
-rw------- 1 root root 1704 Dec 11 06:14 2009_key-certbot.pem
-rw------- 1 root root 1704 Dec 11 13:20 2010_key-certbot.pem
-rw------- 1 root root 1704 Dec 11 13:20 2011_key-certbot.pem
-rw------- 1 root root 1708 Dec 12 10:15 2012_key-certbot.pem
-rw------- 1 root root 1704 Dec 12 10:16 2013_key-certbot.pem
-rw------- 1 root root 1704 Dec 12 13:32 2014_key-certbot.pem
-rw------- 1 root root 1704 Dec 12 13:32 2015_key-certbot.pem
-rw------- 1 root root 1704 Dec 13 10:39 2016_key-certbot.pem
-rw------- 1 root root 1704 Dec 13 10:39 2017_key-certbot.pem
-rw------- 1 root root 1704 Dec 13 14:11 2018_key-certbot.pem
-rw------- 1 root root 1708 Dec 13 14:12 2019_key-certbot.pem
-rw------- 1 root root 1708 Dec 14 02:10 2020_key-certbot.pem
-rw------- 1 root root 1704 Dec 14 02:10 2021_key-certbot.pem
-rw------- 1 root root 1704 Dec 14 14:08 2022_key-certbot.pem
-rw------- 1 root root 1708 Dec 14 14:08 2023_key-certbot.pem
-rw------- 1 root root 1704 Dec 15 06:51 2024_key-certbot.pem
-rw------- 1 root root 1708 Dec 15 06:51 2025_key-certbot.pem
-rw------- 1 root root 1704 Dec 15 17:40 2026_key-certbot.pem
-rw------- 1 root root 1704 Dec 15 17:41 2027_key-certbot.pem
-rw------- 1 root root 1704 Dec 16 04:03 2028_key-certbot.pem
-rw------- 1 root root 1704 Dec 16 04:03 2029_key-certbot.pem
-rw------- 1 root root 1704 Dec 16 15:09 2030_key-certbot.pem
-rw------- 1 root root 1704 Dec 16 15:09 2031_key-certbot.pem
-rw------- 1 root root 1704 Dec 17 04:16 2032_key-certbot.pem
-rw------- 1 root root 1700 Dec 17 04:16 2033_key-certbot.pem
-rw------- 1 root root 1704 Dec 17 14:58 2034_key-certbot.pem
-rw------- 1 root root 1708 Dec 17 14:58 2035_key-certbot.pem
-rw------- 1 root root 1708 Dec 18 10:23 2036_key-certbot.pem
-rw------- 1 root root 1704 Dec 18 10:23 2037_key-certbot.pem
-rw------- 1 root root 1704 Dec 18 16:41 2038_key-certbot.pem
-rw------- 1 root root 1704 Dec 18 16:41 2039_key-certbot.pem
-rw------- 1 root root 1708 Dec 19 04:43 2040_key-certbot.pem
-rw------- 1 root root 1708 Dec 19 04:44 2041_key-certbot.pem
-rw------- 1 root root 1704 Dec 19 21:11 2042_key-certbot.pem
-rw------- 1 root root 1708 Dec 19 21:11 2043_key-certbot.pem
-rw------- 1 root root 1704 Dec 20 05:53 2044_key-certbot.pem
-rw------- 1 root root 1704 Dec 20 05:54 2045_key-certbot.pem
-rw------- 1 root root 1704 Dec 20 14:22 2046_key-certbot.pem
-rw------- 1 root root 1704 Dec 20 14:22 2047_key-certbot.pem
-rw------- 1 root root 1708 Dec 21 05:01 2048_key-certbot.pem
-rw------- 1 root root 1704 Dec 21 05:02 2049_key-certbot.pem
-rw------- 1 root root 1708 Dec 21 19:36 2050_key-certbot.pem
-rw------- 1 root root 1704 Dec 21 19:36 2051_key-certbot.pem
-rw------- 1 root root 1704 Dec 22 10:07 2052_key-certbot.pem
-rw------- 1 root root 1704 Dec 22 10:07 2053_key-certbot.pem
-rw------- 1 root root 1708 Dec 22 13:32 2054_key-certbot.pem
-rw------- 1 root root 1708 Dec 22 13:32 2055_key-certbot.pem
-rw------- 1 root root 1704 Dec 23 08:26 2056_key-certbot.pem
-rw------- 1 root root 1704 Dec 23 08:26 2057_key-certbot.pem
-rw------- 1 root root 1704 Dec 23 16:54 2058_key-certbot.pem
-rw------- 1 root root 1704 Dec 23 16:54 2059_key-certbot.pem
-rw------- 1 root root 1708 Dec 24 11:14 2060_key-certbot.pem
-rw------- 1 root root 1708 Dec 24 11:15 2061_key-certbot.pem
-rw------- 1 root root 1704 Dec 24 20:42 2062_key-certbot.pem
-rw------- 1 root root 1704 Dec 24 20:42 2063_key-certbot.pem
-rw------- 1 root root 1704 Dec 25 08:55 2064_key-certbot.pem
-rw------- 1 root root 1708 Dec 25 08:55 2065_key-certbot.pem
-rw------- 1 root root 1704 Dec 25 12:06 2066_key-certbot.pem
-rw------- 1 root root 1704 Dec 25 12:06 2067_key-certbot.pem
-rw------- 1 root root 1704 Dec 26 04:27 2068_key-certbot.pem
-rw------- 1 root root 1704 Dec 26 04:27 2069_key-certbot.pem
-rw------- 1 root root 1704 Dec 26 18:58 2070_key-certbot.pem
-rw------- 1 root root 1704 Dec 26 18:58 2071_key-certbot.pem
-rw------- 1 root root 1704 Dec 27 06:17 2072_key-certbot.pem
-rw------- 1 root root 1708 Dec 27 06:17 2073_key-certbot.pem
-rw------- 1 root root 1704 Dec 27 12:27 2074_key-certbot.pem
-rw------- 1 root root 1704 Dec 27 12:27 2075_key-certbot.pem
-rw------- 1 root root 1704 Dec 28 00:32 2076_key-certbot.pem
-rw------- 1 root root 1704 Dec 28 00:32 2077_key-certbot.pem
-rw------- 1 root root 1704 Dec 28 12:37 2078_key-certbot.pem
-rw------- 1 root root 1704 Dec 28 12:37 2079_key-certbot.pem
-rw------- 1 root root 1704 Dec 29 00:07 2080_key-certbot.pem
-rw------- 1 root root 1704 Dec 29 00:07 2081_key-certbot.pem
-rw------- 1 root root 1704 Dec 29 23:47 2082_key-certbot.pem
-rw------- 1 root root 1704 Dec 29 23:48 2083_key-certbot.pem
-rw------- 1 root root 1704 Dec 30 03:27 2084_key-certbot.pem
-rw------- 1 root root 1704 Dec 30 03:27 2085_key-certbot.pem
-rw------- 1 root root 1704 Dec 30 20:06 2086_key-certbot.pem
-rw------- 1 root root 1704 Dec 30 20:06 2087_key-certbot.pem
-rw------- 1 root root 1708 Dec 31 08:36 2088_key-certbot.pem
-rw------- 1 root root 1704 Dec 31 08:36 2089_key-certbot.pem
-rw------- 1 root root 1708 Dec 31 16:31 2090_key-certbot.pem
-rw------- 1 root root 1704 Dec 31 16:31 2091_key-certbot.pem
-rw------- 1 root root 1704 Jan  1 06:07 2092_key-certbot.pem
-rw------- 1 root root 1708 Jan  1 06:08 2093_key-certbot.pem
-rw------- 1 root root 1708 Jan  1 20:01 2094_key-certbot.pem
-rw------- 1 root root 1704 Jan  1 20:01 2095_key-certbot.pem
-rw------- 1 root root 1708 Jan  2 04:17 2096_key-certbot.pem
-rw------- 1 root root 1704 Jan  2 04:17 2097_key-certbot.pem
-rw------- 1 root root 1704 Jan  2 12:27 2098_key-certbot.pem
-rw------- 1 root root 1704 Jan  2 12:27 2099_key-certbot.pem
-rw------- 1 root root 1704 Jan  3 10:24 2100_key-certbot.pem
-rw------- 1 root root 1708 Jan  3 10:24 2101_key-certbot.pem
-rw------- 1 root root 1704 Jan  3 23:51 2102_key-certbot.pem
-rw------- 1 root root 1704 Jan  3 23:51 2103_key-certbot.pem
-rw------- 1 root root 1704 Jan  4 10:11 2104_key-certbot.pem
-rw------- 1 root root 1704 Jan  4 10:11 2105_key-certbot.pem
-rw------- 1 root root 1708 Jan  4 21:48 2106_key-certbot.pem
-rw------- 1 root root 1704 Jan  4 21:48 2107_key-certbot.pem
-rw------- 1 root root 1704 Jan  5 04:05 2108_key-certbot.pem
-rw------- 1 root root 1704 Jan  5 04:05 2109_key-certbot.pem
-rw------- 1 root root 1708 Jan  5 13:07 2110_key-certbot.pem
-rw------- 1 root root 1704 Jan  5 13:07 2111_key-certbot.pem
-rw------- 1 root root 1708 Jan  6 08:19 2112_key-certbot.pem
-rw------- 1 root root 1708 Jan  6 08:19 2113_key-certbot.pem
-rw------- 1 root root 1704 Jan  6 23:00 2114_key-certbot.pem
-rw------- 1 root root 1704 Jan  6 23:00 2115_key-certbot.pem
-rw------- 1 root root 1704 Jan  7 00:28 2116_key-certbot.pem
-rw------- 1 root root 1704 Jan  7 00:28 2117_key-certbot.pem
-rw------- 1 root root 1704 Jan  7 16:08 2118_key-certbot.pem
-rw------- 1 root root 1704 Jan  7 16:08 2119_key-certbot.pem
-rw------- 1 root root 1708 Jan  8 11:07 2120_key-certbot.pem
-rw------- 1 root root 1704 Jan  8 11:07 2121_key-certbot.pem
-rw------- 1 root root 1704 Jan  8 15:50 2122_key-certbot.pem
-rw------- 1 root root 1704 Jan  8 15:50 2123_key-certbot.pem
-rw------- 1 root root 1708 Jan  9 02:07 2124_key-certbot.pem
-rw------- 1 root root 1704 Jan  9 02:07 2125_key-certbot.pem
-rw------- 1 root root 1704 Jan  9 16:50 2126_key-certbot.pem
-rw------- 1 root root 1708 Jan  9 16:51 2127_key-certbot.pem
-rw------- 1 root root 1704 Jan 10 00:28 2128_key-certbot.pem
-rw------- 1 root root 1708 Jan 10 00:28 2129_key-certbot.pem
-rw------- 1 root root 1704 Jan 10 13:55 2130_key-certbot.pem
-rw------- 1 root root 1708 Jan 10 13:55 2131_key-certbot.pem
-rw------- 1 root root 1704 Jan 11 07:26 2132_key-certbot.pem
-rw------- 1 root root 1708 Jan 11 07:26 2133_key-certbot.pem
-rw------- 1 root root 1704 Jan 11 23:16 2134_key-certbot.pem
-rw------- 1 root root 1704 Jan 11 23:17 2135_key-certbot.pem
-rw------- 1 root root 1708 Jan 12 06:47 2136_key-certbot.pem
-rw------- 1 root root 1704 Jan 12 06:47 2137_key-certbot.pem
-rw------- 1 root root 1704 Jan 12 15:29 2138_key-certbot.pem
-rw------- 1 root root 1704 Jan 12 15:29 2139_key-certbot.pem
-rw------- 1 root root 1704 Jan 13 00:43 2140_key-certbot.pem
-rw------- 1 root root 1704 Jan 13 00:43 2141_key-certbot.pem
-rw------- 1 root root 1704 Jan 13 17:28 2142_key-certbot.pem
-rw------- 1 root root 1708 Jan 13 17:29 2143_key-certbot.pem
-rw------- 1 root root 1704 Jan 14 08:19 2144_key-certbot.pem
-rw------- 1 root root 1704 Jan 14 08:19 2145_key-certbot.pem
-rw------- 1 root root 1704 Jan 14 21:37 2146_key-certbot.pem
-rw------- 1 root root 1704 Jan 14 21:37 2147_key-certbot.pem
-rw------- 1 root root 1704 Jan 15 04:03 2148_key-certbot.pem
-rw------- 1 root root 1704 Jan 15 04:03 2149_key-certbot.pem
-rw------- 1 root root 1704 Jan 15 13:08 2150_key-certbot.pem
-rw------- 1 root root 1704 Jan 15 13:08 2151_key-certbot.pem
-rw------- 1 root root 1704 Jan 16 01:34 2152_key-certbot.pem
-rw------- 1 root root 1704 Jan 16 01:35 2153_key-certbot.pem
-rw------- 1 root root 1704 Jan 16 17:16 2154_key-certbot.pem
-rw------- 1 root root 1708 Jan 16 17:16 2155_key-certbot.pem
-rw------- 1 root root 1704 Jan 17 08:46 2156_key-certbot.pem
-rw------- 1 root root 1704 Jan 17 08:46 2157_key-certbot.pem
-rw------- 1 root root 1704 Jan 17 19:41 2158_key-certbot.pem
-rw------- 1 root root 1704 Jan 17 19:41 2159_key-certbot.pem
-rw------- 1 root root 1708 Jan 18 04:02 2160_key-certbot.pem
-rw------- 1 root root 1708 Jan 18 04:02 2161_key-certbot.pem
-rw------- 1 root root 1708 Jan 18 21:17 2162_key-certbot.pem
-rw------- 1 root root 1704 Jan 18 21:17 2163_key-certbot.pem
-rw------- 1 root root 1704 Jan 19 07:59 2164_key-certbot.pem
-rw------- 1 root root 1704 Jan 19 07:59 2165_key-certbot.pem
-rw------- 1 root root 1704 Jan 19 21:46 2166_key-certbot.pem
-rw------- 1 root root 1704 Jan 19 21:46 2167_key-certbot.pem
-rw------- 1 root root 1708 Jan 20 08:42 2168_key-certbot.pem
-rw------- 1 root root 1704 Jan 20 08:42 2169_key-certbot.pem
-rw------- 1 root root 1704 Jan 20 12:20 2170_key-certbot.pem
-rw------- 1 root root 1708 Jan 20 12:20 2171_key-certbot.pem
-rw------- 1 root root 1708 Jan 21 08:47 2172_key-certbot.pem
-rw------- 1 root root 1704 Jan 21 08:47 2173_key-certbot.pem
-rw------- 1 root root 1704 Jan 21 19:13 2174_key-certbot.pem
-rw------- 1 root root 1704 Jan 21 19:13 2175_key-certbot.pem
-rw------- 1 root root 1704 Jan 22 05:46 2176_key-certbot.pem
-rw------- 1 root root 1704 Jan 22 05:46 2177_key-certbot.pem
-rw------- 1 root root 1704 Jan 22 12:09 2178_key-certbot.pem
-rw------- 1 root root 1704 Jan 22 12:09 2179_key-certbot.pem
-rw------- 1 root root 1704 Jan 23 08:58 2180_key-certbot.pem
-rw------- 1 root root 1704 Jan 23 08:58 2181_key-certbot.pem
-rw------- 1 root root 1704 Jan 23 17:38 2182_key-certbot.pem
-rw------- 1 root root 1708 Jan 23 17:38 2183_key-certbot.pem
-rw------- 1 root root 1704 Jan 24 07:29 2184_key-certbot.pem
-rw------- 1 root root 1708 Jan 24 07:29 2185_key-certbot.pem
-rw------- 1 root root 1704 Jan 24 18:20 2186_key-certbot.pem
-rw------- 1 root root 1704 Jan 24 18:20 2187_key-certbot.pem
-rw------- 1 root root 1704 Jan 25 00:15 2188_key-certbot.pem
-rw------- 1 root root 1704 Jan 25 00:15 2189_key-certbot.pem
-rw------- 1 root root 1704 Jan 25 14:05 2190_key-certbot.pem
-rw------- 1 root root 1704 Jan 25 14:06 2191_key-certbot.pem
-rw------- 1 root root 1704 Jan 26 01:54 2192_key-certbot.pem
-rw------- 1 root root 1708 Jan 26 01:54 2193_key-certbot.pem
-rw------- 1 root root 1708 Jan 26 15:26 2194_key-certbot.pem
-rw------- 1 root root 1704 Jan 26 15:26 2195_key-certbot.pem
-rw------- 1 root root 1704 Jan 27 08:34 2196_key-certbot.pem
-rw------- 1 root root 1708 Jan 27 08:34 2197_key-certbot.pem
-rw------- 1 root root 1704 Jan 27 14:35 2198_key-certbot.pem
-rw------- 1 root root 1704 Jan 27 14:35 2199_key-certbot.pem
-rw------- 1 root root 1708 Jan 28 02:12 2200_key-certbot.pem
-rw------- 1 root root 1704 Jan 28 02:12 2201_key-certbot.pem
-rw------- 1 root root 1708 Jan 28 17:06 2202_key-certbot.pem
-rw------- 1 root root 1704 Jan 28 17:06 2203_key-certbot.pem
-rw------- 1 root root 1704 Jan 29 04:42 2204_key-certbot.pem
-rw------- 1 root root 1704 Jan 29 04:43 2205_key-certbot.pem
-rw------- 1 root root 1704 Jan 29 12:43 2206_key-certbot.pem
-rw------- 1 root root 1704 Jan 29 12:43 2207_key-certbot.pem
-rw------- 1 root root 1704 Jan 30 08:15 2208_key-certbot.pem
-rw------- 1 root root 1704 Jan 30 08:15 2209_key-certbot.pem
-rw------- 1 root root 1704 Jan 30 21:49 2210_key-certbot.pem
-rw------- 1 root root 1704 Jan 30 21:50 2211_key-certbot.pem
-rw------- 1 root root 1708 Jan 31 00:08 2212_key-certbot.pem
-rw------- 1 root root 1704 Jan 31 00:08 2213_key-certbot.pem
-rw------- 1 root root 1704 Jan 31 12:19 2214_key-certbot.pem
-rw------- 1 root root 1708 Jan 31 12:19 2215_key-certbot.pem
-rw------- 1 root root 1704 Feb  1 08:34 2216_key-certbot.pem
-rw------- 1 root root 1704 Feb  1 08:34 2217_key-certbot.pem
-rw------- 1 root root 1704 Feb  1 16:51 2218_key-certbot.pem
-rw------- 1 root root 1708 Feb  1 16:51 2219_key-certbot.pem
-rw------- 1 root root 1704 Feb  2 09:56 2220_key-certbot.pem
-rw------- 1 root root 1704 Feb  2 09:56 2221_key-certbot.pem
-rw------- 1 root root 1704 Feb  2 18:57 2222_key-certbot.pem
-rw------- 1 root root 1704 Feb  2 18:57 2223_key-certbot.pem
-rw------- 1 root root 1704 Feb  3 08:41 2224_key-certbot.pem
-rw------- 1 root root 1704 Feb  3 08:41 2225_key-certbot.pem
-rw------- 1 root root 1704 Feb  3 15:21 2226_key-certbot.pem
-rw------- 1 root root 1704 Feb  3 15:21 2227_key-certbot.pem
-rw------- 1 root root 1704 Feb  4 05:44 2228_key-certbot.pem
-rw------- 1 root root 1704 Feb  4 05:44 2229_key-certbot.pem
-rw------- 1 root root 1704 Feb  4 12:08 2230_key-certbot.pem
-rw------- 1 root root 1704 Feb  4 12:09 2231_key-certbot.pem
-rw------- 1 root root 1704 Feb  5 07:17 2232_key-certbot.pem
-rw------- 1 root root 1704 Feb  5 07:17 2233_key-certbot.pem
-rw------- 1 root root 1704 Feb  5 19:28 2234_key-certbot.pem
-rw------- 1 root root 1704 Feb  5 19:28 2235_key-certbot.pem
-rw------- 1 root root 1708 Feb  6 06:37 2236_key-certbot.pem
-rw------- 1 root root 1704 Feb  6 06:37 2237_key-certbot.pem
-rw------- 1 root root 1704 Feb  6 20:35 2238_key-certbot.pem
-rw------- 1 root root 1704 Feb  6 20:35 2239_key-certbot.pem
-rw------- 1 root root 1704 Feb  7 03:44 2240_key-certbot.pem
-rw------- 1 root root 1704 Feb  7 03:44 2241_key-certbot.pem
-rw------- 1 root root 1704 Feb  7 21:11 2242_key-certbot.pem
-rw------- 1 root root 1708 Feb  7 21:11 2243_key-certbot.pem
-rw------- 1 root root 1704 Feb  8 08:57 2244_key-certbot.pem
-rw------- 1 root root 1704 Feb  8 08:57 2245_key-certbot.pem
-rw------- 1 root root 1704 Feb  8 22:05 2246_key-certbot.pem
-rw------- 1 root root 1704 Feb  8 22:05 2247_key-certbot.pem
-rw------- 1 root root 1704 Feb  9 09:29 2248_key-certbot.pem
-rw------- 1 root root 1704 Feb  9 09:29 2249_key-certbot.pem
-rw------- 1 root root 1704 Feb  9 21:25 2250_key-certbot.pem
-rw------- 1 root root 1704 Feb  9 21:25 2251_key-certbot.pem
-rw------- 1 root root 1704 Feb 10 08:54 2252_key-certbot.pem
-rw------- 1 root root 1704 Feb 10 08:55 2253_key-certbot.pem
-rw------- 1 root root 1704 Feb 10 20:53 2254_key-certbot.pem
-rw------- 1 root root 1704 Feb 10 20:53 2255_key-certbot.pem
-rw------- 1 root root 1704 Feb 11 01:30 2256_key-certbot.pem
-rw------- 1 root root 1708 Feb 11 01:30 2257_key-certbot.pem
-rw------- 1 root root 1704 Feb 11 15:36 2258_key-certbot.pem
-rw------- 1 root root 1704 Feb 11 15:37 2259_key-certbot.pem
-rw------- 1 root root 1704 Feb 12 05:26 2260_key-certbot.pem
-rw------- 1 root root 1704 Feb 12 05:26 2261_key-certbot.pem
-rw------- 1 root root 1704 Feb 12 20:16 2262_key-certbot.pem
-rw------- 1 root root 1708 Feb 12 20:16 2263_key-certbot.pem
-rw------- 1 root root 1708 Feb 13 05:23 2264_key-certbot.pem
-rw------- 1 root root 1704 Feb 13 05:23 2265_key-certbot.pem
-rw------- 1 root root 1704 Feb 13 23:35 2266_key-certbot.pem
-rw------- 1 root root 1704 Feb 13 23:35 2267_key-certbot.pem
-rw------- 1 root root 1704 Feb 14 11:59 2268_key-certbot.pem
-rw------- 1 root root 1704 Feb 14 11:59 2269_key-certbot.pem
-rw------- 1 root root 1704 Feb 14 22:00 2270_key-certbot.pem
-rw------- 1 root root 1704 Feb 14 22:00 2271_key-certbot.pem
-rw------- 1 root root 1708 Feb 15 02:44 2272_key-certbot.pem
-rw------- 1 root root 1704 Feb 15 02:44 2273_key-certbot.pem
-rw------- 1 root root 1704 Feb 15 22:50 2274_key-certbot.pem
-rw------- 1 root root 1704 Feb 15 22:50 2275_key-certbot.pem
-rw------- 1 root root 1708 Feb 16 00:42 2276_key-certbot.pem
-rw------- 1 root root 1704 Feb 16 00:42 2277_key-certbot.pem
-rw------- 1 root root 1704 Feb 16 21:59 2278_key-certbot.pem
-rw------- 1 root root 1704 Feb 16 21:59 2279_key-certbot.pem
-rw------- 1 root root 1704 Feb 17 05:54 2280_key-certbot.pem
-rw------- 1 root root 1708 Feb 17 05:54 2281_key-certbot.pem
-rw------- 1 root root 1708 Feb 17 20:27 2282_key-certbot.pem
-rw------- 1 root root 1704 Feb 17 20:27 2283_key-certbot.pem
-rw------- 1 root root 1704 Feb 18 07:14 2284_key-certbot.pem
-rw------- 1 root root 1704 Feb 18 07:14 2285_key-certbot.pem
-rw------- 1 root root 1704 Feb 18 15:44 2286_key-certbot.pem
-rw------- 1 root root 1708 Feb 18 15:44 2287_key-certbot.pem
-rw------- 1 root root 1704 Feb 19 10:33 2288_key-certbot.pem
-rw------- 1 root root 1704 Feb 19 10:33 2289_key-certbot.pem
-rw------- 1 root root 1704 Feb 19 14:16 2290_key-certbot.pem
-rw------- 1 root root 1704 Feb 19 14:16 2291_key-certbot.pem
-rw------- 1 root root 1704 Feb 20 09:23 2292_key-certbot.pem
-rw------- 1 root root 1704 Feb 20 09:23 2293_key-certbot.pem
-rw------- 1 root root 1704 Feb 20 15:46 2294_key-certbot.pem
-rw------- 1 root root 1704 Feb 20 15:46 2295_key-certbot.pem
-rw------- 1 root root 1704 Feb 21 02:21 2296_key-certbot.pem
-rw------- 1 root root 1704 Feb 21 02:21 2297_key-certbot.pem
-rw------- 1 root root 1704 Feb 21 18:47 2298_key-certbot.pem
-rw------- 1 root root 1708 Feb 21 18:47 2299_key-certbot.pem
-rw------- 1 root root 1704 Feb 22 06:11 2300_key-certbot.pem
-rw------- 1 root root 1708 Feb 22 06:11 2301_key-certbot.pem
-rw------- 1 root root 1704 Feb 22 14:25 2302_key-certbot.pem
-rw------- 1 root root 1704 Feb 22 14:25 2303_key-certbot.pem
-rw------- 1 root root 1708 Apr 23 17:28 2304_key-certbot.pem
-rw------- 1 root root 1704 Apr 23 17:28 2305_key-certbot.pem
-rw------- 1 root root 1700 Apr 24 07:19 2306_key-certbot.pem
-rw------- 1 root root 1704 Apr 24 07:19 2307_key-certbot.pem
-rw------- 1 root root 1704 Apr 24 20:40 2308_key-certbot.pem
-rw------- 1 root root 1708 Apr 24 20:40 2309_key-certbot.pem
-rw------- 1 root root 1704 Apr 25 04:36 2310_key-certbot.pem
-rw------- 1 root root 1704 Apr 25 04:36 2311_key-certbot.pem
-rw------- 1 root root 1704 Apr 25 13:13 2312_key-certbot.pem
-rw------- 1 root root 1708 Apr 25 13:13 2313_key-certbot.pem
-rw------- 1 root root 1704 Apr 26 00:44 2314_key-certbot.pem
-rw------- 1 root root 1704 Apr 26 00:44 2315_key-certbot.pem
-rw------- 1 root root 1704 Apr 26 13:20 2316_key-certbot.pem
-rw------- 1 root root 1704 Apr 26 13:20 2317_key-certbot.pem
-rw------- 1 root root 1704 Apr 27 03:07 2318_key-certbot.pem
-rw------- 1 root root 1708 Apr 27 03:07 2319_key-certbot.pem
-rw------- 1 root root 1704 Apr 27 21:07 2320_key-certbot.pem
-rw------- 1 root root 1704 Apr 27 21:07 2321_key-certbot.pem
-rw------- 1 root root 1704 Apr 28 06:26 2322_key-certbot.pem
-rw------- 1 root root 1708 Apr 28 06:26 2323_key-certbot.pem
-rw------- 1 root root 1704 Apr 28 21:20 2324_key-certbot.pem
-rw------- 1 root root 1704 Apr 28 21:20 2325_key-certbot.pem
-rw------- 1 root root 1704 Apr 29 07:01 2326_key-certbot.pem
-rw------- 1 root root 1704 Apr 29 07:01 2327_key-certbot.pem
-rw------- 1 root root 1704 Apr 29 21:42 2328_key-certbot.pem
-rw------- 1 root root 1704 Apr 29 21:42 2329_key-certbot.pem
-rw------- 1 root root 1704 Apr 30 04:44 2330_key-certbot.pem
-rw------- 1 root root 1704 Apr 30 04:44 2331_key-certbot.pem
-rw------- 1 root root 1704 Apr 30 22:28 2332_key-certbot.pem
-rw------- 1 root root 1704 Apr 30 22:28 2333_key-certbot.pem
-rw------- 1 root root 1704 May  1 02:42 2334_key-certbot.pem
-rw------- 1 root root 1704 May  1 02:43 2335_key-certbot.pem
-rw------- 1 root root 1704 May  1 16:58 2336_key-certbot.pem
-rw------- 1 root root 1704 May  1 16:58 2337_key-certbot.pem
-rw------- 1 root root 1704 May  2 03:46 2338_key-certbot.pem
-rw------- 1 root root 1708 May  2 03:46 2339_key-certbot.pem
-rw------- 1 root root 1704 May  2 21:24 2340_key-certbot.pem
-rw------- 1 root root 1704 May  2 21:24 2341_key-certbot.pem
-rw------- 1 root root 1708 May  3 05:37 2342_key-certbot.pem
-rw------- 1 root root 1708 May  3 05:37 2343_key-certbot.pem
-rw------- 1 root root 1708 May  3 17:55 2344_key-certbot.pem
-rw------- 1 root root 1708 May  3 17:55 2345_key-certbot.pem
-rw------- 1 root root 1704 May  4 04:43 2346_key-certbot.pem
-rw------- 1 root root 1708 May  4 04:43 2347_key-certbot.pem
-rw------- 1 root root 1704 May  4 20:13 2348_key-certbot.pem
-rw------- 1 root root 1704 May  4 20:13 2349_key-certbot.pem
-rw------- 1 root root 1708 May  5 06:52 2350_key-certbot.pem
-rw------- 1 root root 1708 May  5 06:52 2351_key-certbot.pem
-rw------- 1 root root 1708 May  5 14:18 2352_key-certbot.pem
-rw------- 1 root root 1708 May  5 14:18 2353_key-certbot.pem
-rw------- 1 root root 1708 May  6 06:15 2354_key-certbot.pem
-rw------- 1 root root 1704 May  6 06:15 2355_key-certbot.pem
-rw------- 1 root root 1704 May  6 15:50 2356_key-certbot.pem
-rw------- 1 root root 1704 May  6 15:50 2357_key-certbot.pem
-rw------- 1 root root 1704 May  7 11:02 2358_key-certbot.pem
-rw------- 1 root root 1704 May  7 11:02 2359_key-certbot.pem
-rw------- 1 root root 1704 May  7 19:24 2360_key-certbot.pem
-rw------- 1 root root 1704 May  7 19:24 2361_key-certbot.pem
-rw------- 1 root root 1708 May  8 08:49 2362_key-certbot.pem
-rw------- 1 root root 1704 May  8 08:49 2363_key-certbot.pem
-rw------- 1 root root 1704 May  8 20:27 2364_key-certbot.pem
-rw------- 1 root root 1704 May  8 20:27 2365_key-certbot.pem
-rw------- 1 root root 1704 May  9 11:28 2366_key-certbot.pem
-rw------- 1 root root 1708 May  9 11:28 2367_key-certbot.pem
-rw------- 1 root root 1708 May  9 14:15 2368_key-certbot.pem
-rw------- 1 root root 1704 May  9 14:16 2369_key-certbot.pem
-rw------- 1 root root 1704 May 10 05:53 2370_key-certbot.pem
-rw------- 1 root root 1704 May 10 05:53 2371_key-certbot.pem
-rw------- 1 root root 1708 May 10 20:10 2372_key-certbot.pem
-rw------- 1 root root 1704 May 10 20:10 2373_key-certbot.pem
-rw------- 1 root root 1704 May 11 10:27 2374_key-certbot.pem
-rw------- 1 root root 1704 May 11 10:27 2375_key-certbot.pem
-rw------- 1 root root 1704 May 11 15:50 2376_key-certbot.pem
-rw------- 1 root root 1704 May 11 15:50 2377_key-certbot.pem
-rw------- 1 root root 1708 May 12 00:37 2378_key-certbot.pem
-rw------- 1 root root 1704 May 12 00:37 2379_key-certbot.pem
-rw------- 1 root root 1704 May 12 15:07 2380_key-certbot.pem
-rw------- 1 root root 1704 May 12 15:07 2381_key-certbot.pem
-rw------- 1 root root 1704 May 13 05:20 2382_key-certbot.pem
-rw------- 1 root root 1708 May 13 05:20 2383_key-certbot.pem
-rw------- 1 root root 1704 May 13 12:04 2384_key-certbot.pem
-rw------- 1 root root 1704 May 13 12:04 2385_key-certbot.pem
-rw------- 1 root root 1704 May 14 01:20 2386_key-certbot.pem
-rw------- 1 root root 1704 May 14 01:20 2387_key-certbot.pem
-rw------- 1 root root 1708 May 14 18:47 2388_key-certbot.pem
-rw------- 1 root root 1704 May 14 18:47 2389_key-certbot.pem
-rw------- 1 root root 1704 May 15 08:09 2390_key-certbot.pem
-rw------- 1 root root 1704 May 15 08:09 2391_key-certbot.pem
-rw------- 1 root root 1704 May 15 18:37 2392_key-certbot.pem
-rw------- 1 root root 1704 May 15 18:37 2393_key-certbot.pem
-rw------- 1 root root 1708 May 16 02:34 2394_key-certbot.pem
-rw------- 1 root root 1704 May 16 02:34 2395_key-certbot.pem
-rw------- 1 root root 1704 May 16 19:28 2396_key-certbot.pem
-rw------- 1 root root 1704 May 16 19:28 2397_key-certbot.pem
-rw------- 1 root root 1704 May 17 00:18 2398_key-certbot.pem
-rw------- 1 root root 1704 May 17 00:18 2399_key-certbot.pem
-rw------- 1 root root 1704 May 17 17:37 2400_key-certbot.pem
-rw------- 1 root root 1704 May 17 17:37 2401_key-certbot.pem
-rw------- 1 root root 1708 May 18 04:33 2402_key-certbot.pem
-rw------- 1 root root 1704 May 18 04:33 2403_key-certbot.pem
-rw------- 1 root root 1704 May 18 22:27 2404_key-certbot.pem
-rw------- 1 root root 1704 May 18 22:27 2405_key-certbot.pem
-rw------- 1 root root 1704 May 19 03:42 2406_key-certbot.pem
-rw------- 1 root root 1704 May 19 03:42 2407_key-certbot.pem
-rw------- 1 root root 1704 May 19 16:30 2408_key-certbot.pem
-rw------- 1 root root 1708 May 19 16:30 2409_key-certbot.pem
-rw------- 1 root root 1704 May 20 01:09 2410_key-certbot.pem
-rw------- 1 root root 1704 May 20 01:09 2411_key-certbot.pem
-rw------- 1 root root 1704 May 20 19:11 2412_key-certbot.pem
-rw------- 1 root root 1704 May 20 19:11 2413_key-certbot.pem
-rw------- 1 root root 1704 May 21 10:39 2414_key-certbot.pem
-rw------- 1 root root 1704 May 21 10:39 2415_key-certbot.pem
-rw------- 1 root root 1704 May 21 16:22 2416_key-certbot.pem
-rw------- 1 root root 1704 May 21 16:22 2417_key-certbot.pem
-rw------- 1 root root 1704 May 22 08:26 2418_key-certbot.pem
-rw------- 1 root root 1704 May 22 08:26 2419_key-certbot.pem
-rw------- 1 root root 1704 May 22 21:23 2420_key-certbot.pem
-rw------- 1 root root 1708 May 22 21:23 2421_key-certbot.pem
-rw------- 1 root root 1704 May 23 05:23 2422_key-certbot.pem
-rw------- 1 root root 1704 May 23 05:24 2423_key-certbot.pem
-rw------- 1 root root 1704 May 23 14:25 2424_key-certbot.pem
-rw------- 1 root root 1704 May 23 14:25 2425_key-certbot.pem
-rw------- 1 root root 1704 May 24 01:28 2426_key-certbot.pem
-rw------- 1 root root 1704 May 24 01:28 2427_key-certbot.pem
-rw------- 1 root root 1704 May 24 23:14 2428_key-certbot.pem
-rw------- 1 root root 1704 May 24 23:14 2429_key-certbot.pem
-rw------- 1 root root 1704 May 25 11:50 2430_key-certbot.pem
-rw------- 1 root root 1704 May 25 11:51 2431_key-certbot.pem
-rw------- 1 root root 1708 May 25 22:24 2432_key-certbot.pem
-rw------- 1 root root 1704 May 25 22:24 2433_key-certbot.pem
-rw------- 1 root root 1708 May 26 05:19 2434_key-certbot.pem
-rw------- 1 root root 1708 May 26 05:19 2435_key-certbot.pem
-rw------- 1 root root 1704 May 26 17:32 2436_key-certbot.pem
-rw------- 1 root root 1704 May 26 17:32 2437_key-certbot.pem
-rw------- 1 root root 1704 May 27 03:33 2438_key-certbot.pem
-rw------- 1 root root 1704 May 27 03:33 2439_key-certbot.pem
-rw------- 1 root root 1704 May 27 11:03 2440_key-certbot.pem
-rw------- 1 root root 1704 May 27 11:04 2441_key-certbot.pem

/etc/letsencrypt/live:
total 8
-rw-r--r-- 1 root root  740 May 27  2020 README
drwxr-xr-x 2 root root 4096 Feb 22 14:25 www.worldfixer.com

/etc/letsencrypt/live/www.worldfixer.com:
total 4
-rw-r--r-- 1 root root 692 May 28  2020 README
lrwxrwxrwx 1 root root  42 Feb 22 14:25 cert.pem -> ../../archive/www.worldfixer.com/cert2.pem
lrwxrwxrwx 1 root root  43 Feb 22 14:25 chain.pem -> ../../archive/www.worldfixer.com/chain2.pem
lrwxrwxrwx 1 root root  47 Feb 22 14:25 fullchain.pem -> ../../archive/www.worldfixer.com/fullchain2.pem
lrwxrwxrwx 1 root root  45 Feb 22 14:25 privkey.pem -> ../../archive/www.worldfixer.com/privkey2.pem

/etc/letsencrypt/renewal:
total 4
-rw-r--r-- 1 root root 547 Feb 22 14:25 www.worldfixer.com.conf

/etc/letsencrypt/renewal-hooks:
total 12
drwxr-xr-x 2 root root 4096 May 27  2020 deploy
drwxr-xr-x 2 root root 4096 May 27  2020 post
drwxr-xr-x 2 root root 4096 May 27  2020 pre

/etc/letsencrypt/renewal-hooks/deploy:
total 0

/etc/letsencrypt/renewal-hooks/post:
total 0

/etc/letsencrypt/renewal-hooks/pre:
total 0
2 Likes
7

Sorry, I was not expecting so many key files. Can you show this?
(Also, a backtick on a US keyboard is on far left of keyboard near the 1-! key. I think you used single quote instead)

4 Likes
9

Woops, yea that was an apostraphe.

Here you go:
root@wfx-prod:~# ls -lR /etc/letsencrypt/archive
/etc/letsencrypt/archive:

total 4
drwxr-xr-x 2 root root 4096 Feb 22 14:25 www.worldfixer.com

/etc/letsencrypt/archive/www.worldfixer.com:
total 36
-rw-r--r-- 1 root root 1919 May 28  2020 cert1.pem
-rw-r--r-- 1 root root 1850 Feb 22 14:25 cert2.pem
-rw-r--r-- 1 root root 1647 May 28  2020 chain1.pem
-rw-r--r-- 1 root root 3750 Feb 22 14:25 chain2.pem
-rw-r--r-- 1 root root 3566 May 28  2020 fullchain1.pem
-rw-r--r-- 1 root root 5600 Feb 22 14:25 fullchain2.pem
-rw------- 1 root root 1704 May 28  2020 privkey1.pem
-rw------- 1 root root 1704 Feb 22 14:25 privkey2.pem
2 Likes
10

OK. Your server is currently sending out a cert with both the apex and www domain names in it. That's good. That cert was created Feb22 which matches the date linked to by your LIVE folder for www.worldfixer.com. Yes, it's expired but we have to ignore that for now.

But, this is puzzling why your nginx conf is failing to find a file in a worldfixer.com folder. So, let's do 2 things. One is lets confirm the Feb22 cert matches what is being sent. Show:

sudo certbot certificates

And, show result of this grep

sudo grep -R worldfixer.com /etc/nginx

(backticks before and after again please)

4 Likes
11

Ok, no problem. Here you go:

sudo certbot certificates

Saving debug log to /var/log/letsencrypt/letsencrypt.log
OCSP check failed for /etc/letsencrypt/live/www.worldfixer.com/cert.pem (are we offline?)

- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
Found the following certs:
  Certificate Name: www.worldfixer.com
    Domains: www.worldfixer.com
    Expiry Date: 2022-05-23 13:25:35+00:00 (INVALID: EXPIRED)
    Certificate Path: /etc/letsencrypt/live/www.worldfixer.com/fullchain.pem
    Private Key Path: /etc/letsencrypt/live/www.worldfixer.com/privkey.pem
1 Like
12

and this one:
root@wfx-prod:~# sudo grep -R worldfixer.com /etc/nginx

/etc/nginx/sites-enabled/01-hp_wfx.save:    server_name beta.worldfixer.com worldfixer.com www.worldfixer.com 134.122.77.70;
/etc/nginx/sites-enabled/01-hp_wfx.save:    ssl_certificate /etc/letsencrypt/live/worldfixer.com/fullchain.pem; # managed by Certbot
/etc/nginx/sites-enabled/01-hp_wfx.save:    ssl_certificate_key /etc/letsencrypt/live/worldfixer.com/privkey.pem; # managed by Certbot
/etc/nginx/sites-enabled/01-hp_wfx.save:    if ($host = worldfixer.com) {
/etc/nginx/sites-enabled/01-hp_wfx.save:    if ($host = www.worldfixer.com) {
/etc/nginx/sites-enabled/01-hp_wfx.save:    server_name beta.worldfixer.com worldfixer.com www.worldfixer.com;
/etc/nginx/sites-enabled/01-hp_wfx:    server_name beta.worldfixer.com worldfixer.com www.worldfixer.com 134.122.77.70;
/etc/nginx/sites-enabled/01-hp_wfx:    ssl_certificate /etc/letsencrypt/live/worldfixer.com/fullchain.pem; # managed by Certbot
/etc/nginx/sites-enabled/01-hp_wfx:    ssl_certificate_key /etc/letsencrypt/live/worldfixer.com/privkey.pem; # managed by Certbot
/etc/nginx/sites-enabled/01-hp_wfx:    if ($host = worldfixer.com) {
/etc/nginx/sites-enabled/01-hp_wfx:    if ($host = www.worldfixer.com) {
/etc/nginx/sites-enabled/01-hp_wfx:    server_name beta.worldfixer.com worldfixer.com www.worldfixer.com;
/etc/nginx/sites-available/worldfixer.com.save.1:        root /var/www/worldfixer.com/html;
/etc/nginx/sites-available/worldfixer.com.save.1:        server_name worldfixer.com www.worldfixer.com;
/etc/nginx/sites-available/worldfixer.com.save.1:sudo ln -s /etc/nginx/sites-available/worldfixer.com /etc/nginx/sites-enabled/
13

Also, to just give you a bit of background. The original failure to auto-renew may have been caused by the fact that the site's owner had someone create a new landing page on Webflow.com. Then they redirected the DNS to the IP address for where the landing page was hosted on Webflow...instead of the IP address where the actual application was hosted. I told them there would be issues, but they seemed to ignore this lol.

After that, I had to revert everything back to our IP address and take the landing page created in Webflow and put it on our server. This was back in March I believe.

I think this may have had also added issues as when I tried the command to renew the cert, it showed Webflow within the description of the error:

  Domain: www.worldfixer.com
   Type:   unauthorized
   Detail: 134.122.77.70: Invalid response from
   https://www.worldfixer.com/.well-known/acme-challenge/SfLxB5pZoYICvDv7-TnLu1Yhq71lddk6G14M98q62Hk:
   "<!DOCTYPE html><!--  This site was created in Webflow.
   http://www.webflow.com  -->\r\n<!--  Last Published: Wed Feb 16
   2022 13:53:"

   To fix these errors, please make sure that your domain name was
   entered correctly and the DNS A/AAAA record(s) for that domain
   contain(s) the right IP address.
14

To me, that looks like a clear indication of a problem.
What does the command line look like that is requesting that many certs every single day?

3 Likes
15

I'm not sure. I got all of that after entering:

ls -lR /etc/letsencrypt

There terminal won't show anything older than what I gave...just too many lines

16

Who are you responding to?
Which question?

3 Likes
17

To this question

18

ahh, sorry. Didn't realize right away that you weren't Mike.

19

No, he meant the certbot command causing so many repeated attempts. That really is oddly too many.

On a separate note, the Feb22 cert you have is not the one being sent by your server right now. So, I see you created several that day with diff name combos.

In the grep command it looks like their are 2 overlapping server blocks in sites-enabled. Do you include both of those in your nginx.conf file?

4 Likes
20

OK, well that doesn't exactly answer the question.
How many certificates are being managed?
If only a few, then we need to check the LE logs and renewal config files to better understand why that is happening.

3 Likes
21

Mike is a lot ... taller - LOL

4 Likes
22

They deleted the cert without removing it from nginx. But, I was going to head to lunch so if you want to take over have at it :slight_smile:

4 Likes