Please fill out the fields below so we can help you better. Note: you must provide your domain name to get help. Domain names for issued certificates are all made public in Certificate Transparency logs (e.g. https://crt.sh/?q=example.com), so withholding your domain name here does not increase secrecy, but only makes it harder for us to provide help.
It produced this output: Saving debug log to /var/log/letsencrypt/letsencrypt.log
Plugins selected: Authenticator apache, Installer apache
Starting new HTTPS connection (1): acme-v02.api.letsencrypt.org
Select the appropriate numbers separated by commas and/or spaces, or leave input
blank to select all options shown (Enter 'c' to cancel):
Obtaining a new certificate
Performing the following challenges:
http-01 challenge for www.progresshill.com
Waiting for verification...
Challenge failed for domain www.progresshill.com
http-01 challenge for www.progresshill.com
Cleaning up challenges
Some challenges have failed.
Thank you @rg305 for your help. Since am running the certbot inside DigitalOcean VPS, I assume that it should make the DNS query inside the DigitalOcean DNS server; is that correct? In which case I am wondering why it should not be able to find the CNAME record for the www.progresshill domain.
Also the response from the certbot command is that " DNS problem: SERVFAIL looking up A for www.progresshill.com" which also makes me wonder if it is only lloking for an A Record entry?
certbot doesn't do the DNS query. certbot communicates with LetsEncrypt and they do the DNS query and are responsible for the message:
This seems to be an ongoing problem with DigitalOcean(via CloudFlare) DNS.
As I showed, it is NOT just LetsEncrypt that is having trouble retriving DNS records from them.
It doesn't look specifically for A record type; CNAME records are valid and are used all the time.
The problem is global DNS systems are having trouble with your DNS provider.
Thanks. I have tried and all of them resolved apart from 8.8.8.8 and 1.1.1.1 . May be then it is an issue of delay in propagation since I made the config yesterday. I wonder why the apex domain progresshill.com was able to propagate and not the subdomain "www". In fact 1.1.1.1 actually times out.
I can't be 100 certain...
But the common theme seems to be CNAME records (having this issue).
You might try changing the www to an A record like the apex.
Ah, I got this wrong, this is not related to query flags after all. I think this is just related to DigitalOcean's DNS edge cache which has been causing all sorts of havoc (1 and 2).
if you spam the same query to ns1.digitalocean.com, you will randomly get either a good response or a rubbish referral, which will result in a SERVFAIL. .
I have created two subdomains a.progresshill.com (with an A Record) and c.progresshill.com (with a C Record) and I am able to perform a successful certbot dry run on both. However I still face challenge with www
I have deleted the www entry and recreated it afresh as a CNAME entry. When I run the certbot dry-run, I sometimes get a success and other times an error
]$ sudo certbot certonly --apache -d www.progresshill.com --dry-run
Saving debug log to /var/log/letsencrypt/letsencrypt.log
Plugins selected: Authenticator apache, Installer apache
Starting new HTTPS connection (1): acme-staging-v02.api.letsencrypt.org
Obtaining a new certificate
Performing the following challenges:
http-01 challenge for www.progresshill.com
Waiting for verification...
Challenge failed for domain www.progresshill.com
http-01 challenge for www.progresshill.com
Cleaning up challenges
Some challenges have failed.
$ sudo certbot certonly --apache -d www.progresshill.com --dry-run
Saving debug log to /var/log/letsencrypt/letsencrypt.log
Plugins selected: Authenticator apache, Installer apache
Starting new HTTPS connection (1): acme-staging-v02.api.letsencrypt.org
Obtaining a new certificate
Performing the following challenges:
http-01 challenge for www.progresshill.com
Waiting for verification...
Cleaning up challenges