If the connection just closes immediately, and you can get to other sites, then there's probably a firewall blocking it, either on your end or on Let's Encrypt's. If it's on Let's Encrypt's side, then it's probably due to this sort of blocking:
Have you recently received this IP and is there a chance that it might have been used for "bad things" in the recent past?