Certs aren't being uploaded via SFTP to /etc/letsencrypt/live correctly

So it can't reach the Internet.
But it can be reached from the Internet (through the VPN).

I like the sound of that !