Lets Encrypt on Wordpress on Google Compute Engine

Only the default ones GCP has standard set up. I basically can’t access from the moment I install the key. I also tried to convert the privkey.pem into ssh-rsa format and added this to the ssh key of GCP. But no success so far.

Would it help if I delete all firewalls GCP has set up?