which are pointing to the same IP address of my server on digital ocean running nginx.
git.domain.tld is a reverse proxy for my Gogs installation.
The other domains point to my websites.
All my configs are located in /etc/nginx/conf.d/
I think I might have found the issue.
To everyone that has the same issue and a similiar setup:
All your server blocks have to be set in the /etc/nginx/nginx.conf instead of in separate files in the /etc/nginx/conf.d directory.
certbot renew --dry-run works as expected now.