OMG my alias was wrong… I missed that letsencrypt actually creates those directories. Now my config looks like this:
Alias /.well-known/acme-challenge /var/www/letsencrypt/.well-known/acme-challenge
So it is working now! But it also works without the additional / in the end.