See Certbot failing to install on apache / django sites, it looks like sort of the same issue with the fact that Certbot tries to copy the WSGI related directives from the HTTP virtualhost to the HTTPS virtualhost, but that would lead to duplicates.
The thread also mentions a solution.