Looks like a limitation in Windows CPython.
As mentioned, you should be able to do this in the terminal like this instead:
certbot certonly --standalone -d a.example.com -d b.example.com -d c.example.com ...
8 Likes