If you’re using Apache as the reverse proxy then the Apache plugin will work as normal. Otherwise you’ll have to use webroot by excluding /.well-known/acme-challenge/ from the proxy rules and serving it directly, or mounting the webroots on the other servers.
If none of that is possible then you’ll have to use one of the clients that supports the DNS challenge.