Yes.
Two separate certificates is trivial ( simply run certbot, or your preferred client ) once on each webserver host.
If you wanted a single certificate, that could be used on both hosts, that’s a little more complicated but still perfectly possible.
I’m assuming you want the first. If you want the latter, let us know and we can provide a more detailed response as to how.