Yes, you can. You can issue more than two, too.
https://letsencrypt.org/docs/rate-limits/
You can also use the same certificate on both servers, if you prefer, but setting that up and automating it has its own challenges.
1 Like