Hi @natcohen, welcome to the LE community forum 
In general, the problem can be simplified, in some cases, by using a wildcard cert.
And almost always by copying the entire contents of the ACME client (directory and cert files) from one system to another.
In the specific case of cert-manager, there may be some preferred/recommended methods.
Like: I found this on their site...