That did it!
The resulting command ends up being REQUESTS_CA_BUNDLE=/path/to/ca.pem certbot register --agree-tos -m admin@foo.bar --server https://ca.foo.bar --no-eff-email
Glad it wasn't due to my severely outdated certbot package (something I realized shortly after making this post).