Not getting PEM files when requesting new certificate

Recent versions of certbot-auto are incompatible with the ancient version of pip in Ubuntu 12.04.

See this thread (which mostly discusses Debian 7, which is also EOL, but it's the same issue):

You can work around that issue, but you should upgrade to a newer OS.