Cloning the git repo isn’t useful. The certbot-auto doesn’t use all the other files, including the DNS plugins. Downloading just the certbot-auto script would have been enough. certbot-auto generates a virtual environment and install the required software in that virtual environment with pip. Without the DNS plugins. Officially, the plugins are only installed with distribution packages (if available) or with the Docker image.
I've no idea, I hope some day the dns plugins will be included in the default install but I don't know the reason to not doing it right now. Waiting till a package is available for your distribution could take... months... years... till the end of the world...
I’m using the no-upgrade option for now, I’m wondering if I can force an upgrade using a script that updates certbot and also installs the newest version of the dns plugin? Then I could do that monthly.