Is there a way I can just provide a CSR and get a cert manually?

Yes, with a third-party service such as https://gethttpsforfree.com

Please read the warning of that post before: Web browser based ACME clients

And do not forget that Let’s Encrypt certificates are only valid for 90 days so you need to renew them manually every two months.