There are many hosting providers that not only allow you to use Let's Encrypt certificates but even go to some trouble to make it easy for you. I'm guessing that you would already have switched to one of them yourself, if it wasn't for that unfortunate contract. But contracts only last so long, and eventually they'll start losing customers.
Yes, all 3 files.