I would like to second a recommendation for Digital Ocean. I use them for my personal projects, as well as for all my clients. They are certainly trustworthy and reputable, and growing quickly.
If you want to try it, they start out at only $5/mo, which can be enough for many sites. I personally use 1 of their $10/mo VMs and one of their $5/mo VMs for my personal projects, and many bigger ones for clients. Also, this link (full disclosure: affiliate link) can get you a free $10 when you sign up, so you can tinker free for a month or two, and see if it's right for you.
With Digital Ocean, you can use LE with auto-renew. All my sites are HTTPS and I rarely have to touch them, unless something breaks.