You had a certificate already from Let's Encrypt that did not cost anything. I don't know why you would have then purchased one from them.
Yes You need a virtual host for port 443 and its SSL configuration. You can use the below site for help. I do not recommend enabling OCSP or HSTS Strict Transport until you know for sure what those do they are very advanced features which can cause problems.