Hi @kaushalshriyan,
We've had a large number of threads asking this question, and the answer is that whitelisting the IP addresses is not supported by Let's Encrypt.
If you can't allow inbound connections from arbitrary IP addresses, you're requested to use the DNS-01 validation method instead of HTTP-01.