So far this all looks fine. The openssl verify command is rarely helpful and often behaves in unexpected ways - errors from that command are common and not generally an issue.
Do you have a specific error message generated by your client? Verification errors for Let's Encrypt certificate are often related to old libraries or outdated trust stores.