Answering my own question, thanks to this tip:
The nginx file was missing the listen directive for ipv6.