They don't have to support caa records although they should anyway. But they need to reply with an appropriate 'not found'. They are not.
They also only have the two ip addresses and they do not support IPV 6 for their DNS servers. All in all this may be a good time to switch to a more modern and capable dns provider