Did a little bit more digging.
It looks like you are using this module, which gets bundled with Aegir: https://www.drupal.org/project/hosting_https
And it looks like the module was recently updated to use a newer version of dehydrated, which fixes the JWS error: https://www.drupal.org/project/hosting_https/issues/3086056
So if you upgrade the module, your problem should disappear.