[Staging] 405 malformed error

Hi,

Starting a few hours ago we are seeing challenge failures on http challenges on the staging environment for all domains.
We have seen this before, it was an issue resolved by lets encrypt (Staging Certificate Generation Failure)

We use Acme4j.

We get this output:
Challenge fails:
{
"type": "urn:ietf:params:acme:error:malformed",
"detail": "Method not allowed",
"status": 405
}

Many thanks,
Danny Mann, Duda

4 Likes

@lestaff staging failures seem to be occurring everywhere right now #4

7 Likes

Hi,
We are seeing the same problem since this morning. We use Acme

3 Likes

I can't reproduce it here because on staging, my domain challenge is stuck in pending state for more than a minute. There seems to be a general problem with staging at the moment.

3 Likes

I think I fixed it! Please let me know if problems are persisting.

7 Likes

Just to be clear, @mcpherrinm fixed it, but I broke it!

11 Likes

Looks good now. Many thanks!

2 Likes

I knew it! You let the fox chew the wires again didn't you, J.C.?

:fox_face:

7 Likes

I do my best to come up with unique ways to break staging each time. :slight_smile: In this case, I made all the new multi-VA nodes come up without public IP addresses.

Made it kinda hard for them to reach anything.

9 Likes

Private-public testing... :thinking:... what an interesting concept. It's like a cat who wants to live in the middle of the door.

5 Likes

JC takes too much blame for himself! This was caused by an upgrade of a third-party software component (aws terraform provider) which slightly changed behavior.

While we are all inconvenienced by this failure in staging, I hope everyone appreciates that this staging failure enabled us to avoid the failure happening in production -- that would have been a much bigger deal!

8 Likes

Maybe there should be (a very limited access) an alpha (pre-staging) testing system - LOL

6 Likes

We do have private dev environments, but some things (like autoscaling behavior that caused this) don't really show up until you're in something pretty close to the real thing.

6 Likes

Boulder...
Pebble...
What's smaller than a pebble?
Granule!

6 Likes

sand :wink:

7 Likes

Then, we'll go with: Dust

For:
All we are is dust in the wind
-Kansas

5 Likes

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.