Once you get this message, the accept button is completely disabled and you're forced to reject the challenge. This is mostly relevant for Custom Games, but it's a slight annoyance to me as I do a lot of mechanics testing through Custom Games. I think that the accept button should only be disabled once you've successfully accepted the challenge.