if he does not confirm if he is well at that time, then obviously I have no reason to continue with the schedule
they gave 2 available times, you confirmed one. To me, that would be enough to say both of you are fine to play then, and I would contact at that time that I was here if I was in that scenario. If they don't show up, then that is grounds for activity. Neither of you did so, meaning you both put in the same effort to get the game done by giving your available time to play and nothing more, so it should be flipped. Your opponent may be unavailable so it wouldn't be fair to give one past deadline, the call will stand.