It's a very, very rare moment when another actor hurts you. That's not normal. If anything, it's the actor accidentally punching the stunt double, which happens quite a bit.