Once your body is in workout-mode, a few days off won't hurt. Muscle memory is magical. If you work out consistently, you can afford to miss a few sessions and your body will gladly pick up where you left off.